00000002:00100000:3.0:1787191328.559565:0:57668:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1f100 x1874004626236544/t8589935827(8589935827) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191344 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191328.559611:0:57668:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1f100 x1874004626236544/t8589935827(8589935827) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191344 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191328.559621:0:57668:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191328.559626:0:57668:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1dc00 x1874004626237184/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191328.559642:0:57668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57668:1874004626237184:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191328.563670:0:57668:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c300 going to sleep for 11 seconds 00000100:00100000:3.0:1787191328.563869:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634752768 00000100:00100000:3.0:1787191328.563878:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634752768 00000100:00100000:3.0:1787191328.563944:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 915 00000100:00100000:3.0:1787191328.563954:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:9508:x1874004634752768:12345-192.168.202.101@tcp:105: 00010000:00010000:3.0:1787191328.563975:0:51131:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000002f2df026/0xe5129dc8848380ba lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x145:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fea89 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.563991:0:51131:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000002f2df026/0xe5129dc8848380ba lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x145:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fea89 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.564001:0:51131:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000002f2df026/0xe5129dc8848380ba lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x145:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fea89 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.564013:0:51131:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000002f2df026/0xe5129dc8848380ba lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x145:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080000000000 nid: local remote: 0x7130d520e45fea89 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.564025:0:51131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000002f2df026/0xe5129dc8848380ba lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x145:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080000000000 nid: local remote: 0x7130d520e45fea89 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.564042:0:51131:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000002f2df026/0xe5129dc8848380ba lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x145:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000000000 nid: local remote: 0x7130d520e45fea89 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.564065:0:51131:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b51fe0600) 00000100:00100000:3.0:1787191328.564203:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:9508:x1874004634752768:12345-192.168.202.101@tcp:105: Request processed in 250us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191328.564212:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 915 00000100:00100000:3.0:1787191328.568440:0:57668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57668:1874004626237184:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191328.568484:0:57668:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1f100 x1874004626236544/t8589935827(8589935827) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191344 ref 2 fl Complete:RQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1787191328.568575:0:57668:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848380b3 from it ffff936b466f4ba0 00010000:00010000:3.0:1787191328.568585:0:57668:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc8848380b3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e45fea5f expref: -99 pid: 57668 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.568598:0:57668:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc8848380b3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45fea5f expref: -99 pid: 57668 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191328.568634:0:57668:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x75:0x0](ffff936b4898aa08), inode mode 81a4 mask 44 00000080:00200000:3.0:1787191328.568791:0:57668:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x75:0x0](ffff936b4898aa08), inode mode 81a4 mask 4 00000080:00200000:3.0:1787191328.568801:0:57668:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0x75:0x0](ffff936b4898aa08), xattr lov 00000080:00200008:3.0:1787191328.568899:0:57668:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0x75:0x0](ffff936b4898aa08), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191328.568907:0:57668:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x75:0x0](ffff936b4898aa08),name=f70.sanity-flr 00000002:00010000:3.0:1787191328.568930:0:57668:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x75:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191328.568944:0:57668:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc8848380b3 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45fea5f expref: -99 pid: 57668 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191328.568956:0:57668:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc8848380b3 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45fea5f expref: -99 pid: 57668 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191328.568961:0:57668:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191328.568966:0:57668:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x75:0x0](ffff936b4898aa08) 00000080:00010000:3.0:1787191328.568970:0:57668:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x75:0x0](ffff936b4898aa08) for lock 0xe5129dc8848380b3 00000080:00010000:3.0:1787191328.568974:0:57668:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848380b3 from it ffffa3fb41eb3cd8 00010000:00010000:3.0:1787191328.568977:0:57668:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc8848380b3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e45fea5f expref: -99 pid: 57668 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191328.568982:0:57668:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc8848380b3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45fea5f expref: -99 pid: 57668 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191328.568999:0:57668:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x75:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:3.0:1787191328.569011:0:57668:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x75:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191328.569013:0:57668:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191328.569017:0:57668:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x75:0x0] 00000008:00010000:3.0:1787191328.569037:0:57668:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191328.569039:0:57668:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b506676b0, osc lock ffff936b44f64f70, flags 0x400000400001002 00010000:00010000:3.0:1787191328.569053:0:57668:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000002f2df026/0xe5129dc8848380ba lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x145:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e45fea89 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.569061:0:57668:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000002f2df026/0xe5129dc8848380ba lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x145:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e45fea89 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1787191328.569071:0:57668:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191328.569074:0:57668:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000002f2df026/0xe5129dc8848380ba lrc: 7/0,2 mode: PW/PW res: [0x2c0000401:0x145:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e45fea89 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.569080:0:57668:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000002f2df026/0xe5129dc8848380ba lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x145:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e45fea89 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1787191328.569084:0:57668:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191328.569094:0:57668:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0x75:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1787191328.569097:0:57668:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c38b90 (ffff936b47a17008/0) at cl_lock_release():245 00000020:00010000:3.0:1787191328.569099:0:57668:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c38b90 (ffff936b47a17008/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191328.569101:0:57668:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b506676b0 (ffff936b465cccf8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191328.569103:0:57668:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c38b90 (ffff936b47a17008/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191328.569105:0:57668:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b506676b0 (ffff936b47a17008/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191328.569115:0:57668:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x75:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191328.569173:0:57668:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0x75:0x0](ffff936b4898aa08), flags 154000 00010000:00010000:3.0:1787191328.569189:0:57668:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1800/0xe5129dc884838082 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x75:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fe9d3 expref: -99 pid: 57667 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:3.0:1787191328.569418:0:57668:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191328.569431:0:57668:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191328.569440:0:57668:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191328.569449:0:57668:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191328.569455:0:57668:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191328.569460:0:57668:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191328.569463:0:57668:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191328.569469:0:57668:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41eb3b58 00010000:00010000:3.0:1787191328.569473:0:57668:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191328.569481:0:57668:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191328.569491:0:57668:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191328.569499:0:57668:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191328.569505:0:57668:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191328.569509:0:57668:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=9 00000080:00200008:3.0:1787191328.569515:0:57668:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0x75:0x0](ffff936b4898aa08), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191328.569519:0:57668:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x75:0x0](ffff936b4898aa08),name=f70.sanity-flr 00000002:00010000:3.0:1787191328.569528:0:57668:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x75:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191328.569534:0:57668:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc8848380b3 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45fea5f expref: -99 pid: 57668 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191328.569543:0:57668:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc8848380b3 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45fea5f expref: -99 pid: 57668 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191328.569550:0:57668:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191328.569554:0:57668:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x75:0x0](ffff936b4898aa08) 00000080:00010000:3.0:1787191328.569556:0:57668:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x75:0x0](ffff936b4898aa08) for lock 0xe5129dc8848380b3 00000080:00010000:3.0:1787191328.569561:0:57668:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848380b3 from it ffffa3fb41eb3cb8 00010000:00010000:3.0:1787191328.569564:0:57668:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc8848380b3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e45fea5f expref: -99 pid: 57668 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191328.569576:0:57668:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc8848380b3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45fea5f expref: -99 pid: 57668 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787191328.569589:0:57668:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x75:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:3.0:1787191328.569595:0:57668:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x75:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191328.569599:0:57668:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191328.569601:0:57668:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x75:0x0] 00000008:00010000:3.0:1787191328.569610:0:57668:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191328.569612:0:57668:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b506676b0, osc lock ffff936b44f64f70, flags 0x400000400001002 00010000:00010000:3.0:1787191328.569619:0:57668:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000002f2df026/0xe5129dc8848380ba lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x145:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e45fea89 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.569626:0:57668:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000002f2df026/0xe5129dc8848380ba lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x145:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e45fea89 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1787191328.569631:0:57668:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191328.569634:0:57668:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000002f2df026/0xe5129dc8848380ba lrc: 7/0,2 mode: PW/PW res: [0x2c0000401:0x145:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e45fea89 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.569639:0:57668:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000002f2df026/0xe5129dc8848380ba lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x145:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e45fea89 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1787191328.569643:0:57668:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191328.569646:0:57668:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0x75:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1787191328.569648:0:57668:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c38b90 (ffff936b47a17008/0) at cl_lock_release():245 00000020:00010000:3.0:1787191328.569649:0:57668:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c38b90 (ffff936b47a17008/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191328.569652:0:57668:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b506676b0 (ffff936b465cccf8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191328.569654:0:57668:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c38b90 (ffff936b47a17008/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191328.569656:0:57668:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b506676b0 (ffff936b47a17008/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191328.569661:0:57668:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x75:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191328.569683:0:57668:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191328.569688:0:57668:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191328.569692:0:57668:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191328.569698:0:57668:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191328.569702:0:57668:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191328.569704:0:57668:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191328.569705:0:57668:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191328.569708:0:57668:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41eb3bf8 00010000:00010000:3.0:1787191328.569710:0:57668:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191328.569715:0:57668:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191328.569720:0:57668:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191328.569722:0:57668:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191328.569724:0:57668:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191328.569726:0:57668:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:3.0:1787191328.569729:0:57668:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x75:0x0](ffff936b4898aa08), inode mode 81a4 mask 46 00000080:00200008:3.0:1787191328.569736:0:57668:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0x75:0x0](ffff936b4898aa08), flags 154402 00000080:00200000:3.0:1787191328.569800:0:57668:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x75:0x0](ffff936b4898aa08), inode mode 81a4 mask 4 00000080:00200000:3.0:1787191328.569805:0:57668:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0x75:0x0](ffff936b4898aa08), xattr lov 00000080:00200008:3.0:1787191328.569820:0:57668:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0x75:0x0](ffff936b4898aa08), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191328.569823:0:57668:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x75:0x0](ffff936b4898aa08),name=f70.sanity-flr 00000002:00010000:3.0:1787191328.569874:0:57668:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x75:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191328.569880:0:57668:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc8848380b3 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45fea5f expref: -99 pid: 57668 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191328.569887:0:57668:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc8848380b3 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45fea5f expref: -99 pid: 57668 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787191328.569891:0:57668:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191328.569894:0:57668:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x75:0x0](ffff936b4898aa08) 00000080:00010000:3.0:1787191328.569896:0:57668:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x75:0x0](ffff936b4898aa08) for lock 0xe5129dc8848380b3 00000080:00010000:3.0:1787191328.569899:0:57668:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848380b3 from it ffffa3fb41eb3cd8 00010000:00010000:3.0:1787191328.569901:0:57668:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc8848380b3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e45fea5f expref: -99 pid: 57668 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191328.569906:0:57668:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc8848380b3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x75:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45fea5f expref: -99 pid: 57668 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:3.0:1787191328.569914:0:57668:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x75:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:3.0:1787191328.569917:0:57668:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x75:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191328.569919:0:57668:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191328.569920:0:57668:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x75:0x0] 00000008:00010000:3.0:1787191328.569925:0:57668:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191328.569926:0:57668:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b506676b0, osc lock ffff936b44f64f70, flags 0x400000400001002 00010000:00010000:3.0:1787191328.569931:0:57668:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000002f2df026/0xe5129dc8848380ba lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x145:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e45fea89 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.569938:0:57668:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000002f2df026/0xe5129dc8848380ba lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x145:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e45fea89 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1787191328.569944:0:57668:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191328.569946:0:57668:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000002f2df026/0xe5129dc8848380ba lrc: 7/0,2 mode: PW/PW res: [0x2c0000401:0x145:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e45fea89 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.569951:0:57668:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000002f2df026/0xe5129dc8848380ba lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x145:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e45fea89 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1787191328.569955:0:57668:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191328.569957:0:57668:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0x75:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1787191328.569959:0:57668:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c38b90 (ffff936b47a17008/0) at cl_lock_release():245 00000020:00010000:3.0:1787191328.569960:0:57668:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c38b90 (ffff936b47a17008/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191328.569961:0:57668:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b506676b0 (ffff936b465cccf8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191328.569963:0:57668:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c38b90 (ffff936b47a17008/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191328.569965:0:57668:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b506676b0 (ffff936b47a17008/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191328.569969:0:57668:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x75:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200080:3.0:1787191328.570023:0:57668:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x75:0x0](ffff936b4898aa08) cmd=c00c66f3 arg=11b12e0 00000080:00200008:3.0:1787191328.570115:0:57668:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0x75:0x0](ffff936b4898aa08), flags 154002 00000080:00200000:3.0:1787191328.621719:0:57670:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191328.621754:0:57670:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191328.621775:0:57670:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191328.621800:0:57670:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191328.621808:0:57670:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191328.621817:0:57670:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191328.621822:0:57670:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191328.622669:0:57670:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41e6bbf8 00010000:00010000:3.0:1787191328.622686:0:57670:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191328.622699:0:57670:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191328.622720:0:57670:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191328.622734:0:57670:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191328.622743:0:57670:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191328.622763:0:57670:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b60796780, open_flags d900, mode 0 opened 0 00000080:00200000:3.0:1787191328.622770:0:57670:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:3.0:1787191328.622794:0:57670:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:3.0:1787191328.623605:0:57670:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc8848380c8 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.623617:0:57670:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc8848380c8 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57670 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191328.623631:0:57670:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191328.623647:0:57670:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1f100 x1874004626238720/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191328.623660:0:57670:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc8848380c8 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57670 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191328.623688:0:57670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57670:1874004626238720:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191328.625081:0:57670:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c300 going to sleep for 11 seconds 00000100:00100000:3.0:1787191328.691279:0:40921:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787191328.691306:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634752896 00000100:00100000:3.0:1787191328.691316:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634752896 00000100:00100000:3.0:1787191328.693249:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 916 00000100:00100000:3.0:1787191328.693277:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b4121cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634752896:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191328.693295:0:40921:0:(ldlm_lockd.c:2455:ldlm_callback_handler()) callback on lock 0xe5129dc884838100 - lock disappeared 00010000:00010000:3.0:1787191328.693401:0:40921:0:(ldlm_lockd.c:2352:ldlm_callback_errmsg()) @@@ Operate with invalid parameter, NID=12345-192.168.202.101@tcp lock=0xe5129dc884838100: rc = 0 req@ffff936b4121cc50 x1874004634752896/t0(0) o104->f10005b0-4ec5-4888-9c81-49c0b11e82c4@192.168.202.101@tcp:639/0 lens 328/224 e 0 to 0 dl 1787191339 ref 1 fl Interpret:/0/0 rc -22/-22 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191328.693416:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b4121cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634752896:12345-192.168.202.101@tcp:104: Request processed in 151us (2243us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787191328.697403:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 916 00000100:00100000:3.0:1787191328.736030:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191328.748556:0:57673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57673:1874004626242176:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191328.748599:0:57673:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CW ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc88483811c lrc: 4/1,0 mode: --/CR res: [0x200000405:0x77:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45febaf expref: -99 pid: 57673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.748616:0:57673:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc88483811c lrc: 4/1,0 mode: --/CW res: [0x200000405:0x77:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45febaf expref: -99 pid: 57673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.748662:0:57673:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc88483811c lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x77:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45febaf expref: -99 pid: 57673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.748727:0:57673:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc88483811c lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x77:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45febaf expref: -99 pid: 57673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.748748:0:57673:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc88483811c lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x77:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45febaf expref: -99 pid: 57673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.752374:0:57673:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc88483811c lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x77:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45febaf expref: -99 pid: 57673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.752669:0:57673:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc88483811c lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x77:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45febaf expref: -99 pid: 57673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191328.752706:0:57673:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x200002b, status=0 req@ffff936b513bbb80 x1874004626242176/t8589935840(8589935840) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191344 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191328.752799:0:57673:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bbb80 x1874004626242176/t8589935840(8589935840) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191344 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191328.752819:0:57673:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc88483811c lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x77:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45febaf expref: -99 pid: 57673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.761347:0:57673:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 8 res 8589935621/119 (0 0) 00000080:00200000:3.0:1787191328.761367:0:57673:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x77:0x0] suppgids 0 0: rc 0 00000100:00100000:3.0:1787191328.778424:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b5058d180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626243456:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191328.778444:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884838131 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x77:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45febf5 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.778460:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884838131 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x77:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45febf5 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191328.778472:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b5058d180 x1874004626243456/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191344 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191328.778483:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884838131 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x77:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45febf5 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191328.778494:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884838131 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x77:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45febf5 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.778502:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/119 (0 0) 00000080:00200000:3.0:1787191328.778508:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x77:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1787191328.778517:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x77:0x0](ffff936b5395ba88) for lock 0xe5129dc884838131 00000080:00010000:3.0:1787191328.778523:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884838131 from it ffffa3fb41cab8c8 00010000:00010000:3.0:1787191328.778526:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884838131 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x77:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45febf5 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.778535:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884838131 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x77:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45febf5 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191328.778554:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884838131 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x77:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45febf5 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191328.778562:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884838131 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x77:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45febf5 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:3.0:1787191328.778574:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0x77:0x0](00000000c6a8adc5) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884838131 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x77:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45febf5 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191328.778615:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0x77:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:3.0:1787191328.778620:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884838131 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x77:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e45febf5 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191328.778627:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884838131 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x77:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45febf5 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:3.0:1787191328.778642:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0x77:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:3.0:1787191328.778648:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x77:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191328.778652:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0x77:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:3.0:1787191328.778659:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x77:0x0](ffff936b5395ba88) 00000002:00010000:3.0:1787191328.778666:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x77:0x0]) in obj [0x200000405:0x77:0x0], intent: layout flags 02 00010000:00010000:3.0:1787191328.778679:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884838131 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x77:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e45febf5 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191328.778691:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0x77:0x0]: losing layout lock 00010000:00010000:3.0:1787191328.778727:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884838131 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x77:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e45febf5 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191328.778735:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191328.778738:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884838131 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x77:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e45febf5 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191328.778757:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884838138 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x77:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.778765:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884838138 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x77:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191328.778775:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191328.778781:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1ed80 x1874004626243712/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191328.778789:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884838138 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x77:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191328.778807:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ed80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626243712:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191328.778930:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787191328.796149:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191328.796321:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191328.800586:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634753792 00000100:00100000:3.0:1787191328.800613:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634753792 00000100:00100000:3.0:1787191328.800670:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634754432 00000100:00100000:3.0:1787191328.800673:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634754432 00000100:00100000:3.0:1787191328.801554:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 919 00000100:00100000:3.0:1787191328.801566:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30353:x1874004634753792:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191328.801581:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000002f2df026/0xe5129dc8848380ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x145:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000030000 nid: local remote: 0x7130d520e45fea89 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191328.801674:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191328.801679:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30353:x1874004634753792:12345-192.168.202.101@tcp:104: Request processed in 117us (5558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191328.801691:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 919 00000100:00100000:3.0:1787191328.801714:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 920 00000100:00100000:3.0:1787191328.801722:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8420:x1874004634754432:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191328.801733:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008b8a9ddc/0xe5129dc8848380c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x142:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e45fea90 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191328.801773:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787191328.801779:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8420:x1874004634754432:12345-192.168.202.101@tcp:104: Request processed in 58us (5461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191328.801785:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 920 00000100:00100000:3.0:1787191328.804029:0:57674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57674:1874004626244352:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191328.804263:0:57674:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191328.823668:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191328.824452:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634754560 00000100:00100000:3.0:1787191328.824465:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634754560 00000100:00100000:3.0:1787191328.824529:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 921 00000100:00100000:3.0:1787191328.824541:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634754560:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191328.824564:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc88483811c lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x77:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e45febaf expref: -99 pid: 57673 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191328.824713:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191328.824722:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634754560:12345-192.168.202.101@tcp:104: Request processed in 183us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191328.824731:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 921 00000100:00100000:3.0:1787191328.830716:0:57674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b48724000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57674:1874004626244864:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191328.830739:0:57674:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609000/0xe5129dc884838154 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fec6c expref: -99 pid: 57674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.830771:0:57674:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609000/0xe5129dc884838154 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x77:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fec6c expref: -99 pid: 57674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.830781:0:57674:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609000/0xe5129dc884838154 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x77:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fec6c expref: -99 pid: 57674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.830796:0:57674:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609000/0xe5129dc884838154 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x77:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fec6c expref: -99 pid: 57674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.830810:0:57674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609000/0xe5129dc884838154 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x77:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fec6c expref: -99 pid: 57674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.830824:0:57674:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609000/0xe5129dc884838154 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x77:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fec6c expref: -99 pid: 57674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.830881:0:57674:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609000/0xe5129dc884838154 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x77:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fec6c expref: -99 pid: 57674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.830889:0:57674:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609000/0xe5129dc884838154 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x77:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fec6c expref: -99 pid: 57674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191328.830902:0:57674:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b48724000 x1874004626244864/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/976 e 0 to 0 dl 1787191344 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191328.830914:0:57674:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609000/0xe5129dc884838154 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x77:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fec6c expref: -99 pid: 57674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191328.830935:0:57674:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609000/0xe5129dc884838154 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x77:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fec6c expref: -99 pid: 57674 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.830947:0:57674:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/119 (0 0) 00000080:00200000:3.0:1787191328.830955:0:57674:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191328.831020:0:57674:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0x77:0x0](ffff936b5395ba88): rc = 0 00000080:00200000:3.0:1787191328.831039:0:57674:0:(file.c:6836:ll_layout_conf()) [0x200000405:0x77:0x0]: layout version change: 4 -> 4 00000080:00010000:3.0:1787191328.831045:0:57674:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x77:0x0](ffff936b5395ba88) for lock 0xe5129dc884838154 00000080:00010000:3.0:1787191328.831061:0:57674:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x77:0x0](ffff936b5395ba88) 00000080:00010000:3.0:1787191328.831066:0:57674:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884838154 from it ffffa3fb41e6bb20 00010000:00010000:3.0:1787191328.831070:0:57674:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609000/0xe5129dc884838154 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x77:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e45fec6c expref: -99 pid: 57674 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.831080:0:57674:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609000/0xe5129dc884838154 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x77:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45fec6c expref: -99 pid: 57674 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200008:3.0:1787191328.831126:0:57674:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0x77:0x0](ffff936b5395ba88), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191328.831147:0:57674:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x77:0x0](ffff936b5395ba88),name=f70.sanity-flr 00000002:00010000:3.0:1787191328.831175:0:57674:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x77:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191328.831184:0:57674:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc88483813f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x77:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45fec42 expref: -99 pid: 57674 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191328.831195:0:57674:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc88483813f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x77:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45fec42 expref: -99 pid: 57674 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191328.831201:0:57674:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191328.831208:0:57674:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x77:0x0](ffff936b5395ba88) 00000080:00010000:3.0:1787191328.831211:0:57674:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x77:0x0](ffff936b5395ba88) for lock 0xe5129dc88483813f 00000080:00010000:3.0:1787191328.831215:0:57674:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483813f from it ffffa3fb41e6bcb8 00010000:00010000:3.0:1787191328.831219:0:57674:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc88483813f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x77:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e45fec42 expref: -99 pid: 57674 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191328.831233:0:57674:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc88483813f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x77:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45fec42 expref: -99 pid: 57674 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787191328.831257:0:57674:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x77:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:3.0:1787191328.831270:0:57674:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x77:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191328.831273:0:57674:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191328.831278:0:57674:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x77:0x0] 00000008:00010000:3.0:1787191328.831298:0:57674:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191328.831302:0:57674:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667730, osc lock ffff936b44f64f70, flags 0x400000400001002 00010000:00010000:3.0:1787191328.831320:0:57674:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc884838146 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x144:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e45fec26 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191328.831332:0:57674:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc884838146 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x144:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e45fec26 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:3.0:1787191328.831345:0:57674:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191328.831348:0:57674:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc884838146 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x144:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e45fec26 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191328.831357:0:57674:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc884838146 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x144:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e45fec26 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:3.0:1787191328.831374:0:57674:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191328.831385:0:57674:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0x77:0x0] updating i_size 5 i_blocks 0 00000020:00010000:3.0:1787191328.831393:0:57674:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51654250 (ffff936b465cccf8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191328.831396:0:57674:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51654250 (ffff936b465cccf8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191328.831399:0:57674:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667730 (ffff936b47a17878/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191328.831403:0:57674:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51654250 (ffff936b465cccf8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191328.831406:0:57674:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667730 (ffff936b465cccf8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191328.831418:0:57674:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x77:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191328.831470:0:57674:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191328.831480:0:57674:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191328.831489:0:57674:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191328.831498:0:57674:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191328.831505:0:57674:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191328.831510:0:57674:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191328.831512:0:57674:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191328.831517:0:57674:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41e6bbf8 00010000:00010000:3.0:1787191328.831521:0:57674:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191328.831529:0:57674:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191328.831543:0:57674:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191328.831553:0:57674:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191328.831558:0:57674:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191328.831562:0:57674:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:3.0:1787191328.831567:0:57674:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x77:0x0](ffff936b5395ba88), inode mode 81a4 mask 46 00000080:00200008:3.0:1787191328.831577:0:57674:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0x77:0x0](ffff936b5395ba88), flags 154402 00000002:00010000:3.0:1787191328.831595:0:57674:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x77:0x0]) in obj [0x200000405:0x77:0x0], intent: open flags 0104240114403 00010000:00010000:3.0:1787191328.831653:0:57674:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483815b lrc: 3/1,0 mode: --/CR res: [0x200000405:0x77:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x10000000000000 pid: 57674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.831661:0:57674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483815b lrc: 3/1,0 mode: --/CR res: [0x200000405:0x77:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x0 pid: 57674 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191328.831674:0:57674:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:3.0:1787191328.831682:0:57674:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1d180 x1874004626245760/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191328.831693:0:57674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483815b lrc: 3/1,0 mode: --/CR res: [0x200000405:0x77:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x0 pid: 57674 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191328.831717:0:57674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57674:1874004626245760:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191328.831997:0:57674:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c240 going to sleep for 11 seconds 00000100:00100000:3.0:1787191328.836870:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634754688 00000100:00100000:3.0:1787191328.836883:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634754688 00000100:00100000:3.0:1787191328.836944:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 922 00000100:00100000:3.0:1787191328.836953:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634754688:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191328.836975:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609000/0xe5129dc884838154 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x77:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e45fec6c expref: -99 pid: 57674 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191328.837050:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191328.837054:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634754688:12345-192.168.202.101@tcp:104: Request processed in 104us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191328.837060:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 922 00000100:00100000:3.0:1787191328.839916:0:57674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57674:1874004626245760:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191328.839942:0:57674:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CW ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483815b lrc: 4/1,0 mode: --/CR res: [0x200000405:0x77:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fec7a expref: -99 pid: 57674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.839957:0:57674:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483815b lrc: 4/1,0 mode: --/CW res: [0x200000405:0x77:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fec7a expref: -99 pid: 57674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.839972:0:57674:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483815b lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x77:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fec7a expref: -99 pid: 57674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.839984:0:57674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483815b lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x77:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fec7a expref: -99 pid: 57674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.839999:0:57674:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483815b lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x77:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fec7a expref: -99 pid: 57674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.840008:0:57674:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483815b lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x77:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fec7a expref: -99 pid: 57674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.840015:0:57674:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483815b lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x77:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fec7a expref: -99 pid: 57674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191328.840032:0:57674:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x200002b, status=0 req@ffff936b51d1d180 x1874004626245760/t8589935849(8589935849) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191344 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191328.840047:0:57674:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1d180 x1874004626245760/t8589935849(8589935849) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191344 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191328.840063:0:57674:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483815b lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x77:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fec7a expref: -99 pid: 57674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.840076:0:57674:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 8 res 8589935621/119 (0 0) 00000080:00200000:3.0:1787191328.840082:0:57674:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x77:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1787191328.840157:0:57674:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x77:0x0](ffff936b5395ba88) for lock 0xe5129dc88483815b 00000080:00010000:3.0:1787191328.840167:0:57674:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483815b from it ffffa3fb41e6bbf0 00010000:00010000:3.0:1787191328.840170:0:57674:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483815b lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x77:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fec7a expref: -99 pid: 57674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.840181:0:57674:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483815b lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x77:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fec7a expref: -99 pid: 57674 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00100000:3.0:1787191328.840225:0:57674:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1d180 x1874004626245760/t8589935849(8589935849) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191344 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191328.840468:0:57674:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x77:0x0](ffff936b5395ba88), inode mode 81a4 mask 4 00000080:00200000:3.0:1787191328.840479:0:57674:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0x77:0x0](ffff936b5395ba88), xattr lov 00000080:00200008:3.0:1787191328.840509:0:57674:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0x77:0x0](ffff936b5395ba88), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191328.840517:0:57674:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x77:0x0](ffff936b5395ba88),name=f70.sanity-flr 00000002:00010000:3.0:1787191328.840534:0:57674:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x77:0x0]) in obj [0x200000405:0x77:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191328.840544:0:57674:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc88483813f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x77:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45fec42 expref: -99 pid: 57674 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191328.840557:0:57674:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc88483813f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x77:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45fec42 expref: -99 pid: 57674 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:3.0:1787191328.840564:0:57674:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x77:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191328.840570:0:57674:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x77:0x0](ffff936b5395ba88) 00000080:00010000:3.0:1787191328.840574:0:57674:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x77:0x0](ffff936b5395ba88) for lock 0xe5129dc88483813f 00000080:00010000:3.0:1787191328.840578:0:57674:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483813f from it ffffa3fb41e6bcd8 00010000:00010000:3.0:1787191328.840581:0:57674:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc88483813f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x77:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e45fec42 expref: -99 pid: 57674 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191328.840589:0:57674:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc88483813f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x77:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45fec42 expref: -99 pid: 57674 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:3.0:1787191328.840610:0:57674:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x77:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:3.0:1787191328.840622:0:57674:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x77:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191328.840626:0:57674:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191328.840630:0:57674:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x77:0x0] 00000008:00010000:3.0:1787191328.840653:0:57674:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191328.840656:0:57674:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667730, osc lock ffff936b44f64f70, flags 0x400000400001002 00010000:00010000:3.0:1787191328.840675:0:57674:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc884838146 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x144:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e45fec26 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191328.840688:0:57674:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc884838146 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x144:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e45fec26 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:3.0:1787191328.840708:0:57674:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191328.840712:0:57674:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc884838146 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x144:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e45fec26 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191328.840720:0:57674:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc884838146 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x144:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e45fec26 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:3.0:1787191328.840731:0:57674:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191328.840742:0:57674:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0x77:0x0] updating i_size 5 i_blocks 0 00000020:00010000:3.0:1787191328.840749:0:57674:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51654250 (ffff936b465cccf8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191328.840752:0:57674:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51654250 (ffff936b465cccf8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191328.840755:0:57674:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667730 (ffff936b47a17878/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191328.840759:0:57674:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51654250 (ffff936b465cccf8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191328.840762:0:57674:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667730 (ffff936b465cccf8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191328.840775:0:57674:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x77:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200080:3.0:1787191328.840883:0:57674:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x77:0x0](ffff936b5395ba88) cmd=c00c66f3 arg=18942e0 00000002:00010000:3.0:1787191328.840900:0:57674:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x77:0x0]) in obj [0x200000405:0x77:0x0], intent: open flags 05004040000002 00010000:00010000:3.0:1787191328.840912:0:57674:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483815b lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x77:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e45fec7a expref: -99 pid: 57674 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191328.840963:0:57674:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483815b lrc: 1/0,0 mode: --/CW res: [0x200000405:0x77:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e45fec7a expref: -99 pid: 57674 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191328.840970:0:57674:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191328.840974:0:57674:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483815b lrc: 0/0,0 mode: --/CW res: [0x200000405:0x77:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e45fec7a expref: -99 pid: 57674 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191328.841007:0:57674:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc884838162 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x77:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57674 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.841014:0:57674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc884838162 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x77:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57674 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191328.841026:0:57674:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191328.841033:0:57674:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1df80 x1874004626246144/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191328.841044:0:57674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc884838162 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x77:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x81000000000000 pid: 57674 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191328.841066:0:57674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57674:1874004626246144:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191328.841388:0:57674:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c240 going to sleep for 11 seconds 00000100:00100000:3.0:1787191328.856470:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191328.925314:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191328.932724:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626249984:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191328.932859:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787191328.932866:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626250112:192.168.202.101@tcp:101:lfs.0 00000080:00200000:3.0:1787191328.937576:0:57677:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0x79:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1787191328.937582:0:57677:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c39bc0 (ffff936b47a17638/0) at cl_lock_release():245 00000020:00010000:3.0:1787191328.937585:0:57677:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c39bc0 (ffff936b47a17638/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191328.937590:0:57677:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62b5ff30 (ffff936b47a17488/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191328.937605:0:57677:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62b5ff70 (ffff936b465cc5a8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191328.937607:0:57677:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c39bc0 (ffff936b47a17638/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191328.937609:0:57677:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62b5ff30 (ffff936b47a17638/1) at cl_lock_fini():72 00000020:00010000:3.0:1787191328.937613:0:57677:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62b5ff70 (ffff936b47a17638/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191328.937623:0:57677:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x79:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191328.937659:0:57677:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0x79:0x0](ffff936b5395b248), flags 154000 00000002:00100000:3.0:1787191328.937677:0:57677:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b48725180 x1874004626249600/t8589935858(8589935858) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191344 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191328.937684:0:57677:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:3.0:1787191328.937689:0:57677:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1e300 x1874004626250624/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191328.937701:0:57677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57677:1874004626250624:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191328.937824:0:57677:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cc00 going to sleep for 11 seconds 00000080:00200000:3.0:1787191328.943536:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191328.943557:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191328.943570:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191328.943581:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191328.943585:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191328.943590:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191328.943603:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191328.943609:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:3.0:1787191328.943611:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191328.943617:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191328.943628:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191328.943633:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191328.943638:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191328.943642:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:3.0:1787191328.943647:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x79:0x0](ffff936b5395b248), inode mode 81a4 mask 42 00000080:00200008:3.0:1787191328.943652:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0x79:0x0](ffff936b5395b248), flags 101101 00000002:00010000:3.0:1787191328.943663:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x79:0x0]) in obj [0x200000405:0x79:0x0], intent: open|creat flags 04240101102 00010000:00010000:3.0:1787191328.943672:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608a00/0xe5129dc8848381a1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x79:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e45fed8b expref: -99 pid: 57677 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191328.943687:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0x79:0x0]: losing layout lock 00010000:00010000:3.0:1787191328.943736:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608a00/0xe5129dc8848381a1 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x79:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e45fed8b expref: -99 pid: 57677 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191328.943743:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191328.943746:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608a00/0xe5129dc8848381a1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x79:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e45fed8b expref: -99 pid: 57677 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191328.943767:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc8848381bd lrc: 3/0,1 mode: --/CW res: [0x200000405:0x79:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.943773:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc8848381bd lrc: 3/0,1 mode: --/CW res: [0x200000405:0x79:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191328.943783:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:3.0:1787191328.943795:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1ca80 x1874004626251136/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191328.943803:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc8848381bd lrc: 3/0,1 mode: --/CW res: [0x200000405:0x79:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191328.943822:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ca80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626251136:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191328.944189:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787191328.948024:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ca80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626251136:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191328.948181:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc8848381bd lrc: 4/0,1 mode: --/CW res: [0x200000405:0x79:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fedbc expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.948198:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc8848381bd lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x79:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fedbc expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.948209:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc8848381bd lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x79:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fedbc expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191328.948288:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x200002b, status=0 req@ffff936b51d1ca80 x1874004626251136/t8589935862(8589935862) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191344 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191328.948300:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1ca80 x1874004626251136/t8589935862(8589935862) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191344 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191328.948310:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc8848381bd lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x79:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fedbc expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191328.948324:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc8848381bd lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x79:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fedbc expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.948334:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 8 res 8589935621/121 (0 0) 00000080:00200000:3.0:1787191328.948340:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000405:0x79:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1787191328.949072:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0x79:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:3.0:1787191328.949082:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x79:0x0](ffff936b5395b248) for lock 0xe5129dc8848381bd 00000080:00010000:3.0:1787191328.949090:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848381bd from it ffffa3fb41cabbf0 00010000:00010000:3.0:1787191328.949095:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc8848381bd lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x79:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e45fedbc expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.949104:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc8848381bd lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x79:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45fedbc expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000002:00100000:3.0:1787191328.949149:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1ca80 x1874004626251136/t8589935862(8589935862) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191344 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191328.949234:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0x79:0x0], intent: getxattr flags 0 00010000:00010000:3.0:1787191328.949286:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc8848381c4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x79:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.949293:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc8848381c4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x79:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.949303:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc8848381c4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x79:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191328.949324:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626251264:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191328.949693:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787191328.954305:0:57677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57677:1874004626250880:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191328.954328:0:57677:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CW ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc8848381b6 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x79:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fedae expref: -99 pid: 57677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.954339:0:57677:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc8848381b6 lrc: 4/1,0 mode: --/CW res: [0x200000405:0x79:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fedae expref: -99 pid: 57677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.954354:0:57677:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc8848381b6 lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x79:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fedae expref: -99 pid: 57677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.954363:0:57677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc8848381b6 lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x79:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fedae expref: -99 pid: 57677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.954375:0:57677:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc8848381b6 lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x79:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fedae expref: -99 pid: 57677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.954383:0:57677:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc8848381b6 lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x79:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fedae expref: -99 pid: 57677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.954391:0:57677:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc8848381b6 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x79:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fedae expref: -99 pid: 57677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191328.955251:0:57677:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x200002b, status=0 req@ffff936b513bbb80 x1874004626250880/t8589935863(8589935863) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191344 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191328.955264:0:57677:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bbb80 x1874004626250880/t8589935863(8589935863) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191344 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191328.955283:0:57677:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc8848381b6 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x79:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fedae expref: -99 pid: 57677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.955293:0:57677:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 8 res 8589935621/121 (0 0) 00000080:00200000:3.0:1787191328.955298:0:57677:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x79:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1787191328.955353:0:57677:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x79:0x0](ffff936b5395b248) for lock 0xe5129dc8848381b6 00000080:00010000:3.0:1787191328.955362:0:57677:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848381b6 from it ffffa3fb41ec3bf0 00010000:00010000:3.0:1787191328.955366:0:57677:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc8848381b6 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x79:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fedae expref: -99 pid: 57677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.955374:0:57677:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc8848381b6 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x79:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fedae expref: -99 pid: 57677 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00100000:3.0:1787191328.955413:0:57677:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bbb80 x1874004626250880/t8589935863(8589935863) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191344 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191328.955448:0:57677:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513bbb80 x1874004626250880/t8589935863(8589935863) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191344 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191328.955458:0:57677:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191328.955463:0:57677:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1d180 x1874004626251776/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191328.955482:0:57677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57677:1874004626251776:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191328.955738:0:57677:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191328.957823:0:57677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57677:1874004626251776:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191328.957873:0:57677:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513bbb80 x1874004626250880/t8589935863(8589935863) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191344 ref 2 fl Complete:RQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200080:3.0:1787191328.958021:0:57677:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x79:0x0](ffff936b5395b248) cmd=800466af arg=7ffd68ae15cc 00000080:00200080:3.0:1787191328.958038:0:57677:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x79:0x0](ffff936b5395b248) cmd=80086601 arg=7ffd68ae1568 00000100:00100000:3.0:1787191328.958076:0:57677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57677:1874004626251904:192.168.202.101@tcp:33:lfs.0 00000100:00100000:3.0:1787191328.958156:0:57677:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191328.960958:0:57677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57677:1874004626251904:192.168.202.101@tcp:33:lfs.0 00000080:00200080:3.0:1787191328.960997:0:57677:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x79:0x0](ffff936b5395b248) cmd=c00c66f3 arg=7ffd68ae1554 00000080:00200008:3.0:1787191328.961169:0:57677:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0x79:0x0](ffff936b5395b248), flags 154002 00010000:00010000:3.0:1787191328.961191:0:57677:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc8848381b6 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x79:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fedae expref: -99 pid: 57677 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000100:00100000:3.0:1787191328.970480:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b5058f100 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626252032:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191328.970516:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0e00/0xe5129dc8848381cb lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x79:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fede6 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.970533:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0e00/0xe5129dc8848381cb lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x79:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fede6 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191328.970549:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b5058f100 x1874004626252032/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191344 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191328.970562:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0e00/0xe5129dc8848381cb lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x79:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fede6 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191328.970578:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0e00/0xe5129dc8848381cb lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x79:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fede6 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.970590:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/121 (0 0) 00000080:00200000:3.0:1787191328.970677:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x79:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1787191328.970695:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x79:0x0](ffff936b5395b248) for lock 0xe5129dc8848381cb 00000080:00010000:3.0:1787191328.970704:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848381cb from it ffffa3fb41cab8c8 00010000:00010000:3.0:1787191328.970709:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0e00/0xe5129dc8848381cb lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x79:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fede6 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.970793:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0e00/0xe5129dc8848381cb lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x79:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fede6 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191328.970821:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0e00/0xe5129dc8848381cb lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x79:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fede6 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191328.970881:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0e00/0xe5129dc8848381cb lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x79:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fede6 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:3.0:1787191328.970891:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0x79:0x0](000000003745bbc2) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0e00/0xe5129dc8848381cb lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x79:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fede6 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191328.970936:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0x79:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:3.0:1787191328.970942:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0e00/0xe5129dc8848381cb lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x79:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e45fede6 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191328.970950:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0e00/0xe5129dc8848381cb lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x79:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45fede6 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:3.0:1787191328.970964:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0x79:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:3.0:1787191328.970972:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x79:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191328.970975:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0x79:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:3.0:1787191328.970984:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x79:0x0](ffff936b5395b248) 00000002:00010000:3.0:1787191328.970994:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x79:0x0]) in obj [0x200000405:0x79:0x0], intent: layout flags 02 00010000:00010000:3.0:1787191328.971009:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0e00/0xe5129dc8848381cb lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x79:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e45fede6 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191328.971027:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0x79:0x0]: losing layout lock 00010000:00010000:3.0:1787191328.971059:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0e00/0xe5129dc8848381cb lrc: 1/0,0 mode: --/CR res: [0x200000405:0x79:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e45fede6 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191328.971065:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191328.971069:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0e00/0xe5129dc8848381cb lrc: 0/0,0 mode: --/CR res: [0x200000405:0x79:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e45fede6 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191328.971090:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc8848381d2 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x79:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.971098:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc8848381d2 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x79:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191328.971108:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191328.971116:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1d180 x1874004626252288/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191328.971126:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc8848381d2 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x79:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191328.971157:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626252288:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191328.973085:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191328.997235:0:57570:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589935867 gen 1 00000100:00100000:3.0:1787191328.997384:0:57570:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b51d1ca80 x1874004626251136/t8589935862(8589935862) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191344 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787191328.997404:0:57570:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff936b5058ca80 x1874004626252544/t8589935868(8589935868) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191344 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787191328.997422:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626252288:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191328.997449:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc8848381d2 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x79:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fedf4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.997464:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc8848381d2 lrc: 4/0,1 mode: --/CR res: [0x200000405:0x79:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fedf4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.997479:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc8848381d2 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0x79:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fedf4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.997493:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc8848381d2 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0x79:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fedf4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.997510:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc8848381d2 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0x79:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fedf4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.997519:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc8848381d2 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0x79:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fedf4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.997528:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc8848381d2 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x79:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fedf4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191328.997539:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b51d1d180 x1874004626252288/t8589935867(8589935867) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191344 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191328.997562:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc8848381d2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x79:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fedf4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191328.997581:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc8848381d2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x79:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fedf4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.997595:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/121 (0 0) 00000080:00200000:3.0:1787191328.997603:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x79:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1787191328.997619:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x79:0x0](ffff936b5395b248) for lock 0xe5129dc8848381d2 00000080:00010000:3.0:1787191328.997629:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848381d2 from it ffffa3fb41cab930 00010000:00010000:3.0:1787191328.997633:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc8848381d2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x79:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fedf4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.997643:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc8848381d2 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x79:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fedf4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191328.997668:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:3.0:1787191328.997678:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x79:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:3.0:1787191328.997696:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc8848381d2 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x79:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fedf4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191328.997708:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc8848381d2 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x79:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fedf4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:3.0:1787191328.997716:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0x79:0x0](000000003745bbc2) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc8848381d2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x79:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fedf4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191328.997767:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0x79:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:3.0:1787191328.997772:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc8848381d2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x79:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e45fedf4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191328.997785:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc8848381d2 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x79:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45fedf4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:3.0:1787191328.997803:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0x79:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:3.0:1787191328.997809:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x79:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191328.997812:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191328.997824:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191328.997885:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1787191328.997892:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:3.0:1787191328.997911:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:3.0:1787191328.997915:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b5235ccf0, osc lock ffff936b44f64f70, flags 0x80000000 00000008:00010000:3.0:1787191328.997920:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:3.0:1787191328.997921:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b5235cd30, osc lock ffff936b44f650a0, flags 0x80000000 00010000:00010000:3.0:1787191328.997985:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc8848381e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x149:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.997996:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc8848381e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x149:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191328.998007:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc8848381e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x149:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191328.998032:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626253184:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191328.998159:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c300 going to sleep for 11 seconds 00000100:00100000:3.0:1787191329.000166:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634756608 00000100:00100000:3.0:1787191329.000179:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634756608 00000100:00100000:3.0:1787191329.000394:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 929 00000100:00100000:3.0:1787191329.000408:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634756608:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191329.000431:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc8848381b6 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x79:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e45fedae expref: -99 pid: 57677 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191329.000533:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191329.000542:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634756608:12345-192.168.202.101@tcp:104: Request processed in 137us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191329.000550:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 929 00000100:00100000:3.0:1787191329.003213:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626253184:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191329.003243:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc8848381e7 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x149:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fee48 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.003581:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc8848381e7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x149:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e45fee48 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.003600:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc8848381e7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x149:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e45fee48 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.003618:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc8848381e7 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x149:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e45fee48 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191329.003635:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc8848381e7 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x149:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e45fee48 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.003649:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc8848381e7 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x149:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e45fee48 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.003662:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc8848381e7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x149:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e45fee48 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.003748:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001798b3ab/0xe5129dc8848381ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x146:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.003757:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001798b3ab/0xe5129dc8848381ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x146:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.003770:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001798b3ab/0xe5129dc8848381ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x146:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191329.003797:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626253440:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191329.004824:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c300 going to sleep for 11 seconds 00000100:00100000:3.0:1787191329.008981:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626253440:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191329.009007:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001798b3ab/0xe5129dc8848381ee lrc: 4/0,1 mode: --/PW res: [0x280000401:0x146:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fee4f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.009028:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001798b3ab/0xe5129dc8848381ee lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x146:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e45fee4f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.009043:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001798b3ab/0xe5129dc8848381ee lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x146:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e45fee4f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.009058:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001798b3ab/0xe5129dc8848381ee lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x146:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e45fee4f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191329.009072:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001798b3ab/0xe5129dc8848381ee lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x146:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e45fee4f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.009164:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001798b3ab/0xe5129dc8848381ee lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x146:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e45fee4f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.009172:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001798b3ab/0xe5129dc8848381ee lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x146:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e45fee4f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1787191329.013511:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0x79:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1787191329.013521:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b53cc5038 (ffff936b47a17bd8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191329.013525:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b53cc5038 (ffff936b47a17bd8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191329.013531:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b5235ccf0 (ffff936b47a17638/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191329.013542:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc8848381e7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x149:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e45fee48 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.013558:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc8848381e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x149:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e45fee48 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1787191329.013575:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b5235cd30 (ffff936b465cc5a8/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191329.013581:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001798b3ab/0xe5129dc8848381ee lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x146:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e45fee4f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.013589:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001798b3ab/0xe5129dc8848381ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x146:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e45fee4f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1787191329.013600:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b53cc5038 (ffff936b47a17bd8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191329.013603:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b5235ccf0 (ffff936b47a17bd8/1) at cl_lock_fini():72 00000020:00010000:3.0:1787191329.013609:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b5235cd30 (ffff936b47a17bd8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191329.013634:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x79:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191329.013649:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0x79:0x0](ffff936b5395b248) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191328.000000000, mtime 1787191328.000000000, ctime 1787191328.000000000, rc 0 00000080:00200008:3.0:1787191329.013767:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0x79:0x0], ppos: 0, count: 5 00000080:00200000:3.0:1787191329.013787:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:3.0:1787191329.013795:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:3.0:1787191329.013802:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:3.0:1787191329.013807:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:3.0:1787191329.013814:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@00000000defc741f[0x110, 1, [0x200000405:0x79:0x0] hash] 00000020:00200000:3.0:1787191329.013817:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:3.0:1787191329.013822:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x79:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:3.0:1787191329.013886:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0x79:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:3.0:1787191329.013893:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x79:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191329.013897:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:3.0:1787191329.013904:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1787191329.013913:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:3.0:1787191329.013917:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1787191329.013940:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:3.0:1787191329.013962:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:3.0:1787191329.013968:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667730, osc lock ffff936b44f650a0, flags 0x0 00010000:00010000:3.0:1787191329.013989:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc8848381e7 lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x149:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e45fee48 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191329.014003:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc8848381e7 lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x149:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e45fee48 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191329.014022:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc8848381e7 lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x149:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e45fee48 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191329.014031:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc8848381e7 lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x149:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e45fee48 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191329.014039:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc8848381e7 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x149:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e45fee48 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191329.014053:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:3.0:1787191329.014073:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:3.0:1787191329.014150:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:3.0:1787191329.014161:0:57570:0:(rw26.c:927:ll_write_end()) page@000000008fbeceb2[3 000000007d7573ff 2 1 00000000f4d347a7 0 0 0] 00000080:00200000:3.0:1787191329.014165:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @0000000026fc74b1 17ffffc0001001 3:0 ffff936b50842e00 0 lru 00000080:00200000:3.0:1787191329.014173:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@000000007a2c2074 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000ef00a996 00000000b93a8cff > 3< 0 0 > 4< 0 0 8 319148032 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1787191329.014175:0:57570:0:(rw26.c:927:ll_write_end()) end page@000000008fbeceb2 00000080:00200000:3.0:1787191329.014177:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1787191329.014183:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:3.0:1787191329.014208:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 0000000005f79afd ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc8848381e7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x149:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e45fee48 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191329.014231:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b5395b3f8, count 1, dirtied 1 00000080:00200000:3.0:1787191329.014236:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:3.0:1787191329.014239:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:3.0:1787191329.014682:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b53cc5038 (ffff936b47a17bd8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191329.014687:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b53cc5038 (ffff936b47a17bd8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191329.014690:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667730 (ffff936b465cc5a8/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191329.014695:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc8848381e7 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x149:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e45fee48 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191329.014705:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc8848381e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x149:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e45fee48 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:3.0:1787191329.014719:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b53cc5038 (ffff936b47a17bd8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191329.014722:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667730 (ffff936b47a17bd8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191329.014730:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:3.0:1787191329.014736:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1787191329.014744:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x79:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191329.014748:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:3.0:1787191329.014756:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0x79:0x0] updating i_size 5 i_blocks 0 00000080:00200000:3.0:1787191329.014760:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:3.0:1787191329.014785:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0x79:0x0](ffff936b5395b248), flags 100001 00010000:00010000:3.0:1787191329.017600:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191329.017612:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0400/0xe5129dc8848381f5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x79:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x7130d520e45fee6b expref: -99 pid: 57678 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.017622:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51fe0400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191329.017627:0:40929:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0400/0xe5129dc8848381f5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x79:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x7130d520e45fee6b expref: -99 pid: 57678 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.017636:0:40929:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0400/0xe5129dc8848381f5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x79:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x7130d520e45fee6b expref: -99 pid: 57678 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.017645:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0400/0xe5129dc8848381f5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x79:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e45fee6b expref: -99 pid: 57678 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.017672:0:40929:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1a00/0xe5129dc8848381e0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x79:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45fee41 expref: -99 pid: 57678 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191329.017716:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0400/0xe5129dc8848381f5 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x79:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e45fee6b expref: -99 pid: 57678 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.017725:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191329.017755:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0400/0xe5129dc8848381f5 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x79:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e45fee6b expref: -99 pid: 57678 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.017763:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0400/0xe5129dc8848381f5 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x79:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e45fee6b expref: -99 pid: 57678 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.017781:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191329.017783:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191329.017785:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191329.017795:0:2392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787191329.017817:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626254464:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191329.021503:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191329.021562:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191329.021663:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626254464:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191329.047476:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00010000:00010000:3.0:1787191329.054555:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191329.054570:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609600/0xe5129dc884838203 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x79:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x7130d520e45fee8e expref: -99 pid: 57678 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.056759:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b6a609600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191329.056772:0:40930:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609600/0xe5129dc884838203 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x79:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x7130d520e45fee8e expref: -99 pid: 57678 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.056787:0:40930:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609600/0xe5129dc884838203 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x79:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x7130d520e45fee8e expref: -99 pid: 57678 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.056797:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609600/0xe5129dc884838203 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x79:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e45fee8e expref: -99 pid: 57678 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.056825:0:40930:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc88483820a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x79:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45feeaa expref: -99 pid: 57679 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.056953:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609600/0xe5129dc884838203 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x79:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e45fee8e expref: -99 pid: 57678 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.056961:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191329.056999:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609600/0xe5129dc884838203 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x79:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e45fee8e expref: -99 pid: 57678 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.057008:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609600/0xe5129dc884838203 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x79:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e45fee8e expref: -99 pid: 57678 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.057034:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191329.057036:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191329.057040:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191329.057332:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626255360:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191329.062046:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626255360:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191329.071639:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634757120 00000100:00100000:3.0:1787191329.071651:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634757120 00000100:00100000:3.0:1787191329.071770:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 932 00000100:00100000:3.0:1787191329.071783:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:29543:x1874004634757120:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191329.071805:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc8848381e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x149:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420080000000 nid: local remote: 0x7130d520e45fee48 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1787191329.071929:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191329.071937:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:29543:x1874004634757120:12345-192.168.202.101@tcp:104: Request processed in 157us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191329.071944:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 932 00000100:00100000:3.0:1787191329.257926:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191329.257970:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634758400 00000100:00100000:3.0:1787191329.257981:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634758400 00000100:00100000:3.0:1787191329.258044:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 934 00000100:00100000:3.0:1787191329.258056:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:16982:x1874004634758400:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191329.258085:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc8848381a8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x147:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e45fed99 expref: -99 pid: 57677 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191329.258189:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191329.258197:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:16982:x1874004634758400:12345-192.168.202.101@tcp:104: Request processed in 143us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191329.258207:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 934 00000100:00100000:3.0:1787191329.306372:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191329.318019:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191329.337611:0:40922:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787191329.337626:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634758784 00000100:00100000:3.0:1787191329.337633:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634758784 00000100:00100000:3.0:1787191329.337710:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 937 00000100:00100000:3.0:1787191329.337719:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b50883c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:29543:x1874004634758784:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191329.337731:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bcda4bea/0xe5129dc884838257 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x149:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000000000 nid: local remote: 0x7130d520e45fef83 expref: -99 pid: 57678 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:3.0:1787191329.337784:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191329.337789:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b50883c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:29543:x1874004634758784:12345-192.168.202.101@tcp:104: Request processed in 72us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191329.337794:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 937 00000100:00100000:3.0:1787191329.347988:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191329.361186:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191329.361619:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634759040 00000100:00100000:3.0:1787191329.361630:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634759040 00000100:00100000:3.0:1787191329.361689:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 939 00000100:00100000:3.0:1787191329.361697:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6508:x1874004634759040:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191329.361720:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884838242 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x79:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e45fef60 expref: -99 pid: 57678 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191329.362647:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191329.362657:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6508:x1874004634759040:12345-192.168.202.101@tcp:104: Request processed in 959us (1485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191329.362664:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 939 00000100:00100000:3.0:1787191329.380264:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191329.380366:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191329.382828:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191329.386319:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634760448 00000100:00100000:3.0:1787191329.386333:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634760448 00000100:00100000:3.0:1787191329.386371:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 942 00000100:00100000:3.0:1787191329.386379:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634760448:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191329.386406:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1800/0xe5129dc8848382c7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x7c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e45ff0cc expref: -99 pid: 57683 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191329.388497:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1787191329.388506:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634760448:12345-192.168.202.101@tcp:104: Request processed in 2126us (5691us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191329.388514:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 942 00000080:00200000:3.0:1787191329.413998:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191329.414030:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191329.414052:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191329.414072:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191329.414081:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191329.414089:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191329.414093:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191329.414102:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:3.0:1787191329.414107:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191329.414117:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191329.414145:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191329.414153:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191329.414160:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191329.414167:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:3.0:1787191329.414174:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x7c:0x0](ffff936b5395f448), inode mode 81a4 mask 42 00000080:00200008:3.0:1787191329.414183:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0x7c:0x0](ffff936b5395f448), flags 101101 00000002:00010000:3.0:1787191329.414200:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x7c:0x0]) in obj [0x200000405:0x7c:0x0], intent: open|creat flags 04240101102 00010000:00010000:3.0:1787191329.414213:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc8848382dc lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x7c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e45ff12e expref: -99 pid: 57678 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191329.414235:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0x7c:0x0]: losing layout lock 00010000:00010000:3.0:1787191329.414283:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc8848382dc lrc: 1/0,0 mode: --/PR res: [0x200000405:0x7c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e45ff12e expref: -99 pid: 57678 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191329.414290:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191329.414294:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc8848382dc lrc: 0/0,0 mode: --/PR res: [0x200000405:0x7c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e45ff12e expref: -99 pid: 57678 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191329.414334:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc8848382ea lrc: 3/0,1 mode: --/CW res: [0x200000405:0x7c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.414340:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc8848382ea lrc: 3/0,1 mode: --/CW res: [0x200000405:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191329.414353:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191329.414366:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1c380 x1874004626266496/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191329.414377:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc8848382ea lrc: 3/0,1 mode: --/CW res: [0x200000405:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191329.414403:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626266496:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191329.414696:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191329.416147:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626266624:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191329.426159:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626266496:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191329.426201:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc8848382ea lrc: 4/0,1 mode: --/CW res: [0x200000405:0x7c:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff151 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.426290:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc8848382ea lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x7c:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45ff151 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.426305:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc8848382ea lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x7c:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff151 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191329.426325:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x200002b, status=0 req@ffff936b51d1c380 x1874004626266496/t8589935895(8589935895) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191345 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191329.426341:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1c380 x1874004626266496/t8589935895(8589935895) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191345 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191329.426356:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc8848382ea lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x7c:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff151 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191329.426372:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc8848382ea lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x7c:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff151 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.426387:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 8 res 8589935621/124 (0 0) 00000080:00200000:3.0:1787191329.426395:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000405:0x7c:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1787191329.426479:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0x7c:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:3.0:1787191329.426486:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x7c:0x0](ffff936b5395f448) for lock 0xe5129dc8848382ea 00000080:00010000:3.0:1787191329.426493:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848382ea from it ffffa3fb41cabbf0 00010000:00010000:3.0:1787191329.426498:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc8848382ea lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x7c:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e45ff151 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.426509:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc8848382ea lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x7c:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45ff151 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000002:00100000:3.0:1787191329.426544:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1c380 x1874004626266496/t8589935895(8589935895) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191345 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191329.426698:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0x7c:0x0], intent: getxattr flags 0 00010000:00010000:3.0:1787191329.426927:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc8848382f8 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x7c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.426937:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc8848382f8 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x7c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.427316:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc8848382f8 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x7c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191329.427340:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626266752:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191329.427482:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191329.431143:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626266752:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191329.431165:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc8848382f8 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x7c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff166 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.431187:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc8848382f8 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x7c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45ff166 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.431197:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc8848382f8 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x7c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff166 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191329.431211:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b51d1f480 x1874004626266752/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191345 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191329.431330:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc8848382f8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff166 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.431340:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/124 (0 0) 00000080:00200000:3.0:1787191329.431344:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0x7c:0x0] suppgids 0 -1: rc 0 00000080:00010000:3.0:1787191329.431369:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x7c:0x0](ffff936b5395f448) for lock 0xe5129dc8848382f8 00000080:00010000:3.0:1787191329.431373:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848382f8 from it ffffa3fb41caba38 00010000:00010000:3.0:1787191329.431376:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc8848382f8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45ff166 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.431385:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc8848382f8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x7c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff166 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:3.0:1787191329.431497:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0x7c:0x0](ffff936b5395f448) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191329.000000000, mtime 1787191329.000000000, ctime 1787191329.000000000 00010000:00010000:3.0:1787191329.431529:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc8848382ea lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x7c:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e45ff151 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191329.431627:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0x7c:0x0]: losing layout lock 00010000:00010000:3.0:1787191329.431661:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc8848382ea lrc: 1/0,0 mode: --/CW res: [0x200000405:0x7c:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e45ff151 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191329.431668:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191329.431672:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc8848382ea lrc: 0/0,0 mode: --/CW res: [0x200000405:0x7c:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e45ff151 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:3.0:1787191329.431688:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 36, max 7 00000100:00100000:3.0:1787191329.431693:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1f480 x1874004626267520/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191329.431763:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626267520:192.168.202.101@tcp:36:bash.0 00000100:00100000:3.0:1787191329.431913:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191329.435116:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626267520:192.168.202.101@tcp:36:bash.0 00000080:00200000:3.0:1787191329.435188:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:3.0:1787191329.435197:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x7c:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00010000:00010000:3.0:1787191329.435218:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/124 (0 0) 00000080:00010000:3.0:1787191329.435233:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x7c:0x0](ffff936b5395f448) 00000002:00010000:3.0:1787191329.435245:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x7c:0x0]) in obj [0x200000405:0x7c:0x0], intent: layout flags 0 00010000:00010000:3.0:1787191329.435312:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc884838306 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x7c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.435322:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc884838306 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x7c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.435335:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc884838306 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x7c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191329.435421:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626267648:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191329.435552:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191329.445284:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634760576 00000100:00100000:3.0:1787191329.445293:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634760576 00000100:00100000:3.0:1787191329.445350:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 943 00000100:00100000:3.0:1787191329.445360:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634760576:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191329.445374:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0800/0xe5129dc8848382ff lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x7c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e45ff189 expref: -99 pid: 57678 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191329.445692:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191329.445699:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634760576:12345-192.168.202.101@tcp:104: Request processed in 341us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191329.445716:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 943 00000100:00100000:3.0:1787191329.472582:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191329.472626:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191329.472685:0:40922:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787191329.472721:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634761216 00000100:00100000:3.0:1787191329.472732:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634761216 00000100:00100000:3.0:1787191329.472796:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 944 00000100:00100000:3.0:1787191329.472808:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b4121d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30511:x1874004634761216:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191329.472861:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc8848382b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x149:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000030000 nid: local remote: 0x7130d520e45ff086 expref: -99 pid: 57678 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191329.472949:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191329.472957:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b4121d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30511:x1874004634761216:12345-192.168.202.101@tcp:104: Request processed in 151us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191329.472965:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 944 00010000:00010000:3.0:1787191329.473014:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191329.473021:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc8848382b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x149:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000030000 nid: local remote: 0x7130d520e45ff086 expref: -99 pid: 57678 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191329.473031:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51fe1200 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191329.473037:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc8848382b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x149:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428400030000 nid: local remote: 0x7130d520e45ff086 expref: -99 pid: 57678 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191329.473090:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc8848382b2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x149:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e45ff086 expref: -99 pid: 57678 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191329.473098:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191329.473144:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc8848382b2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x149:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e45ff086 expref: -99 pid: 57678 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191329.473153:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc8848382b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x149:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e45ff086 expref: -99 pid: 57678 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191329.473176:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191329.473178:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191329.473180:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191329.473190:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787191329.473210:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626268800:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191329.480018:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634761984 00000100:00100000:3.0:1787191329.480032:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634761984 00000100:00100000:3.0:1787191329.480099:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634762112 00000100:00100000:3.0:1787191329.480103:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634762112 00000100:00100000:3.0:1787191329.483358:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 945 00000100:00100000:3.0:1787191329.483420:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+5:8420:x1874004634761984:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191329.483448:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc884838296 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x147:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e45ff047 expref: -99 pid: 57678 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191329.483779:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191329.483787:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+5:8420:x1874004634761984:12345-192.168.202.101@tcp:104: Request processed in 401us (4285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191329.488780:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 945 00000100:00100000:3.0:1787191329.498459:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191329.552174:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191329.562907:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634762496 00000100:00100000:3.0:1787191329.562920:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634762496 00000100:00100000:3.0:1787191329.564000:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 949 00000100:00100000:3.0:1787191329.564016:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634762496:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191329.564031:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483833e lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x7c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e45ff231 expref: -99 pid: 57684 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191329.564140:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191329.564148:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634762496:12345-192.168.202.101@tcp:104: Request processed in 137us (1381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191329.564156:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 949 00000100:00100000:3.0:1787191329.622920:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191329.678348:0:40922:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787191329.678375:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634763264 00000100:00100000:3.0:1787191329.678387:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634763264 00000100:00100000:3.0:1787191329.678473:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 951 00000100:00100000:3.0:1787191329.678483:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b4121c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634763264:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191329.678507:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608a00/0xe5129dc88483836f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x7d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e45ff2e0 expref: -99 pid: 57686 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191329.678613:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191329.678620:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b4121c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634763264:12345-192.168.202.101@tcp:104: Request processed in 139us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191329.678628:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 951 00000100:00100000:3.0:1787191329.679459:0:57684:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589935909 gen 1 00000100:00100000:3.0:1787191329.679472:0:57684:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b5058c000 x1874004626270976/t8589935905(8589935905) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191345 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787191329.679496:0:57684:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b453a9f80 x1874004626272000/t8589935907(8589935907) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191345 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787191329.679505:0:57684:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b453a9500 x1874004626273024/t8589935908(8589935908) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191345 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787191329.679517:0:57684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b5058ca80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57684:1874004626273280:192.168.202.101@tcp:36:lfs.0 00010000:00010000:3.0:1787191329.679556:0:57684:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/124 (0 0) 00000080:00010000:3.0:1787191329.679569:0:57684:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x7c:0x0](ffff936b5395f448) 00000002:00010000:3.0:1787191329.679596:0:57684:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x7c:0x0]) in obj [0x200000405:0x7c:0x0], intent: layout flags 0 00010000:00010000:3.0:1787191329.679634:0:57684:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc88483837d lrc: 3/1,0 mode: --/CR res: [0x200000405:0x7c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.679643:0:57684:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc88483837d lrc: 3/1,0 mode: --/CR res: [0x200000405:0x7c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57684 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.679657:0:57684:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc88483837d lrc: 3/1,0 mode: --/CR res: [0x200000405:0x7c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57684 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191329.679673:0:57684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57684:1874004626273792:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191329.679713:0:57684:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787191329.702753:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626274560:192.168.202.101@tcp:101:lfs.0 00000080:00200000:3.0:1787191329.712997:0:57684:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0x7c:0x0] updating i_size 5 i_blocks 8 00000020:00010000:3.0:1787191329.713004:0:57684:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c3b530 (ffff936b47a17998/0) at cl_lock_release():245 00000020:00010000:3.0:1787191329.713008:0:57684:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c3b530 (ffff936b47a17998/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191329.713014:0:57684:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1430 (ffff936b465ccb48/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191329.713020:0:57684:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c3b530 (ffff936b47a17998/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191329.713022:0:57684:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1430 (ffff936b47a17998/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191329.713041:0:57684:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x7c:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191329.772986:0:57687:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191329.773030:0:57687:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191329.773051:0:57687:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191329.773071:0:57687:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191329.773079:0:57687:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191329.773089:0:57687:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191329.773093:0:57687:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191329.773101:0:57687:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41ecbb58 00010000:00010000:3.0:1787191329.773106:0:57687:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191329.773116:0:57687:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191329.775957:0:57687:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191329.775987:0:57687:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:3.0:1787191329.776135:0:57687:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191329.776160:0:57687:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:3.0:1787191329.776167:0:57687:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:3.0:1787191329.776200:0:57687:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1787191329.776371:0:57687:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9be00/0xe5129dc8848383bc lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.776385:0:57687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9be00/0xe5129dc8848383bc lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57687 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.776397:0:57687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9be00/0xe5129dc8848383bc lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57687 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191329.776502:0:57687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57687:1874004626276480:192.168.202.101@tcp:101:rm.0 00000100:00100000:3.0:1787191329.776706:0:57687:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787191329.816674:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191329.849335:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634765440 00000100:00100000:3.0:1787191329.849346:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634765440 00000100:00100000:3.0:1787191329.849414:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 953 00000100:00100000:3.0:1787191329.849426:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634765440:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191329.849450:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609000/0xe5129dc8848383e6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x7f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e45ff437 expref: -99 pid: 57688 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191329.849550:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191329.849556:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634765440:12345-192.168.202.101@tcp:104: Request processed in 134us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191329.849562:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 953 00000100:00100000:3.0:1787191329.865582:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634765696 00000100:00100000:3.0:1787191329.865593:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634765696 00000100:00100000:3.0:1787191329.865702:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 954 00000100:00100000:3.0:1787191329.865714:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8420:x1874004634765696:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191329.865734:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000062a81d6a/0xe5129dc8848382f1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x14e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e45ff143 expref: -99 pid: 57678 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191329.865858:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191329.865866:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8420:x1874004634765696:12345-192.168.202.101@tcp:104: Request processed in 155us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191329.865874:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 954 00000100:00100000:3.0:1787191329.869984:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191329.890541:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b5058ea00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626280448:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191329.890566:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1800/0xe5129dc884838409 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x7f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff499 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.890584:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1800/0xe5129dc884838409 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x7f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45ff499 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.890597:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1800/0xe5129dc884838409 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x7f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff499 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191329.890617:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b5058ea00 x1874004626280448/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191345 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191329.890630:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1800/0xe5129dc884838409 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff499 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.890643:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/127 (0 0) 00000080:00200000:3.0:1787191329.890650:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0x7f:0x0] suppgids 0 -1: rc 0 00000080:00010000:3.0:1787191329.890680:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x7f:0x0](ffff936b5395aa08) for lock 0xe5129dc884838409 00000080:00010000:3.0:1787191329.890690:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884838409 from it ffffa3fb41caba38 00010000:00010000:3.0:1787191329.890695:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1800/0xe5129dc884838409 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x7f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45ff499 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.890706:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1800/0xe5129dc884838409 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x7f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff499 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:3.0:1787191329.890749:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0x7f:0x0](ffff936b5395aa08) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191329.000000000, mtime 1787191329.000000000, ctime 1787191329.000000000 00010000:00010000:3.0:1787191329.890787:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0800/0xe5129dc884838402 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x7f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e45ff484 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191329.890809:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0x7f:0x0]: losing layout lock 00010000:00010000:3.0:1787191329.890890:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0800/0xe5129dc884838402 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x7f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e45ff484 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191329.890897:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191329.890901:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0800/0xe5129dc884838402 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x7f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e45ff484 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:3.0:1787191329.890928:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1787191329.890936:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1ea00 x1874004626280704/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191329.890961:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626280704:192.168.202.101@tcp:36:bash.0 00000100:00100000:3.0:1787191329.891059:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191329.901360:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626280704:192.168.202.101@tcp:36:bash.0 00000080:00200000:3.0:1787191329.901430:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:3.0:1787191329.901440:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x7f:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00010000:00010000:3.0:1787191329.901463:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/127 (0 0) 00000080:00010000:3.0:1787191329.901477:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x7f:0x0](ffff936b5395aa08) 00000002:00010000:3.0:1787191329.901491:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x7f:0x0]) in obj [0x200000405:0x7f:0x0], intent: layout flags 0 00010000:00010000:3.0:1787191329.901555:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838410 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.901566:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838410 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x7f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.901579:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838410 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x7f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191329.901603:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626281088:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191329.901750:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191329.907477:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626281088:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191329.907501:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838410 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x7f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45ff4ae expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.907522:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838410 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x7f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff4ae expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191329.907536:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b51d1c700 x1874004626281088/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191345 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191329.907547:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838410 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x7f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff4ae expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191329.907560:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838410 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x7f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff4ae expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.907574:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/127 (0 0) 00000080:00200000:3.0:1787191329.907581:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x7f:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1787191329.907599:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x7f:0x0](ffff936b5395aa08) for lock 0xe5129dc884838410 00000080:00010000:3.0:1787191329.907607:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884838410 from it ffffa3fb41cab8c8 00010000:00010000:3.0:1787191329.907611:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838410 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x7f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45ff4ae expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.907622:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838410 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x7f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff4ae expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191329.907648:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838410 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x7f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff4ae expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191329.907662:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838410 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x7f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff4ae expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:3.0:1787191329.907678:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0x7f:0x0](000000008454039f) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838410 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x7f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff4ae expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191329.907800:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0x7f:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:3.0:1787191329.907806:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838410 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x7f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e45ff4ae expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191329.907814:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838410 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x7f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45ff4ae expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:3.0:1787191329.907861:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0x7f:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:3.0:1787191329.907869:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x7f:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191329.907873:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0x7f:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:3.0:1787191329.907882:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x7f:0x0](ffff936b5395aa08) 00000002:00010000:3.0:1787191329.907894:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x7f:0x0]) in obj [0x200000405:0x7f:0x0], intent: layout flags 02 00010000:00010000:3.0:1787191329.907908:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838410 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x7f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e45ff4ae expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191329.907923:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0x7f:0x0]: losing layout lock 00010000:00010000:3.0:1787191329.907954:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838410 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x7f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e45ff4ae expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191329.907961:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191329.907964:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838410 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x7f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e45ff4ae expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191329.907986:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884838417 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191329.907994:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884838417 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x7f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191329.908004:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:3.0:1787191329.908010:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1c700 x1874004626281728/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191329.908020:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884838417 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x7f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191329.908035:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626281728:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191329.908240:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191329.910022:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634765952 00000100:00100000:3.0:1787191329.910034:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634765952 00000100:00100000:3.0:1787191329.916566:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634766592 00000100:00100000:3.0:1787191329.916579:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634766592 00000100:00100000:3.0:1787191329.916649:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 957 00000100:00100000:3.0:1787191329.916662:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8720:x1874004634766592:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191329.916687:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000032e8f952/0xe5129dc8848383b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e45ff37a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191329.916790:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191329.916798:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8720:x1874004634766592:12345-192.168.202.101@tcp:104: Request processed in 140us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191329.916807:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 957 00010000:00010000:3.0:1787191329.945169:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191329.945190:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc8848383ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e45ff373 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191329.945214:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b6a609c00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191329.945223:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc8848383ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e45ff373 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191329.945293:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc8848383ae lrc: 2/0,0 mode: --/PW res: [0x280000401:0x14c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e45ff373 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191329.945303:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191329.945329:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc8848383ae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e45ff373 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191329.945338:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc8848383ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e45ff373 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191329.945362:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191329.945364:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191329.945366:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191329.945392:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626282240:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191330.018536:0:57690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57690:1874004626284416:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191330.018568:0:57690:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884838441 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.018585:0:57690:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884838441 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.018597:0:57690:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884838441 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.018604:0:57690:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884838441 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.018613:0:57690:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884838441 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.018620:0:57690:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd5800 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191330.018626:0:57690:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884838441 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.018634:0:57690:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884838441 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.018642:0:57690:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884838441 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.018651:0:57690:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191330.018659:0:57690:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884838441 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.018666:0:57690:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884838441 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57690 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191330.018694:0:57690:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513bb100 x1874004626284416/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191346 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191330.018779:0:57690:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191330.018907:0:57690:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000100:00100000:3.0:1787191330.045974:0:57690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57690:1874004626285312:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191330.046011:0:57690:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc884838464 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff5cd expref: -99 pid: 57690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.046046:0:57690:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc884838464 lrc: 4/0,1 mode: --/PR res: [0x200000405:0x81:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff5cd expref: -99 pid: 57690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.046055:0:57690:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc884838464 lrc: 4/0,1 mode: --/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff5cd expref: -99 pid: 57690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.046068:0:57690:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc884838464 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45ff5cd expref: -99 pid: 57690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.046080:0:57690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc884838464 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff5cd expref: -99 pid: 57690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.046096:0:57690:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc884838464 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45ff5cd expref: -99 pid: 57690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.046106:0:57690:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc884838464 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45ff5cd expref: -99 pid: 57690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.046113:0:57690:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc884838464 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45ff5cd expref: -99 pid: 57690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191330.046139:0:57690:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b6a474380 x1874004626285312/t8589935935(8589935935) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191346 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191330.046155:0:57690:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474380 x1874004626285312/t8589935935(8589935935) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191346 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191330.046171:0:57690:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc884838464 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff5cd expref: -99 pid: 57690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.046182:0:57690:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/129 (0 0) 00000080:00200000:3.0:1787191330.046190:0:57690:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191330.046205:0:57690:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:3.0:1787191330.046257:0:57690:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0x81:0x0](ffff936b489aec08) 00000080:00200000:3.0:1787191330.046267:0:57690:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0x81:0x0], updating i_size 0 00000080:00200000:3.0:1787191330.046316:0:57690:0:(file.c:6836:ll_layout_conf()) [0x200000405:0x81:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:3.0:1787191330.046322:0:57690:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0x81:0x0](ffff936b489aec08) 00000080:00010000:3.0:1787191330.046325:0:57690:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x81:0x0](ffff936b489aec08) for lock 0xe5129dc884838464 00000080:00010000:3.0:1787191330.046337:0:57690:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x81:0x0](ffff936b489aec08) 00000080:00200008:3.0:1787191330.046354:0:57690:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0x81:0x0](ffff936b489aec08), flags 120501 00000002:00100000:3.0:1787191330.046380:0:57690:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474380 x1874004626285312/t8589935935(8589935935) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191346 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1787191330.046440:0:57690:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884838464 from it ffff936b495dcf60 00010000:00010000:3.0:1787191330.046445:0:57690:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc884838464 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e45ff5cd expref: -99 pid: 57690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.046457:0:57690:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc884838464 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45ff5cd expref: -99 pid: 57690 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191330.046486:0:57690:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x81:0x0](ffff936b489aec08), inode mode 81a4 mask 40 00000080:00200000:3.0:1787191330.046562:0:57690:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x81:0x0](ffff936b489aec08), inode mode 81a4 mask 2 00000080:00200000:3.0:1787191330.046574:0:57690:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0x81:0x0](ffff936b489aec08), xattr lov 00000002:00010000:3.0:1787191330.046595:0:57690:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x81:0x0]) in obj [0x200000405:0x81:0x0], intent: open flags 040000002 00010000:00010000:3.0:1787191330.046656:0:57690:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483846b lrc: 3/1,0 mode: --/CR res: [0x200000405:0x81:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.046665:0:57690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483846b lrc: 3/1,0 mode: --/CR res: [0x200000405:0x81:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57690 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191330.046678:0:57690:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191330.046684:0:57690:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1dc00 x1874004626285568/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191330.046694:0:57690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483846b lrc: 3/1,0 mode: --/CR res: [0x200000405:0x81:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57690 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191330.046717:0:57690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57690:1874004626285568:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191330.047013:0:57690:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c240 going to sleep for 11 seconds 00000100:00100000:3.0:1787191330.051516:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634767872 00000100:00100000:3.0:1787191330.051529:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634767872 00000100:00100000:3.0:1787191330.051615:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 959 00000100:00100000:3.0:1787191330.051627:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634767872:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191330.051651:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc884838464 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e45ff5cd expref: -99 pid: 57690 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.051751:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191330.051759:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634767872:12345-192.168.202.101@tcp:104: Request processed in 135us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191330.051768:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 959 00000100:00100000:3.0:1787191330.057889:0:57690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57690:1874004626285568:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191330.057923:0:57690:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483846b lrc: 4/1,0 mode: --/CR res: [0x200000405:0x81:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.057944:0:57690:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483846b lrc: 4/1,0 mode: --/CR res: [0x200000405:0x81:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.057952:0:57690:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483846b lrc: 4/1,0 mode: --/CR res: [0x200000405:0x81:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.057961:0:57690:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483846b lrc: 3/0,0 mode: --/CR res: [0x200000405:0x81:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.057971:0:57690:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483846b lrc: 4/0,0 mode: --/CR res: [0x200000405:0x81:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.057979:0:57690:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9b600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191330.057985:0:57690:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483846b lrc: 4/0,0 mode: --/CR res: [0x200000405:0x81:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.057993:0:57690:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483846b lrc: 4/0,0 mode: --/CR res: [0x200000405:0x81:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.058000:0:57690:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483846b lrc: 5/0,0 mode: --/CR res: [0x200000405:0x81:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.058007:0:57690:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191330.058016:0:57690:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483846b lrc: 3/0,0 mode: --/CR res: [0x200000405:0x81:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57690 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.058023:0:57690:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483846b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x81:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57690 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191330.058050:0:57690:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b51d1dc00 x1874004626285568/t8589935936(8589935936) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191346 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191330.058071:0:57690:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1dc00 x1874004626285568/t8589935936(8589935936) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191346 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191330.058090:0:57690:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x81:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1787191330.058165:0:57690:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x81:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1787191330.058177:0:57690:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x81:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191330.058257:0:57690:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0x81:0x0], updating i_size 0 00000002:00100000:3.0:1787191330.058281:0:57690:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1dc00 x1874004626285568/t8589935936(8589935936) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191346 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191330.058327:0:57690:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1dc00 x1874004626285568/t8589935936(8589935936) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191346 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191330.058337:0:57690:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191330.058342:0:57690:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1f480 x1874004626285952/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191330.058367:0:57690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57690:1874004626285952:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191330.058479:0:57690:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c240 going to sleep for 11 seconds 00000080:00200000:3.0:1787191330.075637:0:57692:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0x81:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1787191330.075646:0:57692:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c3a500 (ffff936b47a176c8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191330.075650:0:57692:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c3a500 (ffff936b47a176c8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191330.075657:0:57692:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1bb0 (ffff936b47a17098/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191330.075662:0:57692:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c3a500 (ffff936b47a176c8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191330.075666:0:57692:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1bb0 (ffff936b47a176c8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191330.075685:0:57692:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x81:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191330.075816:0:57692:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0x81:0x0](ffff936b489aec08), flags 154000 00000002:00100000:3.0:1787191330.075930:0:57692:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513bb800 x1874004626286464/t8589935939(8589935939) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191346 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191330.075944:0:57692:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191330.075951:0:57692:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1d880 x1874004626286848/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191330.075980:0:57692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57692:1874004626286848:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191330.076260:0:57692:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cf00 going to sleep for 11 seconds 00000008:00010000:3.0:1787191330.099078:0:57692:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191330.099085:0:57692:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667eb0, osc lock ffff936b44f650a0, flags 0x400000400001002 00010000:00010000:3.0:1787191330.099109:0:57692:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000062a81d6a/0xe5129dc884838479 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x150:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e45ff613 expref: -99 pid: 57692 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.099155:0:57692:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000062a81d6a/0xe5129dc884838479 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x150:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e45ff613 expref: -99 pid: 57692 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:3.0:1787191330.099171:0:57692:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191330.099176:0:57692:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000062a81d6a/0xe5129dc884838479 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x150:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e45ff613 expref: -99 pid: 57692 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.099189:0:57692:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000062a81d6a/0xe5129dc884838479 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x150:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e45ff613 expref: -99 pid: 57692 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:3.0:1787191330.099202:0:57692:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191330.099216:0:57692:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0x81:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1787191330.099220:0:57692:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b48034de0 (ffff936b43ab8bd8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191330.099223:0:57692:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b48034de0 (ffff936b43ab8bd8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191330.099226:0:57692:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667eb0 (ffff936b47a17098/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191330.099231:0:57692:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b48034de0 (ffff936b43ab8bd8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191330.099234:0:57692:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667eb0 (ffff936b43ab8bd8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191330.099247:0:57692:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x81:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191330.099787:0:57692:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0x81:0x0](ffff936b489aec08), flags 154000 00000002:00100000:3.0:1787191330.100063:0:57692:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513b9f80 x1874004626287488/t8589935942(8589935942) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191346 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191330.100078:0:57692:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191330.100084:0:57692:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1df80 x1874004626288256/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191330.100113:0:57692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57692:1874004626288256:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191330.100288:0:57692:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787191330.122323:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191330.127683:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191330.127759:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634768896 00000100:00100000:3.0:1787191330.127771:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634768896 00000100:00100000:3.0:1787191330.127828:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634769792 00000100:00100000:3.0:1787191330.127868:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634769792 00000100:00100000:3.0:1787191330.127888:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634769920 00000100:00100000:3.0:1787191330.127890:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634769920 00000100:00100000:3.0:1787191330.127905:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634770048 00000100:00100000:3.0:1787191330.127909:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634770048 00000100:00100000:3.0:1787191330.127927:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 961 00000100:00100000:3.0:1787191330.127938:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+5:8420:x1874004634768896:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191330.127961:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007338a079/0xe5129dc884838330 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e45ff207 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.128052:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191330.128060:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+5:8420:x1874004634768896:12345-192.168.202.101@tcp:104: Request processed in 124us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191330.128327:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 961 00000100:00100000:3.0:1787191330.128359:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634770176 00000100:00100000:3.0:1787191330.128363:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634770176 00000100:00100000:3.0:1787191330.128379:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 962 00000100:00100000:3.0:1787191330.128390:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:29543:x1874004634769792:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191330.128403:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc8848383f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e45ff45a expref: -99 pid: 57684 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.128446:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787191330.128454:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:29543:x1874004634769792:12345-192.168.202.101@tcp:104: Request processed in 68us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191330.128461:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 962 00000100:00100000:3.0:1787191330.128476:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 964 00000100:00100000:3.0:1787191330.128485:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+6:8419:x1874004634770048:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191330.128498:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc88483838b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x14d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e45ff31f expref: -99 pid: 57684 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:3.0:1787191330.128540:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787191330.128550:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+5:8419:x1874004634770048:12345-192.168.202.101@tcp:104: Request processed in 65us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191330.128560:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 964 00010000:00010000:3.0:1787191330.128586:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787191330.128596:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007338a079/0xe5129dc884838330 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e45ff207 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.128609:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b6a608400 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191330.128617:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007338a079/0xe5129dc884838330 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e45ff207 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.128667:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007338a079/0xe5129dc884838330 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x14a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e45ff207 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.128678:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191330.128816:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007338a079/0xe5129dc884838330 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e45ff207 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.128869:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007338a079/0xe5129dc884838330 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e45ff207 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.128890:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191330.128896:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000002f2df026/0xe5129dc8848383fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000030000 nid: local remote: 0x7130d520e45ff468 expref: -99 pid: 57684 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.128911:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51fe0600 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191330.128919:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000002f2df026/0xe5129dc8848383fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400030000 nid: local remote: 0x7130d520e45ff468 expref: -99 pid: 57684 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.128949:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000002f2df026/0xe5129dc8848383fb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x14e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e45ff468 expref: -99 pid: 57684 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.128969:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191330.129047:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000002f2df026/0xe5129dc8848383fb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e45ff468 expref: -99 pid: 57684 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.129069:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000002f2df026/0xe5129dc8848383fb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e45ff468 expref: -99 pid: 57684 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.129169:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191330.129172:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191330.129176:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191330.129193:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191330.137634:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191330.145567:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626289536:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191330.156304:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626289664:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191330.156315:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626290048:192.168.202.101@tcp:103:ldlm_bl.0 00000002:00100000:3.0:1787191330.174387:0:57693:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a9500 x1874004626290816/t8589935949(8589935949) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191346 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191330.174931:0:57693:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191330.174970:0:57693:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191330.174986:0:57693:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191330.175000:0:57693:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191330.175008:0:57693:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191330.175015:0:57693:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191330.175020:0:57693:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191330.175028:0:57693:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41ec3b58 00010000:00010000:3.0:1787191330.175032:0:57693:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191330.175041:0:57693:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191330.175055:0:57693:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191330.175064:0:57693:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191330.175071:0:57693:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191330.175075:0:57693:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=9 00000080:00200008:3.0:1787191330.175084:0:57693:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0x81:0x0](ffff936b489aec08), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191330.175089:0:57693:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x81:0x0](ffff936b489aec08),name=f70.sanity-flr 00000002:00010000:3.0:1787191330.175105:0:57693:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x81:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191330.175112:0:57693:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc8848384bf lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45ff708 expref: -99 pid: 57693 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191330.175122:0:57693:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc8848384bf lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45ff708 expref: -99 pid: 57693 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191330.175138:0:57693:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191330.175143:0:57693:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x81:0x0](ffff936b489aec08) 00000080:00010000:3.0:1787191330.175145:0:57693:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x81:0x0](ffff936b489aec08) for lock 0xe5129dc8848384bf 00000080:00010000:3.0:1787191330.175149:0:57693:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848384bf from it ffffa3fb41ec3cb8 00010000:00010000:3.0:1787191330.175152:0:57693:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc8848384bf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e45ff708 expref: -99 pid: 57693 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191330.175165:0:57693:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc8848384bf lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45ff708 expref: -99 pid: 57693 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787191330.175199:0:57693:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x81:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:3.0:1787191330.175213:0:57693:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x81:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191330.175216:0:57693:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191330.175220:0:57693:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x81:0x0] 00000008:00010000:3.0:1787191330.175242:0:57693:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191330.175246:0:57693:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667230, osc lock ffff936b44f650a0, flags 0x400000400001002 00010000:00010000:3.0:1787191330.175266:0:57693:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc8848384b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x150:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e45ff6e5 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191330.175278:0:57693:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc8848384b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x150:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e45ff6e5 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:3.0:1787191330.175290:0:57693:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191330.175295:0:57693:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc8848384b1 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x150:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e45ff6e5 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191330.175308:0:57693:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc8848384b1 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x150:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e45ff6e5 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:3.0:1787191330.175319:0:57693:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191330.175329:0:57693:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0x81:0x0] updating i_size 5 i_blocks 0 00000020:00010000:3.0:1787191330.175335:0:57693:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c39720 (ffff936b47a17098/0) at cl_lock_release():245 00000020:00010000:3.0:1787191330.175338:0:57693:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c39720 (ffff936b47a17098/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191330.175342:0:57693:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667230 (ffff936b465cc5a8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191330.175346:0:57693:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c39720 (ffff936b47a17098/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191330.175348:0:57693:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667230 (ffff936b47a17098/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191330.175359:0:57693:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x81:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191330.175390:0:57693:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191330.175398:0:57693:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191330.175405:0:57693:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191330.175413:0:57693:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191330.175420:0:57693:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191330.175424:0:57693:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191330.175427:0:57693:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191330.175431:0:57693:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41ec3bf8 00010000:00010000:3.0:1787191330.175434:0:57693:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191330.175441:0:57693:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191330.175449:0:57693:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191330.175454:0:57693:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191330.175458:0:57693:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191330.175461:0:57693:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:3.0:1787191330.175466:0:57693:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x81:0x0](ffff936b489aec08), inode mode 81a4 mask 46 00000080:00200008:3.0:1787191330.175475:0:57693:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0x81:0x0](ffff936b489aec08), flags 154402 00000002:00010000:3.0:1787191330.175493:0:57693:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x81:0x0]) in obj [0x200000405:0x81:0x0], intent: open flags 0104240114403 00010000:00010000:3.0:1787191330.175558:0:57693:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc8848384c6 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x81:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.175566:0:57693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc8848384c6 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x81:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57693 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191330.175579:0:57693:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191330.175588:0:57693:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1fb80 x1874004626291584/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191330.176351:0:57693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc8848384c6 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x81:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57693 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191330.176388:0:57693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57693:1874004626291584:192.168.202.101@tcp:101:lfs.0 00000080:00200000:3.0:1787191330.185690:0:57694:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191330.185703:0:57694:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191330.185715:0:57694:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191330.185728:0:57694:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191330.185734:0:57694:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191330.185741:0:57694:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191330.185745:0:57694:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191330.185749:0:57694:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41eebb58 00010000:00010000:3.0:1787191330.185753:0:57694:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191330.185766:0:57694:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191330.185776:0:57694:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191330.185784:0:57694:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:3.0:1787191330.185789:0:57694:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191330.185802:0:57694:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:3.0:1787191330.185807:0:57694:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:3.0:1787191330.185822:0:57694:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1787191330.185887:0:57694:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848384d4 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.185895:0:57694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848384d4 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57694 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.185904:0:57694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848384d4 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57694 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191330.185914:0:57694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ce00 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57694:1874004626291968:192.168.202.101@tcp:101:rm.0 00000100:00100000:3.0:1787191330.186017:0:57694:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787191330.189502:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634770688 00000100:00100000:3.0:1787191330.189515:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634770688 00000100:00100000:3.0:1787191330.189595:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 969 00000100:00100000:3.0:1787191330.189614:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634770688:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191330.189637:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc8848384c6 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x81:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e45ff71d expref: -99 pid: 57693 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.189752:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191330.189760:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634770688:12345-192.168.202.101@tcp:104: Request processed in 149us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191330.189767:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 969 00000100:00100000:3.0:1787191330.198048:0:57694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ce00 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57694:1874004626291968:192.168.202.101@tcp:101:rm.0 00010000:00010000:3.0:1787191330.198083:0:57694:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848384d4 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff74e expref: -99 pid: 57694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.198111:0:57694:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848384d4 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x81:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff74e expref: -99 pid: 57694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.198121:0:57694:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848384d4 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff74e expref: -99 pid: 57694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.198147:0:57694:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848384d4 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45ff74e expref: -99 pid: 57694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.198159:0:57694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848384d4 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff74e expref: -99 pid: 57694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.198172:0:57694:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848384d4 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45ff74e expref: -99 pid: 57694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.198178:0:57694:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848384d4 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45ff74e expref: -99 pid: 57694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.198187:0:57694:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848384d4 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45ff74e expref: -99 pid: 57694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191330.198197:0:57694:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b51d1ce00 x1874004626291968/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/976 e 0 to 0 dl 1787191346 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191330.198206:0:57694:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848384d4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff74e expref: -99 pid: 57694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191330.198217:0:57694:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848384d4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff74e expref: -99 pid: 57694 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.198226:0:57694:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/129 (0 0) 00000080:00200000:3.0:1787191330.198232:0:57694:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191330.198297:0:57694:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0x81:0x0](ffff936b489aec08): rc = 0 00000080:00200000:3.0:1787191330.198311:0:57694:0:(file.c:6836:ll_layout_conf()) [0x200000405:0x81:0x0]: layout version change: 4 -> 4 00000080:00010000:3.0:1787191330.198315:0:57694:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x81:0x0](ffff936b489aec08) for lock 0xe5129dc8848384d4 00000080:00010000:3.0:1787191330.198328:0:57694:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x81:0x0](ffff936b489aec08) 00000080:00010000:3.0:1787191330.198331:0:57694:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848384d4 from it ffffa3fb41eebb20 00010000:00010000:3.0:1787191330.198334:0:57694:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848384d4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e45ff74e expref: -99 pid: 57694 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.198340:0:57694:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848384d4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45ff74e expref: -99 pid: 57694 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200008:3.0:1787191330.198730:0:57694:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0x81:0x0](ffff936b489aec08), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191330.198738:0:57694:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x81:0x0](ffff936b489aec08),name=f70.sanity-flr 00000002:00010000:3.0:1787191330.198763:0:57694:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x81:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191330.198771:0:57694:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848384d4 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45ff74e expref: -99 pid: 57694 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.198781:0:57694:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848384d4 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45ff74e expref: -99 pid: 57694 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191330.198785:0:57694:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191330.198788:0:57694:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x81:0x0](ffff936b489aec08) 00000080:00010000:3.0:1787191330.198791:0:57694:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x81:0x0](ffff936b489aec08) for lock 0xe5129dc8848384d4 00000080:00010000:3.0:1787191330.198794:0:57694:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848384d4 from it ffffa3fb41eebcb8 00010000:00010000:3.0:1787191330.198796:0:57694:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848384d4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e45ff74e expref: -99 pid: 57694 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.198801:0:57694:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848384d4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45ff74e expref: -99 pid: 57694 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191330.198820:0:57694:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x81:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:3.0:1787191330.198869:0:57694:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x81:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191330.198873:0:57694:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191330.198876:0:57694:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x81:0x0] 00000008:00010000:3.0:1787191330.198896:0:57694:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191330.198899:0:57694:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667230, osc lock ffff936b44f650a0, flags 0x400000400001002 00010000:00010000:3.0:1787191330.198915:0:57694:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc8848384b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x150:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e45ff6e5 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191330.198925:0:57694:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc8848384b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x150:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e45ff6e5 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:3.0:1787191330.198939:0:57694:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191330.199032:0:57694:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc8848384b1 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x150:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e45ff6e5 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191330.199039:0:57694:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc8848384b1 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x150:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e45ff6e5 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:3.0:1787191330.199050:0:57694:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191330.199061:0:57694:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0x81:0x0] updating i_size 5 i_blocks 0 00000020:00010000:3.0:1787191330.199067:0:57694:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c39720 (ffff936b47a17098/0) at cl_lock_release():245 00000020:00010000:3.0:1787191330.199069:0:57694:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c39720 (ffff936b47a17098/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191330.199071:0:57694:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667230 (ffff936b465cc5a8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191330.199076:0:57694:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c39720 (ffff936b47a17098/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191330.199080:0:57694:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667230 (ffff936b47a17098/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191330.199094:0:57694:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x81:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191330.199160:0:57694:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191330.199168:0:57694:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191330.199175:0:57694:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191330.199182:0:57694:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191330.199186:0:57694:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191330.199189:0:57694:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191330.199191:0:57694:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191330.199195:0:57694:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41eebc10 00010000:00010000:3.0:1787191330.199197:0:57694:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191330.199202:0:57694:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191330.199208:0:57694:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191330.199214:0:57694:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:3.0:1787191330.199218:0:57694:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191330.199222:0:57694:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:3.0:1787191330.199225:0:57694:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:3.0:1787191330.199229:0:57694:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:3.0:1787191330.199250:0:57694:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1c00/0xe5129dc8848384a3 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x81:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e45ff683 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787191330.199263:0:57694:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0x81:0x0]: losing layout lock 00010000:00010000:3.0:1787191330.199273:0:57694:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848384d4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e45ff74e expref: -99 pid: 57694 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191330.199279:0:57694:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0x81:0x0]: losing layout lock 00010000:00010000:3.0:1787191330.199283:0:57694:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609600/0xe5129dc884838487 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e45ff636 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.199323:0:57694:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1c00/0xe5129dc8848384a3 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x81:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e45ff683 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191330.199327:0:57694:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848384d4 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e45ff74e expref: -99 pid: 57694 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191330.199335:0:57694:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609600/0xe5129dc884838487 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x81:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e45ff636 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.199339:0:57694:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:3.0:1787191330.199342:0:57694:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1c00/0xe5129dc8848384a3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x81:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e45ff683 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191330.199467:0:57694:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848384d4 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e45ff74e expref: -99 pid: 57694 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191330.199481:0:57694:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609600/0xe5129dc884838487 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x81:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e45ff636 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:3.0:1787191330.199509:0:57694:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1787191330.199521:0:57694:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1ce00 x1874004626292352/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191330.199563:0:57694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ce00 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57694:1874004626292352:192.168.202.101@tcp:36:rm.0 00000100:00100000:3.0:1787191330.199762:0:57694:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787191330.202491:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634770816 00000100:00100000:3.0:1787191330.202503:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634770816 00000100:00100000:3.0:1787191330.202568:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 970 00000100:00100000:3.0:1787191330.202580:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634770816:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191330.202601:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc8848384cd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e45ff732 expref: -99 pid: 57693 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.202965:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191330.202975:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634770816:12345-192.168.202.101@tcp:104: Request processed in 397us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191330.202983:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 970 00000100:00100000:3.0:1787191330.209227:0:57693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57693:1874004626292608:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191330.209251:0:57693:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0e00/0xe5129dc8848384db lrc: 4/1,0 mode: --/CR res: [0x200000405:0x81:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e45ff771 expref: -99 pid: 57693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.209262:0:57693:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0e00/0xe5129dc8848384db lrc: 4/1,0 mode: --/PW res: [0x200000405:0x81:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e45ff771 expref: -99 pid: 57693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.209274:0:57693:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0e00/0xe5129dc8848384db lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x81:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e45ff771 expref: -99 pid: 57693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.209285:0:57693:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0e00/0xe5129dc8848384db lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x81:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e45ff771 expref: -99 pid: 57693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.209298:0:57693:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0e00/0xe5129dc8848384db lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x81:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e45ff771 expref: -99 pid: 57693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.209306:0:57693:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0e00/0xe5129dc8848384db lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x81:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e45ff771 expref: -99 pid: 57693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.209313:0:57693:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0e00/0xe5129dc8848384db lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x81:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e45ff771 expref: -99 pid: 57693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191330.209327:0:57693:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x600002b, status=0 req@ffff936b6a475180 x1874004626292608/t8589935953(8589935953) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191346 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191330.209347:0:57693:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475180 x1874004626292608/t8589935953(8589935953) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191346 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191330.209377:0:57693:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0e00/0xe5129dc8848384db lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x81:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e45ff771 expref: -99 pid: 57693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.209387:0:57693:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 2 res 8589935621/129 (0 0) 00000080:00200000:3.0:1787191330.209540:0:57693:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x81:0x0] suppgids 0 0: rc 0 00000002:00100000:3.0:1787191330.209572:0:57693:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475180 x1874004626292608/t8589935953(8589935953) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191346 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1787191330.209664:0:57693:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x81:0x0](ffff936b489aec08) for lock 0xe5129dc8848384db 00000080:00010000:3.0:1787191330.209674:0:57693:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848384db from it ffffa3fb41ec3cc0 00010000:00010000:3.0:1787191330.209678:0:57693:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0e00/0xe5129dc8848384db lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x81:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e45ff771 expref: -99 pid: 57693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.209686:0:57693:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0e00/0xe5129dc8848384db lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x81:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e45ff771 expref: -99 pid: 57693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1787191330.209768:0:57693:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x81:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00010000:00010000:3.0:1787191330.209781:0:57693:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/129 (0 0) 00000080:00010000:3.0:1787191330.209788:0:57693:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x81:0x0](ffff936b489aec08) 00000002:00010000:3.0:1787191330.209800:0:57693:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x81:0x0]) in obj [0x200000405:0x81:0x0], intent: layout flags 0 00010000:00010000:3.0:1787191330.209867:0:57693:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b200/0xe5129dc8848384e2 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x81:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.209876:0:57693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b200/0xe5129dc8848384e2 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x81:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.209886:0:57693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b200/0xe5129dc8848384e2 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x81:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57693 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191330.209907:0:57693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57693:1874004626292864:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191330.212684:0:57693:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c540 going to sleep for 11 seconds 00000100:00100000:3.0:1787191330.218698:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191330.218733:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634770944 00000100:00100000:3.0:1787191330.218741:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634770944 00000100:00100000:3.0:1787191330.218795:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 971 00000100:00100000:3.0:1787191330.218807:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8420:x1874004634770944:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191330.218850:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc8848384b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x150:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420080020000 nid: local remote: 0x7130d520e45ff6e5 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1787191330.218998:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191330.219005:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8420:x1874004634770944:12345-192.168.202.101@tcp:104: Request processed in 201us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191330.219011:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 971 00000100:00100000:3.0:1787191330.226526:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626293248:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191330.234914:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626293248:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787191330.237028:0:57693:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b200/0xe5129dc8848384e2 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x81:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e45ff77f expref: -99 pid: 57693 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191330.237050:0:57693:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0x81:0x0]: losing layout lock 00010000:00010000:3.0:1787191330.237088:0:57693:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b200/0xe5129dc8848384e2 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x81:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e45ff77f expref: -99 pid: 57693 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191330.237098:0:57693:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191330.237101:0:57693:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b200/0xe5129dc8848384e2 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x81:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e45ff77f expref: -99 pid: 57693 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000020:00100000:3.0:1787191330.237114:0:57693:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1787191330.237121:0:57693:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1d500 x1874004626293760/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 472/440 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191330.237163:0:57693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57693:1874004626293760:192.168.202.101@tcp:36:lfs.0 00000100:00100000:3.0:1787191330.237274:0:57693:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c300 going to sleep for 11 seconds 00000100:00100000:3.0:1787191330.280071:0:40922:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787191330.280097:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634771584 00000100:00100000:3.0:1787191330.280109:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634771584 00000100:00100000:3.0:1787191330.280192:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 972 00000100:00100000:3.0:1787191330.280205:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b50880850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634771584:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191330.280239:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc884838513 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x82:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e45ff80b expref: -99 pid: 57695 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.280340:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191330.280347:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b50880850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634771584:12345-192.168.202.101@tcp:104: Request processed in 146us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191330.280355:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 972 00000100:00100000:3.0:1787191330.301707:0:57695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57695:1874004626295552:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191330.301759:0:57695:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a8000 x1874004626294528/t8589935956(8589935956) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191346 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787191330.341047:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626296192:192.168.202.101@tcp:36:bash.0 00000080:00200000:3.0:1787191330.341136:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:3.0:1787191330.341145:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x82:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00010000:00010000:3.0:1787191330.341169:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/130 (0 0) 00000080:00010000:3.0:1787191330.341183:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x82:0x0](ffff936b5395aa08) 00000002:00010000:3.0:1787191330.341196:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x82:0x0]) in obj [0x200000405:0x82:0x0], intent: layout flags 0 00010000:00010000:3.0:1787191330.341260:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b200/0xe5129dc884838536 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x82:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.341270:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b200/0xe5129dc884838536 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x82:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.341282:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b200/0xe5129dc884838536 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x82:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191330.341308:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1e680 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626296320:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191330.341414:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c240 going to sleep for 11 seconds 00000100:00100000:3.0:1787191330.348956:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1e680 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626296320:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191330.349067:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b200/0xe5129dc884838536 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x82:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45ff86d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.349086:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b200/0xe5129dc884838536 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x82:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff86d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191330.349104:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b51d1e680 x1874004626296320/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191346 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191330.349136:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b200/0xe5129dc884838536 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x82:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff86d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191330.349157:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b200/0xe5129dc884838536 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x82:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff86d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.349171:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/130 (0 0) 00000080:00200000:3.0:1787191330.349180:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x82:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1787191330.349203:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x82:0x0](ffff936b5395aa08) for lock 0xe5129dc884838536 00000080:00010000:3.0:1787191330.349281:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884838536 from it ffffa3fb41cab8c8 00010000:00010000:3.0:1787191330.349287:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b200/0xe5129dc884838536 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x82:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45ff86d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.349297:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b200/0xe5129dc884838536 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x82:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff86d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.349331:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b200/0xe5129dc884838536 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x82:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff86d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.349346:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b200/0xe5129dc884838536 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x82:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff86d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:3.0:1787191330.349356:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0x82:0x0](000000008454039f) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b200/0xe5129dc884838536 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x82:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff86d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191330.349506:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0x82:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:3.0:1787191330.349513:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b200/0xe5129dc884838536 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x82:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e45ff86d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.349522:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b200/0xe5129dc884838536 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x82:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45ff86d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:3.0:1787191330.349542:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0x82:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:3.0:1787191330.349553:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x82:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191330.349557:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0x82:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:3.0:1787191330.349568:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x82:0x0](ffff936b5395aa08) 00000002:00010000:3.0:1787191330.349580:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x82:0x0]) in obj [0x200000405:0x82:0x0], intent: layout flags 02 00010000:00010000:3.0:1787191330.349598:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b200/0xe5129dc884838536 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x82:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e45ff86d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191330.349613:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0x82:0x0]: losing layout lock 00010000:00010000:3.0:1787191330.349652:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b200/0xe5129dc884838536 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x82:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e45ff86d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191330.349658:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191330.349662:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b200/0xe5129dc884838536 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x82:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e45ff86d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191330.349697:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483853d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x82:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.349777:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483853d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x82:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191330.349791:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191330.349798:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1e680 x1874004626296576/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191330.349808:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483853d lrc: 3/0,1 mode: --/EX res: [0x200000405:0x82:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191330.349868:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1e680 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626296576:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191330.350077:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c240 going to sleep for 11 seconds 00000100:00100000:3.0:1787191330.361269:0:57570:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589935963 gen 1 00000100:00100000:3.0:1787191330.361390:0:57570:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b513b9f80 x1874004626295808/t8589935960(8589935960) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191346 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787191330.361416:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1e680 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626296576:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191330.361447:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483853d lrc: 4/0,1 mode: --/EX res: [0x200000405:0x82:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff87b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.361464:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483853d lrc: 4/0,1 mode: --/CR res: [0x200000405:0x82:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff87b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.361481:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483853d lrc: 4/0,1 mode: CR/CR res: [0x200000405:0x82:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45ff87b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.361496:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483853d lrc: 4/0,1 mode: CR/CR res: [0x200000405:0x82:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff87b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.361513:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483853d lrc: 5/1,1 mode: CR/CR res: [0x200000405:0x82:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45ff87b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.361534:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483853d lrc: 5/1,1 mode: CR/CR res: [0x200000405:0x82:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45ff87b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.361550:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483853d lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x82:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45ff87b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191330.361561:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b51d1e680 x1874004626296576/t8589935963(8589935963) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191346 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191330.361594:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483853d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x82:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff87b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191330.361608:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483853d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x82:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff87b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.361622:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/130 (0 0) 00000080:00200000:3.0:1787191330.361630:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x82:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1787191330.361645:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x82:0x0](ffff936b5395aa08) for lock 0xe5129dc88483853d 00000080:00010000:3.0:1787191330.361656:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483853d from it ffffa3fb41cab930 00010000:00010000:3.0:1787191330.361660:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483853d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x82:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45ff87b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.361670:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483853d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x82:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff87b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191330.362084:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:3.0:1787191330.362097:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x82:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:3.0:1787191330.362199:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483853d lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x82:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff87b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.362221:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483853d lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x82:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff87b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:3.0:1787191330.362232:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0x82:0x0](000000008454039f) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483853d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x82:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff87b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.362296:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483853d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x82:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45ff87b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.362304:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483853d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x82:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff87b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191330.362322:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x82:0x0] ignore/verify layout 1/0, layout version 3 restore needed 0 00020000:00200000:3.0:1787191330.362336:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x82:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191330.362340:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191330.362348:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191330.362363:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1787191330.362391:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x82:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:3.0:1787191330.362458:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483853d lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x82:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff87b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191330.362469:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483853d lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x82:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff87b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:3.0:1787191330.362477:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0x82:0x0](000000008454039f) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483853d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x82:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ff87b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191330.362503:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x82:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1787191330.362507:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x82:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191330.362510:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191330.362513:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191330.362518:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1787191330.362645:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x82:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000020:00010000:3.0:1787191330.402030:0:57693:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b42ff6218 (ffff936b465ccb48/0) at cl_lock_release():245 00000020:00010000:3.0:1787191330.402036:0:57693:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42ff6218 (ffff936b465ccb48/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191330.402043:0:57693:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b46b504b0 (ffff936b465cc248/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191330.402057:0:57693:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007a412388/0xe5129dc88483851a lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x150:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e45ff82e expref: -99 pid: 57693 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191330.402076:0:57693:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007a412388/0xe5129dc88483851a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x150:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e45ff82e expref: -99 pid: 57693 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00010000:3.0:1787191330.402100:0:57693:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42ff6218 (ffff936b465ccb48/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191330.402104:0:57693:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b46b504b0 (ffff936b465ccb48/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191330.402134:0:57693:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x81:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191330.402148:0:57693:0:(file.c:5244:ll_file_seek()) COMPLETED file f70.sanity-flr:[0x200000405:0x81:0x0], offset: 0, type: SEEK_HOLE, rc = 5 00000080:00200080:3.0:1787191330.402167:0:57693:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x81:0x0](ffff936b489aec08) cmd=400866b1 arg=0 00000080:00200080:3.0:1787191330.402179:0:57693:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x81:0x0](ffff936b489aec08) cmd=400866b1 arg=1 00000080:00200008:3.0:1787191330.402188:0:57693:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0x81:0x0](ffff936b489aec08), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191330.402197:0:57693:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x81:0x0](ffff936b489aec08),name=f70.sanity-flr 00000002:00010000:3.0:1787191330.402292:0:57693:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x81:0x0]) in obj [0x200000405:0x81:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191330.402313:0:57693:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0200/0xe5129dc88483850c lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45ff7ef expref: -99 pid: 57693 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191330.402329:0:57693:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0200/0xe5129dc88483850c lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45ff7ef expref: -99 pid: 57693 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191330.402338:0:57693:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x81:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191330.402347:0:57693:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x81:0x0](ffff936b489aec08) 00000080:00010000:3.0:1787191330.402351:0:57693:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x81:0x0](ffff936b489aec08) for lock 0xe5129dc88483850c 00000080:00010000:3.0:1787191330.402358:0:57693:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483850c from it ffffa3fb41ec3cd8 00010000:00010000:3.0:1787191330.402361:0:57693:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0200/0xe5129dc88483850c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e45ff7ef expref: -99 pid: 57693 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191330.402369:0:57693:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0200/0xe5129dc88483850c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45ff7ef expref: -99 pid: 57693 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787191330.402393:0:57693:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x81:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:3.0:1787191330.402405:0:57693:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x81:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191330.402409:0:57693:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191330.402414:0:57693:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x81:0x0] 00000008:00010000:3.0:1787191330.402436:0:57693:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191330.402440:0:57693:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667db0, osc lock ffff936b44f650a0, flags 0x400000400001002 00010000:00010000:3.0:1787191330.402457:0:57693:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007a412388/0xe5129dc88483851a lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x150:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e45ff82e expref: -99 pid: 57693 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191330.402466:0:57693:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007a412388/0xe5129dc88483851a lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x150:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e45ff82e expref: -99 pid: 57693 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:3.0:1787191330.402480:0:57693:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191330.402484:0:57693:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007a412388/0xe5129dc88483851a lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x150:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e45ff82e expref: -99 pid: 57693 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191330.402492:0:57693:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007a412388/0xe5129dc88483851a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x150:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e45ff82e expref: -99 pid: 57693 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000020:00200000:3.0:1787191330.402502:0:57693:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191330.402514:0:57693:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0x81:0x0] updating i_size 5 i_blocks 8 00000020:00010000:3.0:1787191330.402516:0:57693:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51655720 (ffff936b465ccb48/0) at cl_lock_release():245 00000020:00010000:3.0:1787191330.402639:0:57693:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51655720 (ffff936b465ccb48/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191330.402644:0:57693:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667db0 (ffff936b465cc248/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191330.402648:0:57693:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51655720 (ffff936b465ccb48/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191330.402650:0:57693:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667db0 (ffff936b465ccb48/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191330.402658:0:57693:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x81:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191330.402809:0:57693:0:(file.c:2483:do_file_read_iter()) START file f70.sanity-flr:[0x200000405:0x81:0x0], ppos: 0, count: 4096 00000080:00200000:3.0:1787191330.402822:0:57693:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: read ppos: 0, bytes: 4096 00000080:00200000:3.0:1787191330.402866:0:57693:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000020:00200000:3.0:1787191330.402874:0:57693:0:(cl_io.c:214:cl_io_rw_init()) header@00000000b7f6472f[0x110, 2, [0x200000405:0x81:0x0] hash] 00000020:00200000:3.0:1787191330.402876:0:57693:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 4096) 2048 0 00000080:00200000:3.0:1787191330.402880:0:57693:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x81:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00000080:00200000:3.0:1787191330.402891:0:57693:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1787191330.402899:0:57693:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:3.0:1787191330.402904:0:57693:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1787191330.402920:0:57693:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:3.0:1787191330.402931:0:57693:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:3.0:1787191330.402935:0:57693:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667db0, osc lock ffff936b44f650a0, flags 0x40000 00000080:00200000:3.0:1787191330.402941:0:57693:0:(vvp_io.c:835:vvp_io_read_start()) f70.sanity-flr: read [0, 4096) 00000001:00010000:3.0:1787191330.402949:0:57693:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x81:0x0] 00000008:00010000:3.0:1787191330.402955:0:57693:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191330.402957:0:57693:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b506677b0, osc lock ffff936b44f64f70, flags 0x400001002 00010000:00010000:3.0:1787191330.402966:0:57693:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007a412388/0xe5129dc88483851a lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x150:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e45ff82e expref: -99 pid: 57693 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1787191330.402978:0:57693:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007a412388/0xe5129dc88483851a lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x150:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e45ff82e expref: -99 pid: 57693 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000020:00200000:3.0:1787191330.402987:0:57693:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191330.402991:0:57693:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007a412388/0xe5129dc88483851a lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x150:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e45ff82e expref: -99 pid: 57693 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1787191330.403306:0:57693:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007a412388/0xe5129dc88483851a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x150:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e45ff82e expref: -99 pid: 57693 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 1 00000020:00200000:3.0:1787191330.403323:0:57693:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000100:00100000:3.0:1787191330.418105:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626298240:192.168.202.101@tcp:4:lfs.0 00000080:00200000:3.0:1787191330.432633:0:57693:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1787191330.432651:0:57693:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x81:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191330.432656:0:57693:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:3.0:1787191330.432669:0:57693:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0x81:0x0] updating i_size 5 i_blocks 8 00000020:00200000:3.0:1787191330.432673:0:57693:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191330.432685:0:57693:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200080:3.0:1787191330.432829:0:57693:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x81:0x0](ffff936b489aec08) cmd=400866b1 arg=0 00000080:00200080:3.0:1787191330.433650:0:57693:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x81:0x0](ffff936b489aec08) cmd=400866b1 arg=1 00000080:00200008:3.0:1787191330.433661:0:57693:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0x81:0x0](ffff936b489aec08), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191330.433673:0:57693:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x81:0x0](ffff936b489aec08),name=f70.sanity-flr 00000002:00010000:3.0:1787191330.433772:0:57693:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x81:0x0]) in obj [0x200000405:0x81:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191330.433795:0:57693:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0200/0xe5129dc88483850c lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45ff7ef expref: -99 pid: 57693 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 1 00010000:00010000:3.0:1787191330.433819:0:57693:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0200/0xe5129dc88483850c lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45ff7ef expref: -99 pid: 57693 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 1 00000080:00200000:3.0:1787191330.433829:0:57693:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x81:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191330.433868:0:57693:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x81:0x0](ffff936b489aec08) 00000080:00010000:3.0:1787191330.433875:0:57693:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x81:0x0](ffff936b489aec08) for lock 0xe5129dc88483850c 00000080:00010000:3.0:1787191330.433886:0:57693:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483850c from it ffffa3fb41ec3cd8 00010000:00010000:3.0:1787191330.433891:0:57693:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0200/0xe5129dc88483850c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e45ff7ef expref: -99 pid: 57693 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 1 00010000:00010000:3.0:1787191330.433903:0:57693:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0200/0xe5129dc88483850c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x81:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45ff7ef expref: -99 pid: 57693 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00000100:00100000:3.0:1787191330.489953:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634772736 00000100:00100000:3.0:1787191330.489965:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634772736 00000100:00100000:3.0:1787191330.490077:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 973 00000100:00100000:3.0:1787191330.490091:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:15323:x1874004634772736:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191330.490114:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1800/0xe5129dc884838505 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x81:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e45ff7e1 expref: -99 pid: 57693 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191330.490233:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191330.490241:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:15323:x1874004634772736:12345-192.168.202.101@tcp:104: Request processed in 154us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191330.490250:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 973 00000100:00100000:3.0:1787191330.506569:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191330.506643:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634774016 00000100:00100000:3.0:1787191330.506655:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634774016 00000100:00100000:3.0:1787191330.506716:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 975 00000100:00100000:3.0:1787191330.506727:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30510:x1874004634774016:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191330.506751:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000004181a39/0xe5129dc88483854b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x152:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e45ff889 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.506876:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191330.506883:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30510:x1874004634774016:12345-192.168.202.101@tcp:104: Request processed in 158us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191330.506890:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 975 00010000:00010000:3.0:1787191330.506913:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191330.506920:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000004181a39/0xe5129dc88483854b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x152:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e45ff889 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.506930:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51fe0400 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191330.506937:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000004181a39/0xe5129dc88483854b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x152:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e45ff889 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.506991:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000004181a39/0xe5129dc88483854b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x152:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e45ff889 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.506999:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191330.507022:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000004181a39/0xe5129dc88483854b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x152:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e45ff889 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.507031:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000004181a39/0xe5129dc88483854b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x152:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e45ff889 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.507062:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191330.507064:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191330.507066:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191330.507073:0:2392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787191330.507090:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626301184:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191330.521919:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626301184:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191330.547860:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634774272 00000100:00100000:3.0:1787191330.547871:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634774272 00000100:00100000:3.0:1787191330.547933:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 977 00000100:00100000:3.0:1787191330.547945:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634774272:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191330.547960:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc8848385ad lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e45ff9e0 expref: -99 pid: 57693 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.548061:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191330.548068:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634774272:12345-192.168.202.101@tcp:104: Request processed in 125us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191330.548076:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 977 00010000:00010000:3.0:1787191330.554468:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191330.554478:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc8848385ad lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x84:0x0].0x0 bits 0x1b/0x5 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e45ff9e0 expref: -99 pid: 57693 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.554488:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b6a609e00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191330.554494:0:40929:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc8848385ad lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x84:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e45ff9e0 expref: -99 pid: 57693 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.554509:0:40929:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc8848385ad lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x84:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e45ff9e0 expref: -99 pid: 57693 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.554518:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc8848385ad lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x84:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e45ff9e0 expref: -99 pid: 57693 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1787191330.554543:0:40929:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0x84:0x0]: losing layout lock 00010000:00010000:3.0:1787191330.554595:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc8848385ad lrc: 2/0,0 mode: --/PR res: [0x200000405:0x84:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e45ff9e0 expref: -99 pid: 57693 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.554602:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191330.554640:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc8848385ad lrc: 1/0,0 mode: --/PR res: [0x200000405:0x84:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e45ff9e0 expref: -99 pid: 57693 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.554649:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc8848385ad lrc: 0/0,0 mode: --/PR res: [0x200000405:0x84:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e45ff9e0 expref: -99 pid: 57693 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.554670:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191330.554672:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191330.554674:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191330.554686:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787191330.554710:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626303104:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191330.559780:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626303104:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191330.593281:0:51131:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787191330.593297:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634774912 00000100:00100000:3.0:1787191330.593304:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634774912 00000100:00100000:3.0:1787191330.593346:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634775552 00000100:00100000:3.0:1787191330.593350:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634775552 00000100:00100000:3.0:1787191330.593362:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 978 00000100:00100000:3.0:1787191330.593369:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+5:8419:x1874004634774912:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191330.593380:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007a412388/0xe5129dc88483851a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x150:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e45ff82e expref: -99 pid: 57693 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:3.0:1787191330.594029:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191330.594040:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+5:8419:x1874004634774912:12345-192.168.202.101@tcp:104: Request processed in 669us (2518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191330.594048:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 978 00000100:00100000:3.0:1787191330.594070:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 979 00000100:00100000:3.0:1787191330.594078:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b4121f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:37089:x1874004634775552:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191330.594088:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f4e8297c/0xe5129dc884838575 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x151:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e45ff91c expref: -99 pid: 57693 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.596101:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1787191330.596116:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b4121f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:37089:x1874004634775552:12345-192.168.202.101@tcp:104: Request processed in 2036us (4490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191330.596137:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 979 00010000:00010000:3.0:1787191330.596539:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191330.610942:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626305536:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191330.610980:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000009b4c0e2/0xe5129dc8848385e5 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x157:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ffa7a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.611006:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000009b4c0e2/0xe5129dc8848385e5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x157:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e45ffa7a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.611023:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000009b4c0e2/0xe5129dc8848385e5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x157:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e45ffa7a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.611041:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000009b4c0e2/0xe5129dc8848385e5 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x157:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e45ffa7a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191330.611057:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000009b4c0e2/0xe5129dc8848385e5 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x157:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e45ffa7a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.611070:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000009b4c0e2/0xe5129dc8848385e5 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x157:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e45ffa7a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.611078:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000009b4c0e2/0xe5129dc8848385e5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x157:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e45ffa7a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191330.615087:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626305792:192.168.202.101@tcp:10:bash.0 00000100:00100000:3.0:1787191330.615800:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626305920:192.168.202.101@tcp:10:bash.0 00000080:00200000:3.0:1787191330.624887:0:57698:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191330.624931:0:57698:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191330.624954:0:57698:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191330.624975:0:57698:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191330.624985:0:57698:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191330.624994:0:57698:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191330.624998:0:57698:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191330.625008:0:57698:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41f13b58 00010000:00010000:3.0:1787191330.625012:0:57698:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191330.625022:0:57698:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191330.625043:0:57698:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191330.625051:0:57698:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:3.0:1787191330.625058:0:57698:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191330.625070:0:57698:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:3.0:1787191330.625074:0:57698:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:3.0:1787191330.625092:0:57698:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00000100:00100000:3.0:1787191330.640788:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634775936 00000100:00100000:3.0:1787191330.640799:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634775936 00000100:00100000:3.0:1787191330.640909:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 980 00000100:00100000:3.0:1787191330.640919:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634775936:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191330.640941:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc8848385a6 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e45ff9ee expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191330.641058:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191330.641065:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634775936:12345-192.168.202.101@tcp:104: Request processed in 148us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191330.641077:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 980 00000100:00100000:3.0:1787191330.661100:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634776064 00000100:00100000:3.0:1787191330.661111:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634776064 00000100:00100000:3.0:1787191330.661185:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 981 00000100:00100000:3.0:1787191330.661196:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634776064:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191330.661221:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc8848385f3 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x84:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e45ffaa4 expref: -99 pid: 57699 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.661291:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191330.661298:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634776064:12345-192.168.202.101@tcp:104: Request processed in 104us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191330.661306:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 981 00000100:00100000:3.0:1787191330.701260:0:57700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57700:1874004626307712:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191330.701292:0:57700:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884838608 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.701309:0:57700:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884838608 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.701316:0:57700:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884838608 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.701323:0:57700:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884838608 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.701334:0:57700:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884838608 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.701348:0:57700:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd5400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191330.701355:0:57700:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884838608 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.701362:0:57700:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884838608 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.701370:0:57700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884838608 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.701379:0:57700:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191330.701388:0:57700:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884838608 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.701395:0:57700:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884838608 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57700 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191330.701421:0:57700:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513b9880 x1874004626307712/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191346 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191330.701440:0:57700:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191330.701552:0:57700:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191330.701571:0:57700:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191330.701590:0:57700:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191330.701603:0:57700:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191330.701611:0:57700:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191330.701618:0:57700:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191330.701622:0:57700:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191330.701629:0:57700:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41f1bbe8 00010000:00010000:3.0:1787191330.701633:0:57700:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191330.701641:0:57700:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191330.701660:0:57700:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191330.701669:0:57700:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000080:00200000:3.0:1787191330.701675:0:57700:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191330.701688:0:57700:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:3.0:1787191330.701692:0:57700:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:3.0:1787191330.701706:0:57700:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1787191330.701763:0:57700:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483860f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.701771:0:57700:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483860f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.701783:0:57700:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483860f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191330.701809:0:57700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ca80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57700:1874004626307840:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191330.701945:0:57700:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787191330.705236:0:57700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ca80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57700:1874004626307840:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191330.705265:0:57700:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483860f lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.705282:0:57700:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483860f lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.705289:0:57700:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483860f lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.705296:0:57700:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483860f lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.705306:0:57700:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483860f lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.705313:0:57700:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9bc00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191330.705318:0:57700:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483860f lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.705326:0:57700:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483860f lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.705334:0:57700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483860f lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.705340:0:57700:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191330.705347:0:57700:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483860f lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.705354:0:57700:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483860f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57700 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191330.705377:0:57700:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b51d1ca80 x1874004626307840/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191346 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191330.705400:0:57700:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191330.705513:0:57700:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191330.705532:0:57700:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191330.705543:0:57700:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191330.705556:0:57700:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191330.705564:0:57700:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191330.705569:0:57700:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191330.705573:0:57700:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191330.705580:0:57700:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41f1bb58 00010000:00010000:3.0:1787191330.705583:0:57700:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191330.705590:0:57700:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191330.705607:0:57700:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191330.705617:0:57700:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:3.0:1787191330.705627:0:57700:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:3.0:1787191330.705632:0:57700:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:3.0:1787191330.705646:0:57700:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191330.705654:0:57700:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 33 lru_type: 1 00010000:00010000:3.0:1787191330.705668:0:57700:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 33 lru_type: 1 00000002:00010000:3.0:1787191330.705678:0:57700:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191330.705729:0:57700:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b200/0xe5129dc884838616 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.705736:0:57700:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b200/0xe5129dc884838616 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.705746:0:57700:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b200/0xe5129dc884838616 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191330.705770:0:57700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ca80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57700:1874004626307968:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191330.705886:0:57700:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787191330.730650:0:57700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57700:1874004626308608:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191330.730686:0:57700:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483862b lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ffb68 expref: -99 pid: 57700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.730722:0:57700:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483862b lrc: 4/0,1 mode: --/PR res: [0x200000405:0x85:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ffb68 expref: -99 pid: 57700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.730733:0:57700:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483862b lrc: 4/0,1 mode: --/PR res: [0x200000405:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ffb68 expref: -99 pid: 57700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.730760:0:57700:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483862b lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45ffb68 expref: -99 pid: 57700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.730781:0:57700:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483862b lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ffb68 expref: -99 pid: 57700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.730798:0:57700:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483862b lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45ffb68 expref: -99 pid: 57700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.730809:0:57700:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483862b lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45ffb68 expref: -99 pid: 57700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.730818:0:57700:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483862b lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45ffb68 expref: -99 pid: 57700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191330.730857:0:57700:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b453a8e00 x1874004626308608/t8589935986(8589935986) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191346 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191330.730875:0:57700:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8e00 x1874004626308608/t8589935986(8589935986) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191346 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191330.730891:0:57700:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483862b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ffb68 expref: -99 pid: 57700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.730902:0:57700:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/133 (0 0) 00000080:00200000:3.0:1787191330.730910:0:57700:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191330.730924:0:57700:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:3.0:1787191330.730964:0:57700:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0x85:0x0](ffff936b489aec08) 00000080:00200000:3.0:1787191330.730974:0:57700:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0x85:0x0], updating i_size 0 00000080:00200000:3.0:1787191330.731023:0:57700:0:(file.c:6836:ll_layout_conf()) [0x200000405:0x85:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:3.0:1787191330.731029:0:57700:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0x85:0x0](ffff936b489aec08) 00000080:00010000:3.0:1787191330.731034:0:57700:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x85:0x0](ffff936b489aec08) for lock 0xe5129dc88483862b 00000080:00010000:3.0:1787191330.731047:0:57700:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x85:0x0](ffff936b489aec08) 00000080:00200008:3.0:1787191330.731490:0:57700:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0x85:0x0](ffff936b489aec08), flags 120501 00000002:00100000:3.0:1787191330.731519:0:57700:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8e00 x1874004626308608/t8589935986(8589935986) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191346 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1787191330.731557:0:57700:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483862b from it ffff936b5339fd80 00010000:00010000:3.0:1787191330.731563:0:57700:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483862b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e45ffb68 expref: -99 pid: 57700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.731574:0:57700:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483862b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45ffb68 expref: -99 pid: 57700 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191330.731654:0:57700:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x85:0x0](ffff936b489aec08), inode mode 81a4 mask 40 00000080:00200000:3.0:1787191330.731729:0:57700:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x85:0x0](ffff936b489aec08), inode mode 81a4 mask 2 00000080:00200000:3.0:1787191330.731790:0:57700:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0x85:0x0](ffff936b489aec08), xattr lov 00000002:00010000:3.0:1787191330.731815:0:57700:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x85:0x0]) in obj [0x200000405:0x85:0x0], intent: open flags 040000002 00010000:00010000:3.0:1787191330.731916:0:57700:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884838632 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x85:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.731926:0:57700:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884838632 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x85:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57700 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191330.731942:0:57700:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191330.731950:0:57700:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1f480 x1874004626308864/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191330.731961:0:57700:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884838632 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x85:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191330.731988:0:57700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57700:1874004626308864:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191330.732810:0:57700:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787191330.735469:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634776192 00000100:00100000:3.0:1787191330.735481:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634776192 00000100:00100000:3.0:1787191330.735603:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 982 00000100:00100000:3.0:1787191330.735616:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634776192:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191330.735639:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483862b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e45ffb68 expref: -99 pid: 57700 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.735739:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191330.735747:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634776192:12345-192.168.202.101@tcp:104: Request processed in 134us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191330.735757:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 982 00000100:00100000:3.0:1787191330.748027:0:57700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57700:1874004626308864:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191330.748051:0:57700:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884838632 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x85:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.748070:0:57700:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884838632 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x85:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.748078:0:57700:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884838632 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x85:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.748092:0:57700:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884838632 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x85:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.748104:0:57700:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884838632 lrc: 4/0,0 mode: --/CR res: [0x200000405:0x85:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.748112:0:57700:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9bc00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191330.748129:0:57700:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884838632 lrc: 4/0,0 mode: --/CR res: [0x200000405:0x85:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.748139:0:57700:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884838632 lrc: 4/0,0 mode: --/CR res: [0x200000405:0x85:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.748149:0:57700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884838632 lrc: 5/0,0 mode: --/CR res: [0x200000405:0x85:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.748158:0:57700:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191330.748166:0:57700:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884838632 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x85:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.748174:0:57700:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884838632 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x85:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57700 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191330.748209:0:57700:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b51d1f480 x1874004626308864/t8589935987(8589935987) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191346 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191330.748229:0:57700:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1f480 x1874004626308864/t8589935987(8589935987) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191346 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191330.748257:0:57700:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x85:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1787191330.748326:0:57700:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x85:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1787191330.748341:0:57700:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x85:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191330.748406:0:57700:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0x85:0x0], updating i_size 0 00000002:00100000:3.0:1787191330.748431:0:57700:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1f480 x1874004626308864/t8589935987(8589935987) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191346 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191330.748477:0:57700:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1f480 x1874004626308864/t8589935987(8589935987) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191346 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191330.748489:0:57700:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191330.748496:0:57700:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1dc00 x1874004626309504/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191330.748523:0:57700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57700:1874004626309504:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191330.748632:0:57700:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787191330.754626:0:57700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57700:1874004626309504:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191330.754662:0:57700:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1f480 x1874004626308864/t8589935987(8589935987) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191346 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:3.0:1787191330.754734:0:57700:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0x85:0x0](ffff936b489aec08), flags 100001 00000002:00100000:3.0:1787191330.754784:0:57700:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a8e00 x1874004626308608/t8589935986(8589935986) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191346 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191330.754795:0:57700:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191330.754801:0:57700:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1df80 x1874004626310016/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191330.754819:0:57700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57700:1874004626310016:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191330.755062:0:57700:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787191330.757730:0:57700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57700:1874004626310016:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191330.757777:0:57700:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a8e00 x1874004626308608/t8589935986(8589935986) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191346 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191330.765749:0:57702:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0x85:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1787191330.765756:0:57702:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c3bc20 (ffff936b47a17368/0) at cl_lock_release():245 00000020:00010000:3.0:1787191330.765760:0:57702:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c3bc20 (ffff936b47a17368/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191330.765766:0:57702:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99b70 (ffff936b47a17c68/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191330.765772:0:57702:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99bb0 (ffff936b47a177e8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191330.765776:0:57702:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c3bc20 (ffff936b47a17368/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191330.765780:0:57702:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99b70 (ffff936b47a17368/1) at cl_lock_fini():72 00000020:00010000:3.0:1787191330.765784:0:57702:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99bb0 (ffff936b47a17368/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191330.765964:0:57702:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x85:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:3.0:1787191330.765987:0:57702:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/133 (0 0) 00000080:00010000:3.0:1787191330.766000:0:57702:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x85:0x0](ffff936b489aec08) 00000002:00010000:3.0:1787191330.766014:0:57702:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x85:0x0]) in obj [0x200000405:0x85:0x0], intent: layout flags 0 00010000:00010000:3.0:1787191330.766062:0:57702:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884838655 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x85:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.766070:0:57702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884838655 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x85:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.766081:0:57702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884838655 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x85:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57702 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191330.766104:0:57702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57702:1874004626310400:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191330.766282:0:57702:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787191330.794395:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191330.809370:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191330.809444:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191330.809482:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191330.809535:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191330.809632:0:51131:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787191330.809657:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634777600 00000100:00100000:3.0:1787191330.809670:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634777600 00000100:00100000:3.0:1787191330.809729:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634777728 00000100:00100000:3.0:1787191330.809735:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634777728 00000100:00100000:3.0:1787191330.809751:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 984 00000100:00100000:3.0:1787191330.809761:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8420:x1874004634777600:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191330.809781:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000032e8f952/0xe5129dc8848385bb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x155:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e45ffa03 expref: -99 pid: 57693 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.809894:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191330.809902:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8420:x1874004634777600:12345-192.168.202.101@tcp:104: Request processed in 141us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191330.809910:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 984 00000100:00100000:3.0:1787191330.809935:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634777472 00000100:00100000:3.0:1787191330.809946:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634777472 00000100:00100000:3.0:1787191330.809969:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 985 00000100:00100000:3.0:1787191330.809985:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+5:8720:x1874004634777728:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191330.810006:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000009b4c0e2/0xe5129dc8848385e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x157:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e45ffa7a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.810057:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787191330.810064:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+5:8720:x1874004634777728:12345-192.168.202.101@tcp:104: Request processed in 88us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191330.810071:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 985 00000100:00100000:3.0:1787191330.810085:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 986 00000100:00100000:3.0:1787191330.810095:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b4121d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30353:x1874004634777472:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191330.810116:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc8848385b4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x158:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e45ff9fc expref: -99 pid: 57693 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.810163:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787191330.810169:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b4121d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30353:x1874004634777472:12345-192.168.202.101@tcp:104: Request processed in 76us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191330.810178:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 986 00010000:00010000:3.0:1787191330.810218:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787191330.810226:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000032e8f952/0xe5129dc8848385bb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x155:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e45ffa03 expref: -99 pid: 57693 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.810236:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b6a609a00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191330.810244:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000032e8f952/0xe5129dc8848385bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x155:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e45ffa03 expref: -99 pid: 57693 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.810307:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000032e8f952/0xe5129dc8848385bb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x155:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e45ffa03 expref: -99 pid: 57693 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.810320:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191330.810350:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000032e8f952/0xe5129dc8848385bb lrc: 1/0,0 mode: --/PR res: [0x280000401:0x155:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e45ffa03 expref: -99 pid: 57693 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.810362:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000032e8f952/0xe5129dc8848385bb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x155:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e45ffa03 expref: -99 pid: 57693 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.810399:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787191330.810403:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000009b4c0e2/0xe5129dc8848385e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x157:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e45ffa7a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.810410:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b6a608a00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191330.810414:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000009b4c0e2/0xe5129dc8848385e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x157:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e45ffa7a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.810446:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000009b4c0e2/0xe5129dc8848385e5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x157:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e45ffa7a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.810455:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191330.810468:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000009b4c0e2/0xe5129dc8848385e5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x157:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e45ffa7a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.810477:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000009b4c0e2/0xe5129dc8848385e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x157:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e45ffa7a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.810490:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191330.810494:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc8848385b4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x158:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e45ff9fc expref: -99 pid: 57693 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.810500:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b6a609c00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191330.810504:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc8848385b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x158:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e45ff9fc expref: -99 pid: 57693 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.810523:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc8848385b4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x158:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e45ff9fc expref: -99 pid: 57693 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.810530:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191330.810534:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc8848385b4 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x158:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e45ff9fc expref: -99 pid: 57693 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.810546:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc8848385b4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x158:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e45ff9fc expref: -99 pid: 57693 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.810560:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191330.810563:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191330.810565:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191330.810575:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191330.810581:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191330.810597:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626312576:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191330.810655:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626312960:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191330.810688:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787191330.810704:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626312832:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191330.822066:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626312832:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191330.822090:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626312576:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191330.822104:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626312960:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191330.861457:0:57704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57704:1874004626314624:192.168.202.101@tcp:36:rm.0 00000100:00100000:3.0:1787191330.886781:0:57705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57705:1874004626314880:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191330.886807:0:57705:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884838694 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.886823:0:57705:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884838694 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.887216:0:57705:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884838694 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.887224:0:57705:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884838694 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.887232:0:57705:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884838694 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.887236:0:57705:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd4200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191330.887240:0:57705:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884838694 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.887245:0:57705:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884838694 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.887251:0:57705:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884838694 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.887256:0:57705:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191330.887261:0:57705:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884838694 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.887266:0:57705:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884838694 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57705 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191330.887287:0:57705:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513ba680 x1874004626314880/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191346 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191330.887301:0:57705:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191330.887396:0:57705:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191330.887413:0:57705:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191330.887425:0:57705:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191330.887439:0:57705:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191330.887446:0:57705:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191330.887452:0:57705:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191330.887456:0:57705:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191330.887462:0:57705:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41f2bbe8 00010000:00010000:3.0:1787191330.887465:0:57705:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191330.887471:0:57705:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191330.887483:0:57705:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191330.887490:0:57705:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000080:00200000:3.0:1787191330.887495:0:57705:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191330.887504:0:57705:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:3.0:1787191330.887508:0:57705:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:3.0:1787191330.887519:0:57705:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1787191330.887565:0:57705:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483869b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.887570:0:57705:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483869b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.887583:0:57705:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483869b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57705 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191330.887607:0:57705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57705:1874004626315008:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191330.887750:0:57705:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191330.893968:0:57705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57705:1874004626315008:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191330.893997:0:57705:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483869b lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.894013:0:57705:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483869b lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.894019:0:57705:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483869b lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.894025:0:57705:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483869b lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.894033:0:57705:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483869b lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.894038:0:57705:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9a800 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191330.894042:0:57705:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483869b lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.894047:0:57705:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483869b lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.894063:0:57705:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483869b lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.894070:0:57705:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191330.894076:0:57705:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483869b lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.894081:0:57705:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483869b lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57705 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191330.894103:0:57705:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b51d1f100 x1874004626315008/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191346 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191330.894151:0:57705:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191330.894297:0:57705:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191330.894314:0:57705:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191330.894323:0:57705:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191330.894335:0:57705:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191330.894340:0:57705:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191330.894344:0:57705:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191330.894347:0:57705:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191330.894352:0:57705:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41f2bb58 00010000:00010000:3.0:1787191330.894354:0:57705:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191330.894360:0:57705:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191330.894378:0:57705:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191330.894385:0:57705:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:3.0:1787191330.894394:0:57705:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:3.0:1787191330.894399:0:57705:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:3.0:1787191330.894409:0:57705:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191330.894414:0:57705:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 34 lru_type: 1 00010000:00010000:3.0:1787191330.894419:0:57705:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 34 lru_type: 1 00000002:00010000:3.0:1787191330.894425:0:57705:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191330.894469:0:57705:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc8848386a2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.894474:0:57705:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc8848386a2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.894480:0:57705:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc8848386a2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57705 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191330.894499:0:57705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57705:1874004626315136:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191330.894584:0:57705:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191330.900157:0:57705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57705:1874004626315136:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191330.900191:0:57705:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc8848386a2 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ffcf0 expref: -99 pid: 57705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.900211:0:57705:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc8848386a2 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ffcf0 expref: -99 pid: 57705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.900225:0:57705:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc8848386a2 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45ffcf0 expref: -99 pid: 57705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.900237:0:57705:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc8848386a2 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ffcf0 expref: -99 pid: 57705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.900251:0:57705:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc8848386a2 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45ffcf0 expref: -99 pid: 57705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.900261:0:57705:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc8848386a2 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45ffcf0 expref: -99 pid: 57705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.900268:0:57705:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc8848386a2 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45ffcf0 expref: -99 pid: 57705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191330.900282:0:57705:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b51d1f100 x1874004626315136/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191346 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191330.900297:0:57705:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc8848386a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ffcf0 expref: -99 pid: 57705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.900308:0:57705:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:3.0:1787191330.900317:0:57705:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc8848386a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45ffcf0 expref: -99 pid: 57705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.900332:0:57705:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc8848386a2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ffcf0 expref: -99 pid: 57705 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1787191330.913644:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191330.913751:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634778112 00000100:00100000:3.0:1787191330.913763:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634778112 00000100:00100000:3.0:1787191330.913858:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 987 00000100:00100000:3.0:1787191330.913870:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634778112:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191330.913897:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608e00/0xe5129dc8848386b0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x86:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e45ffd21 expref: -99 pid: 57705 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.913994:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191330.914002:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634778112:12345-192.168.202.101@tcp:104: Request processed in 134us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191330.914010:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 987 00010000:00010000:3.0:1787191330.962224:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191330.962533:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626319104:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191330.962569:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc8848386e8 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x86:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45ffdde expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.962586:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc8848386e8 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x86:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ffdde expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191330.962605:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b453a8380 x1874004626319104/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191346 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191330.962625:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc8848386e8 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x86:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ffdde expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191330.962638:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc8848386e8 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x86:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ffdde expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.962651:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/134 (0 0) 00000080:00200000:3.0:1787191330.962659:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x86:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1787191330.962681:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x86:0x0](ffff936b5395d348) for lock 0xe5129dc8848386e8 00000080:00010000:3.0:1787191330.962691:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848386e8 from it ffffa3fb41cab8c8 00010000:00010000:3.0:1787191330.962694:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc8848386e8 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x86:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45ffdde expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.962705:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc8848386e8 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x86:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ffdde expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.962735:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc8848386e8 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x86:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ffdde expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.962747:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc8848386e8 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x86:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ffdde expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:3.0:1787191330.962756:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0x86:0x0](000000001d24cd79) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc8848386e8 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x86:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ffdde expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191330.962813:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0x86:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:3.0:1787191330.962818:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc8848386e8 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x86:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e45ffdde expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.962826:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc8848386e8 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x86:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45ffdde expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:3.0:1787191330.962945:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0x86:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:3.0:1787191330.962955:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x86:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191330.962960:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0x86:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:3.0:1787191330.962972:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x86:0x0](ffff936b5395d348) 00000002:00010000:3.0:1787191330.962993:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x86:0x0]) in obj [0x200000405:0x86:0x0], intent: layout flags 02 00010000:00010000:3.0:1787191330.963014:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc8848386e8 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x86:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e45ffdde expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191330.963030:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0x86:0x0]: losing layout lock 00010000:00010000:3.0:1787191330.963067:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc8848386e8 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x86:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e45ffdde expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191330.963074:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191330.963078:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc8848386e8 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x86:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e45ffdde expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191330.963104:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc8848386ef lrc: 3/0,1 mode: --/EX res: [0x200000405:0x86:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191330.963111:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc8848386ef lrc: 3/0,1 mode: --/EX res: [0x200000405:0x86:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191330.963136:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191330.963144:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1ed80 x1874004626319360/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191330.963154:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc8848386ef lrc: 3/0,1 mode: --/EX res: [0x200000405:0x86:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191330.963179:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ed80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626319360:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191330.963386:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c300 going to sleep for 11 seconds 00000100:00100000:3.0:1787191330.996945:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634778752 00000100:00100000:3.0:1787191330.996959:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634778752 00000100:00100000:3.0:1787191330.997037:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634778880 00000100:00100000:3.0:1787191330.997041:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634778880 00000100:00100000:3.0:1787191330.997053:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634779520 00000100:00100000:3.0:1787191330.997244:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634779520 00000100:00100000:3.0:1787191330.997262:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634779648 00000100:00100000:3.0:1787191330.997263:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634779648 00000100:00100000:3.0:1787191330.997278:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 988 00000100:00100000:3.0:1787191330.997288:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+5:29543:x1874004634778752:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191330.997313:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d8e6cc91/0xe5129dc884838640 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x157:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e45ffbb5 expref: -99 pid: 57702 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191330.997477:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191330.997485:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+5:29543:x1874004634778752:12345-192.168.202.101@tcp:104: Request processed in 198us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191330.997493:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 988 00000100:00100000:3.0:1787191330.997515:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 989 00000100:00100000:3.0:1787191330.997522:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30510:x1874004634778880:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191330.997531:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483867f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x156:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e45ffc64 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.997574:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787191330.997580:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30510:x1874004634778880:12345-192.168.202.101@tcp:104: Request processed in 59us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191330.997586:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 989 00000100:00100000:3.0:1787191330.997598:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 990 00000100:00100000:3.0:1787191330.997603:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+5:30511:x1874004634779520:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191330.997612:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884838678 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x159:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e45ffc5d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191330.997640:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787191330.997644:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+5:30511:x1874004634779520:12345-192.168.202.101@tcp:104: Request processed in 41us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191330.997650:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 990 00000100:00100000:3.0:1787191330.997660:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 991 00000100:00100000:3.0:1787191330.997665:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8422:x1874004634779648:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191330.997672:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bcda4bea/0xe5129dc884838647 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x15a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e45ffbae expref: -99 pid: 57702 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191330.997697:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787191330.997702:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8422:x1874004634779648:12345-192.168.202.101@tcp:104: Request processed in 36us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191330.997708:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 991 00010000:00010000:3.0:1787191330.997725:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787191330.997731:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d8e6cc91/0xe5129dc884838640 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x157:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e45ffbb5 expref: -99 pid: 57702 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191330.997745:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51fe1c00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191330.997751:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d8e6cc91/0xe5129dc884838640 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x157:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e45ffbb5 expref: -99 pid: 57702 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191330.997796:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d8e6cc91/0xe5129dc884838640 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x157:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e45ffbb5 expref: -99 pid: 57702 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191330.997803:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191330.997828:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d8e6cc91/0xe5129dc884838640 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x157:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e45ffbb5 expref: -99 pid: 57702 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191330.997862:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d8e6cc91/0xe5129dc884838640 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x157:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e45ffbb5 expref: -99 pid: 57702 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191330.997885:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787191330.997889:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483867f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x156:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e45ffc64 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.997895:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b6a608800 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191330.997898:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483867f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x156:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e45ffc64 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.997916:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483867f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x156:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e45ffc64 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.997928:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191330.997934:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483867f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x156:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e45ffc64 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.997941:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483867f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x156:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e45ffc64 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191330.997955:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787191330.997957:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884838678 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x159:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e45ffc5d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191330.997965:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd5c00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191330.997968:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884838678 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x159:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e45ffc5d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191330.998008:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884838678 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x159:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e45ffc5d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191330.998015:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191330.998020:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884838678 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x159:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e45ffc5d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191330.998037:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884838678 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x159:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e45ffc5d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191330.998052:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191330.998063:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bcda4bea/0xe5129dc884838647 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x15a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e45ffbae expref: -99 pid: 57702 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191330.998069:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b6a608200 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191330.998073:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bcda4bea/0xe5129dc884838647 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x15a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e45ffbae expref: -99 pid: 57702 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191330.998089:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bcda4bea/0xe5129dc884838647 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x15a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e45ffbae expref: -99 pid: 57702 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191330.998095:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191330.998100:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bcda4bea/0xe5129dc884838647 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x15a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e45ffbae expref: -99 pid: 57702 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191330.998107:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bcda4bea/0xe5129dc884838647 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x15a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e45ffbae expref: -99 pid: 57702 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191330.998129:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191330.998131:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191330.998133:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191330.998141:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191330.998148:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191330.998164:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626319744:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191330.998231:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626320000:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191330.998260:0:2392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787191330.998267:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626319872:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191330.998295:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626320128:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191331.008317:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626319744:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191331.008655:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626319872:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191331.008665:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626320128:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191331.008694:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634779776 00000100:00100000:3.0:1787191331.008700:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634779776 00000100:00100000:3.0:1787191331.008759:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 992 00000100:00100000:3.0:1787191331.008770:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8422:x1874004634779776:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191331.008792:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc8848386cc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x158:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000010000 nid: local remote: 0x7130d520e45ffd8a expref: -99 pid: 57707 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191331.008921:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191331.008928:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8422:x1874004634779776:12345-192.168.202.101@tcp:104: Request processed in 161us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191331.008936:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 992 00000100:00100000:3.0:1787191331.011011:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626320000:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191331.017771:0:51131:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787191331.017798:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634779904 00000100:00100000:3.0:1787191331.017809:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634779904 00000100:00100000:3.0:1787191331.018089:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 993 00000100:00100000:3.0:1787191331.018102:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b4121dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:6489:x1874004634779904:12345-192.168.202.101@tcp:105: 00010000:00010000:3.0:1787191331.018133:0:51131:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc8848386fd lrc: 5/0,1 mode: --/PW res: [0x280000401:0x158:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e45ffe32 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.018164:0:51131:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc8848386fd lrc: 5/0,1 mode: --/PW res: [0x280000401:0x158:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e45ffe32 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.018176:0:51131:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc8848386fd lrc: 5/0,1 mode: --/PW res: [0x280000401:0x158:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e45ffe32 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.018188:0:51131:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc8848386fd lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x158:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080080020000 nid: local remote: 0x7130d520e45ffe32 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.018199:0:51131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc8848386fd lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x158:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080080020000 nid: local remote: 0x7130d520e45ffe32 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.018381:0:51131:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc8848386fd lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x158:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80080020000 nid: local remote: 0x7130d520e45ffe32 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.018472:0:51131:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b6a609c00) 00000100:00100000:3.0:1787191331.018550:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b4121dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:6489:x1874004634779904:12345-192.168.202.101@tcp:105: Request processed in 449us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191331.018557:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 993 00000100:00100000:3.0:1787191331.054290:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00010000:00010000:3.0:1787191331.057045:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191331.057051:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483870b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x86:0x0].0x0 bits 0xd/0x3 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e45ffe47 expref: -99 pid: 57709 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.057059:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51fe1200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191331.057065:0:40930:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483870b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x86:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e45ffe47 expref: -99 pid: 57709 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.057073:0:40930:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483870b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x86:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e45ffe47 expref: -99 pid: 57709 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.057081:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483870b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x86:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e45ffe47 expref: -99 pid: 57709 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1787191331.057102:0:40930:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0x86:0x0]: losing layout lock 00010000:00010000:3.0:1787191331.057203:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483870b lrc: 2/0,0 mode: --/CR res: [0x200000405:0x86:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e45ffe47 expref: -99 pid: 57709 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.057277:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191331.057314:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483870b lrc: 1/0,0 mode: --/CR res: [0x200000405:0x86:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e45ffe47 expref: -99 pid: 57709 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.057321:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483870b lrc: 0/0,0 mode: --/CR res: [0x200000405:0x86:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e45ffe47 expref: -99 pid: 57709 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.057345:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191331.057347:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191331.057349:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191331.057358:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787191331.057379:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626321920:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191331.061440:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626321920:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191331.087267:0:57712:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57712:1874004626322944:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191331.087292:0:57712:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1c00/0xe5129dc88483872e lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.087307:0:57712:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1c00/0xe5129dc88483872e lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.087314:0:57712:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1c00/0xe5129dc88483872e lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.087322:0:57712:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1c00/0xe5129dc88483872e lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.087333:0:57712:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1c00/0xe5129dc88483872e lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.087354:0:57712:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51fe1c00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191331.087359:0:57712:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1c00/0xe5129dc88483872e lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x206400000000 pid: 57712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.087366:0:57712:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1c00/0xe5129dc88483872e lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.087377:0:57712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1c00/0xe5129dc88483872e lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x20e400000000 pid: 57712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.087390:0:57712:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191331.087396:0:57712:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1c00/0xe5129dc88483872e lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.087410:0:57712:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1c00/0xe5129dc88483872e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57712 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191331.087427:0:57712:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x7, status=0 req@ffff936b6a475f80 x1874004626322944/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/608 e 0 to 0 dl 1787191347 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191331.087445:0:57712:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1787191331.087825:0:57712:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc884838735 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ffeda expref: -99 pid: 57711 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191331.087887:0:57712:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc884838735 lrc: 3/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45ffeda expref: -99 pid: 57711 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00010000:3.0:1787191331.087896:0:57712:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884838735 from it ffffa3fb41f1b9a0 00010000:00010000:3.0:1787191331.087900:0:57712:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc884838735 lrc: 4/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45ffeda expref: -99 pid: 57711 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191331.087906:0:57712:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc884838735 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45ffeda expref: -99 pid: 57711 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191331.088169:0:57712:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191331.088187:0:57712:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191331.088194:0:57712:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191331.088260:0:57712:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191331.088267:0:57712:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191331.088272:0:57712:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191331.088275:0:57712:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191331.088278:0:57712:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41f1bb58 00010000:00010000:3.0:1787191331.088282:0:57712:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191331.088290:0:57712:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191331.088299:0:57712:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191331.088305:0:57712:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191331.088312:0:57712:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191331.088315:0:57712:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=9 00000100:00100000:3.0:1787191331.106536:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191331.106587:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634780160 00000100:00100000:3.0:1787191331.106599:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634780160 00000100:00100000:3.0:1787191331.106661:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 995 00000100:00100000:3.0:1787191331.106673:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634780160:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191331.106755:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0800/0xe5129dc88483873c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x87:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e45ffef6 expref: -99 pid: 57711 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191331.107026:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191331.107034:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634780160:12345-192.168.202.101@tcp:104: Request processed in 364us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191331.107043:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 995 00000080:00200000:3.0:1787191331.124536:0:57713:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0x87:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1787191331.124543:0:57713:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b516572e0 (ffff936b465cce18/0) at cl_lock_release():245 00000020:00010000:3.0:1787191331.124545:0:57713:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b516572e0 (ffff936b465cce18/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191331.124551:0:57713:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62893930 (ffff936b465cc3f8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191331.124557:0:57713:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62893970 (ffff936b465cc2d8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191331.124559:0:57713:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b516572e0 (ffff936b465cce18/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191331.124561:0:57713:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62893930 (ffff936b465cce18/1) at cl_lock_fini():72 00000020:00010000:3.0:1787191331.124567:0:57713:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62893970 (ffff936b465cce18/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191331.124623:0:57713:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x87:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:3.0:1787191331.124641:0:57713:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/135 (0 0) 00000080:00010000:3.0:1787191331.124652:0:57713:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x87:0x0](ffff936b489221c8) 00000002:00010000:3.0:1787191331.124662:0:57713:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x87:0x0]) in obj [0x200000405:0x87:0x0], intent: layout flags 0 00010000:00010000:3.0:1787191331.124706:0:57713:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884838766 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x87:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.124713:0:57713:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884838766 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x87:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.124724:0:57713:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884838766 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x87:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191331.124748:0:57713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57713:1874004626325120:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191331.124948:0:57713:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787191331.140327:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191331.140368:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634780288 00000100:00100000:3.0:1787191331.140376:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634780288 00000100:00100000:3.0:1787191331.140675:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 996 00000100:00100000:3.0:1787191331.140689:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634780288:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191331.140702:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc884838774 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x87:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e45fff90 expref: -99 pid: 57713 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.140785:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191331.140792:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634780288:12345-192.168.202.101@tcp:104: Request processed in 106us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191331.140799:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 996 00000100:00100000:3.0:1787191331.145277:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626326400:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191331.153869:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787191331.153881:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626326656:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191331.159949:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626326272:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191331.159987:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483877b lrc: 4/0,1 mode: --/EX res: [0x200000405:0x87:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fffa5 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.159999:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483877b lrc: 4/0,1 mode: --/CR res: [0x200000405:0x87:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fffa5 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.160010:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483877b lrc: 4/0,1 mode: CR/CR res: [0x200000405:0x87:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fffa5 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.160020:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483877b lrc: 4/0,1 mode: CR/CR res: [0x200000405:0x87:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fffa5 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.160032:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483877b lrc: 5/1,1 mode: CR/CR res: [0x200000405:0x87:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fffa5 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.160039:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483877b lrc: 5/1,1 mode: CR/CR res: [0x200000405:0x87:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fffa5 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.160044:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483877b lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x87:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fffa5 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191331.160053:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b6a474e00 x1874004626326272/t8589936035(8589936035) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191347 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191331.160081:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483877b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x87:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fffa5 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191331.160097:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483877b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x87:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fffa5 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.160109:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/135 (0 0) 00000080:00200000:3.0:1787191331.160126:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x87:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1787191331.160149:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x87:0x0](ffff936b489221c8) for lock 0xe5129dc88483877b 00000080:00010000:3.0:1787191331.160158:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483877b from it ffffa3fb41cab930 00010000:00010000:3.0:1787191331.160163:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483877b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x87:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fffa5 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.160172:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483877b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x87:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fffa5 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191331.160195:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:3.0:1787191331.160204:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x87:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:3.0:1787191331.160223:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483877b lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x87:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fffa5 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191331.160236:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483877b lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x87:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fffa5 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:3.0:1787191331.160246:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0x87:0x0](00000000a4c36dae) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483877b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x87:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fffa5 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191331.160295:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483877b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x87:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fffa5 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191331.160300:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483877b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x87:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fffa5 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191331.160312:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x87:0x0] ignore/verify layout 1/0, layout version 5 restore needed 0 00020000:00200000:3.0:1787191331.160323:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x87:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191331.160325:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191331.160332:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:3.0:1787191331.160369:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x87:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:3.0:1787191331.160379:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483877b lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x87:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fffa5 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191331.160385:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483877b lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x87:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fffa5 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:3.0:1787191331.160389:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0x87:0x0](00000000a4c36dae) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483877b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x87:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fffa5 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000100:00100000:3.0:1787191331.160866:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626326656:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00200000:3.0:1787191331.160918:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x87:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1787191331.160924:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x87:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191331.160926:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191331.160929:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:3.0:1787191331.160946:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x87:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:3.0:1787191331.160984:0:57570:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007a412388/0xe5129dc884838751 lrc: 1/0,0 mode: PR/PR res: [0x280000401:0x15b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e45fff3c expref: -99 pid: 57713 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000008:00010000:3.0:1787191331.161003:0:57570:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b9bf1031/0xe5129dc884838758 lrc: 1/0,0 mode: PR/PR res: [0x2c0000401:0x15e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e45fff43 expref: -99 pid: 57713 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191331.161070:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0x87:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:3.0:1787191331.161076:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483877b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x87:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e45fffa5 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191331.161086:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483877b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x87:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e45fffa5 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00020000:00200000:3.0:1787191331.161103:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0x87:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:3.0:1787191331.161107:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x87:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191331.161109:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191331.161128:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191331.161140:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1787191331.161144:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:3.0:1787191331.161158:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:3.0:1787191331.161163:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b5235c570, osc lock ffff936b44f64ab0, flags 0x80000000 00000008:00010000:3.0:1787191331.161167:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:3.0:1787191331.161168:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b5235c5b0, osc lock ffff936b44f64be0, flags 0x80000000 00010000:00010000:3.0:1787191331.161228:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000931bffc4/0xe5129dc884838789 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.161238:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000931bffc4/0xe5129dc884838789 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15d:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.161255:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000931bffc4/0xe5129dc884838789 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15d:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191331.161281:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626326912:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191331.161380:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191331.164828:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626326912:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191331.164899:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000931bffc4/0xe5129dc884838789 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x15d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fffd6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.164923:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000931bffc4/0xe5129dc884838789 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x15d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e45fffd6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.164935:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000931bffc4/0xe5129dc884838789 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x15d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e45fffd6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.164950:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000931bffc4/0xe5129dc884838789 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x15d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e45fffd6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191331.164962:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000931bffc4/0xe5129dc884838789 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x15d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e45fffd6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.164971:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000931bffc4/0xe5129dc884838789 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x15d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e45fffd6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.164982:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000931bffc4/0xe5129dc884838789 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x15d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e45fffd6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.165050:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000793f6478/0xe5129dc884838797 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.165056:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000793f6478/0xe5129dc884838797 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.165063:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000793f6478/0xe5129dc884838797 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191331.165080:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626327168:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191331.165173:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191331.167301:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634781696 00000100:00100000:3.0:1787191331.167313:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634781696 00000100:00100000:3.0:1787191331.167445:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 999 00000100:00100000:3.0:1787191331.167457:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:37089:x1874004634781696:12345-192.168.202.101@tcp:106: 00010000:00010000:3.0:1787191331.167475:0:51131:0:(ldlm_lockd.c:2541:ldlm_callback_handler()) ### glimpse ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000931bffc4/0xe5129dc884838789 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x15d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e45fffd6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.167490:0:51131:0:(ldlm_lockd.c:2123:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000931bffc4/0xe5129dc884838789 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x15d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e45fffd6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00010000:3.0:1787191331.167522:0:51131:0:(cl_object.c:322:cl_object_glimpse()) header@000000006f9502d7[0x110, 1, [0x200000405:0x87:0x0] hash] 00000020:00010000:3.0:1787191331.167525:0:51131:0:(cl_object.c:322:cl_object_glimpse()) size: 0 mtime: 1787191331 atime: 1787191331 ctime: 1787191331 blocks: 0 00000020:00010000:3.0:1787191331.167528:0:51131:0:(cl_object.c:322:cl_object_glimpse()) header@00000000a62d3e7e[0x110, 2, [0x2c0000401:0x15d:0x0] hash] 00000020:00010000:3.0:1787191331.167529:0:51131:0:(cl_object.c:322:cl_object_glimpse()) size: 0 mtime: 1787191331 atime: 1787191331 ctime: 1787191331 blocks: 0 00000100:00100000:3.0:1787191331.167581:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:37089:x1874004634781696:12345-192.168.202.101@tcp:106: Request processed in 128us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191331.167587:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 999 00000100:00100000:3.0:1787191331.214256:0:57713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57713:1874004626329344:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191331.214273:0:57713:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609a00/0xe5129dc8848387b3 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x87:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4600054 expref: -99 pid: 57713 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.214285:0:57713:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609a00/0xe5129dc8848387b3 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x87:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600054 expref: -99 pid: 57713 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191331.214294:0:57713:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b453a9500 x1874004626329344/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191347 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191331.214304:0:57713:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609a00/0xe5129dc8848387b3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x87:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600054 expref: -99 pid: 57713 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191331.214315:0:57713:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609a00/0xe5129dc8848387b3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x87:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600054 expref: -99 pid: 57713 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.214322:0:57713:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/135 (0 0) 00000080:00200000:3.0:1787191331.214328:0:57713:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x87:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1787191331.214339:0:57713:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x87:0x0](ffff936b489221c8) for lock 0xe5129dc8848387b3 00000080:00010000:3.0:1787191331.214344:0:57713:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848387b3 from it ffffa3fb41ed3bc8 00010000:00010000:3.0:1787191331.214348:0:57713:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609a00/0xe5129dc8848387b3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x87:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4600054 expref: -99 pid: 57713 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.214362:0:57713:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609a00/0xe5129dc8848387b3 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x87:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600054 expref: -99 pid: 57713 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191331.214377:0:57713:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609a00/0xe5129dc8848387b3 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x87:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600054 expref: -99 pid: 57713 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191331.214386:0:57713:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609a00/0xe5129dc8848387b3 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x87:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600054 expref: -99 pid: 57713 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:3.0:1787191331.215176:0:57713:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0x87:0x0](00000000a4c36dae) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609a00/0xe5129dc8848387b3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x87:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600054 expref: -99 pid: 57713 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1787191331.238885:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191331.272658:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626333184:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191331.272681:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483880e lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x88:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460015e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.272703:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483880e lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x88:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460015e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191331.272718:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b513b9180 x1874004626333184/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191347 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191331.272728:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483880e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x88:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460015e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191331.272740:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483880e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x88:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460015e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.272749:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/136 (0 0) 00000080:00200000:3.0:1787191331.272753:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x88:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1787191331.272769:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x88:0x0](ffff936b489221c8) for lock 0xe5129dc88483880e 00000080:00010000:3.0:1787191331.272774:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483880e from it ffffa3fb41cab8c8 00010000:00010000:3.0:1787191331.272778:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483880e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x88:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460015e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.272786:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483880e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x88:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460015e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191331.272804:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608e00/0xe5129dc884838807 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x88:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4600150 expref: -99 pid: 57716 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191331.272811:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608e00/0xe5129dc884838807 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x88:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4600150 expref: -99 pid: 57716 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:3.0:1787191331.272819:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0x88:0x0](00000000a4c36dae) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608e00/0xe5129dc884838807 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x88:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4600150 expref: -99 pid: 57716 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191331.272828:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608e00/0xe5129dc884838807 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x88:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4600150 expref: -99 pid: 57716 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191331.272855:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608e00/0xe5129dc884838807 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x88:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4600150 expref: -99 pid: 57716 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00020000:00200000:3.0:1787191331.272867:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0x88:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:3.0:1787191331.272875:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x88:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191331.272879:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0x88:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:3.0:1787191331.272885:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x88:0x0](ffff936b489221c8) 00000002:00010000:3.0:1787191331.272891:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x88:0x0]) in obj [0x200000405:0x88:0x0], intent: layout flags 02 00010000:00010000:3.0:1787191331.272907:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483880e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x88:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e460015e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191331.272923:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0x88:0x0]: losing layout lock 00010000:00010000:3.0:1787191331.272937:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608e00/0xe5129dc884838807 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x88:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4600150 expref: -99 pid: 57716 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787191331.272946:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0x88:0x0]: losing layout lock 00010000:00010000:3.0:1787191331.272976:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483880e lrc: 1/0,0 mode: --/CR res: [0x200000405:0x88:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e460015e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191331.272983:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608e00/0xe5129dc884838807 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x88:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4600150 expref: -99 pid: 57716 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191331.272990:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:3.0:1787191331.272994:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483880e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x88:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e460015e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191331.273006:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608e00/0xe5129dc884838807 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x88:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4600150 expref: -99 pid: 57716 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191331.273023:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884838815 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x88:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.273030:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884838815 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x88:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191331.273042:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191331.273049:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1dc00 x1874004626333440/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 384/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191331.273059:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884838815 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x88:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191331.273083:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626333440:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191331.273313:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787191331.275889:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634781952 00000100:00100000:3.0:1787191331.275901:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634781952 00000100:00100000:3.0:1787191331.276018:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1001 00000100:00100000:3.0:1787191331.276029:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634781952:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191331.276045:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc88483881c lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x88:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e4600165 expref: -99 pid: 57716 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.276141:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191331.276148:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634781952:12345-192.168.202.101@tcp:104: Request processed in 122us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191331.276156:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1001 00000100:00100000:3.0:1787191331.298766:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634783232 00000100:00100000:3.0:1787191331.298770:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634783232 00000100:00100000:3.0:1787191331.298802:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634783360 00000100:00100000:3.0:1787191331.298805:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634783360 00000100:00100000:3.0:1787191331.298818:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1003 00000100:00100000:3.0:1787191331.298824:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+5:30510:x1874004634783104:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191331.298864:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000931bffc4/0xe5129dc884838789 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e45fffd6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191331.298978:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191331.298986:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+5:30510:x1874004634783104:12345-192.168.202.101@tcp:104: Request processed in 161us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191331.298995:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1003 00000100:00100000:3.0:1787191331.299016:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1004 00000100:00100000:3.0:1787191331.299022:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8422:x1874004634783360:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191331.299031:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000793f6478/0xe5129dc884838797 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e45fffe4 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191331.301529:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787191331.301539:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8422:x1874004634783360:12345-192.168.202.101@tcp:104: Request processed in 2516us (2827us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191331.301551:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1004 00000100:00100000:3.0:1787191331.301649:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191331.301677:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634783488 00000100:00100000:3.0:1787191331.301684:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634783488 00000100:00100000:3.0:1787191331.301726:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1005 00000100:00100000:3.0:1787191331.301734:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8420:x1874004634783488:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191331.301747:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007a412388/0xe5129dc884838751 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x15b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e45fff3c expref: -99 pid: 57713 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191331.301965:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787191331.301970:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8420:x1874004634783488:12345-192.168.202.101@tcp:104: Request processed in 237us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191331.301980:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1005 00010000:00010000:3.0:1787191331.301995:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787191331.302002:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000793f6478/0xe5129dc884838797 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e45fffe4 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191331.302013:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9ae00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191331.302019:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000793f6478/0xe5129dc884838797 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e45fffe4 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191331.302056:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000793f6478/0xe5129dc884838797 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x15a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e45fffe4 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191331.302064:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191331.302084:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000793f6478/0xe5129dc884838797 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e45fffe4 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191331.302092:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000793f6478/0xe5129dc884838797 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e45fffe4 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191331.302106:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191331.302107:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191331.302109:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191331.302137:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626334976:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191331.302269:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626334848:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191331.306614:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626335232:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191331.306996:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626334976:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191331.307169:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626334848:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191331.311928:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626335104:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191331.311963:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483882a lrc: 4/0,1 mode: --/PW res: [0x280000401:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46001b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.311987:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483882a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e46001b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.312002:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483882a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e46001b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.312020:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483882a lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e46001b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191331.312034:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483882a lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e46001b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.312046:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483882a lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46001b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.312054:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483882a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46001b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.312150:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000793f6478/0xe5129dc884838831 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.312160:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000793f6478/0xe5129dc884838831 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.312172:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000793f6478/0xe5129dc884838831 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191331.312543:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626335360:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191331.312645:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191331.313034:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626335232:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191331.316037:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626335488:192.168.202.101@tcp:10:bash.0 00000100:00100000:3.0:1787191331.316138:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787191331.316149:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626335616:192.168.202.101@tcp:10:bash.0 00000100:00100000:3.0:1787191331.320030:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626335488:192.168.202.101@tcp:10:bash.0 00000080:00200000:3.0:1787191331.320309:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0x88:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1787191331.320318:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b42ff6038 (ffff936b465cc008/0) at cl_lock_release():245 00000020:00010000:3.0:1787191331.320322:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42ff6038 (ffff936b465cc008/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191331.320328:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99b70 (ffff936b465ccab8/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191331.320341:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483882a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46001b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.320359:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483882a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46001b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1787191331.320386:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99bb0 (ffff936b47a17c68/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191331.320505:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000793f6478/0xe5129dc884838831 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x15f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46001c0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.320517:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000793f6478/0xe5129dc884838831 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46001c0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1787191331.320530:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42ff6038 (ffff936b465cc008/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191331.320535:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99b70 (ffff936b465cc008/1) at cl_lock_fini():72 00000020:00010000:3.0:1787191331.320541:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99bb0 (ffff936b465cc008/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191331.320566:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x88:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191331.320583:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0x88:0x0](ffff936b489221c8) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191331.000000000, mtime 1787191331.000000000, ctime 1787191331.000000000, rc 0 00000080:00200008:3.0:1787191331.320675:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0x88:0x0], ppos: 0, count: 5 00000080:00200000:3.0:1787191331.320758:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:3.0:1787191331.320766:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:3.0:1787191331.320773:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:3.0:1787191331.320779:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:3.0:1787191331.320787:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@0000000062999b9a[0x110, 1, [0x200000405:0x88:0x0] hash] 00000020:00200000:3.0:1787191331.320790:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:3.0:1787191331.320795:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x88:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:3.0:1787191331.320815:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0x88:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:3.0:1787191331.320821:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x88:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191331.320825:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:3.0:1787191331.320941:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1787191331.320951:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:3.0:1787191331.320956:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000100:00100000:3.0:1787191331.343376:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634783616 00000100:00100000:3.0:1787191331.343771:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634783616 00000100:00100000:3.0:1787191331.344266:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1006 00000100:00100000:3.0:1787191331.344281:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634783616:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191331.344301:0:40921:0:(ldlm_lockd.c:2455:ldlm_callback_handler()) callback on lock 0xe5129dc884838838 - lock disappeared 00010000:00010000:3.0:1787191331.344427:0:40921:0:(ldlm_lockd.c:2352:ldlm_callback_errmsg()) @@@ Operate with invalid parameter, NID=12345-192.168.202.101@tcp lock=0xe5129dc884838838: rc = 0 req@ffff936b513b9500 x1874004634783616/t0(0) o104->f10005b0-4ec5-4888-9c81-49c0b11e82c4@192.168.202.101@tcp:642/0 lens 328/224 e 0 to 0 dl 1787191342 ref 1 fl Interpret:/0/0 rc -22/-22 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191331.344440:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634783616:12345-192.168.202.101@tcp:104: Request processed in 165us (4527us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787191331.344448:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1006 00000100:00100000:3.0:1787191331.378185:0:40922:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787191331.378270:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634783744 00000100:00100000:3.0:1787191331.378279:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634783744 00000100:00100000:3.0:1787191331.378340:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1007 00000100:00100000:3.0:1787191331.378351:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b50883850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:29543:x1874004634783744:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191331.378368:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483882a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420080000000 nid: local remote: 0x7130d520e46001b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00010000:00010000:3.0:1787191331.378457:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191331.378464:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b50883850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:29543:x1874004634783744:12345-192.168.202.101@tcp:104: Request processed in 114us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191331.378472:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1007 00000080:00200000:3.0:1787191331.385437:0:40930:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x88:0x0] ignore/verify layout 1/0, layout version 3 restore needed 0 00000080:00200000:3.0:1787191331.385508:0:40930:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x88:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1787191331.385575:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483882a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69480000020 nid: local remote: 0x7130d520e46001b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00010000:00010000:3.0:1787191331.385585:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191331.385763:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483882a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69480000020 nid: local remote: 0x7130d520e46001b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00010000:00010000:3.0:1787191331.385772:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483882a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69480000020 nid: local remote: 0x7130d520e46001b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00010000:00010000:3.0:1787191331.385799:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191331.385802:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191331.385804:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191331.404752:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191331.428698:0:57719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57719:1874004626339840:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191331.428749:0:57719:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a475180 x1874004626339328/t8589936065(8589936065) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191347 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:3.0:1787191331.428829:0:57719:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0x8a:0x0](ffff936b5396db88), flags 100001 00000002:00100000:3.0:1787191331.428919:0:57719:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a475c00 x1874004626338816/t8589936064(8589936064) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191347 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191331.428932:0:57719:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191331.428938:0:57719:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1f800 x1874004626340096/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191331.428964:0:57719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57719:1874004626340096:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191331.429065:0:57719:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787191331.436280:0:57719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57719:1874004626340096:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191331.436322:0:57719:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a475c00 x1874004626338816/t8589936064(8589936064) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191347 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787191331.452355:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626340352:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191331.452386:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc884838893 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46002fb expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.452417:0:57570:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc884838893 lrc: 4/0,1 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46002fb expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.452425:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc884838893 lrc: 4/0,1 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46002fb expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.452437:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc884838893 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46002fb expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.452449:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc884838893 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46002fb expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.452462:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc884838893 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46002fb expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.452470:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc884838893 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46002fb expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.452478:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc884838893 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46002fb expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191331.452495:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x2b, status=0 req@ffff936b513b8700 x1874004626340352/t8589936068(8589936068) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191347 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191331.452509:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b8700 x1874004626340352/t8589936068(8589936068) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191347 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191331.452522:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc884838893 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46002fb expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191331.452534:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc884838893 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46002fb expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.452659:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/138 (0 0) 00000080:00200000:3.0:1787191331.452665:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191331.452721:0:57570:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0x8a:0x0](ffff936b5396db88): rc = 0 00000080:00200000:3.0:1787191331.452737:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0x8a:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:3.0:1787191331.452743:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff936b5396db88) for lock 0xe5129dc884838893 00000080:00010000:3.0:1787191331.452754:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8a:0x0](ffff936b5396db88) 00000080:00200008:3.0:1787191331.452769:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0x8a:0x0](ffff936b5396db88), flags 101101 00000002:00100000:3.0:1787191331.452793:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b8700 x1874004626340352/t8589936068(8589936068) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191347 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1787191331.452829:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884838893 from it ffff936b60dc4000 00010000:00010000:3.0:1787191331.452866:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc884838893 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46002fb expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.452876:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc884838893 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46002fb expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191331.452906:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8a:0x0](ffff936b5396db88), inode mode 81a4 mask 42 00000002:00010000:3.0:1787191331.452936:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0x8a:0x0], intent: getxattr flags 0 00010000:00010000:3.0:1787191331.452977:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483889a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.452985:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483889a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.452995:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483889a lrc: 3/1,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191331.453015:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626340480:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191331.453105:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787191331.461031:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626340480:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191331.461071:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483889a lrc: 4/1,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600310 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.461093:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483889a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4600310 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.461107:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483889a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600310 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191331.461139:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b51d1fb80 x1874004626340480/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191347 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191331.461154:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483889a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600310 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.461170:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/138 (0 0) 00000080:00200000:3.0:1787191331.461178:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0x8a:0x0] suppgids 0 -1: rc 0 00000080:00010000:3.0:1787191331.461228:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8a:0x0](ffff936b5396db88) for lock 0xe5129dc88483889a 00000080:00010000:3.0:1787191331.461239:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483889a from it ffffa3fb41caba38 00010000:00010000:3.0:1787191331.461244:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483889a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4600310 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.461255:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483889a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600310 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:3.0:1787191331.461306:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0x8a:0x0](ffff936b5396db88) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191331.000000000, mtime 1787191331.000000000, ctime 1787191331.000000000 00010000:00010000:3.0:1787191331.461347:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc884838893 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46002fb expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191331.461372:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0x8a:0x0]: losing layout lock 00010000:00010000:3.0:1787191331.461623:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc884838893 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46002fb expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191331.461632:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191331.461635:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc884838893 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46002fb expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:3.0:1787191331.461659:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1787191331.461667:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1fb80 x1874004626340736/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191331.461952:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626340736:192.168.202.101@tcp:36:bash.0 00000100:00100000:3.0:1787191331.462060:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787191331.466076:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626340736:192.168.202.101@tcp:36:bash.0 00000080:00200000:3.0:1787191331.466157:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:3.0:1787191331.466167:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x8a:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00010000:00010000:3.0:1787191331.466193:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/138 (0 0) 00000080:00010000:3.0:1787191331.466221:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x8a:0x0](ffff936b5396db88) 00000002:00010000:3.0:1787191331.466236:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x8a:0x0]) in obj [0x200000405:0x8a:0x0], intent: layout flags 0 00010000:00010000:3.0:1787191331.466313:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc8848388a1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.466324:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc8848388a1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.466336:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc8848388a1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191331.466361:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626340864:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191331.466480:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787191331.490778:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626341376:192.168.202.101@tcp:23:lfs.0 00000080:00200000:3.0:1787191331.513043:0:57717:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1787191331.513061:0:57717:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x88:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191331.513066:0:57717:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 1 io complete with rc: 0, result: 5, restart: 0 00000020:00200000:3.0:1787191331.513070:0:57717:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191331.513078:0:57717:0:(file.c:2324:ll_file_io_generic()) iot: 1, result: 5 00000080:00200080:3.0:1787191331.513124:0:57717:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x88:0x0](ffff936b489221c8) cmd=400866b1 arg=0 00000080:00200080:3.0:1787191331.513136:0:57717:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x88:0x0](ffff936b489221c8) cmd=400866b1 arg=2 00000080:00200008:3.0:1787191331.513143:0:57717:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0x88:0x0](ffff936b489221c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191331.513151:0:57717:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x88:0x0](ffff936b489221c8),name=f70.sanity-flr 00000002:00010000:3.0:1787191331.513174:0:57717:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x88:0x0]) in obj [0x200000405:0x88:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191331.513188:0:57717:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483887e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x88:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46002c3 expref: -99 pid: 57717 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191331.513201:0:57717:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483887e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x88:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46002c3 expref: -99 pid: 57717 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787191331.513209:0:57717:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x88:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191331.513216:0:57717:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x88:0x0](ffff936b489221c8) 00000080:00010000:3.0:1787191331.513220:0:57717:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x88:0x0](ffff936b489221c8) for lock 0xe5129dc88483887e 00000080:00010000:3.0:1787191331.513229:0:57717:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483887e from it ffffa3fb41f1bcd8 00010000:00010000:3.0:1787191331.513232:0:57717:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483887e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x88:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46002c3 expref: -99 pid: 57717 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191331.513242:0:57717:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483887e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x88:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46002c3 expref: -99 pid: 57717 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:3.0:1787191331.513264:0:57717:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x88:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:3.0:1787191331.513273:0:57717:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x88:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191331.513276:0:57717:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191331.513279:0:57717:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x88:0x0] 00000008:00010000:3.0:1787191331.513297:0:57717:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191331.513301:0:57717:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667230, osc lock ffff936b44f64390, flags 0x400000400001002 00010000:00010000:3.0:1787191331.513317:0:57717:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000014cd24a9/0xe5129dc88483888c lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x15c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46002d8 expref: -99 pid: 57717 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00010000:00010000:3.0:1787191331.513330:0:57717:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000014cd24a9/0xe5129dc88483888c lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46002d8 expref: -99 pid: 57717 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00000020:00200000:3.0:1787191331.513346:0:57717:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191331.513349:0:57717:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000014cd24a9/0xe5129dc88483888c lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46002d8 expref: -99 pid: 57717 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00010000:00010000:3.0:1787191331.513356:0:57717:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000014cd24a9/0xe5129dc88483888c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46002d8 expref: -99 pid: 57717 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 1 00000020:00200000:3.0:1787191331.513366:0:57717:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191331.513374:0:57717:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0x88:0x0] updating i_size 5 i_blocks 8 00000020:00010000:3.0:1787191331.513378:0:57717:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b516569a0 (ffff936b465cc1b8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191331.513382:0:57717:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b516569a0 (ffff936b465cc1b8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191331.513385:0:57717:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667230 (ffff936b465cc518/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191331.513388:0:57717:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b516569a0 (ffff936b465cc1b8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191331.513391:0:57717:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667230 (ffff936b465cc1b8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191331.513398:0:57717:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x88:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191331.513419:0:57717:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0x88:0x0], ppos: 0, count: 4096 00000080:00200000:3.0:1787191331.513425:0:57717:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 4096 00000080:00200000:3.0:1787191331.513433:0:57717:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 2 00000020:00200000:3.0:1787191331.513439:0:57717:0:(cl_io.c:214:cl_io_rw_init()) header@0000000062999b9a[0x110, 2, [0x200000405:0x88:0x0] hash] 00000020:00200000:3.0:1787191331.513441:0:57717:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 4096) 2048 0 00000080:00200000:3.0:1787191331.513443:0:57717:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x88:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00000080:00200000:3.0:1787191331.513452:0:57717:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1787191331.513458:0:57717:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:3.0:1787191331.513462:0:57717:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x11 00000080:00200000:3.0:1787191331.513475:0:57717:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:3.0:1787191331.513483:0:57717:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:3.0:1787191331.513486:0:57717:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667230, osc lock ffff936b44f64390, flags 0x40000 00000080:00200000:3.0:1787191331.513493:0:57717:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 4096) append 0 append lockpos 0 00000002:00010000:3.0:1787191331.513515:0:57717:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0x88:0x0], intent: getxattr flags 0 00010000:00010000:3.0:1787191331.513549:0:57717:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b200/0xe5129dc8848388b6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x88:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.513555:0:57717:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b200/0xe5129dc8848388b6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x88:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.513562:0:57717:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b200/0xe5129dc8848388b6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x88:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57717 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191331.513576:0:57717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57717:1874004626341760:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191331.513731:0:57717:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191331.520513:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000080:00200000:3.0:1787191331.534684:0:57717:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1787191331.534716:0:57717:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x88:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191331.534721:0:57717:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:3.0:1787191331.534736:0:57717:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0x88:0x0] updating i_size 5 i_blocks 8 00000020:00200000:3.0:1787191331.534740:0:57717:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191331.534753:0:57717:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200080:3.0:1787191331.534776:0:57717:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x88:0x0](ffff936b489221c8) cmd=400866b1 arg=0 00000080:00200080:3.0:1787191331.534787:0:57717:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x88:0x0](ffff936b489221c8) cmd=400866b1 arg=1 00000080:00200008:3.0:1787191331.534795:0:57717:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0x88:0x0](ffff936b489221c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191331.534804:0:57717:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x88:0x0](ffff936b489221c8),name=f70.sanity-flr 00000002:00010000:3.0:1787191331.534867:0:57717:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x88:0x0]) in obj [0x200000405:0x88:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191331.534888:0:57717:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483887e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x88:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46002c3 expref: -99 pid: 57717 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191331.534904:0:57717:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483887e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x88:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46002c3 expref: -99 pid: 57717 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:3.0:1787191331.534919:0:57717:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x88:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191331.534930:0:57717:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x88:0x0](ffff936b489221c8) 00000080:00010000:3.0:1787191331.534933:0:57717:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x88:0x0](ffff936b489221c8) for lock 0xe5129dc88483887e 00000080:00010000:3.0:1787191331.534942:0:57717:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483887e from it ffffa3fb41f1bcd8 00010000:00010000:3.0:1787191331.534947:0:57717:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483887e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x88:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46002c3 expref: -99 pid: 57717 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191331.534957:0:57717:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483887e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x88:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46002c3 expref: -99 pid: 57717 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00000080:00200000:3.0:1787191331.534985:0:57717:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x88:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:3.0:1787191331.534996:0:57717:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x88:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191331.534999:0:57717:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191331.535004:0:57717:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x88:0x0] 00000008:00010000:3.0:1787191331.535027:0:57717:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191331.535031:0:57717:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667730, osc lock ffff936b44f644c0, flags 0x400000400001002 00010000:00010000:3.0:1787191331.535050:0:57717:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000014cd24a9/0xe5129dc88483888c lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x15c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46002d8 expref: -99 pid: 57717 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 1 00010000:00010000:3.0:1787191331.535062:0:57717:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000014cd24a9/0xe5129dc88483888c lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46002d8 expref: -99 pid: 57717 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 1 00000020:00200000:3.0:1787191331.535074:0:57717:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191331.535077:0:57717:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000014cd24a9/0xe5129dc88483888c lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46002d8 expref: -99 pid: 57717 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 1 00010000:00010000:3.0:1787191331.535091:0:57717:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000014cd24a9/0xe5129dc88483888c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46002d8 expref: -99 pid: 57717 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00000020:00200000:3.0:1787191331.535101:0:57717:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191331.535121:0:57717:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0x88:0x0] updating i_size 5 i_blocks 8 00000020:00010000:3.0:1787191331.535125:0:57717:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b516569a0 (ffff936b465cc1b8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191331.535128:0:57717:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b516569a0 (ffff936b465cc1b8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191331.535131:0:57717:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667730 (ffff936b465cc518/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191331.535135:0:57717:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b516569a0 (ffff936b465cc1b8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191331.535138:0:57717:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667730 (ffff936b465cc1b8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191331.535146:0:57717:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x88:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191331.535157:0:57717:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0x88:0x0], offset: 5, type: SEEK_DATA 00000080:00200000:3.0:1787191331.535163:0:57717:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x88:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:3.0:1787191331.535167:0:57717:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x88:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191331.535170:0:57717:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191331.535174:0:57717:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191331.535180:0:57717:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1787191331.535195:0:57717:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0x88:0x0] updating i_size 5 i_blocks 8 00000080:00200000:3.0:1787191331.535212:0:57717:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x88:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191331.535217:0:57717:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000080:00200000:3.0:1787191331.535219:0:57717:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x88:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:3.0:1787191331.535223:0:57717:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191331.535226:0:57717:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1787191331.535229:0:57717:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:3.0:1787191331.535235:0:57717:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:3.0:1787191331.535237:0:57717:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667730, osc lock ffff936b44f644c0, flags 0x0 00010000:00010000:3.0:1787191331.535244:0:57717:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000014cd24a9/0xe5129dc88483888c lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x15c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46002d8 expref: -99 pid: 57717 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:3.0:1787191331.535255:0:57717:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000014cd24a9/0xe5129dc88483888c lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46002d8 expref: -99 pid: 57717 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:3.0:1787191331.535265:0:57717:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000014cd24a9/0xe5129dc88483888c lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46002d8 expref: -99 pid: 57717 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:3.0:1787191331.535274:0:57717:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000014cd24a9/0xe5129dc88483888c lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46002d8 expref: -99 pid: 57717 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:3.0:1787191331.535282:0:57717:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000014cd24a9/0xe5129dc88483888c lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46002d8 expref: -99 pid: 57717 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00000080:00200000:3.0:1787191331.535292:0:57717:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0x88:0x0] updating i_size 5 i_blocks 8 00000020:00010000:3.0:1787191331.535297:0:57717:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b42ff66c8 (ffff936b465cc1b8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191331.535300:0:57717:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42ff66c8 (ffff936b465cc1b8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191331.535304:0:57717:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667730 (ffff936b465cc518/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191331.535308:0:57717:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000014cd24a9/0xe5129dc88483888c lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46002d8 expref: -99 pid: 57717 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:3.0:1787191331.535316:0:57717:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000014cd24a9/0xe5129dc88483888c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46002d8 expref: -99 pid: 57717 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00000020:00010000:3.0:1787191331.535325:0:57717:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42ff66c8 (ffff936b465cc1b8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191331.535328:0:57717:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667730 (ffff936b465cc1b8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191331.535334:0:57717:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x88:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191331.535341:0:57717:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0x88:0x0], offset: 0, type: (null) 00000080:00200000:3.0:1787191331.535345:0:57717:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x88:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:3.0:1787191331.535349:0:57717:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x88:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191331.535352:0:57717:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191331.535354:0:57717:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x88:0x0] 00000008:00010000:3.0:1787191331.535359:0:57717:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191331.535361:0:57717:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667730, osc lock ffff936b44f644c0, flags 0x400000400001002 00010000:00010000:3.0:1787191331.535367:0:57717:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000014cd24a9/0xe5129dc88483888c lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x15c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46002d8 expref: -99 pid: 57717 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00010000:00010000:3.0:1787191331.535375:0:57717:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000014cd24a9/0xe5129dc88483888c lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46002d8 expref: -99 pid: 57717 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00000020:00200000:3.0:1787191331.535383:0:57717:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191331.535385:0:57717:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000014cd24a9/0xe5129dc88483888c lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46002d8 expref: -99 pid: 57717 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00010000:00010000:3.0:1787191331.535645:0:57717:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000014cd24a9/0xe5129dc88483888c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46002d8 expref: -99 pid: 57717 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00000020:00200000:3.0:1787191331.535660:0:57717:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191331.535665:0:57717:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0x88:0x0] updating i_size 5 i_blocks 8 00000020:00010000:3.0:1787191331.535667:0:57717:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b516569a0 (ffff936b465cc1b8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191331.535670:0:57717:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b516569a0 (ffff936b465cc1b8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191331.535672:0:57717:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667730 (ffff936b465cc518/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191331.535675:0:57717:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b516569a0 (ffff936b465cc1b8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191331.535678:0:57717:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667730 (ffff936b465cc1b8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191331.535731:0:57717:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x88:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191331.535741:0:57717:0:(file.c:5244:ll_file_seek()) COMPLETED file f70.sanity-flr:[0x200000405:0x88:0x0], offset: 0, type: (null), rc = 5 00000080:00200080:3.0:1787191331.535747:0:57717:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x88:0x0](ffff936b489221c8) cmd=400866b1 arg=0 00000080:00200080:3.0:1787191331.551068:0:57717:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x88:0x0](ffff936b489221c8) cmd=400866b1 arg=2 00000080:00200008:3.0:1787191331.551093:0:57717:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0x88:0x0](ffff936b489221c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191331.551102:0:57717:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x88:0x0](ffff936b489221c8),name=f70.sanity-flr 00000002:00010000:3.0:1787191331.554961:0:57717:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x88:0x0]) in obj [0x200000405:0x88:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191331.554990:0:57717:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483887e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x88:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46002c3 expref: -99 pid: 57717 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00010000:00010000:3.0:1787191331.555006:0:57717:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483887e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x88:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46002c3 expref: -99 pid: 57717 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00000080:00200000:3.0:1787191331.555013:0:57717:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x88:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191331.555023:0:57717:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x88:0x0](ffff936b489221c8) 00000080:00010000:3.0:1787191331.555027:0:57717:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x88:0x0](ffff936b489221c8) for lock 0xe5129dc88483887e 00000080:00010000:3.0:1787191331.555035:0:57717:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483887e from it ffffa3fb41f1bcd8 00010000:00010000:3.0:1787191331.555038:0:57717:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483887e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x88:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46002c3 expref: -99 pid: 57717 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00010000:00010000:3.0:1787191331.555045:0:57717:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483887e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x88:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46002c3 expref: -99 pid: 57717 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00000080:00200000:3.0:1787191331.555092:0:57717:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x88:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:3.0:1787191331.555109:0:57717:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x88:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191331.555122:0:57717:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191331.555127:0:57717:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x88:0x0] 00000008:00010000:3.0:1787191331.555157:0:57717:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191331.555163:0:57717:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667730, osc lock ffff936b44f644c0, flags 0x400000400001002 00010000:00010000:3.0:1787191331.555189:0:57717:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000014cd24a9/0xe5129dc88483888c lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x15c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46002d8 expref: -99 pid: 57717 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00010000:00010000:3.0:1787191331.555277:0:57717:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000014cd24a9/0xe5129dc88483888c lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46002d8 expref: -99 pid: 57717 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00000020:00200000:3.0:1787191331.555296:0:57717:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191331.555303:0:57717:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000014cd24a9/0xe5129dc88483888c lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46002d8 expref: -99 pid: 57717 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00010000:00010000:3.0:1787191331.555314:0:57717:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000014cd24a9/0xe5129dc88483888c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46002d8 expref: -99 pid: 57717 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00000020:00200000:3.0:1787191331.555331:0:57717:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191331.555345:0:57717:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0x88:0x0] updating i_size 5 i_blocks 8 00000020:00010000:3.0:1787191331.555351:0:57717:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b516569a0 (ffff936b465cc1b8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191331.555355:0:57717:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b516569a0 (ffff936b465cc1b8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191331.555358:0:57717:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667730 (ffff936b465cc518/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191331.555364:0:57717:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b516569a0 (ffff936b465cc1b8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191331.555368:0:57717:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667730 (ffff936b465cc1b8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191331.555384:0:57717:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x88:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191331.555447:0:57717:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0x88:0x0](ffff936b489221c8) current size 5, valid attrs 2068, mode 0, uid -1322410190, gid -1, new size 5, atime 1787191331.000000000, mtime 1787191331.000000000, ctime 1787191331.000000000 00010000:00010000:3.0:1787191331.555473:0:57717:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483887e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x88:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46002c3 expref: -99 pid: 57717 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00010000:00010000:3.0:1787191331.555509:0:57717:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc884838877 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x88:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46002b5 expref: -99 pid: 57717 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191331.555559:0:57717:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483887e lrc: 1/0,0 mode: --/PR res: [0x200000405:0x88:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46002c3 expref: -99 pid: 57717 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00010000:00010000:3.0:1787191331.555570:0:57717:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191331.555574:0:57717:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483887e lrc: 0/0,0 mode: --/PR res: [0x200000405:0x88:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46002c3 expref: -99 pid: 57717 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00000020:00100000:3.0:1787191331.555593:0:57717:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1787191331.555605:0:57717:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1e300 x1874004626343296/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191331.555628:0:57717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57717:1874004626343296:192.168.202.101@tcp:36:lfs.0 00000100:00100000:3.0:1787191331.555965:0:57717:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c840 going to sleep for 11 seconds 00000100:00100000:3.0:1787191331.574754:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191331.574797:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634785152 00000100:00100000:3.0:1787191331.574807:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634785152 00000100:00100000:3.0:1787191331.574881:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1010 00000100:00100000:3.0:1787191331.574892:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30510:x1874004634785152:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191331.574911:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008b8a9ddc/0xe5129dc8848387f2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x15d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46000fc expref: -99 pid: 57716 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191331.574994:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191331.575003:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30510:x1874004634785152:12345-192.168.202.101@tcp:104: Request processed in 113us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191331.575011:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1010 00000100:00100000:3.0:1787191331.578472:0:57717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57717:1874004626343680:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191331.578508:0:57717:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b9bf1031/0xe5129dc8848388d9 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x15d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x80000020000 nid: local remote: 0x7130d520e46003a3 expref: -99 pid: 57717 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.578536:0:57717:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b9bf1031/0xe5129dc8848388d9 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x15d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000020000 nid: local remote: 0x7130d520e46003a3 expref: -99 pid: 57717 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191331.578554:0:57717:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b9bf1031/0xe5129dc8848388d9 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x15d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000020000 nid: local remote: 0x7130d520e46003a3 expref: -99 pid: 57717 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.578569:0:57717:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b9bf1031/0xe5129dc8848388d9 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x15d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e46003a3 expref: -99 pid: 57717 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.578579:0:57717:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b9bf1031/0xe5129dc8848388d9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x15d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e46003a3 expref: -99 pid: 57717 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1787191331.591525:0:57717:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0x88:0x0] updating i_size 5 i_blocks 8 00000020:00010000:3.0:1787191331.591534:0:57717:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b53cc5c68 (ffff936b47a17908/0) at cl_lock_release():245 00000020:00010000:3.0:1787191331.591538:0:57717:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b53cc5c68 (ffff936b47a17908/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191331.591542:0:57717:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99870 (ffff936b47a172d8/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191331.591553:0:57717:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000004c213878/0xe5129dc8848388cb lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x160:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460039c expref: -99 pid: 57717 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.591584:0:57717:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000004c213878/0xe5129dc8848388cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x160:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460039c expref: -99 pid: 57717 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1787191331.591617:0:57717:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f998b0 (ffff936b47a17128/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191331.591637:0:57717:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b9bf1031/0xe5129dc8848388d9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x15d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e46003a3 expref: -99 pid: 57717 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.591651:0:57717:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b9bf1031/0xe5129dc8848388d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e46003a3 expref: -99 pid: 57717 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1787191331.591755:0:57717:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b53cc5c68 (ffff936b47a17908/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191331.591759:0:57717:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99870 (ffff936b47a17908/1) at cl_lock_fini():72 00000020:00010000:3.0:1787191331.591765:0:57717:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f998b0 (ffff936b47a17908/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191331.592457:0:57717:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x88:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191331.592493:0:57717:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0x88:0x0](ffff936b489221c8) current size 5, valid attrs 10002168, mode 0, uid -1322410190, gid -1, new size 5, atime 1787191331.000000000, mtime 1787191331.000000000, ctime 1787191331.000000000, rc 0 00000080:00200080:3.0:1787191331.592514:0:57717:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x88:0x0](ffff936b489221c8) cmd=400866b1 arg=0 00000080:00200008:3.0:1787191331.592548:0:57717:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0x88:0x0](ffff936b489221c8) current size 5, valid attrs 101f0, mode a3fb, uid 1628898576, gid -27797, new size 18446624687721161160, atime 1787191331.000000000, mtime 1787191331.000000000, ctime 1787191331.000000000 00000020:00100000:3.0:1787191331.592614:0:57717:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1787191331.592625:0:57717:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1d180 x1874004626344576/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191331.592653:0:57717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57717:1874004626344576:192.168.202.101@tcp:36:lfs.0 00000100:00100000:3.0:1787191331.611729:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634785408 00000100:00100000:3.0:1787191331.611739:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634785408 00000100:00100000:3.0:1787191331.611828:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1012 00000100:00100000:3.0:1787191331.611874:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6509:x1874004634785408:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191331.611892:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc884838877 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x88:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46002b5 expref: -99 pid: 57717 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191331.611970:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191331.611977:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6509:x1874004634785408:12345-192.168.202.101@tcp:104: Request processed in 106us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191331.611984:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1012 00000100:00100000:3.0:1787191331.624680:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634786048 00000100:00100000:3.0:1787191331.624690:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634786048 00000100:00100000:3.0:1787191331.624775:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1013 00000100:00100000:3.0:1787191331.624786:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30511:x1874004634786048:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191331.624804:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003b2ea1d7/0xe5129dc8848388bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4600341 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191331.624915:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191331.624922:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30511:x1874004634786048:12345-192.168.202.101@tcp:104: Request processed in 138us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191331.624929:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1013 00000100:00100000:3.0:1787191331.629646:0:51131:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787191331.629664:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634786176 00000100:00100000:3.0:1787191331.629673:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634786176 00000100:00100000:3.0:1787191331.629726:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1014 00000100:00100000:3.0:1787191331.629736:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b4121c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634786176:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191331.629755:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc8848388f5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e460041a expref: -99 pid: 57721 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191331.629858:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191331.629866:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b4121c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634786176:12345-192.168.202.101@tcp:104: Request processed in 132us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191331.629873:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1014 00000100:00100000:3.0:1787191331.640975:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626346240:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191331.702219:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634787840 00000100:00100000:3.0:1787191331.702241:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634787840 00000100:00100000:3.0:1787191331.702344:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1015 00000100:00100000:3.0:1787191331.702356:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8422:x1874004634787840:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191331.702381:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000014cd24a9/0xe5129dc88483888c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x15c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e46002d8 expref: -99 pid: 57717 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:3.0:1787191331.702576:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191331.702583:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8422:x1874004634787840:12345-192.168.202.101@tcp:104: Request processed in 230us (8767us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191331.702591:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1015 00000100:00100000:3.0:1787191331.705891:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1018 00000100:00100000:3.0:1787191331.705908:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8419:x1874004634788352:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191331.705926:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000004c213878/0xe5129dc8848388cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x160:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e460039c expref: -99 pid: 57717 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191331.706004:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191331.706014:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8419:x1874004634788352:12345-192.168.202.101@tcp:104: Request processed in 111us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191331.706036:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1018 00000100:00100000:3.0:1787191331.706138:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191331.706166:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634788480 00000100:00100000:3.0:1787191331.706175:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634788480 00000100:00100000:3.0:1787191331.706220:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1019 00000100:00100000:3.0:1787191331.706230:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+5:30510:x1874004634788480:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191331.706240:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc884838911 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x160:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e460048a expref: -99 pid: 57717 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191331.706276:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191331.706282:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+5:30510:x1874004634788480:12345-192.168.202.101@tcp:104: Request processed in 54us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191331.706288:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1019 00000100:00100000:3.0:1787191331.717557:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634788608 00000100:00100000:3.0:1787191331.717566:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634788608 00000100:00100000:3.0:1787191331.717664:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1020 00000100:00100000:3.0:1787191331.717674:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:37090:x1874004634788608:12345-192.168.202.101@tcp:105: 00010000:00010000:3.0:1787191331.717686:0:40921:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008d34baf3/0xe5129dc88483893b lrc: 5/0,1 mode: --/PW res: [0x280000401:0x160:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4600508 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.717697:0:40921:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008d34baf3/0xe5129dc88483893b lrc: 5/0,1 mode: --/PW res: [0x280000401:0x160:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4600508 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.717706:0:40921:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008d34baf3/0xe5129dc88483893b lrc: 5/0,1 mode: --/PW res: [0x280000401:0x160:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e4600508 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.717715:0:40921:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008d34baf3/0xe5129dc88483893b lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x160:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080080020000 nid: local remote: 0x7130d520e4600508 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.717724:0:40921:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008d34baf3/0xe5129dc88483893b lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x160:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080080020000 nid: local remote: 0x7130d520e4600508 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.717735:0:40921:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008d34baf3/0xe5129dc88483893b lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x160:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80080020000 nid: local remote: 0x7130d520e4600508 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.717764:0:40921:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b51dd5a00) 00000100:00100000:3.0:1787191331.717822:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:37090:x1874004634788608:12345-192.168.202.101@tcp:105: Request processed in 149us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191331.717927:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1020 00000080:00200000:3.0:1787191331.725476:0:57722:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0x8c:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1787191331.725482:0:57722:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51656500 (ffff936b465cc008/0) at cl_lock_release():245 00000020:00010000:3.0:1787191331.725485:0:57722:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51656500 (ffff936b465cc008/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191331.725490:0:57722:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7d230 (ffff936b47a17488/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191331.725494:0:57722:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51656500 (ffff936b465cc008/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191331.725497:0:57722:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7d230 (ffff936b465cc008/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191331.725531:0:57722:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x8c:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191331.725597:0:57722:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0x8c:0x0](ffff936b5395d348), flags 154000 00000002:00100000:3.0:1787191331.725651:0:57722:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453aa300 x1874004626349696/t8589936090(8589936090) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191347 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191331.725662:0:57722:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191331.725667:0:57722:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1ce00 x1874004626351104/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191331.725687:0:57722:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ce00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57722:1874004626351104:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191331.725754:0:57722:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191331.738277:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191331.739237:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634788864 00000100:00100000:3.0:1787191331.739251:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634788864 00000100:00100000:3.0:1787191331.739320:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1022 00000100:00100000:3.0:1787191331.739332:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634788864:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191331.739348:0:40921:0:(ldlm_lockd.c:2455:ldlm_callback_handler()) callback on lock 0xe5129dc884838942 - lock disappeared 00010000:00010000:3.0:1787191331.739427:0:40921:0:(ldlm_lockd.c:2352:ldlm_callback_errmsg()) @@@ Operate with invalid parameter, NID=12345-192.168.202.101@tcp lock=0xe5129dc884838942: rc = 0 req@ffff936b51d1d500 x1874004634788864/t0(0) o104->f10005b0-4ec5-4888-9c81-49c0b11e82c4@192.168.202.101@tcp:642/0 lens 328/224 e 0 to 0 dl 1787191342 ref 1 fl Interpret:/0/0 rc -22/-22 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191331.739443:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634788864:12345-192.168.202.101@tcp:104: Request processed in 112us (1250us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787191331.739456:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1022 00000100:00100000:3.0:1787191331.747625:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191331.761771:0:57722:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57722:1874004626352384:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191331.761810:0:57722:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc884838965 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x8c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4600586 expref: -99 pid: 57722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.761827:0:57722:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc884838965 lrc: 4/1,0 mode: --/PW res: [0x200000405:0x8c:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4600586 expref: -99 pid: 57722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.761879:0:57722:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc884838965 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x8c:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4600586 expref: -99 pid: 57722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.761893:0:57722:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc884838965 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x8c:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4600586 expref: -99 pid: 57722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.761910:0:57722:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc884838965 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x8c:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4600586 expref: -99 pid: 57722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.761925:0:57722:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc884838965 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x8c:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4600586 expref: -99 pid: 57722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.761933:0:57722:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc884838965 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x8c:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4600586 expref: -99 pid: 57722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191331.761949:0:57722:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x600002b, status=0 req@ffff936b453a8a80 x1874004626352384/t8589936095(8589936095) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191347 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191331.761967:0:57722:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8a80 x1874004626352384/t8589936095(8589936095) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191347 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191331.761986:0:57722:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc884838965 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8c:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4600586 expref: -99 pid: 57722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.762000:0:57722:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 2 res 8589935621/140 (0 0) 00000080:00200000:3.0:1787191331.762007:0:57722:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x8c:0x0] suppgids 0 0: rc 0 00000002:00100000:3.0:1787191331.762034:0:57722:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8a80 x1874004626352384/t8589936095(8589936095) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191347 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1787191331.762042:0:57722:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8c:0x0](ffff936b5395d348) for lock 0xe5129dc884838965 00000080:00010000:3.0:1787191331.762049:0:57722:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884838965 from it ffffa3fb41ed3cc0 00010000:00010000:3.0:1787191331.762052:0:57722:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc884838965 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x8c:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4600586 expref: -99 pid: 57722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.762060:0:57722:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc884838965 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x8c:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4600586 expref: -99 pid: 57722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1787191331.762149:0:57722:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x8c:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:3.0:1787191331.762165:0:57722:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x8c:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191331.762170:0:57722:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191331.762179:0:57722:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191331.762203:0:57722:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000100:00100000:3.0:1787191331.762287:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787191331.762308:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626352512:192.168.202.101@tcp:1:lfs.0 00000100:00100000:3.0:1787191331.766080:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191331.775660:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626352896:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191331.782582:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626352896:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191331.782631:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626352512:192.168.202.101@tcp:1:lfs.0 00000080:00200000:3.0:1787191331.818751:0:57722:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0x8c:0x0] updating i_size 5 i_blocks 8 00000020:00010000:3.0:1787191331.818764:0:57722:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b516569a0 (ffff936b465cc1b8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191331.818770:0:57722:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b516569a0 (ffff936b465cc1b8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191331.818776:0:57722:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7dd30 (ffff936b465cc518/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191331.818783:0:57722:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b516569a0 (ffff936b465cc1b8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191331.818786:0:57722:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7dd30 (ffff936b465cc1b8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191331.818804:0:57722:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x8c:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:3.0:1787191331.823628:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191331.823701:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634789760 00000100:00100000:3.0:1787191331.823716:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634789760 00000100:00100000:3.0:1787191331.823794:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1025 00000100:00100000:3.0:1787191331.823808:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634789760:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191331.823874:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1c00/0xe5129dc884838996 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4600619 expref: -99 pid: 57724 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191331.824062:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191331.824070:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634789760:12345-192.168.202.101@tcp:104: Request processed in 265us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191331.824079:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1025 00000080:00200000:3.0:1787191331.874654:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191331.874692:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191331.874881:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191331.874902:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191331.874911:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191331.874921:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191331.874924:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191331.874933:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:3.0:1787191331.874936:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191331.874946:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191331.874965:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191331.874972:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191331.874981:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191331.874997:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:3.0:1787191331.875002:0:57570:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b464a8d80, open_flags 8241, mode 81b6 opened 0 00000080:00200000:3.0:1787191331.875013:0:57570:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:3.0:1787191331.875038:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0x8e:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0101102 00010000:00010000:3.0:1787191331.875097:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848389ab lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191331.875107:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848389ab lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191331.875131:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191331.875146:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1c380 x1874004626355328/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191331.875157:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848389ab lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191331.875183:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626355328:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191331.875349:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cf00 going to sleep for 11 seconds 00010000:00010000:3.0:1787191331.986288:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191331.998513:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626358528:192.168.202.101@tcp:10:lfs.0 00000100:00100000:3.0:1787191331.998609:0:2392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787191331.998617:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626358656:192.168.202.101@tcp:10:lfs.0 00000100:00100000:3.0:1787191332.004620:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626358528:192.168.202.101@tcp:10:lfs.0 00000100:00100000:3.0:1787191332.017671:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634790400 00000100:00100000:3.0:1787191332.017680:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634790400 00000100:00100000:3.0:1787191332.017768:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1026 00000100:00100000:3.0:1787191332.017777:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:29543:x1874004634790400:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191332.017794:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483899d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x160:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000000000 nid: local remote: 0x7130d520e4600627 expref: -99 pid: 57722 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:3.0:1787191332.017896:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191332.017903:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:29543:x1874004634790400:12345-192.168.202.101@tcp:104: Request processed in 127us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191332.017912:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1026 00000100:00100000:3.0:1787191332.025001:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191332.055986:0:57726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57726:1874004626360448:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191332.056017:0:57726:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc884838a14 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460077e expref: -99 pid: 57726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.056049:0:57726:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc884838a14 lrc: 4/0,1 mode: --/PR res: [0x200000405:0x8f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460077e expref: -99 pid: 57726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.056058:0:57726:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc884838a14 lrc: 4/0,1 mode: --/PR res: [0x200000405:0x8f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460077e expref: -99 pid: 57726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.056070:0:57726:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc884838a14 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x8f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460077e expref: -99 pid: 57726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.056081:0:57726:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc884838a14 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x8f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460077e expref: -99 pid: 57726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.056094:0:57726:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc884838a14 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x8f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460077e expref: -99 pid: 57726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.056103:0:57726:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc884838a14 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x8f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460077e expref: -99 pid: 57726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.056122:0:57726:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc884838a14 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x8f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460077e expref: -99 pid: 57726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191332.056134:0:57726:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b453ab480 x1874004626360448/t8589936109(8589936109) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191348 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191332.056148:0:57726:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453ab480 x1874004626360448/t8589936109(8589936109) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191348 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191332.056160:0:57726:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc884838a14 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460077e expref: -99 pid: 57726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.056170:0:57726:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/143 (0 0) 00000080:00200000:3.0:1787191332.056176:0:57726:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191332.056187:0:57726:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:3.0:1787191332.056218:0:57726:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0x8f:0x0](ffff936b489a9988) 00000080:00200000:3.0:1787191332.056225:0:57726:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0x8f:0x0], updating i_size 0 00000080:00200000:3.0:1787191332.056258:0:57726:0:(file.c:6836:ll_layout_conf()) [0x200000405:0x8f:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:3.0:1787191332.056263:0:57726:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0x8f:0x0](ffff936b489a9988) 00000080:00010000:3.0:1787191332.056267:0:57726:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x8f:0x0](ffff936b489a9988) for lock 0xe5129dc884838a14 00000080:00010000:3.0:1787191332.056277:0:57726:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x8f:0x0](ffff936b489a9988) 00000080:00200008:3.0:1787191332.056290:0:57726:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0x8f:0x0](ffff936b489a9988), flags 120501 00000002:00100000:3.0:1787191332.056310:0:57726:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453ab480 x1874004626360448/t8589936109(8589936109) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191348 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1787191332.056352:0:57726:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884838a14 from it ffff936b5339fae0 00010000:00010000:3.0:1787191332.056356:0:57726:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc884838a14 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x8f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460077e expref: -99 pid: 57726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.056366:0:57726:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc884838a14 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x8f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460077e expref: -99 pid: 57726 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191332.056391:0:57726:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8f:0x0](ffff936b489a9988), inode mode 81a4 mask 40 00000080:00200000:3.0:1787191332.056460:0:57726:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x8f:0x0](ffff936b489a9988), inode mode 81a4 mask 2 00000080:00200000:3.0:1787191332.056471:0:57726:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0x8f:0x0](ffff936b489a9988), xattr lov 00000002:00010000:3.0:1787191332.057945:0:57726:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x8f:0x0]) in obj [0x200000405:0x8f:0x0], intent: open flags 040000002 00000100:00100000:3.0:1787191332.067796:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1030 00000100:00100000:3.0:1787191332.067819:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30510:x1874004634791680:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191332.067871:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc8848389d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x162:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e46006ac expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191332.068089:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787191332.068099:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30510:x1874004634791680:12345-192.168.202.101@tcp:104: Request processed in 289us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191332.068106:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1030 00000100:00100000:3.0:1787191332.074535:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191332.110768:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626362880:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191332.112743:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626362880:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191332.140740:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191332.140884:0:51131:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787191332.140899:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634793344 00000100:00100000:3.0:1787191332.140906:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634793344 00000100:00100000:3.0:1787191332.140959:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1035 00000100:00100000:3.0:1787191332.140979:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b50882050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8419:x1874004634793344:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191332.141000:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009db114fb/0xe5129dc8848389e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x164:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e46006f9 expref: -99 pid: 57722 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191332.141061:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191332.141067:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b50882050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8419:x1874004634793344:12345-192.168.202.101@tcp:104: Request processed in 100us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191332.141074:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1035 00010000:00010000:3.0:1787191332.141123:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191332.141129:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009db114fb/0xe5129dc8848389e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x164:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e46006f9 expref: -99 pid: 57722 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191332.141138:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd4200 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191332.141145:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009db114fb/0xe5129dc8848389e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x164:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e46006f9 expref: -99 pid: 57722 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191332.141180:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009db114fb/0xe5129dc8848389e3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x164:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e46006f9 expref: -99 pid: 57722 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191332.141187:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191332.141206:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009db114fb/0xe5129dc8848389e3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x164:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e46006f9 expref: -99 pid: 57722 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191332.141219:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009db114fb/0xe5129dc8848389e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x164:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e46006f9 expref: -99 pid: 57722 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191332.141236:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191332.141238:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191332.141240:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191332.141253:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626364288:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191332.151043:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626364288:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191332.157249:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191332.157278:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634793856 00000100:00100000:3.0:1787191332.157285:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634793856 00000100:00100000:3.0:1787191332.157338:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1037 00000100:00100000:3.0:1787191332.157349:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30131:x1874004634793856:12345-192.168.202.101@tcp:105: 00010000:00010000:3.0:1787191332.157362:0:40922:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007a412388/0xe5129dc884838a61 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x164:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4600865 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.157373:0:40922:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007a412388/0xe5129dc884838a61 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x164:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4600865 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.157383:0:40922:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007a412388/0xe5129dc884838a61 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x164:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e4600865 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.157565:0:40922:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007a412388/0xe5129dc884838a61 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x164:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080080020000 nid: local remote: 0x7130d520e4600865 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.157582:0:40922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007a412388/0xe5129dc884838a61 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x164:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080080020000 nid: local remote: 0x7130d520e4600865 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.157592:0:40922:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007a412388/0xe5129dc884838a61 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x164:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80080020000 nid: local remote: 0x7130d520e4600865 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.157618:0:40922:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b51fe0800) 00000100:00100000:3.0:1787191332.157671:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30131:x1874004634793856:12345-192.168.202.101@tcp:105: Request processed in 323us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191332.157679:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1037 00000100:00100000:3.0:1787191332.161158:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626364928:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191332.186497:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634793984 00000100:00100000:3.0:1787191332.186507:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634793984 00000100:00100000:3.0:1787191332.186546:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634794112 00000100:00100000:3.0:1787191332.186549:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634794112 00000100:00100000:3.0:1787191332.186561:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634794240 00000100:00100000:3.0:1787191332.186563:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634794240 00000100:00100000:3.0:1787191332.186578:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1038 00000100:00100000:3.0:1787191332.186588:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+7:15323:x1874004634793984:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191332.186599:0:40921:0:(ldlm_lockd.c:2455:ldlm_callback_handler()) callback on lock 0xe5129dc884838a53 - lock disappeared 00010000:00010000:3.0:1787191332.187302:0:40921:0:(ldlm_lockd.c:2352:ldlm_callback_errmsg()) @@@ Operate with invalid parameter, NID=12345-192.168.202.101@tcp lock=0xe5129dc884838a53: rc = 0 req@ffff936b513b9880 x1874004634793984/t0(0) o104->f10005b0-4ec5-4888-9c81-49c0b11e82c4@192.168.202.101@tcp:643/0 lens 328/224 e 0 to 0 dl 1787191343 ref 1 fl Interpret:/0/0 rc -22/-22 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191332.187315:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+7:15323:x1874004634793984:12345-192.168.202.101@tcp:104: Request processed in 729us (976us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787191332.187327:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1038 00000100:00100000:3.0:1787191332.187350:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1039 00000100:00100000:3.0:1787191332.187358:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+6:15323:x1874004634794112:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191332.187364:0:40921:0:(ldlm_lockd.c:2455:ldlm_callback_handler()) callback on lock 0xe5129dc884838a68 - lock disappeared 00010000:00010000:3.0:1787191332.187657:0:40921:0:(ldlm_lockd.c:2352:ldlm_callback_errmsg()) @@@ Operate with invalid parameter, NID=12345-192.168.202.101@tcp lock=0xe5129dc884838a68: rc = 0 req@ffff936b513b9180 x1874004634794112/t0(0) o104->f10005b0-4ec5-4888-9c81-49c0b11e82c4@192.168.202.101@tcp:643/0 lens 328/224 e 0 to 0 dl 1787191343 ref 1 fl Interpret:/0/0 rc -22/-22 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191332.187668:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+6:15323:x1874004634794112:12345-192.168.202.101@tcp:104: Request processed in 313us (1276us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787191332.187675:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1039 00000100:00100000:3.0:1787191332.187688:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1040 00000100:00100000:3.0:1787191332.187694:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:15323:x1874004634794240:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191332.187700:0:40921:0:(ldlm_lockd.c:2455:ldlm_callback_handler()) callback on lock 0xe5129dc884838a3e - lock disappeared 00010000:00010000:3.0:1787191332.188104:0:40921:0:(ldlm_lockd.c:2352:ldlm_callback_errmsg()) @@@ Operate with invalid parameter, NID=12345-192.168.202.101@tcp lock=0xe5129dc884838a3e: rc = 0 req@ffff936b513ba680 x1874004634794240/t0(0) o104->f10005b0-4ec5-4888-9c81-49c0b11e82c4@192.168.202.101@tcp:643/0 lens 328/224 e 0 to 0 dl 1787191343 ref 1 fl Interpret:/0/0 rc -22/-22 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191332.188126:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:15323:x1874004634794240:12345-192.168.202.101@tcp:104: Request processed in 432us (1707us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787191332.188132:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1040 00000100:00100000:3.0:1787191332.225172:0:57728:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57728:1874004626367360:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191332.225224:0:57728:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc884838a8b lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.225250:0:57728:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc884838a8b lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.225272:0:57728:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc884838a8b lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.225279:0:57728:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc884838a8b lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.225301:0:57728:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc884838a8b lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.225307:0:57728:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b6a609400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191332.225323:0:57728:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc884838a8b lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.225330:0:57728:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc884838a8b lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.225348:0:57728:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc884838a8b lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.225364:0:57728:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191332.225371:0:57728:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc884838a8b lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.225378:0:57728:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc884838a8b lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57728 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191332.225476:0:57728:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b453aa680 x1874004626367360/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191348 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191332.225503:0:57728:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191332.226852:0:57728:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191332.226877:0:57728:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191332.226890:0:57728:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191332.226904:0:57728:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191332.226911:0:57728:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191332.226918:0:57728:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191332.226922:0:57728:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191332.226929:0:57728:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41f6bb58 00010000:00010000:3.0:1787191332.226932:0:57728:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191332.226941:0:57728:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191332.226957:0:57728:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191332.226964:0:57728:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:3.0:1787191332.227139:0:57728:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:3.0:1787191332.227145:0:57728:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:3.0:1787191332.227160:0:57728:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191332.227167:0:57728:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 41 lru_type: 1 00010000:00010000:3.0:1787191332.227174:0:57728:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 41 lru_type: 1 00000002:00010000:3.0:1787191332.227187:0:57728:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191332.227290:0:57728:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838a92 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.227299:0:57728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838a92 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.227319:0:57728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838a92 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57728 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191332.227357:0:57728:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57728:1874004626367488:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191332.227484:0:57728:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191332.232017:0:57728:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57728:1874004626367488:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191332.232043:0:57728:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838a92 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600906 expref: -99 pid: 57728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.232057:0:57728:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838a92 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600906 expref: -99 pid: 57728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.232068:0:57728:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838a92 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4600906 expref: -99 pid: 57728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.232080:0:57728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838a92 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600906 expref: -99 pid: 57728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.232092:0:57728:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838a92 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4600906 expref: -99 pid: 57728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.232116:0:57728:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838a92 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4600906 expref: -99 pid: 57728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.232125:0:57728:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838a92 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4600906 expref: -99 pid: 57728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191332.232137:0:57728:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b51d1df80 x1874004626367488/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191348 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191332.232151:0:57728:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838a92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600906 expref: -99 pid: 57728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.232160:0:57728:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:3.0:1787191332.232168:0:57728:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838a92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4600906 expref: -99 pid: 57728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.232177:0:57728:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838a92 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600906 expref: -99 pid: 57728 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:3.0:1787191332.232222:0:57728:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191332.232233:0:57728:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 82 lru_type: 1 00010000:00010000:3.0:1787191332.232245:0:57728:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 82 lru_type: 1 00010000:00010000:3.0:1787191332.232253:0:57728:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 82 lru_type: 1 00010000:00010000:3.0:1787191332.232262:0:57728:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 83 lru_type: 1 00000080:00200000:3.0:1787191332.232275:0:57728:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1787191332.232284:0:57728:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:3.0:1787191332.232288:0:57728:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:3.0:1787191332.232294:0:57728:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb41f6bcb8 00010000:00010000:3.0:1787191332.232298:0:57728:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 41 lru_type: 1 00010000:00010000:3.0:1787191332.232305:0:57728:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 42 lru_type: 1 00000002:00010000:3.0:1787191332.232323:0:57728:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191332.232329:0:57728:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838a92 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600906 expref: -99 pid: 57728 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191332.232337:0:57728:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838a92 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600906 expref: -99 pid: 57728 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191332.232344:0:57728:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838a92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4600906 expref: -99 pid: 57728 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191332.232351:0:57728:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838a92 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600906 expref: -99 pid: 57728 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:3.0:1787191332.232359:0:57728:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191332.232365:0:57728:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 83 lru_type: 1 00010000:00010000:3.0:1787191332.232373:0:57728:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 83 lru_type: 1 00010000:00010000:3.0:1787191332.232380:0:57728:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 83 lru_type: 1 00010000:00010000:3.0:1787191332.232387:0:57728:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 84 lru_type: 1 00000080:00200008:3.0:1787191332.233251:0:57728:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:3.0:1787191332.233259:0:57728:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191332.233290:0:57728:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191332.233312:0:57728:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191332.233334:0:57728:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191332.233343:0:57728:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191332.233361:0:57728:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191332.233365:0:57728:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191332.233380:0:57728:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41f6bcb8 00010000:00010000:3.0:1787191332.233385:0:57728:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191332.233398:0:57728:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191332.233551:0:57728:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191332.233560:0:57728:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191332.233567:0:57728:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191332.233574:0:57728:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191332.233580:0:57728:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191332.233583:0:57728:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191332.233585:0:57728:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191332.233588:0:57728:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41f6bb58 00010000:00010000:3.0:1787191332.233591:0:57728:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191332.233598:0:57728:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191332.233606:0:57728:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191332.233611:0:57728:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:3.0:1787191332.233616:0:57728:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191332.233625:0:57728:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:3.0:1787191332.233629:0:57728:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:3.0:1787191332.233641:0:57728:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1787191332.233682:0:57728:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884838a99 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.233689:0:57728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884838a99 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.233698:0:57728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884838a99 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57728 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191332.233719:0:57728:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57728:1874004626367616:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191332.233812:0:57728:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191332.240891:0:57728:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57728:1874004626367616:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191332.240912:0:57728:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884838a99 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.240925:0:57728:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884838a99 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.240932:0:57728:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884838a99 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.240939:0:57728:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884838a99 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.240951:0:57728:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884838a99 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.240958:0:57728:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9b400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191332.240962:0:57728:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884838a99 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.240978:0:57728:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884838a99 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.240985:0:57728:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884838a99 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.240991:0:57728:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191332.240998:0:57728:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884838a99 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.241014:0:57728:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884838a99 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57728 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191332.241038:0:57728:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b51d1df80 x1874004626367616/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191348 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191332.241052:0:57728:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1787191332.241085:0:57728:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838a92 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600906 expref: -99 pid: 57728 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191332.241096:0:57728:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838a92 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600906 expref: -99 pid: 57728 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:3.0:1787191332.241114:0:57728:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884838a92 from it ffffa3fb41f6b930 00010000:00010000:3.0:1787191332.241119:0:57728:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838a92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4600906 expref: -99 pid: 57728 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191332.241127:0:57728:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838a92 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600906 expref: -99 pid: 57728 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787191332.241222:0:57728:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191332.241237:0:57728:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191332.241246:0:57728:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191332.241254:0:57728:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191332.241261:0:57728:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191332.241267:0:57728:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191332.241270:0:57728:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191332.241276:0:57728:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41f6bbf8 00010000:00010000:3.0:1787191332.241279:0:57728:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191332.241287:0:57728:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191332.241297:0:57728:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191332.241303:0:57728:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191332.241308:0:57728:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191332.243113:0:57728:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:3.0:1787191332.243125:0:57728:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:3.0:1787191332.243134:0:57728:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b464a8900, open_flags a141, mode 81b6 opened 0 00000080:00200000:3.0:1787191332.243145:0:57728:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:3.0:1787191332.243167:0:57728:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0x90:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:3.0:1787191332.243181:0:57728:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838a92 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4600906 expref: -99 pid: 57728 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191332.243256:0:57728:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838a92 lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4600906 expref: -99 pid: 57728 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191332.243263:0:57728:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191332.243266:0:57728:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838a92 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4600906 expref: -99 pid: 57728 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191332.243303:0:57728:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884838aa0 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.243311:0:57728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884838aa0 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57728 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191332.243323:0:57728:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191332.243339:0:57728:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1df80 x1874004626367872/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191332.243348:0:57728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884838aa0 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57728 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191332.243370:0:57728:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57728:1874004626367872:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191332.243509:0:57728:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191332.252625:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191332.252666:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634794368 00000100:00100000:3.0:1787191332.252675:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634794368 00000100:00100000:3.0:1787191332.253292:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1041 00000100:00100000:3.0:1787191332.253305:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634794368:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191332.253331:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884838aa0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4600937 expref: -99 pid: 57728 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191332.255226:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191332.255247:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634794368:12345-192.168.202.101@tcp:104: Request processed in 1939us (2625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191332.255259:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1041 00000100:00100000:3.0:1787191332.269454:0:57730:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57730:1874004626368512:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191332.269469:0:57730:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884838aae lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460096f expref: -99 pid: 57730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.269685:0:57730:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884838aae lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460096f expref: -99 pid: 57730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.269695:0:57730:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884838aae lrc: 4/1,0 mode: --/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460096f expref: -99 pid: 57730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.269705:0:57730:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884838aae lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460096f expref: -99 pid: 57730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.269714:0:57730:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884838aae lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460096f expref: -99 pid: 57730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.269790:0:57730:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884838aae lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460096f expref: -99 pid: 57730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.269800:0:57730:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884838aae lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460096f expref: -99 pid: 57730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.269808:0:57730:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884838aae lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460096f expref: -99 pid: 57730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191332.269821:0:57730:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b513b9f80 x1874004626368512/t8589936129(8589936129) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191348 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191332.269944:0:57730:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9f80 x1874004626368512/t8589936129(8589936129) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191348 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191332.269958:0:57730:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884838aae lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460096f expref: -99 pid: 57730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191332.270150:0:57730:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884838aae lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460096f expref: -99 pid: 57730 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.270162:0:57730:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/144 (0 0) 00000080:00200000:3.0:1787191332.270168:0:57730:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191332.270228:0:57730:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1787191332.270237:0:57730:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191332.270289:0:57730:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0x90:0x0](ffff936b5396cb08): rc = 0 00000080:00200000:3.0:1787191332.270314:0:57730:0:(file.c:6836:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:3.0:1787191332.270319:0:57730:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff936b5396cb08) for lock 0xe5129dc884838aae 00000080:00010000:3.0:1787191332.270333:0:57730:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff936b5396cb08) 00000080:00200008:3.0:1787191332.270346:0:57730:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0x90:0x0](ffff936b5396cb08), flags 154400 00000002:00100000:3.0:1787191332.270367:0:57730:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9f80 x1874004626368512/t8589936129(8589936129) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191348 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1787191332.270421:0:57730:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884838aae from it ffff936b60dc4c60 00010000:00010000:3.0:1787191332.270426:0:57730:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884838aae lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460096f expref: -99 pid: 57730 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.270435:0:57730:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884838aae lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460096f expref: -99 pid: 57730 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191332.270456:0:57730:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff936b5396cb08), inode mode 81a4 mask 44 00000080:00200000:3.0:1787191332.270550:0:57730:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff936b5396cb08), inode mode 81a4 mask 4 00000080:00200000:3.0:1787191332.270558:0:57730:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0x90:0x0](ffff936b5396cb08), xattr lov 00000080:00200008:3.0:1787191332.270581:0:57730:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0x90:0x0](ffff936b5396cb08), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191332.270587:0:57730:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x90:0x0](ffff936b5396cb08),name=f70.sanity-flr 00000002:00010000:3.0:1787191332.270605:0:57730:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191332.270614:0:57730:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884838aae lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460096f expref: -99 pid: 57730 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191332.270626:0:57730:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884838aae lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460096f expref: -99 pid: 57730 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191332.270633:0:57730:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191332.270638:0:57730:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x90:0x0](ffff936b5396cb08) 00000080:00010000:3.0:1787191332.270642:0:57730:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff936b5396cb08) for lock 0xe5129dc884838aae 00000080:00010000:3.0:1787191332.270646:0:57730:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884838aae from it ffffa3fb41f7bcd8 00010000:00010000:3.0:1787191332.270649:0:57730:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884838aae lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460096f expref: -99 pid: 57730 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191332.270661:0:57730:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884838aae lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460096f expref: -99 pid: 57730 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191332.270676:0:57730:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:3.0:1787191332.270685:0:57730:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191332.270688:0:57730:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191332.270692:0:57730:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x90:0x0] 00000008:00010000:3.0:1787191332.270708:0:57730:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191332.270711:0:57730:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667eb0, osc lock ffff936b44f644c0, flags 0x400000400001002 00010000:00010000:3.0:1787191332.271384:0:57730:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000e4f900c6/0xe5129dc884838ab5 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x169:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57730 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.271396:0:57730:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000e4f900c6/0xe5129dc884838ab5 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x169:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57730 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.271409:0:57730:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b51d1d500 x1874004626368640/t0(0) o101->lustre-OST0001-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:3.0:1787191332.271583:0:57730:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:3.0:1787191332.280278:0:57730:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57730:1874004626369408:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191332.280311:0:57730:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513b9f80 x1874004626368512/t8589936129(8589936129) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191348 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191332.280511:0:57730:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191332.280533:0:57730:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191332.280550:0:57730:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191332.280571:0:57730:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191332.280579:0:57730:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191332.280585:0:57730:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191332.280589:0:57730:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191332.280597:0:57730:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41f7bbf8 00010000:00010000:3.0:1787191332.280601:0:57730:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191332.280609:0:57730:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191332.280625:0:57730:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191332.280632:0:57730:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191332.280638:0:57730:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191332.280642:0:57730:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:3.0:1787191332.280646:0:57730:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff936b5396cb08), inode mode 81a4 mask 44 00000080:00200008:3.0:1787191332.280653:0:57730:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0x90:0x0](ffff936b5396cb08), flags 154400 00000002:00010000:3.0:1787191332.280667:0:57730:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: open flags 0104240114401 00010000:00010000:3.0:1787191332.280722:0:57730:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838abc lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.280739:0:57730:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838abc lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57730 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191332.280750:0:57730:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:3.0:1787191332.280758:0:57730:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1f480 x1874004626369664/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191332.280767:0:57730:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838abc lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57730 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191332.280787:0:57730:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57730:1874004626369664:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191332.280998:0:57730:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787191332.295338:0:51131:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787191332.295366:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634794496 00000100:00100000:3.0:1787191332.295374:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634794496 00000100:00100000:3.0:1787191332.295438:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1042 00000100:00100000:3.0:1787191332.295448:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b4121f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634794496:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191332.295466:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc884838ac3 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46009a0 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191332.295545:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191332.295552:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b4121f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634794496:12345-192.168.202.101@tcp:104: Request processed in 106us (2518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191332.295559:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1042 00000100:00100000:3.0:1787191332.314003:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626370560:192.168.202.101@tcp:400:kworker.0 00000100:00100000:3.0:1787191332.316159:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:95df428c-87a4-4fae-83fd-e31aed0d69bf:2392:1874004626370432:192.168.202.101@tcp:400:kworker.0 00000100:00100000:3.0:1787191332.316998:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634794624 00000100:00100000:3.0:1787191332.317006:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634794624 00000100:00100000:3.0:1787191332.318035:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1043 00000100:00100000:3.0:1787191332.318051:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634794624:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191332.318069:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1800/0xe5129dc884838ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x90:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46009df expref: -99 pid: 57730 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.319349:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191332.319367:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634794624:12345-192.168.202.101@tcp:104: Request processed in 1316us (2452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191332.319377:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1043 00000100:00100000:3.0:1787191332.326536:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626371584:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191332.372454:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634796032 00000100:00100000:3.0:1787191332.372461:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634796032 00000100:00100000:3.0:1787191332.386090:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191332.387643:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634796160 00000100:00100000:3.0:1787191332.387655:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634796160 00000100:00100000:3.0:1787191332.389071:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1047 00000100:00100000:3.0:1787191332.389081:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:29543:x1874004634796160:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191332.389093:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000e4f900c6/0xe5129dc884838ab5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x169:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000010000 nid: local remote: 0x7130d520e460097d expref: -99 pid: 57730 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191332.389153:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191332.389160:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:29543:x1874004634796160:12345-192.168.202.101@tcp:104: Request processed in 81us (3642us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191332.389167:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1047 00000100:00100000:3.0:1787191332.392441:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000080:00200000:3.0:1787191332.406827:0:57732:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191332.406883:0:57732:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191332.406901:0:57732:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191332.406923:0:57732:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191332.406932:0:57732:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191332.406939:0:57732:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191332.406943:0:57732:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191332.406952:0:57732:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41f8bbf8 00010000:00010000:3.0:1787191332.406956:0:57732:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191332.406965:0:57732:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191332.406983:0:57732:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191332.406990:0:57732:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191332.406996:0:57732:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191332.407001:0:57732:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:3.0:1787191332.407004:0:57732:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x90:0x0](ffff936b5396cb08), inode mode 81a4 mask 44 00000080:00200008:3.0:1787191332.407009:0:57732:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0x90:0x0](ffff936b5396cb08), flags 154400 00000002:00010000:3.0:1787191332.407024:0:57732:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: open flags 0104240114401 00010000:00010000:3.0:1787191332.407070:0:57732:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884838b02 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.407079:0:57732:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884838b02 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57732 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191332.407091:0:57732:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191332.407117:0:57732:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1dc00 x1874004626374528/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191332.407128:0:57732:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884838b02 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57732 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191332.407152:0:57732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57732:1874004626374528:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191332.407734:0:57732:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c840 going to sleep for 11 seconds 00000100:00100000:3.0:1787191332.422635:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626374784:192.168.202.101@tcp:35:bash.0 00000002:00100000:3.0:1787191332.422673:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513bb100 x1874004626369920/t8589936134(8589936134) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191348 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787191332.439338:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191332.453028:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634796544 00000100:00100000:3.0:1787191332.453039:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634796544 00000100:00100000:3.0:1787191332.453149:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1050 00000100:00100000:3.0:1787191332.453161:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634796544:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191332.453180:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc884838b09 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x90:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e4600a8e expref: -99 pid: 57733 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191332.453278:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191332.453285:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634796544:12345-192.168.202.101@tcp:104: Request processed in 127us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191332.453293:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1050 00000100:00100000:3.0:1787191332.458478:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626376320:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191332.461304:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626376320:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191332.470170:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634796672 00000100:00100000:3.0:1787191332.470179:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634796672 00000100:00100000:3.0:1787191332.470240:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1051 00000100:00100000:3.0:1787191332.470251:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8420:x1874004634796672:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191332.470268:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000cfb66679/0xe5129dc884838af4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x169:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420080020000 nid: local remote: 0x7130d520e4600a64 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 1 00010000:00010000:3.0:1787191332.470348:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191332.470355:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8420:x1874004634796672:12345-192.168.202.101@tcp:104: Request processed in 106us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191332.470362:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1051 00000100:00100000:3.0:1787191332.480246:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626376832:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191332.483356:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626376832:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787191332.483760:0:57733:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0800/0xe5129dc884838b1e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4600ad4 expref: -99 pid: 57733 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191332.483781:0:57733:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0x90:0x0]: losing layout lock 00010000:00010000:3.0:1787191332.483816:0:57733:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0800/0xe5129dc884838b1e lrc: 1/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4600ad4 expref: -99 pid: 57733 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191332.483822:0:57733:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191332.483826:0:57733:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0800/0xe5129dc884838b1e lrc: 0/0,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4600ad4 expref: -99 pid: 57733 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000020:00100000:3.0:1787191332.483872:0:57733:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1787191332.483881:0:57733:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1d880 x1874004626377216/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 472/440 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191332.483899:0:57733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57733:1874004626377216:192.168.202.101@tcp:36:lfs.0 00000100:00100000:3.0:1787191332.483996:0:57733:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c840 going to sleep for 11 seconds 00000080:00200000:3.0:1787191332.515761:0:57733:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 5 i_blocks 8 00000020:00010000:3.0:1787191332.515767:0:57733:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51656e40 (ffff936b465cca28/0) at cl_lock_release():245 00000020:00010000:3.0:1787191332.515770:0:57733:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51656e40 (ffff936b465cca28/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191332.515776:0:57733:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7d0b0 (ffff936b465cc7e8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191332.515780:0:57733:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51656e40 (ffff936b465cca28/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191332.515782:0:57733:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7d0b0 (ffff936b465cca28/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191332.515820:0:57733:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:3.0:1787191332.568478:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626380032:192.168.202.101@tcp:23:lfs.0 00000100:00100000:3.0:1787191332.572665:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626380032:192.168.202.101@tcp:23:lfs.0 00000080:00200000:3.0:1787191332.638491:0:57733:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0x90:0x0] updating i_size 5 i_blocks 8 00000020:00010000:3.0:1787191332.638499:0:57733:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b53cc5128 (ffff936b47a175a8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191332.638503:0:57733:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b53cc5128 (ffff936b47a175a8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191332.638507:0:57733:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99030 (ffff936b47a17d88/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191332.638516:0:57733:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b9bf1031/0xe5129dc884838b9c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x167:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4600c24 expref: -99 pid: 57733 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.638531:0:57733:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b9bf1031/0xe5129dc884838b9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x167:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4600c24 expref: -99 pid: 57733 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1787191332.638548:0:57733:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99070 (ffff936b47a17008/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191332.638553:0:57733:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007a412388/0xe5129dc884838ba3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x16a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4600c47 expref: -99 pid: 57733 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.638561:0:57733:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007a412388/0xe5129dc884838ba3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4600c47 expref: -99 pid: 57733 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1787191332.638571:0:57733:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b53cc5128 (ffff936b47a175a8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191332.638574:0:57733:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99030 (ffff936b47a175a8/1) at cl_lock_fini():72 00000020:00010000:3.0:1787191332.638579:0:57733:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99070 (ffff936b47a175a8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191332.638625:0:57733:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191332.638643:0:57733:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0x90:0x0](ffff936b5396cb08) current size 5, valid attrs 10002168, mode 0, uid -1322410190, gid -1, new size 5, atime 1787191332.000000000, mtime 1787191332.000000000, ctime 1787191332.000000000, rc 0 00000080:00200080:3.0:1787191332.638659:0:57733:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff936b5396cb08) cmd=400866b1 arg=0 00000080:00200008:3.0:1787191332.638729:0:57733:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0x90:0x0](ffff936b5396cb08) current size 5, valid attrs 101f0, mode a3fb, uid 1404174984, gid -27797, new size 18446624687906016008, atime 1787191332.000000000, mtime 1787191332.000000000, ctime 1787191332.000000000 00000020:00100000:3.0:1787191332.638778:0:57733:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1787191332.638786:0:57733:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1f100 x1874004626382976/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191332.638802:0:57733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57733:1874004626382976:192.168.202.101@tcp:36:lfs.0 00000100:00100000:3.0:1787191332.638881:0:57733:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c9c0 going to sleep for 11 seconds 00000080:00200000:3.0:1787191332.647161:0:57733:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191332.647298:0:57733:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0x90:0x0](ffff936b5396cb08) current size 5, valid attrs 100101f0, mode a3fb, uid 1404174984, gid -27797, new size 18446624687906016008, atime 1787191332.000000000, mtime 1787191332.000000000, ctime 1787191332.000000000, rc 0 00000080:00200080:3.0:1787191332.647385:0:57733:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x90:0x0](ffff936b5396cb08) cmd=c00c66f3 arg=16d52e0 00010000:00010000:3.0:1787191332.647430:0:57733:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0200/0xe5129dc884838b17 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81008000000000 nid: local remote: 0x7130d520e4600ac6 expref: -99 pid: 57733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.647446:0:57733:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0200/0xe5129dc884838b17 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x90:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x85809400000000 nid: local remote: 0x7130d520e4600ac6 expref: -99 pid: 57733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191332.647467:0:57733:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a477480 x1874004626376192/t8589936149(8589936149) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191348 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191332.647477:0:57733:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191332.647483:0:57733:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1c380 x1874004626383616/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191332.647499:0:57733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57733:1874004626383616:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191332.647599:0:57733:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787191332.649787:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634797952 00000100:00100000:3.0:1787191332.649795:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634797952 00000100:00100000:3.0:1787191332.649870:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1053 00000100:00100000:3.0:1787191332.649881:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35858:x1874004634797952:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191332.649893:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1800/0xe5129dc884838b33 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4600b13 expref: -99 pid: 57733 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191332.649958:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191332.649965:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35858:x1874004634797952:12345-192.168.202.101@tcp:104: Request processed in 86us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191332.649971:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1053 00000100:00100000:3.0:1787191332.664584:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634798592 00000100:00100000:3.0:1787191332.664593:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634798592 00000100:00100000:3.0:1787191332.664654:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1054 00000100:00100000:3.0:1787191332.664667:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:37089:x1874004634798592:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191332.664682:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc884838b87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x168:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4600bf3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191332.664777:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191332.664786:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:37089:x1874004634798592:12345-192.168.202.101@tcp:104: Request processed in 121us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191332.664897:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1054 00000100:00100000:3.0:1787191332.665042:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191332.665074:0:57733:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589936164 gen 1 00000100:00100000:3.0:1787191332.665094:0:57733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57733:1874004626383616:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191332.665127:0:57733:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a477480 x1874004626376192/t8589936149(8589936149) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191348 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1787191332.665153:0:57733:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/144 (0 0) 00000080:00010000:3.0:1787191332.665160:0:57733:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x90:0x0](ffff936b5396cb08) 00000002:00010000:3.0:1787191332.665165:0:57733:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x90:0x0]) in obj [0x200000405:0x90:0x0], intent: layout flags 0 00010000:00010000:3.0:1787191332.665195:0:57733:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9be00/0xe5129dc884838bc6 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.665204:0:57733:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9be00/0xe5129dc884838bc6 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.665214:0:57733:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9be00/0xe5129dc884838bc6 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191332.669312:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626384384:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191332.673490:0:57733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57733:1874004626384128:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191332.673523:0:57733:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9be00/0xe5129dc884838bc6 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4600ce8 expref: -99 pid: 57733 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.673545:0:57733:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9be00/0xe5129dc884838bc6 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600ce8 expref: -99 pid: 57733 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191332.673572:0:57733:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b51d1c380 x1874004626384128/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191348 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191332.673597:0:57733:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9be00/0xe5129dc884838bc6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600ce8 expref: -99 pid: 57733 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191332.673623:0:57733:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9be00/0xe5129dc884838bc6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600ce8 expref: -99 pid: 57733 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.673640:0:57733:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/144 (0 0) 00000080:00200000:3.0:1787191332.673651:0:57733:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x90:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1787191332.673668:0:57733:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x90:0x0](ffff936b5396cb08) for lock 0xe5129dc884838bc6 00000080:00010000:3.0:1787191332.673678:0:57733:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884838bc6 from it ffffa3fb41f93bc8 00010000:00010000:3.0:1787191332.673684:0:57733:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9be00/0xe5129dc884838bc6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4600ce8 expref: -99 pid: 57733 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.673698:0:57733:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9be00/0xe5129dc884838bc6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600ce8 expref: -99 pid: 57733 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191332.673719:0:57733:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9be00/0xe5129dc884838bc6 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600ce8 expref: -99 pid: 57733 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191332.673733:0:57733:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9be00/0xe5129dc884838bc6 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600ce8 expref: -99 pid: 57733 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:3.0:1787191332.673748:0:57733:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0x90:0x0](000000006f6816b2) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9be00/0xe5129dc884838bc6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600ce8 expref: -99 pid: 57733 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191332.673785:0:57733:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9be00/0xe5129dc884838bc6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4600ce8 expref: -99 pid: 57733 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191332.673799:0:57733:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9be00/0xe5129dc884838bc6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600ce8 expref: -99 pid: 57733 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191332.673814:0:57733:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1787191332.673824:0:57733:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191332.673828:0:57733:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191332.673853:0:57733:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191332.673863:0:57733:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1787191332.673882:0:57733:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:3.0:1787191332.673899:0:57733:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9be00/0xe5129dc884838bc6 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600ce8 expref: -99 pid: 57733 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191332.673914:0:57733:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9be00/0xe5129dc884838bc6 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600ce8 expref: -99 pid: 57733 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:3.0:1787191332.673922:0:57733:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0x90:0x0](000000006f6816b2) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9be00/0xe5129dc884838bc6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600ce8 expref: -99 pid: 57733 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191332.673939:0:57733:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1787191332.673943:0:57733:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x90:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191332.673945:0:57733:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191332.673948:0:57733:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191332.673952:0:57733:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1787191332.673958:0:57733:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x90:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:3.0:1787191332.673971:0:57733:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 5 blocks 8 [cma]time: 1787191332 1787191332 0 by oinfo size 5 blocks 8 [cma]time 1787191332 1787191332 1787191332 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bcda4bea/0xe5129dc884838b4f lrc: 1/0,0 mode: PR/PR res: [0x2c0000401:0x169:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4600b4b expref: -99 pid: 57733 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00000008:00010000:3.0:1787191332.674004:0:57733:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 4096 blocks 8 [cma]time: 1787191332 1787191332 0 by oinfo size 5 blocks 8 [cma]time 1787191332 1787191332 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b9bf1031/0xe5129dc884838b9c lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x167:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4600c24 expref: -99 pid: 57733 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000008:00010000:3.0:1787191332.674019:0:57733:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191332 1787191332 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007a412388/0xe5129dc884838ba3 lrc: 1/0,0 mode: PW/PW res: [0x2c0000401:0x16a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4600c47 expref: -99 pid: 57733 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191332.674080:0:57733:0:(file.c:6836:ll_layout_conf()) [0x200000405:0x90:0x0]: layout version change: 4294967294 -> 6 00010000:00010000:3.0:1787191332.674086:0:57733:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9be00/0xe5129dc884838bc6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4600ce8 expref: -99 pid: 57733 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191332.674094:0:57733:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9be00/0xe5129dc884838bc6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4600ce8 expref: -99 pid: 57733 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200008:3.0:1787191332.674134:0:57733:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0x90:0x0](ffff936b5396cb08), flags 154002 00000002:00100000:3.0:1787191332.674161:0:57733:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a9f80 x1874004626375040/t8589936148(8589936148) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191348 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191332.674171:0:57733:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:3.0:1787191332.674175:0:57733:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1c380 x1874004626385152/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191332.674196:0:57733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57733:1874004626385152:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191332.674234:0:57733:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787191332.678647:0:40921:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787191332.678669:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634799360 00000100:00100000:3.0:1787191332.678678:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634799360 00000100:00100000:3.0:1787191332.678775:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1056 00000100:00100000:3.0:1787191332.678790:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b50882850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634799360:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191332.678804:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc884838bcd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x93:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4600cda expref: -99 pid: 57737 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191332.678914:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191332.678922:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b50882850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634799360:12345-192.168.202.101@tcp:104: Request processed in 138us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191332.678930:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1056 00000100:00100000:3.0:1787191332.686181:0:57733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57733:1874004626385408:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191332.686207:0:57733:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0600/0xe5129dc884838bdb lrc: 4/1,0 mode: --/CR res: [0x200000405:0x93:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600d12 expref: -99 pid: 57733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.686220:0:57733:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0600/0xe5129dc884838bdb lrc: 4/1,0 mode: --/PR res: [0x200000405:0x93:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600d12 expref: -99 pid: 57733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.686231:0:57733:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0600/0xe5129dc884838bdb lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x93:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4600d12 expref: -99 pid: 57733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.686242:0:57733:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0600/0xe5129dc884838bdb lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x93:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600d12 expref: -99 pid: 57733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.686255:0:57733:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0600/0xe5129dc884838bdb lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x93:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4600d12 expref: -99 pid: 57733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.686262:0:57733:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0600/0xe5129dc884838bdb lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x93:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4600d12 expref: -99 pid: 57733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.686270:0:57733:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0600/0xe5129dc884838bdb lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x93:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4600d12 expref: -99 pid: 57733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191332.686281:0:57733:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b6a475c00 x1874004626385408/t8589936168(8589936168) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191348 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191332.686293:0:57733:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475c00 x1874004626385408/t8589936168(8589936168) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191348 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191332.686304:0:57733:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0600/0xe5129dc884838bdb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x93:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600d12 expref: -99 pid: 57733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191332.686318:0:57733:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0600/0xe5129dc884838bdb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x93:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600d12 expref: -99 pid: 57733 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.686328:0:57733:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/147 (0 0) 00000080:00200000:3.0:1787191332.686335:0:57733:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x93:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1787191332.686382:0:57733:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x93:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1787191332.686391:0:57733:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x93:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191332.686461:0:57733:0:(file.c:6836:ll_layout_conf()) [0x200000405:0x93:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:3.0:1787191332.686467:0:57733:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x93:0x0](ffff936b5396a1c8) for lock 0xe5129dc884838bdb 00000080:00010000:3.0:1787191332.686474:0:57733:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884838bdb from it ffffa3fb41f93bf0 00010000:00010000:3.0:1787191332.686478:0:57733:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0600/0xe5129dc884838bdb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x93:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4600d12 expref: -99 pid: 57733 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.686487:0:57733:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0600/0xe5129dc884838bdb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x93:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4600d12 expref: -99 pid: 57733 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000002:00100000:3.0:1787191332.686516:0:57733:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475c00 x1874004626385408/t8589936168(8589936168) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191348 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191332.686627:0:57733:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x93:0x0](ffff936b5396a1c8), inode mode 81a4 mask 4 00000080:00200000:3.0:1787191332.686634:0:57733:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0x93:0x0](ffff936b5396a1c8), xattr lov 00000080:00200008:3.0:1787191332.686659:0:57733:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0x93:0x0](ffff936b5396a1c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191332.686667:0:57733:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x93:0x0](ffff936b5396a1c8),name=f70.sanity-flr 00000002:00010000:3.0:1787191332.686680:0:57733:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x93:0x0]) in obj [0x200000405:0x93:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191332.686688:0:57733:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0600/0xe5129dc884838bdb lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x93:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4600d12 expref: -99 pid: 57733 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191332.686699:0:57733:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0600/0xe5129dc884838bdb lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x93:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4600d12 expref: -99 pid: 57733 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191332.686705:0:57733:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x93:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191332.686710:0:57733:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x93:0x0](ffff936b5396a1c8) 00000080:00010000:3.0:1787191332.686714:0:57733:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x93:0x0](ffff936b5396a1c8) for lock 0xe5129dc884838bdb 00000080:00010000:3.0:1787191332.686717:0:57733:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884838bdb from it ffffa3fb41f93cd8 00010000:00010000:3.0:1787191332.686720:0:57733:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0600/0xe5129dc884838bdb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x93:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4600d12 expref: -99 pid: 57733 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191332.686730:0:57733:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0600/0xe5129dc884838bdb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x93:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4600d12 expref: -99 pid: 57733 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191332.686746:0:57733:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x93:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:3.0:1787191332.686755:0:57733:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x93:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191332.686758:0:57733:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191332.686762:0:57733:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x93:0x0] 00000008:00010000:3.0:1787191332.686779:0:57733:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191332.686782:0:57733:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b5235ce70, osc lock ffff936b44f645f0, flags 0x400000400001002 00000008:00010000:3.0:1787191332.686787:0:57733:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191332.686789:0:57733:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b5235ceb0, osc lock ffff936b44f657c0, flags 0x400000400001002 00010000:00010000:3.0:1787191332.688747:0:57733:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000729b914c/0xe5129dc884838be2 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x16b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57733 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.688768:0:57733:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000729b914c/0xe5129dc884838be2 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x16b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57733 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.688787:0:57733:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b51d1fb80 x1874004626385664/t0(0) o101->lustre-OST0000-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191332.688944:0:2392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787191332.688962:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626385664:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191332.690011:0:57733:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc884838be9 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x16e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57733 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.690024:0:57733:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc884838be9 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x16e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57733 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.690043:0:57733:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b51d1f100 x1874004626385792/t0(0) o101->lustre-OST0001-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:3.0:1787191332.690225:0:57733:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 2 items remaining. 00000080:00200000:3.0:1787191332.699126:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191332.699148:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191332.699172:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191332.699183:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191332.699190:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191332.699197:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191332.699200:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191332.699207:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:3.0:1787191332.699212:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191332.699221:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191332.699237:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191332.699243:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191332.699248:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191332.699258:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:3.0:1787191332.699261:0:57570:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b464a9b00, open_flags 8241, mode 81b6 opened 0 00000080:00200000:3.0:1787191332.699267:0:57570:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:3.0:1787191332.699282:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0x94:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0101102 00010000:00010000:3.0:1787191332.699427:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838bf0 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.699435:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838bf0 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191332.699447:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191332.699455:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1ce00 x1874004626386560/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191332.699461:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838bf0 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191332.699476:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ce00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626386560:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191332.699659:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cc00 going to sleep for 11 seconds 00000080:00200000:3.0:1787191332.701890:0:57733:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0x93:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1787191332.701897:0:57733:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c3abf0 (ffff936b47a176c8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191332.701901:0:57733:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c3abf0 (ffff936b47a176c8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191332.701907:0:57733:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b5235ce70 (ffff936b47a17638/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191332.701913:0:57733:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b5235ceb0 (ffff936b465ccab8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191332.701916:0:57733:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c3abf0 (ffff936b47a176c8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191332.701919:0:57733:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b5235ce70 (ffff936b47a176c8/1) at cl_lock_fini():72 00000020:00010000:3.0:1787191332.701924:0:57733:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b5235ceb0 (ffff936b47a176c8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191332.701938:0:57733:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x93:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191332.701985:0:57733:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0x93:0x0](ffff936b5396a1c8), flags 154000 00000002:00100000:3.0:1787191332.702632:0:57733:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a475c00 x1874004626385408/t8589936168(8589936168) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191348 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191332.702645:0:57733:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:3.0:1787191332.702650:0:57733:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1ca80 x1874004626386816/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191332.702672:0:57733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ca80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57733:1874004626386816:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191332.702742:0:57733:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191332.704690:0:57733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ca80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57733:1874004626386816:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191332.704714:0:57733:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a475c00 x1874004626385408/t8589936168(8589936168) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191348 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191332.704788:0:57733:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191332.704802:0:57733:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191332.704814:0:57733:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191332.704825:0:57733:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191332.704863:0:57733:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191332.704868:0:57733:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191332.704872:0:57733:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191332.704877:0:57733:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41f93bf8 00010000:00010000:3.0:1787191332.704881:0:57733:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191332.704890:0:57733:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191332.704907:0:57733:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191332.704913:0:57733:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191332.704918:0:57733:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191332.704922:0:57733:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:3.0:1787191332.704925:0:57733:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x93:0x0](ffff936b5396a1c8), inode mode 81a4 mask 46 00000080:00200008:3.0:1787191332.704931:0:57733:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0x93:0x0](ffff936b5396a1c8), flags 154402 00000080:00200080:3.0:1787191332.704967:0:57733:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x93:0x0](ffff936b5396a1c8) cmd=800466af arg=7ffc41b01c3c 00000080:00200080:3.0:1787191332.704979:0:57733:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x93:0x0](ffff936b5396a1c8) cmd=80086601 arg=7ffc41b01bd8 00000100:00100000:3.0:1787191332.705003:0:57733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ca80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57733:1874004626387072:192.168.202.101@tcp:33:lfs.0 00000100:00100000:3.0:1787191332.705053:0:57733:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191332.712041:0:57733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ca80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57733:1874004626387072:192.168.202.101@tcp:33:lfs.0 00000080:00200080:3.0:1787191332.712089:0:57733:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x93:0x0](ffff936b5396a1c8) cmd=c00c66f3 arg=7ffc41b01bc4 00000080:00200008:3.0:1787191332.712555:0:57733:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0x93:0x0](ffff936b5396a1c8), flags 154002 00000100:00100000:3.0:1787191332.716459:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626387584:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191332.716488:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1a00/0xe5129dc884838bfe lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x93:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4600d66 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.716503:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1a00/0xe5129dc884838bfe lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x93:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600d66 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191332.716519:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b6a477800 x1874004626387584/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191348 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191332.716530:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1a00/0xe5129dc884838bfe lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x93:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600d66 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191332.716548:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1a00/0xe5129dc884838bfe lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x93:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600d66 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.716560:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/147 (0 0) 00000080:00200000:3.0:1787191332.716565:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x93:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1787191332.716583:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x93:0x0](ffff936b5396a1c8) for lock 0xe5129dc884838bfe 00000080:00010000:3.0:1787191332.716591:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884838bfe from it ffffa3fb41cab8c8 00010000:00010000:3.0:1787191332.716595:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1a00/0xe5129dc884838bfe lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x93:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4600d66 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.716606:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1a00/0xe5129dc884838bfe lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x93:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600d66 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191332.716630:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1a00/0xe5129dc884838bfe lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x93:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600d66 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191332.716642:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1a00/0xe5129dc884838bfe lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x93:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600d66 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:3.0:1787191332.716650:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0x93:0x0](00000000ca5bc91d) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1a00/0xe5129dc884838bfe lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x93:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600d66 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191332.716694:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0x93:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:3.0:1787191332.716699:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1a00/0xe5129dc884838bfe lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x93:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4600d66 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191332.716706:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1a00/0xe5129dc884838bfe lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x93:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4600d66 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:3.0:1787191332.716720:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0x93:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:3.0:1787191332.716727:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x93:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191332.716731:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0x93:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:3.0:1787191332.716738:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x93:0x0](ffff936b5396a1c8) 00000002:00010000:3.0:1787191332.716746:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x93:0x0]) in obj [0x200000405:0x93:0x0], intent: layout flags 02 00010000:00010000:3.0:1787191332.716760:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1a00/0xe5129dc884838bfe lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x93:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4600d66 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191332.716773:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0x93:0x0]: losing layout lock 00010000:00010000:3.0:1787191332.716798:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1a00/0xe5129dc884838bfe lrc: 1/0,0 mode: --/CR res: [0x200000405:0x93:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4600d66 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191332.716805:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191332.716808:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1a00/0xe5129dc884838bfe lrc: 0/0,0 mode: --/CR res: [0x200000405:0x93:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4600d66 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191332.716860:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884838c05 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x93:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.716868:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884838c05 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x93:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191332.716879:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191332.716887:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1ca80 x1874004626387840/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191332.716896:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884838c05 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x93:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191332.716920:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ca80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626387840:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191332.716985:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191332.730029:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191332.730090:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191332.730121:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634800768 00000100:00100000:3.0:1787191332.730127:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634800768 00000100:00100000:3.0:1787191332.730158:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634800896 00000100:00100000:3.0:1787191332.730161:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634800896 00000100:00100000:3.0:1787191332.730183:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1059 00000100:00100000:3.0:1787191332.730269:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30511:x1874004634800768:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191332.730277:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bcda4bea/0xe5129dc884838b4f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x169:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4600b4b expref: -99 pid: 57733 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:3.0:1787191332.730319:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191332.730324:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30511:x1874004634800768:12345-192.168.202.101@tcp:104: Request processed in 136us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191332.730329:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1059 00000100:00100000:3.0:1787191332.730341:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1060 00000100:00100000:3.0:1787191332.730344:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30510:x1874004634800896:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191332.730349:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000009bae9229/0xe5129dc884838afb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x166:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4600a6b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191332.730365:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787191332.730368:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30510:x1874004634800896:12345-192.168.202.101@tcp:104: Request processed in 24us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191332.730372:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1060 00000100:00100000:3.0:1787191332.730647:0:57570:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589936175 gen 1 00000100:00100000:3.0:1787191332.730716:0:57570:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b51d1ce00 x1874004626386560/t8589936171(8589936171) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191348 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787191332.730732:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ca80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626387840:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191332.730748:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884838c05 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x93:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600d74 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.730758:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884838c05 lrc: 4/0,1 mode: --/CR res: [0x200000405:0x93:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600d74 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.730770:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884838c05 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0x93:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4600d74 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.730781:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884838c05 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0x93:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600d74 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.730794:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884838c05 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0x93:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4600d74 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.730803:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884838c05 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0x93:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4600d74 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.730812:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884838c05 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x93:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4600d74 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191332.730822:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b51d1ca80 x1874004626387840/t8589936175(8589936175) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191348 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191332.730868:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884838c05 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x93:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600d74 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191332.730878:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884838c05 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x93:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600d74 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.730888:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/147 (0 0) 00000080:00200000:3.0:1787191332.730894:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x93:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1787191332.730906:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x93:0x0](ffff936b5396a1c8) for lock 0xe5129dc884838c05 00000080:00010000:3.0:1787191332.730916:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884838c05 from it ffffa3fb41cab930 00010000:00010000:3.0:1787191332.730919:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884838c05 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x93:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4600d74 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.730928:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884838c05 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x93:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600d74 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191332.730946:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:3.0:1787191332.730955:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x93:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:3.0:1787191332.730971:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884838c05 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x93:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600d74 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191332.730982:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884838c05 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x93:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600d74 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:3.0:1787191332.730990:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0x93:0x0](00000000ca5bc91d) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884838c05 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x93:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600d74 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191332.731120:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884838c05 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x93:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4600d74 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191332.731128:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884838c05 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x93:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600d74 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191332.731142:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x93:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1787191332.731152:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x93:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191332.731155:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191332.731161:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:3.0:1787191332.731321:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x93:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:3.0:1787191332.731336:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884838c05 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x93:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600d74 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191332.731345:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884838c05 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x93:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600d74 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:3.0:1787191332.731352:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0x93:0x0](00000000ca5bc91d) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884838c05 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x93:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600d74 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191332.731372:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x93:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00020000:00200000:3.0:1787191332.731377:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x93:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191332.731380:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191332.731382:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:3.0:1787191332.731394:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x93:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:3.0:1787191332.731426:0:57570:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000729b914c/0xe5129dc884838be2 lrc: 1/0,0 mode: PR/PR res: [0x280000401:0x16b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4600d20 expref: -99 pid: 57733 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000008:00010000:3.0:1787191332.731442:0:57570:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc884838be9 lrc: 1/0,0 mode: PR/PR res: [0x2c0000401:0x16e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4600d27 expref: -99 pid: 57733 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191332.731500:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0x93:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:3.0:1787191332.731505:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884838c05 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x93:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4600d74 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191332.731513:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884838c05 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x93:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4600d74 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00020000:00200000:3.0:1787191332.731526:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0x93:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:3.0:1787191332.731530:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x93:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191332.731533:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191332.731538:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191332.731548:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1787191332.731552:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:3.0:1787191332.731563:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:3.0:1787191332.731568:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b5235ce70, osc lock ffff936b44f657c0, flags 0x80000000 00000008:00010000:3.0:1787191332.731572:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:3.0:1787191332.731574:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b5235ceb0, osc lock ffff936b44f645f0, flags 0x80000000 00010000:00010000:3.0:1787191332.731610:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000eb2ebc95/0xe5129dc884838c0c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.731617:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000eb2ebc95/0xe5129dc884838c0c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16d:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.731628:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000eb2ebc95/0xe5129dc884838c0c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16d:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191332.731644:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ca80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626388224:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191332.731973:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787191332.740669:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626388608:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191332.740685:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc884838c1a lrc: 4/0,1 mode: --/PW res: [0x280000401:0x16a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600dc1 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.740699:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc884838c1a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x16a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4600dc1 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.740710:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc884838c1a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x16a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4600dc1 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.740721:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc884838c1a lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x16a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4600dc1 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191332.740731:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc884838c1a lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x16a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4600dc1 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.740742:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc884838c1a lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x16a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4600dc1 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.740756:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc884838c1a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x16a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4600dc1 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191332.747425:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626388992:192.168.202.101@tcp:10:bash.0 00000100:00100000:3.0:1787191332.747441:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626389120:192.168.202.101@tcp:10:bash.0 00000100:00100000:3.0:1787191332.772364:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634801024 00000100:00100000:3.0:1787191332.772374:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634801024 00000100:00100000:3.0:1787191332.772441:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1061 00000100:00100000:3.0:1787191332.772452:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634801024:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191332.772470:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc884838c28 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e4600de4 expref: -99 pid: 57739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.772671:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191332.772679:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634801024:12345-192.168.202.101@tcp:104: Request processed in 229us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191332.772686:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1061 00000100:00100000:3.0:1787191332.778996:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787191332.779150:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626390656:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00200000:3.0:1787191332.805425:0:57742:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191332.805434:0:57742:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191332.805442:0:57742:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191332.805449:0:57742:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191332.805456:0:57742:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191332.805460:0:57742:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191332.805462:0:57742:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191332.805465:0:57742:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41fd3bf8 00010000:00010000:3.0:1787191332.805468:0:57742:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191332.805475:0:57742:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191332.805483:0:57742:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191332.805487:0:57742:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191332.805490:0:57742:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191332.808454:0:57742:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:3.0:1787191332.808461:0:57742:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b44caf980, open_flags d900, mode 0 opened 0 00000080:00200000:3.0:1787191332.808615:0:57742:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191332.808623:0:57742:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191332.808629:0:57742:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191332.808636:0:57742:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191332.808643:0:57742:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191332.808647:0:57742:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191332.808650:0:57742:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191332.808655:0:57742:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41fd3b58 00010000:00010000:3.0:1787191332.808657:0:57742:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191332.808664:0:57742:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191332.808672:0:57742:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191332.808676:0:57742:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191332.808679:0:57742:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191332.812765:0:57742:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=9 00000080:00200008:3.0:1787191332.812779:0:57742:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0x95:0x0](ffff936b5396cb08), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191332.812785:0:57742:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x95:0x0](ffff936b5396cb08),name=f70.sanity-flr 00000002:00010000:3.0:1787191332.812802:0:57742:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x95:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191332.812810:0:57742:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc884838c59 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x95:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4600e85 expref: -99 pid: 57741 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191332.812819:0:57742:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc884838c59 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x95:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4600e85 expref: -99 pid: 57741 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191332.812825:0:57742:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191332.812863:0:57742:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x95:0x0](ffff936b5396cb08) 00000080:00010000:3.0:1787191332.812867:0:57742:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x95:0x0](ffff936b5396cb08) for lock 0xe5129dc884838c59 00000080:00010000:3.0:1787191332.812870:0:57742:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884838c59 from it ffffa3fb41fd3cb8 00010000:00010000:3.0:1787191332.812874:0:57742:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc884838c59 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x95:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4600e85 expref: -99 pid: 57741 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191332.812882:0:57742:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc884838c59 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x95:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4600e85 expref: -99 pid: 57741 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000100:00100000:3.0:1787191332.821872:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634801152 00000100:00100000:3.0:1787191332.821885:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634801152 00000080:00200000:3.0:1787191332.827899:0:57742:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191332.827912:0:57742:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191332.827925:0:57742:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191332.827939:0:57742:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191332.827947:0:57742:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191332.827953:0:57742:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191332.827956:0:57742:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191332.827962:0:57742:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41fd3bf8 00010000:00010000:3.0:1787191332.827966:0:57742:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191332.827974:0:57742:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191332.827987:0:57742:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191332.827993:0:57742:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191332.827998:0:57742:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191332.828012:0:57742:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b44caf980, open_flags d902, mode 0 opened 0 00000080:00200000:3.0:1787191332.828018:0:57742:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:3.0:1787191332.828034:0:57742:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154403 00010000:00010000:3.0:1787191332.828067:0:57742:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884838c67 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.828072:0:57742:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884838c67 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57742 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191332.828078:0:57742:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:3.0:1787191332.828082:0:57742:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1fb80 x1874004626392960/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191332.828087:0:57742:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884838c67 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191332.828095:0:57742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57742:1874004626392960:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191332.828579:0:57742:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cb40 going to sleep for 11 seconds 00000080:00200000:3.0:1787191332.832493:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191332.832512:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191332.832523:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191332.832534:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191332.832540:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191332.832547:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191332.832550:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191332.832556:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:3.0:1787191332.832559:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191332.832570:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191332.832584:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191332.832590:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191332.832595:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191332.832743:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:3.0:1787191332.832749:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x95:0x0](ffff936b5396cb08), inode mode 81a4 mask 42 00000080:00200008:3.0:1787191332.832753:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0x95:0x0](ffff936b5396cb08), flags 101101 00000002:00010000:3.0:1787191332.832778:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0x95:0x0], intent: getxattr flags 0 00010000:00010000:3.0:1787191332.832817:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884838c6e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x95:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.832826:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884838c6e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x95:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.832943:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884838c6e lrc: 3/1,0 mode: --/PR res: [0x200000405:0x95:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191332.832963:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626393088:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191332.833084:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191332.835605:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626393088:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191332.835626:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884838c6e lrc: 4/1,0 mode: --/PR res: [0x200000405:0x95:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600ed2 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.835639:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884838c6e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x95:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4600ed2 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.835650:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884838c6e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x95:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600ed2 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191332.835660:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b51d1c380 x1874004626393088/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191348 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191332.835667:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884838c6e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x95:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600ed2 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.835674:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/149 (0 0) 00000080:00200000:3.0:1787191332.835680:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0x95:0x0] suppgids 0 -1: rc 0 00000080:00010000:3.0:1787191332.835702:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x95:0x0](ffff936b5396cb08) for lock 0xe5129dc884838c6e 00000080:00010000:3.0:1787191332.835710:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884838c6e from it ffffa3fb41caba38 00010000:00010000:3.0:1787191332.835714:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884838c6e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x95:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4600ed2 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.835724:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884838c6e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x95:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600ed2 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:3.0:1787191332.835757:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0x95:0x0](ffff936b5396cb08) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191332.000000000, mtime 1787191332.000000000, ctime 1787191332.000000000 00010000:00010000:3.0:1787191332.835781:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884838c67 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x95:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4600ebd expref: -99 pid: 57742 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191332.835797:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0x95:0x0]: losing layout lock 00010000:00010000:3.0:1787191332.835825:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884838c67 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x95:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4600ebd expref: -99 pid: 57742 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191332.835865:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191332.835869:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884838c67 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x95:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4600ebd expref: -99 pid: 57742 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000020:00100000:3.0:1787191332.835888:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1787191332.835893:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1c380 x1874004626393472/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191332.835909:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626393472:192.168.202.101@tcp:36:bash.0 00000100:00100000:3.0:1787191332.836047:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191332.858566:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191332.858700:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191332.858732:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191332.859672:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191332.864227:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626394496:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191332.869569:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191332.875895:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626394496:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00200000:3.0:1787191332.878257:0:57742:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0x95:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1787191332.878265:0:57742:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51655280 (ffff936b465cc248/0) at cl_lock_release():245 00000020:00010000:3.0:1787191332.878272:0:57742:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51655280 (ffff936b465cc248/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191332.878280:0:57742:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7d1b0 (ffff936b465cc098/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191332.878285:0:57742:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51655280 (ffff936b465cc248/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191332.878292:0:57742:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7d1b0 (ffff936b465cc248/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191332.878310:0:57742:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x95:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191332.878351:0:57742:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0x95:0x0](ffff936b5396cb08), flags 154002 00000080:00200000:3.0:1787191332.878432:0:57742:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191332.878454:0:57742:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191332.878465:0:57742:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191332.878478:0:57742:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191332.878486:0:57742:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191332.878494:0:57742:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191332.878497:0:57742:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191332.878503:0:57742:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41fd3bf8 00010000:00010000:3.0:1787191332.878507:0:57742:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191332.878515:0:57742:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191332.878529:0:57742:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191332.878536:0:57742:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191332.878542:0:57742:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191332.878546:0:57742:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:3.0:1787191332.878550:0:57742:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x95:0x0](ffff936b5396cb08), inode mode 81a4 mask 44 00000080:00200008:3.0:1787191332.878556:0:57742:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0x95:0x0](ffff936b5396cb08), flags 154400 00000002:00010000:3.0:1787191332.878570:0:57742:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x95:0x0]) in obj [0x200000405:0x95:0x0], intent: open flags 0104240114401 00010000:00010000:3.0:1787191332.878616:0:57742:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884838c9f lrc: 3/1,0 mode: --/CR res: [0x200000405:0x95:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.878624:0:57742:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884838c9f lrc: 3/1,0 mode: --/CR res: [0x200000405:0x95:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57742 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191332.878636:0:57742:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191332.878644:0:57742:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1dc00 x1874004626395136/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191332.878654:0:57742:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884838c9f lrc: 3/1,0 mode: --/CR res: [0x200000405:0x95:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191332.878675:0:57742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57742:1874004626395136:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191332.879040:0:57742:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787191332.885201:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626395264:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191332.885218:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000002f2df026/0xe5129dc884838ca6 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x16f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600f57 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.885234:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000002f2df026/0xe5129dc884838ca6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x16f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4600f57 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.885246:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000002f2df026/0xe5129dc884838ca6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x16f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4600f57 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.885257:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000002f2df026/0xe5129dc884838ca6 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x16f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4600f57 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191332.885270:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000002f2df026/0xe5129dc884838ca6 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x16f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4600f57 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.885282:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000002f2df026/0xe5129dc884838ca6 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x16f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4600f57 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.885291:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000002f2df026/0xe5129dc884838ca6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x16f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4600f57 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191332.885390:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626395648:192.168.202.101@tcp:10:bash.0 00000100:00100000:3.0:1787191332.885436:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787191332.885442:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626395520:192.168.202.101@tcp:10:bash.0 00000080:00200000:3.0:1787191332.889445:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0x95:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1787191332.889453:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b53cc5218 (ffff936b47a17ea8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191332.889457:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b53cc5218 (ffff936b47a17ea8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191332.889462:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99630 (ffff936b47a175a8/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191332.889473:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc884838c91 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x16c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4600f34 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.889488:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc884838c91 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4600f34 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1787191332.889507:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99670 (ffff936b47a17008/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191332.889513:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000002f2df026/0xe5129dc884838ca6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x16f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4600f57 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.889521:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000002f2df026/0xe5129dc884838ca6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4600f57 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1787191332.889531:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b53cc5218 (ffff936b47a17ea8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191332.889535:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99630 (ffff936b47a17ea8/1) at cl_lock_fini():72 00000020:00010000:3.0:1787191332.889541:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99670 (ffff936b47a17ea8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191332.889605:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x95:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191332.889629:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0x95:0x0](ffff936b5396cb08) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191332.000000000, mtime 1787191332.000000000, ctime 1787191332.000000000, rc 0 00000080:00200008:3.0:1787191332.889825:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0x95:0x0], ppos: 0, count: 5 00000080:00200000:3.0:1787191332.889851:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:3.0:1787191332.889857:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:3.0:1787191332.889862:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:3.0:1787191332.889867:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:3.0:1787191332.889874:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@00000000bf2f0372[0x110, 1, [0x200000405:0x95:0x0] hash] 00000020:00200000:3.0:1787191332.889876:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:3.0:1787191332.889880:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x95:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:3.0:1787191332.889893:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0x95:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:3.0:1787191332.889898:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x95:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191332.889901:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:3.0:1787191332.889906:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1787191332.889913:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:3.0:1787191332.889917:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1787191332.889934:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:3.0:1787191332.889947:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:3.0:1787191332.889952:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b506678b0, osc lock ffff936b44f65db0, flags 0x0 00010000:00010000:3.0:1787191332.889971:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc884838c91 lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x16c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4600f34 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191332.889984:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc884838c91 lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x16c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4600f34 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191332.889996:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc884838c91 lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x16c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4600f34 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191332.890010:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc884838c91 lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x16c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4600f34 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191332.890017:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc884838c91 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x16c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4600f34 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191332.890029:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:3.0:1787191332.890037:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:3.0:1787191332.890072:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:3.0:1787191332.890080:0:57570:0:(rw26.c:927:ll_write_end()) page@00000000ca7e306a[3 00000000e7069d3c 2 1 00000000368de7cd 0 0 0] 00000080:00200000:3.0:1787191332.890084:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @00000000cec2ed55 17ffffc0001001 3:0 ffff936b508428c0 0 lru 00000080:00200000:3.0:1787191332.890090:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@00000000fed7422b 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000a2a44f55 00000000f9406232 > 3< 0 0 > 4< 0 0 8 311676928 - | - - - - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1787191332.890092:0:57570:0:(rw26.c:927:ll_write_end()) end page@00000000ca7e306a 00000080:00200000:3.0:1787191332.890094:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1787191332.890098:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:3.0:1787191332.890130:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 00000000be8d3648 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc884838c91 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x16c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4600f34 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191332.890150:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b5396ccb8, count 1, dirtied 1 00000080:00200000:3.0:1787191332.890156:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:3.0:1787191332.890158:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:3.0:1787191332.890173:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b42ff64e8 (ffff936b465cc248/0) at cl_lock_release():245 00000020:00010000:3.0:1787191332.890176:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42ff64e8 (ffff936b465cc248/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191332.890179:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b506678b0 (ffff936b465cc098/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191332.890184:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc884838c91 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x16c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4600f34 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191332.890206:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc884838c91 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x16c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4600f34 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:3.0:1787191332.890218:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42ff64e8 (ffff936b465cc248/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191332.890221:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b506678b0 (ffff936b465cc248/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191332.890228:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:3.0:1787191332.890232:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1787191332.890237:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x95:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191332.890240:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:3.0:1787191332.890245:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0x95:0x0] updating i_size 5 i_blocks 0 00000080:00200000:3.0:1787191332.890248:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:3.0:1787191332.890261:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0x95:0x0](ffff936b5396cb08), flags 100001 00000002:00100000:3.0:1787191332.890322:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1fb80 x1874004626392960/t8589936186(8589936186) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191348 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191332.890334:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191332.890339:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1df80 x1874004626395904/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191332.890360:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626395904:192.168.202.101@tcp:35:bash.0 00000100:00100000:3.0:1787191332.890441:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c840 going to sleep for 11 seconds 00000100:00100000:3.0:1787191332.943547:0:57745:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893000 going to sleep for 11 seconds 00000100:00100000:3.0:1787191332.946081:0:57745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57745:1874004626397056:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191332.946114:0:57745:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc884838cc2 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.946126:0:57745:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc884838cc2 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.946133:0:57745:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc884838cc2 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.946139:0:57745:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc884838cc2 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.946146:0:57745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc884838cc2 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.946151:0:57745:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b6a609c00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191332.946155:0:57745:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc884838cc2 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.946162:0:57745:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc884838cc2 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.946169:0:57745:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc884838cc2 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.946175:0:57745:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191332.946181:0:57745:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc884838cc2 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.946187:0:57745:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc884838cc2 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57745 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191332.946208:0:57745:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b453aa300 x1874004626397056/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191348 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191332.946221:0:57745:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191332.946297:0:57745:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191332.946318:0:57745:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191332.946327:0:57745:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191332.946336:0:57745:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191332.946342:0:57745:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191332.946347:0:57745:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191332.946349:0:57745:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191332.946354:0:57745:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41fe3b58 00010000:00010000:3.0:1787191332.946357:0:57745:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191332.946365:0:57745:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191332.946376:0:57745:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191332.946393:0:57745:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:3.0:1787191332.946402:0:57745:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:3.0:1787191332.946407:0:57745:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:3.0:1787191332.946418:0:57745:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191332.946425:0:57745:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 45 lru_type: 1 00010000:00010000:3.0:1787191332.946433:0:57745:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 45 lru_type: 1 00000002:00010000:3.0:1787191332.946447:0:57745:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191332.946488:0:57745:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838cc9 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.946496:0:57745:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838cc9 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.946504:0:57745:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838cc9 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57745 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191332.946523:0:57745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57745:1874004626397184:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191332.946590:0:57745:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c240 going to sleep for 11 seconds 00000100:00100000:3.0:1787191332.958644:0:57745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57745:1874004626397184:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191332.958669:0:57745:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838cc9 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600fdc expref: -99 pid: 57745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.958682:0:57745:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838cc9 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600fdc expref: -99 pid: 57745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.958706:0:57745:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838cc9 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4600fdc expref: -99 pid: 57745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.958718:0:57745:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838cc9 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600fdc expref: -99 pid: 57745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.958730:0:57745:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838cc9 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4600fdc expref: -99 pid: 57745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.958745:0:57745:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838cc9 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4600fdc expref: -99 pid: 57745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.958753:0:57745:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838cc9 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4600fdc expref: -99 pid: 57745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191332.958764:0:57745:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b51d1f480 x1874004626397184/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191348 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191332.958779:0:57745:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600fdc expref: -99 pid: 57745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.958788:0:57745:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:3.0:1787191332.958795:0:57745:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4600fdc expref: -99 pid: 57745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.958804:0:57745:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838cc9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600fdc expref: -99 pid: 57745 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:3.0:1787191332.958872:0:57745:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191332.958882:0:57745:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 90 lru_type: 1 00010000:00010000:3.0:1787191332.958893:0:57745:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 90 lru_type: 1 00010000:00010000:3.0:1787191332.958901:0:57745:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 90 lru_type: 1 00010000:00010000:3.0:1787191332.958909:0:57745:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 91 lru_type: 1 00000080:00200000:3.0:1787191332.958921:0:57745:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1787191332.958930:0:57745:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:3.0:1787191332.958933:0:57745:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:3.0:1787191332.958938:0:57745:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb41fe3cb8 00010000:00010000:3.0:1787191332.958942:0:57745:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 45 lru_type: 1 00010000:00010000:3.0:1787191332.958948:0:57745:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 46 lru_type: 1 00000002:00010000:3.0:1787191332.958962:0:57745:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191332.958967:0:57745:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838cc9 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600fdc expref: -99 pid: 57745 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191332.958974:0:57745:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838cc9 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600fdc expref: -99 pid: 57745 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191332.958980:0:57745:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4600fdc expref: -99 pid: 57745 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191332.958985:0:57745:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838cc9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4600fdc expref: -99 pid: 57745 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:3.0:1787191332.958992:0:57745:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191332.958997:0:57745:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 91 lru_type: 1 00010000:00010000:3.0:1787191332.959003:0:57745:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 91 lru_type: 1 00010000:00010000:3.0:1787191332.959008:0:57745:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 91 lru_type: 1 00010000:00010000:3.0:1787191332.959014:0:57745:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 92 lru_type: 1 00000080:00200008:3.0:1787191332.959506:0:57745:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:3.0:1787191332.959512:0:57745:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191332.959524:0:57745:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191332.959531:0:57745:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191332.959539:0:57745:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191332.959544:0:57745:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191332.959548:0:57745:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191332.959551:0:57745:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191332.959555:0:57745:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41fe3cb8 00010000:00010000:3.0:1787191332.959558:0:57745:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191332.959570:0:57745:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191332.959669:0:57745:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191332.959677:0:57745:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191332.959683:0:57745:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191332.959690:0:57745:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191332.959696:0:57745:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191332.959700:0:57745:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191332.959702:0:57745:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191332.959705:0:57745:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41fe3b58 00010000:00010000:3.0:1787191332.959708:0:57745:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191332.959715:0:57745:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191332.959722:0:57745:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191332.959727:0:57745:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:3.0:1787191332.959732:0:57745:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191332.963702:0:57745:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=8 00000080:00200000:3.0:1787191332.963744:0:57745:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191332.963773:0:57745:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191332.963792:0:57745:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191332.963809:0:57745:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191332.963817:0:57745:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191332.963824:0:57745:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191332.963827:0:57745:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191332.963857:0:57745:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41fe3bf8 00010000:00010000:3.0:1787191332.963861:0:57745:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191332.963869:0:57745:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191332.963885:0:57745:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191332.963891:0:57745:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191332.963896:0:57745:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191332.963900:0:57745:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:3.0:1787191332.963903:0:57745:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:3.0:1787191332.963907:0:57745:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b5258fe00, open_flags a141, mode 81b6 opened 0 00000080:00200000:3.0:1787191332.963916:0:57745:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:3.0:1787191332.963933:0:57745:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0x96:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:3.0:1787191332.963944:0:57745:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838cc9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4600fdc expref: -99 pid: 57745 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191332.963999:0:57745:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838cc9 lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4600fdc expref: -99 pid: 57745 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191332.964007:0:57745:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191332.964009:0:57745:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838cc9 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4600fdc expref: -99 pid: 57745 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191332.964040:0:57745:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884838cd7 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.964047:0:57745:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884838cd7 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57745 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191332.964059:0:57745:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191332.964072:0:57745:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1f480 x1874004626397696/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191332.964082:0:57745:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884838cd7 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57745 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191332.964117:0:57745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57745:1874004626397696:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191332.964511:0:57745:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c240 going to sleep for 11 seconds 00000100:00100000:3.0:1787191332.968019:0:57745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57745:1874004626397696:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191332.968043:0:57745:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884838cd7 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601006 expref: -99 pid: 57745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.968071:0:57745:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884838cd7 lrc: 4/0,1 mode: --/PR res: [0x200000405:0x96:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601006 expref: -99 pid: 57745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.968079:0:57745:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884838cd7 lrc: 4/0,1 mode: --/PR res: [0x200000405:0x96:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601006 expref: -99 pid: 57745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.968096:0:57745:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884838cd7 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x96:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601006 expref: -99 pid: 57745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.968289:0:57745:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884838cd7 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x96:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601006 expref: -99 pid: 57745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.968305:0:57745:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884838cd7 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x96:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601006 expref: -99 pid: 57745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.968324:0:57745:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884838cd7 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x96:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601006 expref: -99 pid: 57745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.968332:0:57745:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884838cd7 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x96:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601006 expref: -99 pid: 57745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191332.968344:0:57745:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b51d1f480 x1874004626397696/t8589936194(8589936194) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191348 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191332.968357:0:57745:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1f480 x1874004626397696/t8589936194(8589936194) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191348 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191332.968369:0:57745:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884838cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x96:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601006 expref: -99 pid: 57745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.968377:0:57745:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/150 (0 0) 00000080:00200000:3.0:1787191332.968383:0:57745:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191332.968396:0:57745:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:3.0:1787191332.968424:0:57745:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0x96:0x0](ffff936b489a9988) 00000080:00200000:3.0:1787191332.968432:0:57745:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0x96:0x0], updating i_size 0 00000080:00200000:3.0:1787191332.968465:0:57745:0:(file.c:6836:ll_layout_conf()) [0x200000405:0x96:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:3.0:1787191332.968470:0:57745:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0x96:0x0](ffff936b489a9988) 00000080:00010000:3.0:1787191332.968473:0:57745:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x96:0x0](ffff936b489a9988) for lock 0xe5129dc884838cd7 00000080:00010000:3.0:1787191332.968482:0:57745:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x96:0x0](ffff936b489a9988) 00000080:00200008:3.0:1787191332.968496:0:57745:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0x96:0x0](ffff936b489a9988), flags 120501 00000002:00100000:3.0:1787191332.968515:0:57745:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1f480 x1874004626397696/t8589936194(8589936194) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191348 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1787191332.968551:0:57745:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884838cd7 from it ffff936b466f4240 00010000:00010000:3.0:1787191332.968557:0:57745:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884838cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x96:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4601006 expref: -99 pid: 57745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.968565:0:57745:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884838cd7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x96:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4601006 expref: -99 pid: 57745 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191332.968587:0:57745:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x96:0x0](ffff936b489a9988), inode mode 81a4 mask 40 00000080:00200000:3.0:1787191332.968639:0:57745:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x96:0x0](ffff936b489a9988), inode mode 81a4 mask 2 00000080:00200000:3.0:1787191332.968649:0:57745:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0x96:0x0](ffff936b489a9988), xattr lov 00000002:00010000:3.0:1787191332.968666:0:57745:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x96:0x0]) in obj [0x200000405:0x96:0x0], intent: open flags 040000002 00010000:00010000:3.0:1787191332.968941:0:57745:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838cde lrc: 3/1,0 mode: --/CR res: [0x200000405:0x96:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.968950:0:57745:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838cde lrc: 3/1,0 mode: --/CR res: [0x200000405:0x96:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57745 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191332.968963:0:57745:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191332.968970:0:57745:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1d500 x1874004626397952/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191332.968983:0:57745:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838cde lrc: 3/1,0 mode: --/CR res: [0x200000405:0x96:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57745 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191332.969004:0:57745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57745:1874004626397952:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191332.970495:0:57745:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c240 going to sleep for 11 seconds 00000100:00100000:3.0:1787191332.974281:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634803072 00000100:00100000:3.0:1787191332.974292:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634803072 00000100:00100000:3.0:1787191332.974355:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1066 00000100:00100000:3.0:1787191332.974368:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634803072:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191332.974387:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884838cd7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x96:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4601006 expref: -99 pid: 57745 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191332.974854:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191332.974863:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634803072:12345-192.168.202.101@tcp:104: Request processed in 498us (1703us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191332.974872:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1066 00000100:00100000:3.0:1787191332.983864:0:57747:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57747:1874004626398208:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191332.983885:0:57747:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884838ce5 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x96:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.983900:0:57747:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884838ce5 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x96:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.983908:0:57747:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884838ce5 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x96:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.983915:0:57747:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884838ce5 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x96:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.983927:0:57747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884838ce5 lrc: 4/0,0 mode: --/CR res: [0x200000405:0x96:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.983956:0:57747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51fe0000 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191332.983961:0:57747:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884838ce5 lrc: 4/0,0 mode: --/CR res: [0x200000405:0x96:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.983969:0:57747:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884838ce5 lrc: 4/0,0 mode: --/CR res: [0x200000405:0x96:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.983975:0:57747:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884838ce5 lrc: 5/0,0 mode: --/CR res: [0x200000405:0x96:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.983980:0:57747:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191332.983986:0:57747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884838ce5 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x96:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57747 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.983991:0:57747:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884838ce5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x96:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57747 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191332.984006:0:57747:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b6a475500 x1874004626398208/t8589936195(8589936195) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191348 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191332.984016:0:57747:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475500 x1874004626398208/t8589936195(8589936195) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191348 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191332.984025:0:57747:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x96:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1787191332.984043:0:57747:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0x96:0x0], updating i_size 0 00000100:00100000:3.0:1787191332.985642:0:57745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57745:1874004626397952:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191332.985653:0:57745:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838cde lrc: 4/1,0 mode: --/CR res: [0x200000405:0x96:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.985661:0:57745:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838cde lrc: 4/1,0 mode: --/CR res: [0x200000405:0x96:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.985665:0:57745:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838cde lrc: 4/1,0 mode: --/CR res: [0x200000405:0x96:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.985670:0:57745:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838cde lrc: 3/0,0 mode: --/CR res: [0x200000405:0x96:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.985684:0:57745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838cde lrc: 4/0,0 mode: --/CR res: [0x200000405:0x96:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.985688:0:57745:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9b600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191332.985690:0:57745:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838cde lrc: 4/0,0 mode: --/CR res: [0x200000405:0x96:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.985694:0:57745:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838cde lrc: 4/0,0 mode: --/CR res: [0x200000405:0x96:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.985698:0:57745:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838cde lrc: 5/0,0 mode: --/CR res: [0x200000405:0x96:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.985702:0:57745:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191332.985706:0:57745:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838cde lrc: 3/0,0 mode: --/CR res: [0x200000405:0x96:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57745 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.985709:0:57745:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838cde lrc: 0/0,0 mode: --/CR res: [0x200000405:0x96:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57745 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191332.985724:0:57745:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b51d1d500 x1874004626397952/t8589936196(8589936196) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191348 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191332.985735:0:57745:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1d500 x1874004626397952/t8589936196(8589936196) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191348 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191332.985746:0:57745:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x96:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1787191332.985781:0:57745:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x96:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1787191332.985788:0:57745:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x96:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191332.985875:0:57745:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0x96:0x0], updating i_size 0 00000002:00100000:3.0:1787191332.985894:0:57745:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1d500 x1874004626397952/t8589936196(8589936196) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191348 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191332.985930:0:57745:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1d500 x1874004626397952/t8589936196(8589936196) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191348 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191332.985939:0:57745:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191332.985943:0:57745:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1dc00 x1874004626398848/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191332.985960:0:57745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57745:1874004626398848:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191332.988180:0:57745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57745:1874004626398848:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191332.988345:0:57745:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1d500 x1874004626397952/t8589936196(8589936196) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191348 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:3.0:1787191332.988405:0:57745:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0x96:0x0](ffff936b489a9988), flags 100001 00000002:00100000:3.0:1787191332.988453:0:57745:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1f480 x1874004626397696/t8589936194(8589936194) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191348 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191332.988463:0:57745:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191332.988468:0:57745:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1df80 x1874004626399104/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191332.988490:0:57745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57745:1874004626399104:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191332.988617:0:57745:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c240 going to sleep for 11 seconds 00000080:00200000:3.0:1787191332.991922:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191332.991948:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191332.991964:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191332.991979:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191332.991987:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191332.991994:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191332.991998:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191332.992005:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:3.0:1787191332.992009:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191332.992017:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191332.992032:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191332.992038:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191332.992043:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191332.994182:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:3.0:1787191332.994192:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x96:0x0](ffff936b489a9988), inode mode 81a4 mask 42 00000080:00200008:3.0:1787191332.994199:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0x96:0x0](ffff936b489a9988), flags 101101 00000002:00010000:3.0:1787191332.994214:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x96:0x0]) in obj [0x200000405:0x96:0x0], intent: open|creat flags 04240101102 00010000:00010000:3.0:1787191332.994228:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0800/0xe5129dc884838cec lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x96:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4601053 expref: -99 pid: 57747 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191332.994242:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0x96:0x0]: losing layout lock 00010000:00010000:3.0:1787191332.994269:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0800/0xe5129dc884838cec lrc: 1/0,0 mode: --/PR res: [0x200000405:0x96:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4601053 expref: -99 pid: 57747 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191332.994277:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191332.994280:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0800/0xe5129dc884838cec lrc: 0/0,0 mode: --/PR res: [0x200000405:0x96:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4601053 expref: -99 pid: 57747 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191332.994503:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838d01 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x96:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191332.994512:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838d01 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x96:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191332.994524:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191332.994530:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1fb80 x1874004626399872/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191332.994539:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838d01 lrc: 3/0,1 mode: --/CW res: [0x200000405:0x96:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191332.994553:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626399872:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191332.994688:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787191333.019591:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191333.037995:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191333.038033:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634803968 00000100:00100000:3.0:1787191333.038043:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634803968 00000100:00100000:3.0:1787191333.038110:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1068 00000100:00100000:3.0:1787191333.038121:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:29543:x1874004634803968:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191333.038139:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc884838c91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080030000 nid: local remote: 0x7130d520e4600f34 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191333.038220:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191333.038227:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:29543:x1874004634803968:12345-192.168.202.101@tcp:104: Request processed in 108us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191333.038235:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1068 00000100:00100000:3.0:1787191333.049972:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191333.055288:0:57748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57748:1874004626403072:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191333.055335:0:57748:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513bb100 x1874004626401920/t8589936208(8589936208) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191349 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191333.055708:0:57748:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191333.055728:0:57748:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191333.055745:0:57748:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191333.055761:0:57748:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191333.055769:0:57748:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191333.055775:0:57748:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191333.055778:0:57748:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191333.055785:0:57748:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41febb58 00010000:00010000:3.0:1787191333.055790:0:57748:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191333.055799:0:57748:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191333.055815:0:57748:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191333.055822:0:57748:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191333.055827:0:57748:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191333.055861:0:57748:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=9 00000080:00200000:3.0:1787191333.055865:0:57748:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:3.0:1787191333.055876:0:57748:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1787191333.055920:0:57748:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838d47 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.055928:0:57748:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838d47 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.055938:0:57748:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838d47 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57748 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191333.055956:0:57748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57748:1874004626403328:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191333.056023:0:57748:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191333.059278:0:57748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57748:1874004626403328:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191333.059304:0:57748:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838d47 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601148 expref: -99 pid: 57748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.059327:0:57748:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838d47 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x96:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601148 expref: -99 pid: 57748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.059341:0:57748:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838d47 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x96:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601148 expref: -99 pid: 57748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.059353:0:57748:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838d47 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x96:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601148 expref: -99 pid: 57748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.059365:0:57748:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838d47 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x96:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601148 expref: -99 pid: 57748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.059379:0:57748:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838d47 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x96:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601148 expref: -99 pid: 57748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.059388:0:57748:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838d47 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x96:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601148 expref: -99 pid: 57748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.059396:0:57748:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838d47 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x96:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601148 expref: -99 pid: 57748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191333.059408:0:57748:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b51d1c380 x1874004626403328/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/976 e 0 to 0 dl 1787191349 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191333.059421:0:57748:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838d47 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x96:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601148 expref: -99 pid: 57748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191333.059434:0:57748:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838d47 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x96:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601148 expref: -99 pid: 57748 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.059452:0:57748:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0200/0xe5129dc884838d2b lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x96:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4601110 expref: -99 pid: 57748 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.059467:0:57748:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0200/0xe5129dc884838d2b lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x96:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4601110 expref: -99 pid: 57748 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.059476:0:57748:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838d47 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x96:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601148 expref: -99 pid: 57748 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.059483:0:57748:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838d47 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x96:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x7130d520e4601148 expref: -99 pid: 57748 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.059490:0:57748:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838d47 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x96:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x7130d520e4601148 expref: -99 pid: 57748 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.059677:0:57748:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000080:00200000:3.0:1787191333.059690:0:57748:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191333.059742:0:57748:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0x96:0x0](ffff936b489a9988): rc = 0 00000080:00200000:3.0:1787191333.059756:0:57748:0:(file.c:6836:ll_layout_conf()) [0x200000405:0x96:0x0]: layout version change: 4 -> 4 00000080:00010000:3.0:1787191333.059760:0:57748:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x96:0x0](ffff936b489a9988) for lock 0xe5129dc884838d2b 00000080:00010000:3.0:1787191333.059772:0:57748:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x96:0x0](ffff936b489a9988) 00000080:00010000:3.0:1787191333.059775:0:57748:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884838d2b from it ffffa3fb41febb20 00010000:00010000:3.0:1787191333.059778:0:57748:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0200/0xe5129dc884838d2b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x96:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4601110 expref: -99 pid: 57748 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.059785:0:57748:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0200/0xe5129dc884838d2b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x96:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4601110 expref: -99 pid: 57748 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200008:3.0:1787191333.061108:0:57748:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0x96:0x0](ffff936b489a9988), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191333.061123:0:57748:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x96:0x0](ffff936b489a9988),name=f70.sanity-flr 00000002:00010000:3.0:1787191333.061152:0:57748:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x96:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191333.061168:0:57748:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0200/0xe5129dc884838d2b lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x96:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4601110 expref: -99 pid: 57748 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191333.061180:0:57748:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0200/0xe5129dc884838d2b lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x96:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4601110 expref: -99 pid: 57748 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191333.061258:0:57748:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191333.061266:0:57748:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x96:0x0](ffff936b489a9988) 00000080:00010000:3.0:1787191333.061270:0:57748:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x96:0x0](ffff936b489a9988) for lock 0xe5129dc884838d2b 00000080:00010000:3.0:1787191333.061277:0:57748:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884838d2b from it ffffa3fb41febcb8 00010000:00010000:3.0:1787191333.061281:0:57748:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0200/0xe5129dc884838d2b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x96:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4601110 expref: -99 pid: 57748 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191333.061290:0:57748:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0200/0xe5129dc884838d2b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x96:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4601110 expref: -99 pid: 57748 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787191333.061319:0:57748:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x96:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:3.0:1787191333.061331:0:57748:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x96:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191333.061335:0:57748:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191333.061338:0:57748:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x96:0x0] 00000008:00010000:3.0:1787191333.061357:0:57748:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191333.061361:0:57748:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667b30, osc lock ffff936b44f65db0, flags 0x400000400001002 00010000:00010000:3.0:1787191333.061379:0:57748:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007a412388/0xe5129dc884838d32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x171:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460111e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191333.061391:0:57748:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007a412388/0xe5129dc884838d32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x171:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460111e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:3.0:1787191333.061403:0:57748:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191333.061407:0:57748:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007a412388/0xe5129dc884838d32 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x171:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460111e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191333.061415:0:57748:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007a412388/0xe5129dc884838d32 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x171:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460111e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:3.0:1787191333.061425:0:57748:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191333.061434:0:57748:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0x96:0x0] updating i_size 5 i_blocks 0 00000020:00010000:3.0:1787191333.061439:0:57748:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51655280 (ffff936b465cc248/0) at cl_lock_release():245 00000020:00010000:3.0:1787191333.061442:0:57748:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51655280 (ffff936b465cc248/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191333.061445:0:57748:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667b30 (ffff936b465cc098/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191333.061449:0:57748:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51655280 (ffff936b465cc248/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191333.061452:0:57748:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667b30 (ffff936b465cc248/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191333.061462:0:57748:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x96:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191333.061495:0:57748:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191333.061504:0:57748:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191333.061512:0:57748:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191333.061520:0:57748:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191333.061537:0:57748:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191333.061542:0:57748:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191333.061544:0:57748:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191333.061548:0:57748:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41febbf8 00010000:00010000:3.0:1787191333.061552:0:57748:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191333.061560:0:57748:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191333.061568:0:57748:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191333.061574:0:57748:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191333.061579:0:57748:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191333.061582:0:57748:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:3.0:1787191333.061585:0:57748:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x96:0x0](ffff936b489a9988), inode mode 81a4 mask 46 00000080:00200008:3.0:1787191333.061590:0:57748:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0x96:0x0](ffff936b489a9988), flags 154402 00000002:00010000:3.0:1787191333.061605:0:57748:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x96:0x0]) in obj [0x200000405:0x96:0x0], intent: open flags 0104240114403 00010000:00010000:3.0:1787191333.061650:0:57748:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884838d4e lrc: 3/1,0 mode: --/CR res: [0x200000405:0x96:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x10000000000000 pid: 57748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.061657:0:57748:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884838d4e lrc: 3/1,0 mode: --/CR res: [0x200000405:0x96:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x0 pid: 57748 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191333.061667:0:57748:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191333.061676:0:57748:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1c380 x1874004626403968/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191333.061686:0:57748:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884838d4e lrc: 3/1,0 mode: --/CR res: [0x200000405:0x96:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x0 pid: 57748 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191333.061705:0:57748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57748:1874004626403968:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191333.061829:0:57748:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c300 going to sleep for 11 seconds 00000100:00100000:3.0:1787191333.074546:0:57748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57748:1874004626404480:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191333.074570:0:57748:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884838d55 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.074584:0:57748:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884838d55 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.074591:0:57748:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884838d55 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.074598:0:57748:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884838d55 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.074607:0:57748:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884838d55 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.074613:0:57748:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd4400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191333.074617:0:57748:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884838d55 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.074625:0:57748:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884838d55 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.074632:0:57748:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884838d55 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.074639:0:57748:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191333.074646:0:57748:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884838d55 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.074653:0:57748:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884838d55 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57748 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191333.074820:0:57748:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x7, status=0 req@ffff936b513b9500 x1874004626404480/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/608 e 0 to 0 dl 1787191349 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191333.074901:0:57748:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000100:00100000:3.0:1787191333.117004:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191333.117036:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634804864 00000100:00100000:3.0:1787191333.117043:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634804864 00000100:00100000:3.0:1787191333.117089:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1071 00000100:00100000:3.0:1787191333.117596:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634804864:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191333.117610:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc884838d86 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e460121a expref: -99 pid: 57750 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.117709:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191333.117717:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634804864:12345-192.168.202.101@tcp:104: Request processed in 126us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191333.117723:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1071 00000100:00100000:3.0:1787191333.150918:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634806016 00000100:00100000:3.0:1787191333.150928:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634806016 00000100:00100000:3.0:1787191333.151004:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634806144 00000100:00100000:3.0:1787191333.151009:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634806144 00000100:00100000:3.0:1787191333.152414:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191333.152541:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634806272 00000100:00100000:3.0:1787191333.152547:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634806272 00000100:00100000:3.0:1787191333.152573:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1074 00000100:00100000:3.0:1787191333.152580:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+5:30511:x1874004634806272:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191333.152588:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000cfb66679/0xe5129dc884838cf3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x16f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4601061 expref: -99 pid: 57747 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.152628:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191333.152634:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+5:30511:x1874004634806272:12345-192.168.202.101@tcp:104: Request processed in 55us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191333.152640:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1074 00000100:00100000:3.0:1787191333.152959:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191333.152974:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634806400 00000100:00100000:3.0:1787191333.152977:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634806400 00000100:00100000:3.0:1787191333.152994:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1075 00000100:00100000:3.0:1787191333.153000:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8720:x1874004634806400:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191333.153007:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009bae9229/0xe5129dc884838cfa lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x172:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4601068 expref: -99 pid: 57747 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.153040:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787191333.153045:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8720:x1874004634806400:12345-192.168.202.101@tcp:104: Request processed in 45us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191333.153051:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1075 00010000:00010000:3.0:1787191333.153064:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787191333.153069:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000cfb66679/0xe5129dc884838cf3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x16f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4601061 expref: -99 pid: 57747 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.153076:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51fe1a00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191333.153079:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000cfb66679/0xe5129dc884838cf3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x16f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e4601061 expref: -99 pid: 57747 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.153113:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000cfb66679/0xe5129dc884838cf3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x16f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4601061 expref: -99 pid: 57747 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.153120:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191333.153135:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000cfb66679/0xe5129dc884838cf3 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x16f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4601061 expref: -99 pid: 57747 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.153143:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000cfb66679/0xe5129dc884838cf3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x16f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4601061 expref: -99 pid: 57747 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.153157:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191333.153160:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009bae9229/0xe5129dc884838cfa lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x172:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4601068 expref: -99 pid: 57747 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.153166:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51fe0e00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191333.153170:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009bae9229/0xe5129dc884838cfa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x172:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e4601068 expref: -99 pid: 57747 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.153195:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009bae9229/0xe5129dc884838cfa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x172:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4601068 expref: -99 pid: 57747 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.153202:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191333.153208:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009bae9229/0xe5129dc884838cfa lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x172:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4601068 expref: -99 pid: 57747 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.153222:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009bae9229/0xe5129dc884838cfa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x172:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4601068 expref: -99 pid: 57747 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.153234:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191333.153236:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191333.153237:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:3.0:1787191333.175794:0:57755:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191333.175829:0:57755:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191333.176003:0:57755:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191333.176021:0:57755:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191333.176031:0:57755:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191333.176085:0:57755:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191333.176089:0:57755:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191333.176113:0:57755:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41ffbb58 00010000:00010000:3.0:1787191333.176118:0:57755:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191333.176127:0:57755:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191333.176144:0:57755:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191333.176152:0:57755:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:3.0:1787191333.176158:0:57755:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191333.178240:0:57755:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:3.0:1787191333.178245:0:57755:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:3.0:1787191333.178264:0:57755:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1787191333.178302:0:57755:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884838de8 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.178316:0:57755:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884838de8 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.178323:0:57755:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884838de8 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191333.178337:0:57755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57755:1874004626411136:192.168.202.101@tcp:101:rm.0 00000100:00100000:3.0:1787191333.178405:0:57755:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191333.181251:0:57755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57755:1874004626411136:192.168.202.101@tcp:101:rm.0 00010000:00010000:3.0:1787191333.181269:0:57755:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884838de8 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601347 expref: -99 pid: 57755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.181290:0:57755:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884838de8 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x97:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601347 expref: -99 pid: 57755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.181297:0:57755:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884838de8 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601347 expref: -99 pid: 57755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.181320:0:57755:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884838de8 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601347 expref: -99 pid: 57755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.181331:0:57755:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884838de8 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601347 expref: -99 pid: 57755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.181344:0:57755:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884838de8 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601347 expref: -99 pid: 57755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.181352:0:57755:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884838de8 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601347 expref: -99 pid: 57755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.181360:0:57755:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884838de8 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601347 expref: -99 pid: 57755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191333.181372:0:57755:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b51d1fb80 x1874004626411136/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/976 e 0 to 0 dl 1787191349 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191333.181384:0:57755:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884838de8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601347 expref: -99 pid: 57755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191333.181398:0:57755:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884838de8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601347 expref: -99 pid: 57755 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.181409:0:57755:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc884838de1 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4601324 expref: -99 pid: 57754 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191333.181422:0:57755:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc884838de1 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4601324 expref: -99 pid: 57754 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191333.181429:0:57755:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884838de8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601347 expref: -99 pid: 57755 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.181436:0:57755:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884838de8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x7130d520e4601347 expref: -99 pid: 57755 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.181444:0:57755:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884838de8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x7130d520e4601347 expref: -99 pid: 57755 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.181470:0:57755:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000080:00200000:3.0:1787191333.181478:0:57755:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191333.181531:0:57755:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0x97:0x0](ffff936b53968908): rc = 0 00000080:00200000:3.0:1787191333.181548:0:57755:0:(file.c:6836:ll_layout_conf()) [0x200000405:0x97:0x0]: layout version change: 4 -> 4 00000080:00010000:3.0:1787191333.181554:0:57755:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x97:0x0](ffff936b53968908) for lock 0xe5129dc884838de1 00000080:00010000:3.0:1787191333.181568:0:57755:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x97:0x0](ffff936b53968908) 00000080:00010000:3.0:1787191333.181572:0:57755:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884838de1 from it ffffa3fb41ffbb20 00010000:00010000:3.0:1787191333.181575:0:57755:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc884838de1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4601324 expref: -99 pid: 57754 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191333.181585:0:57755:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc884838de1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4601324 expref: -99 pid: 57754 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200008:3.0:1787191333.181624:0:57755:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0x97:0x0](ffff936b53968908), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191333.181631:0:57755:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x97:0x0](ffff936b53968908),name=f70.sanity-flr 00000002:00010000:3.0:1787191333.181734:0:57755:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x97:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191333.181742:0:57755:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc884838de1 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4601324 expref: -99 pid: 57754 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191333.181750:0:57755:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc884838de1 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4601324 expref: -99 pid: 57754 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787191333.181756:0:57755:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191333.181763:0:57755:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x97:0x0](ffff936b53968908) 00000080:00010000:3.0:1787191333.181766:0:57755:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x97:0x0](ffff936b53968908) for lock 0xe5129dc884838de1 00000080:00010000:3.0:1787191333.181770:0:57755:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884838de1 from it ffffa3fb41ffbcb8 00010000:00010000:3.0:1787191333.181773:0:57755:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc884838de1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4601324 expref: -99 pid: 57754 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191333.181780:0:57755:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc884838de1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4601324 expref: -99 pid: 57754 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:3.0:1787191333.181801:0:57755:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x97:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:3.0:1787191333.181812:0:57755:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x97:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191333.181816:0:57755:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191333.181820:0:57755:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x97:0x0] 00000008:00010000:3.0:1787191333.182541:0:57755:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191333.182546:0:57755:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667730, osc lock ffff936b44f65db0, flags 0x400000400001002 00010000:00010000:3.0:1787191333.182564:0:57755:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000877a7f5d/0xe5129dc884838dd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x170:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4601301 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191333.182577:0:57755:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000877a7f5d/0xe5129dc884838dd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x170:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4601301 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:3.0:1787191333.182589:0:57755:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191333.182593:0:57755:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000877a7f5d/0xe5129dc884838dd3 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x170:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4601301 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191333.182600:0:57755:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000877a7f5d/0xe5129dc884838dd3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x170:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4601301 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:3.0:1787191333.182617:0:57755:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191333.182625:0:57755:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0x97:0x0] updating i_size 5 i_blocks 0 00000020:00010000:3.0:1787191333.182631:0:57755:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51655280 (ffff936b465cc248/0) at cl_lock_release():245 00000020:00010000:3.0:1787191333.182635:0:57755:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51655280 (ffff936b465cc248/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191333.182638:0:57755:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667730 (ffff936b465cc098/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191333.182642:0:57755:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51655280 (ffff936b465cc248/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191333.182644:0:57755:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667730 (ffff936b465cc248/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191333.182654:0:57755:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x97:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191333.182697:0:57755:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191333.182711:0:57755:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191333.182719:0:57755:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191333.182728:0:57755:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191333.182735:0:57755:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191333.182740:0:57755:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191333.182743:0:57755:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191333.182747:0:57755:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41ffbc10 00010000:00010000:3.0:1787191333.182750:0:57755:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191333.182757:0:57755:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191333.182820:0:57755:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191333.183231:0:57755:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:3.0:1787191333.183239:0:57755:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191333.183247:0:57755:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:3.0:1787191333.183250:0:57755:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:3.0:1787191333.183255:0:57755:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:3.0:1787191333.183283:0:57755:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc884838dcc lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x97:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46012c2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787191333.183297:0:57755:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0x97:0x0]: losing layout lock 00010000:00010000:3.0:1787191333.183494:0:57755:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc884838de1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4601324 expref: -99 pid: 57754 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:3.0:1787191333.183506:0:57755:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0x97:0x0]: losing layout lock 00010000:00010000:3.0:1787191333.183516:0:57755:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc884838dbe lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x97:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e46012a6 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.183554:0:57755:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc884838dcc lrc: 1/0,0 mode: --/CR res: [0x200000405:0x97:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46012c2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191333.183562:0:57755:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc884838de1 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4601324 expref: -99 pid: 57754 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1787191333.183568:0:57755:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc884838dbe lrc: 1/0,0 mode: --/PR res: [0x200000405:0x97:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46012a6 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.183573:0:57755:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:3.0:1787191333.183576:0:57755:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc884838dcc lrc: 0/0,0 mode: --/CR res: [0x200000405:0x97:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46012c2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191333.183588:0:57755:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc884838de1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x97:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4601324 expref: -99 pid: 57754 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1787191333.183597:0:57755:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc884838dbe lrc: 0/0,0 mode: --/PR res: [0x200000405:0x97:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46012a6 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:3.0:1787191333.183615:0:57755:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 36, max 7 00000100:00100000:3.0:1787191333.183625:0:57755:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1fb80 x1874004626411776/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191333.183646:0:57755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57755:1874004626411776:192.168.202.101@tcp:36:rm.0 00000100:00100000:3.0:1787191333.183764:0:57755:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cf00 going to sleep for 11 seconds 00000080:00200000:3.0:1787191333.197390:0:57757:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191333.197407:0:57757:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191333.197419:0:57757:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191333.197431:0:57757:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191333.197438:0:57757:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191333.197444:0:57757:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191333.197448:0:57757:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191333.197453:0:57757:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41ffbbf8 00010000:00010000:3.0:1787191333.197457:0:57757:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191333.197470:0:57757:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191333.197483:0:57757:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191333.197488:0:57757:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191333.197493:0:57757:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191333.199610:0:57757:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b51dd7c80, open_flags d900, mode 0 opened 0 00000080:00200000:3.0:1787191333.199619:0:57757:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:3.0:1787191333.199639:0:57757:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:3.0:1787191333.199809:0:57757:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884838dfd lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.199816:0:57757:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884838dfd lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57757 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191333.199824:0:57757:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191333.199828:0:57757:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1d880 x1874004626412288/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191333.199868:0:57757:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884838dfd lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57757 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191333.199893:0:57757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57757:1874004626412288:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191333.200160:0:57757:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787191333.218543:0:57757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57757:1874004626412672:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191333.218563:0:57757:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884838e12 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.218578:0:57757:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884838e12 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.218584:0:57757:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884838e12 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.218590:0:57757:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884838e12 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.218598:0:57757:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884838e12 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.218603:0:57757:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd4400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191333.218607:0:57757:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884838e12 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.218614:0:57757:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884838e12 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.218620:0:57757:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884838e12 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.218627:0:57757:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191333.218634:0:57757:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884838e12 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.218640:0:57757:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884838e12 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57757 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191333.218657:0:57757:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513b9c00 x1874004626412672/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191349 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191333.218739:0:57757:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1787191333.218774:0:57757:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc884838e0b lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46013c5 expref: -99 pid: 57756 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191333.218786:0:57757:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc884838e0b lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46013c5 expref: -99 pid: 57756 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:3.0:1787191333.218794:0:57757:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884838e0b from it ffffa3fb41ffb930 00010000:00010000:3.0:1787191333.218797:0:57757:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc884838e0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46013c5 expref: -99 pid: 57756 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191333.218805:0:57757:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc884838e0b lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46013c5 expref: -99 pid: 57756 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000100:00100000:3.0:1787191333.235604:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191333.282600:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1077 00000100:00100000:3.0:1787191333.282615:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b50883850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634806784:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191333.282632:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc884838e51 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x98:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e460149e expref: -99 pid: 57758 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.284195:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1787191333.284208:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b50883850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634806784:12345-192.168.202.101@tcp:104: Request processed in 1594us (1779us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191333.284219:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1077 00000100:00100000:3.0:1787191333.298519:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191333.298616:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00010000:00010000:3.0:1787191333.302182:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191333.306161:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626417536:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191333.306308:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191333.306413:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191333.306467:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634808192 00000100:00100000:3.0:1787191333.306474:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634808192 00000100:00100000:3.0:1787191333.306514:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634808320 00000100:00100000:3.0:1787191333.306517:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634808320 00000100:00100000:3.0:1787191333.306535:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1080 00000100:00100000:3.0:1787191333.306545:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8420:x1874004634808192:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191333.306558:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc884838dda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x173:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4601308 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.306607:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191333.306614:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8420:x1874004634808192:12345-192.168.202.101@tcp:104: Request processed in 71us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191333.306621:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1080 00000100:00100000:3.0:1787191333.306638:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1081 00000100:00100000:3.0:1787191333.306644:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30511:x1874004634808320:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191333.306652:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000877a7f5d/0xe5129dc884838dd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x170:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4601301 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191333.306742:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787191333.306748:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30511:x1874004634808320:12345-192.168.202.101@tcp:104: Request processed in 104us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191333.306754:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1081 00010000:00010000:3.0:1787191333.306779:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787191333.306787:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc884838dda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x173:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4601308 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.306797:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51fe0a00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191333.306803:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc884838dda lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x173:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4601308 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.306861:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc884838dda lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x173:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4601308 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.306869:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191333.306883:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc884838dda lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x173:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4601308 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.306891:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc884838dda lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x173:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4601308 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.306907:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191333.306911:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000877a7f5d/0xe5129dc884838dd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x170:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4601301 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191333.306917:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51fe0200 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191333.306920:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000877a7f5d/0xe5129dc884838dd3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x170:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4601301 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191333.306956:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000877a7f5d/0xe5129dc884838dd3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x170:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4601301 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191333.306968:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191333.306975:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000877a7f5d/0xe5129dc884838dd3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x170:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4601301 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191333.306982:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000877a7f5d/0xe5129dc884838dd3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x170:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4601301 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191333.306996:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191333.306998:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191333.307000:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191333.307010:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626417664:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191333.307045:0:2392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787191333.307051:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626417792:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191333.311924:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626417792:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191333.311955:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626417664:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191333.313271:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191333.335738:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634808576 00000100:00100000:3.0:1787191333.335748:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634808576 00000100:00100000:3.0:1787191333.335808:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1083 00000100:00100000:3.0:1787191333.335819:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634808576:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191333.335861:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc884838e5f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x98:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46014dd expref: -99 pid: 57759 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191333.335959:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191333.335965:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634808576:12345-192.168.202.101@tcp:104: Request processed in 149us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191333.335973:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1083 00000100:00100000:3.0:1787191333.351463:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634808832 00000100:00100000:3.0:1787191333.351472:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634808832 00000100:00100000:3.0:1787191333.351570:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1085 00000100:00100000:3.0:1787191333.351581:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634808832:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191333.351600:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc884838e89 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x98:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4601546 expref: -99 pid: 57759 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.351695:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191333.351703:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634808832:12345-192.168.202.101@tcp:104: Request processed in 124us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191333.351711:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1085 00000100:00100000:3.0:1787191333.364108:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634808960 00000100:00100000:3.0:1787191333.364117:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634808960 00000100:00100000:3.0:1787191333.364168:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1086 00000100:00100000:3.0:1787191333.364177:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:29543:x1874004634808960:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191333.364196:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b9bf1031/0xe5129dc884838e66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x175:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420080000000 nid: local remote: 0x7130d520e46014f9 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1787191333.364272:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191333.364279:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:29543:x1874004634808960:12345-192.168.202.101@tcp:104: Request processed in 104us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191333.364290:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1086 00000100:00100000:3.0:1787191333.380092:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626420608:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191333.387000:0:57761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57761:1874004626421120:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191333.387032:0:57761:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc884838ea5 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.387046:0:57761:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc884838ea5 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.387053:0:57761:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc884838ea5 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.387060:0:57761:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc884838ea5 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.387070:0:57761:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc884838ea5 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.387075:0:57761:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b6a609400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191333.387080:0:57761:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc884838ea5 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.387087:0:57761:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc884838ea5 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.387102:0:57761:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc884838ea5 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.387110:0:57761:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191333.387119:0:57761:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc884838ea5 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.387125:0:57761:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609400/0xe5129dc884838ea5 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191333.387146:0:57761:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b453a8a80 x1874004626421120/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191349 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191333.387162:0:57761:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191333.387257:0:57761:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191333.387274:0:57761:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191333.387286:0:57761:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191333.387297:0:57761:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191333.387303:0:57761:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191333.387308:0:57761:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191333.387311:0:57761:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191333.387316:0:57761:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42003b58 00010000:00010000:3.0:1787191333.387320:0:57761:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191333.387327:0:57761:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191333.387341:0:57761:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191333.387348:0:57761:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:3.0:1787191333.387357:0:57761:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:3.0:1787191333.387361:0:57761:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:3.0:1787191333.387372:0:57761:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191333.387379:0:57761:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 48 lru_type: 1 00010000:00010000:3.0:1787191333.387387:0:57761:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 48 lru_type: 1 00000002:00010000:3.0:1787191333.387507:0:57761:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191333.387882:0:57761:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884838eac lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.387891:0:57761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884838eac lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.387901:0:57761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884838eac lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191333.387922:0:57761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57761:1874004626421248:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191333.388015:0:57761:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191333.396428:0:57761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57761:1874004626421248:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191333.396488:0:57761:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884838eac lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46015bd expref: -99 pid: 57761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.396501:0:57761:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884838eac lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46015bd expref: -99 pid: 57761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.396512:0:57761:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884838eac lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46015bd expref: -99 pid: 57761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.396525:0:57761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884838eac lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46015bd expref: -99 pid: 57761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.396538:0:57761:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884838eac lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46015bd expref: -99 pid: 57761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.396547:0:57761:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884838eac lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46015bd expref: -99 pid: 57761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.396555:0:57761:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884838eac lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46015bd expref: -99 pid: 57761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191333.396566:0:57761:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b51d1df80 x1874004626421248/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191349 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191333.396580:0:57761:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884838eac lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46015bd expref: -99 pid: 57761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.396590:0:57761:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:3.0:1787191333.396597:0:57761:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884838eac lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46015bd expref: -99 pid: 57761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.396606:0:57761:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884838eac lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46015bd expref: -99 pid: 57761 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:3.0:1787191333.396633:0:57761:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191333.396643:0:57761:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 96 lru_type: 1 00010000:00010000:3.0:1787191333.396655:0:57761:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 96 lru_type: 1 00010000:00010000:3.0:1787191333.396664:0:57761:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 96 lru_type: 1 00010000:00010000:3.0:1787191333.396671:0:57761:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 97 lru_type: 1 00000080:00200000:3.0:1787191333.396683:0:57761:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1787191333.396692:0:57761:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:3.0:1787191333.396696:0:57761:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:3.0:1787191333.396702:0:57761:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb42003cb8 00010000:00010000:3.0:1787191333.396705:0:57761:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 48 lru_type: 1 00010000:00010000:3.0:1787191333.396713:0:57761:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 49 lru_type: 1 00000002:00010000:3.0:1787191333.396728:0:57761:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191333.396735:0:57761:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884838eac lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46015bd expref: -99 pid: 57761 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.396743:0:57761:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884838eac lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46015bd expref: -99 pid: 57761 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.396750:0:57761:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884838eac lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46015bd expref: -99 pid: 57761 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.396758:0:57761:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884838eac lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46015bd expref: -99 pid: 57761 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:3.0:1787191333.396766:0:57761:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191333.396772:0:57761:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 97 lru_type: 1 00010000:00010000:3.0:1787191333.396779:0:57761:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 97 lru_type: 1 00010000:00010000:3.0:1787191333.396787:0:57761:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 97 lru_type: 1 00010000:00010000:3.0:1787191333.396794:0:57761:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 98 lru_type: 1 00000080:00200008:3.0:1787191333.397367:0:57761:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:3.0:1787191333.397375:0:57761:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191333.397388:0:57761:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191333.397397:0:57761:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191333.397406:0:57761:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191333.397413:0:57761:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191333.397418:0:57761:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191333.397422:0:57761:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191333.397426:0:57761:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42003cb8 00010000:00010000:3.0:1787191333.397430:0:57761:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191333.397437:0:57761:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191333.397552:0:57761:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191333.397562:0:57761:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191333.397568:0:57761:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191333.397577:0:57761:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191333.397583:0:57761:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191333.397587:0:57761:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191333.397590:0:57761:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191333.397594:0:57761:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42003b58 00010000:00010000:3.0:1787191333.397597:0:57761:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191333.397604:0:57761:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191333.397612:0:57761:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191333.397618:0:57761:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:3.0:1787191333.397623:0:57761:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191333.397632:0:57761:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:3.0:1787191333.397637:0:57761:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:3.0:1787191333.397648:0:57761:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1787191333.397701:0:57761:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838eba lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.397709:0:57761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838eba lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.397718:0:57761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838eba lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191333.397742:0:57761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57761:1874004626421504:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191333.397818:0:57761:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191333.409534:0:57761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57761:1874004626421504:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191333.409557:0:57761:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838eba lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.409570:0:57761:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838eba lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.409577:0:57761:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838eba lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.409584:0:57761:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838eba lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.409599:0:57761:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838eba lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.409610:0:57761:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9b000 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191333.409615:0:57761:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838eba lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.409622:0:57761:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838eba lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.409628:0:57761:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838eba lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.409635:0:57761:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191333.409642:0:57761:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838eba lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.409649:0:57761:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838eba lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191333.409666:0:57761:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b51d1df80 x1874004626421504/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191349 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191333.409693:0:57761:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1787191333.409725:0:57761:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884838eac lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46015bd expref: -99 pid: 57761 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191333.409738:0:57761:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884838eac lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46015bd expref: -99 pid: 57761 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:3.0:1787191333.409747:0:57761:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884838eac from it ffffa3fb42003930 00010000:00010000:3.0:1787191333.409751:0:57761:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884838eac lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46015bd expref: -99 pid: 57761 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191333.409765:0:57761:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884838eac lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46015bd expref: -99 pid: 57761 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787191333.409890:0:57761:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191333.409907:0:57761:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191333.409915:0:57761:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191333.409923:0:57761:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191333.409967:0:57761:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191333.409974:0:57761:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191333.409977:0:57761:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191333.409982:0:57761:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42003bf8 00010000:00010000:3.0:1787191333.409986:0:57761:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191333.409993:0:57761:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191333.410001:0:57761:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191333.410009:0:57761:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191333.410014:0:57761:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191333.410020:0:57761:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:3.0:1787191333.410024:0:57761:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:3.0:1787191333.410028:0:57761:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b51dd7080, open_flags a141, mode 81b6 opened 0 00000080:00200000:3.0:1787191333.410037:0:57761:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:3.0:1787191333.410056:0:57761:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0x99:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:3.0:1787191333.410067:0:57761:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884838eac lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e46015bd expref: -99 pid: 57761 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191333.410123:0:57761:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884838eac lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46015bd expref: -99 pid: 57761 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191333.410131:0:57761:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191333.410133:0:57761:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884838eac lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46015bd expref: -99 pid: 57761 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191333.410167:0:57761:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884838ec8 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.410175:0:57761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884838ec8 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191333.410555:0:57761:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191333.410563:0:57761:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1df80 x1874004626421888/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191333.410572:0:57761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884838ec8 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191333.410593:0:57761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57761:1874004626421888:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191333.410773:0:57761:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191333.415745:0:57761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57761:1874004626421888:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191333.415769:0:57761:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884838ec8 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601603 expref: -99 pid: 57761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.415795:0:57761:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884838ec8 lrc: 4/0,1 mode: --/PR res: [0x200000405:0x99:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601603 expref: -99 pid: 57761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.415803:0:57761:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884838ec8 lrc: 4/0,1 mode: --/PR res: [0x200000405:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601603 expref: -99 pid: 57761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.415812:0:57761:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884838ec8 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601603 expref: -99 pid: 57761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.415822:0:57761:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884838ec8 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601603 expref: -99 pid: 57761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.415873:0:57761:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884838ec8 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601603 expref: -99 pid: 57761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.415882:0:57761:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884838ec8 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601603 expref: -99 pid: 57761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.415889:0:57761:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884838ec8 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601603 expref: -99 pid: 57761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191333.415901:0:57761:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b51d1df80 x1874004626421888/t8589936251(8589936251) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191349 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191333.415913:0:57761:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1df80 x1874004626421888/t8589936251(8589936251) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191349 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191333.415925:0:57761:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884838ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601603 expref: -99 pid: 57761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.415945:0:57761:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/153 (0 0) 00000080:00200000:3.0:1787191333.415950:0:57761:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191333.415969:0:57761:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:3.0:1787191333.416000:0:57761:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0x99:0x0](ffff936b489aec08) 00000080:00200000:3.0:1787191333.416007:0:57761:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0x99:0x0], updating i_size 0 00000080:00200000:3.0:1787191333.416037:0:57761:0:(file.c:6836:ll_layout_conf()) [0x200000405:0x99:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:3.0:1787191333.416042:0:57761:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0x99:0x0](ffff936b489aec08) 00000080:00010000:3.0:1787191333.416045:0:57761:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x99:0x0](ffff936b489aec08) for lock 0xe5129dc884838ec8 00000080:00010000:3.0:1787191333.416054:0:57761:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x99:0x0](ffff936b489aec08) 00000080:00200008:3.0:1787191333.416068:0:57761:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0x99:0x0](ffff936b489aec08), flags 120501 00000002:00100000:3.0:1787191333.416088:0:57761:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1df80 x1874004626421888/t8589936251(8589936251) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191349 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1787191333.416135:0:57761:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884838ec8 from it ffff936b466f4960 00010000:00010000:3.0:1787191333.416140:0:57761:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884838ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4601603 expref: -99 pid: 57761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.416148:0:57761:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884838ec8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4601603 expref: -99 pid: 57761 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191333.416169:0:57761:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x99:0x0](ffff936b489aec08), inode mode 81a4 mask 40 00000080:00200000:3.0:1787191333.416219:0:57761:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x99:0x0](ffff936b489aec08), inode mode 81a4 mask 2 00000080:00200000:3.0:1787191333.416227:0:57761:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0x99:0x0](ffff936b489aec08), xattr lov 00000002:00010000:3.0:1787191333.416243:0:57761:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x99:0x0]) in obj [0x200000405:0x99:0x0], intent: open flags 040000002 00010000:00010000:3.0:1787191333.416285:0:57761:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838ed6 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x99:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.416298:0:57761:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838ed6 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x99:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191333.416307:0:57761:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191333.416314:0:57761:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1dc00 x1874004626422272/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191333.416322:0:57761:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838ed6 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x99:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191333.416338:0:57761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57761:1874004626422272:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191333.416508:0:57761:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191333.419357:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634809600 00000100:00100000:3.0:1787191333.419368:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634809600 00000100:00100000:3.0:1787191333.419485:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1087 00000100:00100000:3.0:1787191333.419497:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634809600:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191333.419517:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884838ec8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4601603 expref: -99 pid: 57761 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.419596:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191333.419604:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634809600:12345-192.168.202.101@tcp:104: Request processed in 110us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191333.419611:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1087 00000100:00100000:3.0:1787191333.432746:0:57761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57761:1874004626422272:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191333.432779:0:57761:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838ed6 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x99:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.432803:0:57761:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838ed6 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x99:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.432810:0:57761:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838ed6 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x99:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.432818:0:57761:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838ed6 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x99:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.432828:0:57761:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838ed6 lrc: 4/0,0 mode: --/CR res: [0x200000405:0x99:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.432892:0:57761:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9b000 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191333.432898:0:57761:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838ed6 lrc: 4/0,0 mode: --/CR res: [0x200000405:0x99:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.432904:0:57761:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838ed6 lrc: 4/0,0 mode: --/CR res: [0x200000405:0x99:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.432912:0:57761:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838ed6 lrc: 5/0,0 mode: --/CR res: [0x200000405:0x99:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.432919:0:57761:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191333.432927:0:57761:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838ed6 lrc: 3/0,0 mode: --/CR res: [0x200000405:0x99:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.432934:0:57761:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884838ed6 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x99:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57761 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191333.432977:0:57761:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b51d1dc00 x1874004626422272/t8589936252(8589936252) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191349 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191333.432996:0:57761:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1dc00 x1874004626422272/t8589936252(8589936252) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191349 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191333.433012:0:57761:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x99:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1787191333.433061:0:57761:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x99:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1787191333.433069:0:57761:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x99:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191333.433129:0:57761:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0x99:0x0], updating i_size 0 00000002:00100000:3.0:1787191333.433148:0:57761:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1dc00 x1874004626422272/t8589936252(8589936252) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191349 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191333.433186:0:57761:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1dc00 x1874004626422272/t8589936252(8589936252) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191349 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191333.433195:0:57761:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191333.433201:0:57761:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1d500 x1874004626422656/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191333.433224:0:57761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57761:1874004626422656:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191333.433309:0:57761:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191333.441270:0:57761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57761:1874004626422656:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191333.441317:0:57761:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1dc00 x1874004626422272/t8589936252(8589936252) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191349 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:3.0:1787191333.441392:0:57761:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0x99:0x0](ffff936b489aec08), flags 100001 00000002:00100000:3.0:1787191333.441452:0:57761:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1df80 x1874004626421888/t8589936251(8589936251) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191349 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191333.441462:0:57761:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191333.441466:0:57761:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1f480 x1874004626422912/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191333.441486:0:57761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57761:1874004626422912:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191333.441566:0:57761:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191333.448405:0:57761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57761:1874004626422912:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191333.448441:0:57761:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1df80 x1874004626421888/t8589936251(8589936251) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191349 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787191333.465573:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626423168:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191333.465604:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884838edd lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601642 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.465634:0:57570:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884838edd lrc: 4/0,1 mode: --/PR res: [0x200000405:0x99:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601642 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.465643:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884838edd lrc: 4/0,1 mode: --/PR res: [0x200000405:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601642 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.465654:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884838edd lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601642 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.465666:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884838edd lrc: 4/0,1 mode: PR/PR res: [0x200000405:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601642 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.465680:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884838edd lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601642 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.465689:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884838edd lrc: 5/1,1 mode: PR/PR res: [0x200000405:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601642 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.465697:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884838edd lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601642 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191333.465710:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x2b, status=0 req@ffff936b513bb800 x1874004626423168/t8589936255(8589936255) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191349 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191333.465723:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bb800 x1874004626423168/t8589936255(8589936255) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191349 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191333.465737:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884838edd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601642 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191333.465751:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884838edd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601642 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.465761:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/153 (0 0) 00000080:00200000:3.0:1787191333.465767:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191333.465819:0:57570:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0x99:0x0](ffff936b489aec08): rc = 0 00000080:00200000:3.0:1787191333.465914:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0x99:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:3.0:1787191333.465921:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x99:0x0](ffff936b489aec08) for lock 0xe5129dc884838edd 00000080:00010000:3.0:1787191333.465990:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x99:0x0](ffff936b489aec08) 00000080:00200008:3.0:1787191333.466005:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0x99:0x0](ffff936b489aec08), flags 101101 00000002:00100000:3.0:1787191333.466028:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bb800 x1874004626423168/t8589936255(8589936255) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191349 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1787191333.466061:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884838edd from it ffff936b60dc4c60 00010000:00010000:3.0:1787191333.466065:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884838edd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4601642 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.466079:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884838edd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4601642 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191333.466110:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x99:0x0](ffff936b489aec08), inode mode 81a4 mask 42 00000002:00010000:3.0:1787191333.466142:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0x99:0x0], intent: getxattr flags 0 00010000:00010000:3.0:1787191333.466181:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884838ee4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x99:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.466189:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884838ee4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x99:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.466199:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884838ee4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x99:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191333.466217:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626423296:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191333.466330:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191333.477285:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626423296:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191333.477316:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884838ee4 lrc: 4/1,0 mode: --/PR res: [0x200000405:0x99:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601657 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.477333:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884838ee4 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x99:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601657 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.477346:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884838ee4 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x99:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601657 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191333.477361:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b51d1c000 x1874004626423296/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191349 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191333.477374:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884838ee4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x99:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601657 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.477384:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/153 (0 0) 00000080:00200000:3.0:1787191333.477401:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0x99:0x0] suppgids 0 -1: rc 0 00000080:00010000:3.0:1787191333.477426:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x99:0x0](ffff936b489aec08) for lock 0xe5129dc884838ee4 00000080:00010000:3.0:1787191333.477433:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884838ee4 from it ffffa3fb41caba38 00010000:00010000:3.0:1787191333.477438:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884838ee4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x99:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601657 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.477447:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884838ee4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x99:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601657 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:3.0:1787191333.477486:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0x99:0x0](ffff936b489aec08) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191333.000000000, mtime 1787191333.000000000, ctime 1787191333.000000000 00010000:00010000:3.0:1787191333.477511:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884838edd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4601642 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191333.477528:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0x99:0x0]: losing layout lock 00010000:00010000:3.0:1787191333.477679:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884838edd lrc: 1/0,0 mode: --/PR res: [0x200000405:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4601642 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.477688:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191333.477691:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884838edd lrc: 0/0,0 mode: --/PR res: [0x200000405:0x99:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4601642 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:3.0:1787191333.477709:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1787191333.477716:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1c000 x1874004626423552/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191333.477737:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626423552:192.168.202.101@tcp:36:bash.0 00000100:00100000:3.0:1787191333.477810:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191333.502800:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626424576:192.168.202.101@tcp:10:bash.0 00000100:00100000:3.0:1787191333.503282:0:2392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787191333.503289:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626424704:192.168.202.101@tcp:10:bash.0 00000100:00100000:3.0:1787191333.522386:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000080:00200080:3.0:1787191333.566384:0:57759:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x98:0x0](ffff936b5396e3c8) cmd=400866b1 arg=2 00000080:00200008:3.0:1787191333.566412:0:57759:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0x98:0x0](ffff936b5396e3c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191333.566422:0:57759:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x98:0x0](ffff936b5396e3c8),name=f70.sanity-flr 00000002:00010000:3.0:1787191333.566444:0:57759:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x98:0x0]) in obj [0x200000405:0x98:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191333.566462:0:57759:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc884838ec1 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x98:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46015e7 expref: -99 pid: 57759 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00010000:00010000:3.0:1787191333.566475:0:57759:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc884838ec1 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x98:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46015e7 expref: -99 pid: 57759 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00000080:00200000:3.0:1787191333.566482:0:57759:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x98:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191333.566489:0:57759:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x98:0x0](ffff936b5396e3c8) 00000080:00010000:3.0:1787191333.566492:0:57759:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x98:0x0](ffff936b5396e3c8) for lock 0xe5129dc884838ec1 00000080:00010000:3.0:1787191333.566500:0:57759:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884838ec1 from it ffffa3fb41ffbcd8 00010000:00010000:3.0:1787191333.566503:0:57759:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc884838ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x98:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46015e7 expref: -99 pid: 57759 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00010000:00010000:3.0:1787191333.566511:0:57759:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc884838ec1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x98:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46015e7 expref: -99 pid: 57759 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00000080:00200000:3.0:1787191333.566538:0:57759:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x98:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:3.0:1787191333.566549:0:57759:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x98:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191333.566552:0:57759:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191333.566556:0:57759:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x98:0x0] 00000008:00010000:3.0:1787191333.566577:0:57759:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191333.566580:0:57759:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b506677b0, osc lock ffff936b44f65db0, flags 0x400000400001002 00010000:00010000:3.0:1787191333.566597:0:57759:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009bae9229/0xe5129dc884838ecf lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x175:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4601611 expref: -99 pid: 57759 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00010000:00010000:3.0:1787191333.566609:0:57759:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009bae9229/0xe5129dc884838ecf lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x175:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4601611 expref: -99 pid: 57759 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00000020:00200000:3.0:1787191333.566621:0:57759:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191333.566624:0:57759:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009bae9229/0xe5129dc884838ecf lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x175:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4601611 expref: -99 pid: 57759 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00010000:00010000:3.0:1787191333.566633:0:57759:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009bae9229/0xe5129dc884838ecf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x175:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4601611 expref: -99 pid: 57759 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00000020:00200000:3.0:1787191333.566643:0:57759:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191333.566653:0:57759:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0x98:0x0] updating i_size 5 i_blocks 8 00000020:00010000:3.0:1787191333.566657:0:57759:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51655280 (ffff936b465cc248/0) at cl_lock_release():245 00000020:00010000:3.0:1787191333.566660:0:57759:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51655280 (ffff936b465cc248/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191333.566663:0:57759:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b506677b0 (ffff936b465cc098/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191333.566666:0:57759:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51655280 (ffff936b465cc248/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191333.566680:0:57759:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b506677b0 (ffff936b465cc248/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191333.566692:0:57759:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x98:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191333.566721:0:57759:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0x98:0x0](ffff936b5396e3c8) current size 5, valid attrs 2068, mode 0, uid -1322410190, gid -1, new size 5, atime 1787191333.000000000, mtime 1787191333.000000000, ctime 1787191333.000000000 00010000:00010000:3.0:1787191333.566744:0:57759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc884838ec1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x98:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46015e7 expref: -99 pid: 57759 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00010000:00010000:3.0:1787191333.566758:0:57759:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc884838eb3 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x98:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46015c4 expref: -99 pid: 57759 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191333.566799:0:57759:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc884838ec1 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x98:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46015e7 expref: -99 pid: 57759 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00010000:00010000:3.0:1787191333.566806:0:57759:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191333.566809:0:57759:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc884838ec1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x98:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46015e7 expref: -99 pid: 57759 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00000020:00100000:3.0:1787191333.566828:0:57759:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1787191333.566874:0:57759:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1f800 x1874004626426240/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191333.566897:0:57759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57759:1874004626426240:192.168.202.101@tcp:36:lfs.0 00000100:00100000:3.0:1787191333.567263:0:57759:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191333.592415:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634810368 00000100:00100000:3.0:1787191333.592423:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634810368 00000100:00100000:3.0:1787191333.592473:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1089 00000100:00100000:3.0:1787191333.592483:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:29543:x1874004634810368:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191333.592496:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884838e43 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x176:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4601451 expref: -99 pid: 57758 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.592565:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191333.592572:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:29543:x1874004634810368:12345-192.168.202.101@tcp:104: Request processed in 90us (2480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191333.592578:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1089 00000100:00100000:3.0:1787191333.599342:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634810496 00000100:00100000:3.0:1787191333.599351:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634810496 00000100:00100000:3.0:1787191333.599414:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1090 00000100:00100000:3.0:1787191333.599424:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:6490:x1874004634810496:12345-192.168.202.101@tcp:105: 00010000:00010000:3.0:1787191333.599434:0:51131:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc884838f31 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x176:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e4601729 expref: -99 pid: 57759 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.599444:0:51131:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc884838f31 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x176:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e4601729 expref: -99 pid: 57759 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.599453:0:51131:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc884838f31 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x176:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000020000 nid: local remote: 0x7130d520e4601729 expref: -99 pid: 57759 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.599462:0:51131:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc884838f31 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x176:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10080000020000 nid: local remote: 0x7130d520e4601729 expref: -99 pid: 57759 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.599471:0:51131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc884838f31 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x176:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10080000020000 nid: local remote: 0x7130d520e4601729 expref: -99 pid: 57759 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.599480:0:51131:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc884838f31 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x176:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x80000020000 nid: local remote: 0x7130d520e4601729 expref: -99 pid: 57759 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.599502:0:51131:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b51fe1200) 00000100:00100000:3.0:1787191333.599555:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:6490:x1874004634810496:12345-192.168.202.101@tcp:105: Request processed in 132us (1427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191333.599563:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1090 00010000:00010000:3.0:1787191333.599588:0:57759:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc884838f31 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x176:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e4601729 expref: -99 pid: 57759 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.599598:0:57759:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc884838f31 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x176:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e4601729 expref: -99 pid: 57759 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.599610:0:57759:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc884838f31 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x176:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000020000 nid: local remote: 0x7130d520e4601729 expref: -99 pid: 57759 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191333.599622:0:57759:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc884838f31 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x176:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000020000 nid: local remote: 0x7130d520e4601729 expref: -99 pid: 57759 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.599633:0:57759:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc884838f31 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x176:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4601729 expref: -99 pid: 57759 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.599640:0:57759:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc884838f31 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x176:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4601729 expref: -99 pid: 57759 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191333.601500:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787191333.601524:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626427520:192.168.202.101@tcp:10:lfs.0 00000100:00100000:3.0:1787191333.601638:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626427648:192.168.202.101@tcp:10:lfs.0 00000100:00100000:3.0:1787191333.607472:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626427648:192.168.202.101@tcp:10:lfs.0 00000100:00100000:3.0:1787191333.608241:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626427520:192.168.202.101@tcp:10:lfs.0 00000100:00100000:3.0:1787191333.610068:0:40921:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787191333.610084:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634810624 00000100:00100000:3.0:1787191333.610092:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634810624 00000100:00100000:3.0:1787191333.610160:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1091 00000100:00100000:3.0:1787191333.610170:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b50880450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634810624:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191333.610196:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e600/0xe5129dc884838f3f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x9b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4601753 expref: -99 pid: 57763 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.610260:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191333.610266:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b50880450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634810624:12345-192.168.202.101@tcp:104: Request processed in 98us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191333.610273:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1091 00000100:00100000:3.0:1787191333.626880:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634810752 00000100:00100000:3.0:1787191333.626895:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634810752 00000100:00100000:3.0:1787191333.627056:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1092 00000100:00100000:3.0:1787191333.627066:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:15323:x1874004634810752:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191333.627086:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc884838eb3 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x98:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46015c4 expref: -99 pid: 57759 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191333.627458:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191333.627465:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:15323:x1874004634810752:12345-192.168.202.101@tcp:104: Request processed in 401us (2893us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191333.627473:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1092 00000100:00100000:3.0:1787191333.667681:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626430592:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191333.667714:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f400/0xe5129dc884838f62 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x9b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46017df expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.667729:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f400/0xe5129dc884838f62 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x9b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46017df expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191333.667743:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b453a9500 x1874004626430592/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191349 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191333.667753:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f400/0xe5129dc884838f62 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x9b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46017df expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191333.667763:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f400/0xe5129dc884838f62 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x9b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46017df expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.667772:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/155 (0 0) 00000080:00200000:3.0:1787191333.667777:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x9b:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1787191333.667790:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x9b:0x0](ffff936b5396ec08) for lock 0xe5129dc884838f62 00000080:00010000:3.0:1787191333.667796:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884838f62 from it ffffa3fb41cab8c8 00010000:00010000:3.0:1787191333.667799:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f400/0xe5129dc884838f62 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x9b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46017df expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.667806:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f400/0xe5129dc884838f62 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x9b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46017df expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.667829:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f400/0xe5129dc884838f62 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x9b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46017df expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.667879:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f400/0xe5129dc884838f62 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x9b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46017df expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:3.0:1787191333.667888:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0x9b:0x0](00000000cf29bab9) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f400/0xe5129dc884838f62 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x9b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46017df expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191333.667939:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0x9b:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:3.0:1787191333.667944:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f400/0xe5129dc884838f62 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x9b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46017df expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.667950:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f400/0xe5129dc884838f62 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x9b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46017df expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:3.0:1787191333.667962:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0x9b:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:3.0:1787191333.667969:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x9b:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191333.667971:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0x9b:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:3.0:1787191333.667978:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x9b:0x0](ffff936b5396ec08) 00000002:00010000:3.0:1787191333.667985:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x9b:0x0]) in obj [0x200000405:0x9b:0x0], intent: layout flags 02 00010000:00010000:3.0:1787191333.667997:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f400/0xe5129dc884838f62 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x9b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46017df expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191333.668007:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0x9b:0x0]: losing layout lock 00010000:00010000:3.0:1787191333.668035:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f400/0xe5129dc884838f62 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x9b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46017df expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191333.668043:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191333.668046:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f400/0xe5129dc884838f62 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x9b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46017df expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191333.668067:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838f69 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x9b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.668072:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838f69 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x9b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191333.668081:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191333.668085:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1c700 x1874004626430848/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191333.668091:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838f69 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x9b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191333.668120:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626430848:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191333.668182:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c840 going to sleep for 11 seconds 00000100:00100000:3.0:1787191333.676916:0:57570:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589936272 gen 1 00000100:00100000:3.0:1787191333.676950:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626430848:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191333.676972:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838f69 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x9b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46017f4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.676984:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838f69 lrc: 4/0,1 mode: --/CR res: [0x200000405:0x9b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46017f4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.676996:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838f69 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0x9b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46017f4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.677019:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838f69 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0x9b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46017f4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.677034:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838f69 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0x9b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46017f4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.677042:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838f69 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0x9b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46017f4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.677049:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838f69 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x9b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46017f4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191333.677061:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b51d1c700 x1874004626430848/t8589936272(8589936272) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191349 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191333.677081:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838f69 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x9b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46017f4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191333.677090:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838f69 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x9b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46017f4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.677111:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/155 (0 0) 00000080:00200000:3.0:1787191333.677117:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x9b:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1787191333.677129:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x9b:0x0](ffff936b5396ec08) for lock 0xe5129dc884838f69 00000080:00010000:3.0:1787191333.677137:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884838f69 from it ffffa3fb41cab930 00010000:00010000:3.0:1787191333.677140:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838f69 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x9b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46017f4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.677154:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838f69 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x9b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46017f4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191333.677178:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:3.0:1787191333.677203:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x9b:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:3.0:1787191333.677218:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838f69 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x9b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46017f4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.677229:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838f69 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x9b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46017f4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:3.0:1787191333.677237:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0x9b:0x0](00000000cf29bab9) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838f69 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x9b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46017f4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.677278:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838f69 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x9b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46017f4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.677286:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838f69 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x9b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46017f4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191333.677299:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x9b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1787191333.677307:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x9b:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191333.677310:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191333.677316:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191333.677328:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1787191333.677349:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x9b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:3.0:1787191333.677363:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838f69 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x9b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46017f4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191333.677371:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838f69 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x9b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46017f4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:3.0:1787191333.677379:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0x9b:0x0](00000000cf29bab9) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838f69 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x9b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46017f4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191333.677406:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x9b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1787191333.677411:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x9b:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191333.677413:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191333.677416:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191333.677421:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1787191333.677427:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x9b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191333.677499:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0x9b:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:3.0:1787191333.677505:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838f69 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x9b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46017f4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191333.677513:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884838f69 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x9b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46017f4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00020000:00200000:3.0:1787191333.677526:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0x9b:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:3.0:1787191333.677530:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x9b:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191333.677532:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191333.677538:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191333.677548:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1787191333.677552:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:3.0:1787191333.677563:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:3.0:1787191333.677567:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b5235c870, osc lock ffff936b44f65db0, flags 0x80000000 00000008:00010000:3.0:1787191333.677570:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:3.0:1787191333.677572:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b5235c8b0, osc lock ffff936b44f65690, flags 0x80000000 00010000:00010000:3.0:1787191333.677614:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000920173e2/0xe5129dc884838f77 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x179:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.677623:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000920173e2/0xe5129dc884838f77 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x179:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.677633:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000920173e2/0xe5129dc884838f77 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x179:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191333.677654:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626431232:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191333.677738:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c240 going to sleep for 11 seconds 00000100:00100000:3.0:1787191333.682621:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191333.682750:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191333.683781:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191333.688401:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626431232:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191333.688427:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000920173e2/0xe5129dc884838f77 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x179:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e460183a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.688443:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000920173e2/0xe5129dc884838f77 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x179:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e460183a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.688455:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000920173e2/0xe5129dc884838f77 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x179:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e460183a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.688469:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000920173e2/0xe5129dc884838f77 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x179:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e460183a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191333.688487:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000920173e2/0xe5129dc884838f77 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x179:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e460183a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.688498:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000920173e2/0xe5129dc884838f77 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x179:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460183a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.688506:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000920173e2/0xe5129dc884838f77 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x179:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460183a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.688558:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc884838f85 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x176:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.688566:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc884838f85 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x176:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.688575:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc884838f85 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x176:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191333.688590:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626431872:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191333.688622:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c240 going to sleep for 11 seconds 00000100:00100000:3.0:1787191333.696623:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626431872:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191333.696650:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc884838f85 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x176:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e460184f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.696677:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc884838f85 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x176:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e460184f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.696689:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc884838f85 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x176:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e460184f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.696703:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc884838f85 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x176:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e460184f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191333.696715:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc884838f85 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x176:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e460184f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.696726:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc884838f85 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x176:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460184f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.696733:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc884838f85 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x176:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460184f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191333.703271:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626432512:192.168.202.101@tcp:10:bash.0 00000100:00100000:3.0:1787191333.703300:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626432384:192.168.202.101@tcp:10:bash.0 00000100:00100000:3.0:1787191333.724363:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191333.724398:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634813952 00000100:00100000:3.0:1787191333.724404:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634813952 00000100:00100000:3.0:1787191333.724437:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1101 00000100:00100000:3.0:1787191333.724445:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+6:6508:x1874004634813952:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191333.724457:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f000/0xe5129dc884838f54 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x9b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e46017ae expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.724501:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191333.724505:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+6:6508:x1874004634813952:12345-192.168.202.101@tcp:104: Request processed in 63us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191333.724511:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1101 00000100:00100000:3.0:1787191333.795217:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191333.795253:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634814080 00000100:00100000:3.0:1787191333.795262:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634814080 00000100:00100000:3.0:1787191333.795387:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1102 00000100:00100000:3.0:1787191333.795660:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634814080:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191333.795677:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f400/0xe5129dc884838fc4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4601936 expref: -99 pid: 57765 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.795751:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191333.795756:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634814080:12345-192.168.202.101@tcp:104: Request processed in 100us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191333.795762:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1102 00000080:00200000:3.0:1787191333.813470:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191333.813498:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191333.813515:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191333.813530:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191333.813538:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191333.813559:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191333.813563:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191333.813579:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:3.0:1787191333.813583:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191333.813593:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191333.813608:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191333.813615:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191333.813621:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191333.813632:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:3.0:1787191333.813637:0:57570:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b51dd7080, open_flags 8241, mode 81b6 opened 0 00000080:00200000:3.0:1787191333.813646:0:57570:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:3.0:1787191333.813665:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0x9e:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0101102 00010000:00010000:3.0:1787191333.813719:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838fd2 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.813728:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838fd2 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191333.813739:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191333.813752:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1ce00 x1874004626436992/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191333.813766:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884838fd2 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191333.813788:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ce00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626436992:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191333.813951:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cb40 going to sleep for 11 seconds 00000080:00200000:3.0:1787191333.822602:0:57767:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191333.822637:0:57767:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191333.822655:0:57767:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191333.822671:0:57767:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191333.822678:0:57767:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191333.822686:0:57767:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191333.822689:0:57767:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191333.822697:0:57767:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4201bbf8 00010000:00010000:3.0:1787191333.822702:0:57767:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191333.822711:0:57767:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191333.822726:0:57767:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191333.822734:0:57767:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191333.822740:0:57767:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191333.822744:0:57767:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:3.0:1787191333.822748:0:57767:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x9d:0x0](ffff936b5395d348), inode mode 81a4 mask 44 00000080:00200008:3.0:1787191333.822753:0:57767:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0x9d:0x0](ffff936b5395d348), flags 154400 00000002:00010000:3.0:1787191333.822768:0:57767:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x9d:0x0]) in obj [0x200000405:0x9d:0x0], intent: open flags 0104240114401 00010000:00010000:3.0:1787191333.822818:0:57767:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884838fe0 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x9d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.822826:0:57767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884838fe0 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x9d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57767 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191333.822873:0:57767:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191333.822887:0:57767:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1f800 x1874004626437376/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191333.822898:0:57767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884838fe0 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x9d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191333.822921:0:57767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57767:1874004626437376:192.168.202.101@tcp:101:lfs.0 00000002:00010000:3.0:1787191333.851244:0:57767:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc884838fe7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e46019b4 expref: -99 pid: 57767 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.851258:0:57767:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/157 (0 0) 00000080:00200000:3.0:1787191333.851265:0:57767:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x9d:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1787191333.851336:0:57767:0:(file.c:6836:ll_layout_conf()) [0x200000405:0x9d:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:3.0:1787191333.851343:0:57767:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x9d:0x0](ffff936b5395d348) for lock 0xe5129dc884838fe7 00000080:00010000:3.0:1787191333.851349:0:57767:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x9d:0x0](ffff936b5395d348) 00000080:00010000:3.0:1787191333.851352:0:57767:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884838fe7 from it ffffa3fb4201bcd8 00010000:00010000:3.0:1787191333.851355:0:57767:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc884838fe7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10420400000000 nid: local remote: 0x7130d520e46019b4 expref: -99 pid: 57767 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.851367:0:57767:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc884838fe7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10420400000000 nid: local remote: 0x7130d520e46019b4 expref: -99 pid: 57767 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.851502:0:57767:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000080:00200000:3.0:1787191333.851533:0:57767:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x9d:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:3.0:1787191333.851545:0:57767:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x9d:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191333.851548:0:57767:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191333.851552:0:57767:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x9d:0x0] 00000008:00010000:3.0:1787191333.851582:0:57767:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191333.851586:0:57767:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667db0, osc lock ffff936b44f64980, flags 0x400000400001002 00010000:00010000:3.0:1787191333.851638:0:57767:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000793f6478/0xe5129dc884838ff5 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x178:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57767 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.851647:0:57767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000793f6478/0xe5129dc884838ff5 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x178:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57767 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.851658:0:57767:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b51d1ea00 x1874004626438144/t0(0) o101->lustre-OST0000-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:3.0:1787191333.851704:0:57767:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:3.0:1787191333.851714:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787191333.851730:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626438144:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191333.872306:0:40922:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787191333.872324:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634814720 00000100:00100000:3.0:1787191333.872332:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634814720 00000100:00100000:3.0:1787191333.872370:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634814848 00000100:00100000:3.0:1787191333.872372:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634814848 00000100:00100000:3.0:1787191333.872380:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634814976 00000100:00100000:3.0:1787191333.872383:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634814976 00000100:00100000:3.0:1787191333.872394:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1103 00000100:00100000:3.0:1787191333.872403:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+6:12284:x1874004634814720:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191333.872421:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884838fee lrc: 4/0,1 mode: --/EX res: [0x200000405:0x9d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e46019bb expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.872807:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191333.872815:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+6:12284:x1874004634814720:12345-192.168.202.101@tcp:104: Request processed in 414us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191333.872823:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1103 00000100:00100000:3.0:1787191333.872913:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1104 00000100:00100000:3.0:1787191333.872920:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30353:x1874004634814848:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191333.872936:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000920173e2/0xe5129dc884838f77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x179:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e460183a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191333.874089:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191333.874109:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30353:x1874004634814848:12345-192.168.202.101@tcp:104: Request processed in 1187us (1991us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191333.874118:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1104 00000100:00100000:3.0:1787191333.876469:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191333.876574:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634815616 00000100:00100000:3.0:1787191333.876581:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634815616 00000100:00100000:3.0:1787191333.876626:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1106 00000100:00100000:3.0:1787191333.876636:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:29543:x1874004634815616:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191333.876653:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc884838f85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x176:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e460184f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.876733:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191333.876740:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:29543:x1874004634815616:12345-192.168.202.101@tcp:104: Request processed in 107us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191333.876747:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1106 00010000:00010000:2.0:1787191333.882168:0:57627:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884838fee lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x9d:0x0].0x0 bits 0xa/0xa rrc: 4 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e46019bb expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191333.882181:0:57627:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884838fee lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x9d:0x0].0x0 bits 0xa/0xa rrc: 4 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e46019bb expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191333.882189:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884838fee lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x9d:0x0].0x0 bits 0xa/0xa rrc: 4 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x7130d520e46019bb expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191333.882222:0:57627:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc884838ffc lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x9d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46019c9 expref: -99 pid: 57767 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191333.882258:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884838fee lrc: 2/0,0 mode: --/CR res: [0x200000405:0x9d:0x0].0x0 bits 0xa/0xa rrc: 4 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e46019bb expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191333.882264:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787191333.882411:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626438912:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787191333.882501:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884838fee lrc: 1/0,0 mode: --/CR res: [0x200000405:0x9d:0x0].0x0 bits 0xa/0xa rrc: 4 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e46019bb expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191333.882509:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884838fee lrc: 0/0,0 mode: --/CR res: [0x200000405:0x9d:0x0].0x0 bits 0xa/0xa rrc: 4 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e46019bb expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191333.882525:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191333.882527:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191333.882529:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191333.885069:0:57767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aaa00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57767:1874004626438784:192.168.202.101@tcp:49:lfs.0 00000100:00100000:3.0:1787191333.885120:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626438912:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787191333.885518:0:57767:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc884838ffc lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x9d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46019c9 expref: -99 pid: 57767 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191333.885531:0:57767:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc884838ffc lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x9d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46019c9 expref: -99 pid: 57767 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191333.885730:0:57767:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x9d:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1787191333.885741:0:57767:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x9d:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191333.885745:0:57767:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191333.885751:0:57767:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191333.885763:0:57767:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1787191333.885781:0:57767:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x9d:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:3.0:1787191333.885810:0:57767:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc884838ffc lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x9d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46019c9 expref: -99 pid: 57767 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191333.885824:0:57767:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc884838ffc lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x9d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46019c9 expref: -99 pid: 57767 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:3.0:1787191333.885999:0:57767:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0x9d:0x0](000000001d24cd79) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc884838ffc lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x9d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46019c9 expref: -99 pid: 57767 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191333.887164:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc884838ffc lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x9d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46019c9 expref: -99 pid: 57767 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191333.887186:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc884838ffc lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x9d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46019c9 expref: -99 pid: 57767 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:3.0:1787191333.887202:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0x9d:0x0](000000001d24cd79) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc884838ffc lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x9d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46019c9 expref: -99 pid: 57767 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191333.887213:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc884838ffc lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x9d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46019c9 expref: -99 pid: 57767 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191333.887221:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc884838ffc lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x9d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46019c9 expref: -99 pid: 57767 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00020000:00200000:3.0:1787191333.887237:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0x9d:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:3.0:1787191333.887242:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x9d:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191333.887244:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191333.887254:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191333.887269:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1787191333.887273:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:3.0:1787191333.887286:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:3.0:1787191333.887290:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b5235cc30, osc lock ffff936b44f65430, flags 0x80000000 00000008:00010000:3.0:1787191333.887293:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:3.0:1787191333.887296:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b5235cc70, osc lock ffff936b44f65b50, flags 0x80000000 00010000:00010000:3.0:1787191333.887484:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b52377800 type 11 mode 2 res 10737419265/376 (0 1048575) 00010000:00010000:3.0:1787191333.887521:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000eb2ebc95/0xe5129dc884839003 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x178:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.887531:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000eb2ebc95/0xe5129dc884839003 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x178:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.887541:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000eb2ebc95/0xe5129dc884839003 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x178:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191333.887644:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626439040:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191333.887735:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787191333.889695:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191333.889796:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634815744 00000100:00100000:3.0:1787191333.889804:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634815744 00000100:00100000:3.0:1787191333.890377:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1107 00000100:00100000:3.0:1787191333.890401:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8720:x1874004634815744:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191333.890414:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000793f6478/0xe5129dc884838ff5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x178:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000010000 nid: local remote: 0x7130d520e46019c2 expref: -99 pid: 57767 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191333.890465:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191333.890472:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8720:x1874004634815744:12345-192.168.202.101@tcp:104: Request processed in 86us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191333.890479:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1107 00000100:00100000:3.0:1787191333.895893:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191333.895924:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634815872 00000100:00100000:3.0:1787191333.895932:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634815872 00000100:00100000:3.0:1787191333.895981:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1108 00000100:00100000:3.0:1787191333.895993:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30131:x1874004634815872:12345-192.168.202.101@tcp:105: 00010000:00010000:3.0:1787191333.896005:0:51131:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000eb2ebc95/0xe5129dc884839003 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x178:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e46019ec expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.896017:0:51131:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000eb2ebc95/0xe5129dc884839003 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x178:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e46019ec expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.896026:0:51131:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000eb2ebc95/0xe5129dc884839003 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x178:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e46019ec expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.896036:0:51131:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000eb2ebc95/0xe5129dc884839003 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x178:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080080020000 nid: local remote: 0x7130d520e46019ec expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.896045:0:51131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000eb2ebc95/0xe5129dc884839003 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x178:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080080020000 nid: local remote: 0x7130d520e46019ec expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.896055:0:51131:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000eb2ebc95/0xe5129dc884839003 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x178:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80080020000 nid: local remote: 0x7130d520e46019ec expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.896081:0:51131:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b44e9a400) 00000100:00100000:3.0:1787191333.897453:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30131:x1874004634815872:12345-192.168.202.101@tcp:105: Request processed in 1455us (1554us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191333.897464:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1108 00000100:00100000:2.0:1787191333.911135:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99000 going to sleep for 11 seconds 00000100:00100000:2.0:1787191333.911156:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626439808:192.168.202.101@tcp:101:bash.0 00010000:00010000:2.0:1787191333.911169:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007a412388/0xe5129dc884839011 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601a08 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191333.911245:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007a412388/0xe5129dc884839011 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4601a08 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191333.911256:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007a412388/0xe5129dc884839011 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4601a08 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191333.911268:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007a412388/0xe5129dc884839011 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4601a08 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1787191333.911281:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007a412388/0xe5129dc884839011 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4601a08 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191333.911293:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007a412388/0xe5129dc884839011 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4601a08 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191333.911300:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007a412388/0xe5129dc884839011 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4601a08 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191333.911435:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626439936:192.168.202.101@tcp:10:bash.0 00000100:00100000:3.0:1787191333.912991:0:2392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787191333.913002:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626440064:192.168.202.101@tcp:10:bash.0 00000100:00100000:2.0:1787191333.916701:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626439936:192.168.202.101@tcp:10:bash.0 00000100:00100000:3.0:1787191333.917812:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626440064:192.168.202.101@tcp:10:bash.0 00000080:00200000:2.0:1787191333.918240:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0x9d:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191333.918248:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b42ff65d8 (ffff936b465cc1b8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191333.918252:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42ff65d8 (ffff936b465cc1b8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191333.918258:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b5235cc30 (ffff936b47a17878/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191333.918269:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000eb2ebc95/0xe5129dc884839003 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x178:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e46019ec expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191333.918286:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000eb2ebc95/0xe5129dc884839003 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x178:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e46019ec expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191333.918306:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b5235cc70 (ffff936b465cc6c8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191333.918311:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007a412388/0xe5129dc884839011 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4601a08 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191333.918318:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007a412388/0xe5129dc884839011 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4601a08 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191333.918326:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42ff65d8 (ffff936b465cc1b8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191333.918329:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b5235cc30 (ffff936b465cc1b8/1) at cl_lock_fini():72 00000020:00010000:2.0:1787191333.918334:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b5235cc70 (ffff936b465cc1b8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191333.918398:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x9d:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191333.918421:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0x9d:0x0](ffff936b5395d348) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191333.000000000, mtime 1787191333.000000000, ctime 1787191333.000000000, rc 0 00000080:00200008:2.0:1787191333.918511:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0x9d:0x0], ppos: 0, count: 5 00000080:00200000:2.0:1787191333.918524:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191333.918530:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:2.0:1787191333.918535:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:2.0:1787191333.918540:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1787191333.918546:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@00000000e2389d26[0x110, 1, [0x200000405:0x9d:0x0] hash] 00000020:00200000:2.0:1787191333.918548:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:2.0:1787191333.918552:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x9d:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:2.0:1787191333.918576:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0x9d:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:2.0:1787191333.918580:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x9d:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191333.918584:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1787191333.918589:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1787191333.918595:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:2.0:1787191333.918598:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1787191333.918614:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:2.0:1787191333.918627:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1787191333.918632:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d17b0, osc lock ffff936b44e631d0, flags 0x0 00010000:00010000:2.0:1787191333.918653:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000eb2ebc95/0xe5129dc884839003 lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x178:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e46019ec expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191333.918666:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000eb2ebc95/0xe5129dc884839003 lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x178:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e46019ec expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191333.918677:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000eb2ebc95/0xe5129dc884839003 lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x178:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e46019ec expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191333.918685:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000eb2ebc95/0xe5129dc884839003 lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x178:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e46019ec expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191333.918691:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000eb2ebc95/0xe5129dc884839003 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x178:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e46019ec expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191333.918700:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:2.0:1787191333.918708:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191333.918752:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:2.0:1787191333.918760:0:57570:0:(rw26.c:927:ll_write_end()) page@000000009e16895d[3 00000000ce8455bd 2 1 00000000fd37f800 0 0 0] 00000080:00200000:2.0:1787191333.918764:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @0000000035eaf25d 17ffffc0001001 3:0 ffff936b43a1e000 0 lru 00000080:00200000:2.0:1787191333.918771:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@0000000042776c1b 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000a2a44f55 00000000280494ef > 3< 0 0 > 4< 0 0 8 320000000 - | - - - - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1787191333.918774:0:57570:0:(rw26.c:927:ll_write_end()) end page@000000009e16895d 00000080:00200000:2.0:1787191333.918776:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:2.0:1787191333.918780:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:2.0:1787191333.918798:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 0000000089ad0d4e ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000eb2ebc95/0xe5129dc884839003 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x178:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e46019ec expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191333.918818:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b5395d4f8, count 1, dirtied 1 00000080:00200000:2.0:1787191333.918823:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:2.0:1787191333.918825:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:2.0:1787191333.918874:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b42ff6218 (ffff936b465cc998/0) at cl_lock_release():245 00000020:00010000:2.0:1787191333.918878:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42ff6218 (ffff936b465cc998/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191333.918880:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d17b0 (ffff936b47a172d8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191333.918884:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000eb2ebc95/0xe5129dc884839003 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x178:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e46019ec expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191333.918892:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000eb2ebc95/0xe5129dc884839003 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x178:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e46019ec expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:2.0:1787191333.918902:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42ff6218 (ffff936b465cc998/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191333.918904:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d17b0 (ffff936b465cc998/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191333.918911:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:2.0:1787191333.918915:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1787191333.918920:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x9d:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191333.918923:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:2.0:1787191333.918929:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0x9d:0x0] updating i_size 5 i_blocks 0 00000080:00200000:2.0:1787191333.918932:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:2.0:1787191333.918948:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0x9d:0x0](ffff936b5395d348), flags 100001 00000002:00100000:2.0:1787191333.919003:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1ce00 x1874004626436992/t8589936285(8589936285) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191349 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191333.919150:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:2.0:1787191333.919158:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb480 x1874004626440576/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191333.919180:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626440576:192.168.202.101@tcp:35:bash.0 00000100:00100000:2.0:1787191333.919319:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191333.930670:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191333.930755:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634816000 00000100:00100000:2.0:1787191333.930764:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634816000 00000100:00100000:2.0:1787191333.931183:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1109 00000100:00100000:2.0:1787191333.931196:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634816000:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191333.931214:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f400/0xe5129dc88483900a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x9d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4601a0f expref: -99 pid: 57767 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191333.931299:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191333.931306:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634816000:12345-192.168.202.101@tcp:104: Request processed in 114us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191333.931313:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1109 00000080:00200000:2.0:1787191333.942460:0:57768:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191333.942484:0:57768:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191333.942498:0:57768:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191333.942512:0:57768:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191333.942520:0:57768:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191333.942528:0:57768:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191333.942532:0:57768:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191333.942539:0:57768:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4200bb58 00010000:00010000:2.0:1787191333.942543:0:57768:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191333.942552:0:57768:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191333.942637:0:57768:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191333.942648:0:57768:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191333.942654:0:57768:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191333.942667:0:57768:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:2.0:1787191333.942671:0:57768:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191333.942684:0:57768:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191333.942724:0:57768:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc884839026 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191333.942733:0:57768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc884839026 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191333.942742:0:57768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc884839026 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191333.942761:0:57768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57768:1874004626441472:192.168.202.101@tcp:101:rm.0 00000100:00100000:2.0:1787191333.942910:0:57768:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b523596c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191333.947361:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191333.947391:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634816128 00000100:00100000:2.0:1787191333.947399:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634816128 00000100:00100000:2.0:1787191333.947449:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1110 00000100:00100000:2.0:1787191333.947460:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:15323:x1874004634816128:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191333.947478:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc884838ffc lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x9d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46019c9 expref: -99 pid: 57767 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1787191333.947538:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191333.947545:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:15323:x1874004634816128:12345-192.168.202.101@tcp:104: Request processed in 87us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191333.947552:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1110 00000100:00100000:2.0:1787191333.948066:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191333.948085:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634816256 00000100:00100000:2.0:1787191333.948099:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634816256 00000100:00100000:2.0:1787191333.948124:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1111 00000100:00100000:2.0:1787191333.948130:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:15323:x1874004634816256:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191333.948139:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc884839026 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e4601a5c expref: -99 pid: 57768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191333.948185:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191333.948191:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:15323:x1874004634816256:12345-192.168.202.101@tcp:104: Request processed in 61us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191333.948197:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1111 00000100:00100000:2.0:1787191333.948250:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191333.948271:0:40921:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787191333.948280:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634816384 00000100:00100000:2.0:1787191333.948283:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634816384 00000100:00100000:2.0:1787191333.948302:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1112 00000100:00100000:2.0:1787191333.948308:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b5258b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:15323:x1874004634816384:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191333.948316:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc884838fd9 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x9d:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e4601983 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191333.948349:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787191333.948355:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b5258b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:15323:x1874004634816384:12345-192.168.202.101@tcp:104: Request processed in 47us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191333.948361:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1112 00010000:00010000:2.0:1787191333.948389:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787191333.948394:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc884839026 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e4601a5c expref: -99 pid: 57768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191333.948402:0:40929:0:(ldlm_lockd.c:1935:ldlm_handle_bl_callback()) Lock ffff936b51dd5e00 is referenced, will be cancelled later 00010000:00010000:2.0:1787191333.948405:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc884839026 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4601a5c expref: -99 pid: 57768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191333.948412:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787191333.948414:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc884838fd9 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x9d:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e4601983 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191333.948420:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51fe1200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191333.948424:0:40929:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc884838fd9 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x9d:0x0].0x0 bits 0x20/0x20 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4601983 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191333.948432:0:40929:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc884838fd9 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x9d:0x0].0x0 bits 0x20/0x20 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4601983 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191333.948439:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc884838fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9d:0x0].0x0 bits 0x20/0x20 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x7130d520e4601983 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191333.948478:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc884838fd9 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x9d:0x0].0x0 bits 0x20/0x20 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e4601983 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191333.948485:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191333.948504:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc884838fd9 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x9d:0x0].0x0 bits 0x20/0x20 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e4601983 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191333.948511:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc884838fd9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x9d:0x0].0x0 bits 0x20/0x20 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e4601983 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191333.948526:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191333.948527:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191333.948529:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191333.948537:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787191333.948546:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626441984:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191333.956808:0:57768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57768:1874004626442112:192.168.202.101@tcp:101:rm.0 00010000:00010000:3.0:1787191333.956875:0:57768:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e600/0xe5129dc88483902d lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601a71 expref: -99 pid: 57768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.956906:0:57768:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e600/0xe5129dc88483902d lrc: 4/1,0 mode: --/PR res: [0x200000405:0x9d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601a71 expref: -99 pid: 57768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.956915:0:57768:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e600/0xe5129dc88483902d lrc: 4/1,0 mode: --/PR res: [0x200000405:0x9d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601a71 expref: -99 pid: 57768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.956926:0:57768:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e600/0xe5129dc88483902d lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x9d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601a71 expref: -99 pid: 57768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.956936:0:57768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e600/0xe5129dc88483902d lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x9d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601a71 expref: -99 pid: 57768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.956948:0:57768:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e600/0xe5129dc88483902d lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x9d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601a71 expref: -99 pid: 57768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.956957:0:57768:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e600/0xe5129dc88483902d lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x9d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601a71 expref: -99 pid: 57768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.956964:0:57768:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e600/0xe5129dc88483902d lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x9d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601a71 expref: -99 pid: 57768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191333.956983:0:57768:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b453a8380 x1874004626442112/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/976 e 0 to 0 dl 1787191349 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191333.957000:0:57768:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e600/0xe5129dc88483902d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601a71 expref: -99 pid: 57768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.957010:0:57768:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/157 (0 0) 00000080:00200000:3.0:1787191333.957017:0:57768:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1787191333.957076:0:57768:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x9d:0x0](ffff936b5395d348) for lock 0xe5129dc88483902d 00000080:00010000:3.0:1787191333.957083:0:57768:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x9d:0x0](ffff936b5395d348) 00000080:00010000:3.0:1787191333.957086:0:57768:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483902d from it ffffa3fb4200bcb8 00010000:00010000:3.0:1787191333.957099:0:57768:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e600/0xe5129dc88483902d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601a71 expref: -99 pid: 57768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.957109:0:57768:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e600/0xe5129dc88483902d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x9d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601a71 expref: -99 pid: 57768 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191333.957143:0:57768:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x9d:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00010000:00010000:3.0:1787191333.957156:0:57768:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/157 (0 0) 00000080:00010000:3.0:1787191333.957165:0:57768:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x9d:0x0](ffff936b5395d348) 00000002:00010000:3.0:1787191333.957185:0:57768:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x9d:0x0]) in obj [0x200000405:0x9d:0x0], intent: layout flags 0 00010000:00010000:3.0:1787191333.957223:0:57768:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884839034 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x9d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.957230:0:57768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884839034 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x9d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.957244:0:57768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884839034 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x9d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191333.957265:0:57768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57768:1874004626442368:192.168.202.101@tcp:101:rm.0 00000100:00100000:3.0:1787191333.957349:0:57768:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c300 going to sleep for 11 seconds 00000100:00100000:3.0:1787191333.961102:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626441984:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191333.964944:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191333.965138:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634816512 00000100:00100000:3.0:1787191333.965147:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634816512 00000100:00100000:3.0:1787191333.965206:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1113 00000100:00100000:3.0:1787191333.965218:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:15323:x1874004634816512:12345-192.168.202.101@tcp:105: 00010000:00010000:3.0:1787191333.965238:0:40921:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884839034 lrc: 5/1,0 mode: --/CR res: [0x200000405:0x9d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601a78 expref: -99 pid: 57768 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.965250:0:40921:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884839034 lrc: 5/1,0 mode: --/CR res: [0x200000405:0x9d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601a78 expref: -99 pid: 57768 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.965260:0:40921:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884839034 lrc: 5/1,0 mode: --/CR res: [0x200000405:0x9d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601a78 expref: -99 pid: 57768 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.965270:0:40921:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884839034 lrc: 5/1,0 mode: CR/CR res: [0x200000405:0x9d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10080000000000 nid: local remote: 0x7130d520e4601a78 expref: -99 pid: 57768 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.965280:0:40921:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884839034 lrc: 6/1,0 mode: CR/CR res: [0x200000405:0x9d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10080000000000 nid: local remote: 0x7130d520e4601a78 expref: -99 pid: 57768 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.965291:0:40921:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884839034 lrc: 6/1,0 mode: CR/CR res: [0x200000405:0x9d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x80000000000 nid: local remote: 0x7130d520e4601a78 expref: -99 pid: 57768 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191333.965321:0:40921:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b44e9bc00) 00000100:00100000:3.0:1787191333.965445:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:15323:x1874004634816512:12345-192.168.202.101@tcp:105: Request processed in 228us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191333.965453:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1113 00000100:00100000:3.0:1787191333.971052:0:57767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57767:1874004626441728:192.168.202.101@tcp:35:lfs.0 00000080:00020000:3.0:1787191333.971073:0:57767:0:(file.c:251:ll_close_inode_openhandle()) lustre-clilmv-ffff936b581fb000: inode [0x200000405:0x9d:0x0] mdc close failed: rc = -1 00000002:00100000:3.0:1787191333.971101:0:57767:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a8700 x1874004626441344/t8589936295(8589936295) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191349 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1787191333.971680:0:57767:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884839034 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x9d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4601a78 expref: -99 pid: 57768 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191333.971690:0:57767:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884839034 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x9d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4601a78 expref: -99 pid: 57768 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:3.0:1787191333.971699:0:57767:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0x9d:0x0](000000001d24cd79) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884839034 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x9d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4601a78 expref: -99 pid: 57768 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191333.971710:0:57767:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884839034 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x9d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4601a78 expref: -99 pid: 57768 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191333.971717:0:57767:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc884839034 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x9d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4601a78 expref: -99 pid: 57768 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200008:2.0:1787191333.973036:0:57767:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0x9d:0x0](ffff936b5395d348), flags 154002 00000002:00100000:2.0:1787191333.973076:0:57767:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a8a80 x1874004626440832/t8589936294(8589936294) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191349 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191333.973087:0:57767:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191333.973104:0:57767:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9180 x1874004626442880/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191333.973119:0:57767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57767:1874004626442880:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191333.973177:0:57767:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359780 going to sleep for 11 seconds 00000080:00200000:2.0:1787191334.005327:0:57770:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191334.005367:0:57770:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191334.005385:0:57770:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191334.005455:0:57770:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191334.005464:0:57770:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191334.005473:0:57770:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191334.005476:0:57770:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191334.005484:0:57770:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42023b58 00010000:00010000:2.0:1787191334.005488:0:57770:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191334.005497:0:57770:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191334.005515:0:57770:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191334.005523:0:57770:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:2.0:1787191334.005529:0:57770:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191334.006275:0:57770:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:2.0:1787191334.006281:0:57770:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191334.006300:0:57770:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191334.006350:0:57770:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884839049 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.006358:0:57770:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884839049 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.006372:0:57770:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884839049 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191334.006405:0:57770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57770:1874004626443520:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191334.006544:0:57770:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787191334.010149:0:57770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57770:1874004626443520:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191334.010186:0:57770:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884839049 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.010201:0:57770:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884839049 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.010208:0:57770:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884839049 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.010216:0:57770:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884839049 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.010226:0:57770:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884839049 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.010232:0:57770:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd4200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191334.010237:0:57770:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884839049 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.010243:0:57770:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884839049 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.010250:0:57770:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884839049 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.010258:0:57770:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191334.010265:0:57770:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884839049 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.010272:0:57770:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884839049 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57770 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191334.010298:0:57770:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513baa00 x1874004626443520/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191350 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191334.010314:0:57770:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191334.010425:0:57770:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191334.010442:0:57770:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191334.010451:0:57770:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191334.010464:0:57770:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191334.010471:0:57770:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191334.010476:0:57770:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191334.010479:0:57770:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191334.010485:0:57770:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42023be8 00010000:00010000:2.0:1787191334.010488:0:57770:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191334.010495:0:57770:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191334.010513:0:57770:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191334.010520:0:57770:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000080:00200000:2.0:1787191334.010525:0:57770:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191334.010542:0:57770:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:2.0:1787191334.010546:0:57770:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191334.010557:0:57770:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191334.010828:0:57770:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839050 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.010869:0:57770:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839050 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.010879:0:57770:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839050 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191334.010901:0:57770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57770:1874004626443648:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191334.010981:0:57770:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787191334.014561:0:57770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57770:1874004626443648:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191334.014582:0:57770:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839050 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.014596:0:57770:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839050 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.014603:0:57770:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839050 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.014611:0:57770:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839050 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.014621:0:57770:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839050 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.014627:0:57770:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd4600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191334.014631:0:57770:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839050 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.014638:0:57770:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839050 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.014645:0:57770:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839050 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.014651:0:57770:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191334.014656:0:57770:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839050 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.014662:0:57770:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839050 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57770 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191334.014696:0:57770:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513baa00 x1874004626443648/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191350 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191334.014709:0:57770:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191334.014810:0:57770:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191334.014825:0:57770:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191334.014865:0:57770:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191334.014878:0:57770:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191334.014886:0:57770:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191334.014892:0:57770:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191334.014896:0:57770:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191334.014901:0:57770:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42023b58 00010000:00010000:2.0:1787191334.014905:0:57770:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191334.014914:0:57770:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191334.014930:0:57770:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191334.014939:0:57770:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:2.0:1787191334.014949:0:57770:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:2.0:1787191334.014954:0:57770:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:2.0:1787191334.014965:0:57770:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191334.014972:0:57770:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 51 lru_type: 1 00010000:00010000:2.0:1787191334.014981:0:57770:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 51 lru_type: 1 00000002:00010000:2.0:1787191334.014990:0:57770:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191334.015029:0:57770:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc884839057 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.015036:0:57770:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc884839057 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.015048:0:57770:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc884839057 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191334.015067:0:57770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57770:1874004626443776:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191334.015156:0:57770:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787191334.018297:0:57770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57770:1874004626443776:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191334.018309:0:57770:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc884839057 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601afd expref: -99 pid: 57770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.018318:0:57770:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc884839057 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601afd expref: -99 pid: 57770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.018330:0:57770:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc884839057 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601afd expref: -99 pid: 57770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.018340:0:57770:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc884839057 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601afd expref: -99 pid: 57770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.018347:0:57770:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc884839057 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601afd expref: -99 pid: 57770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.018353:0:57770:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc884839057 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601afd expref: -99 pid: 57770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.018357:0:57770:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc884839057 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601afd expref: -99 pid: 57770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191334.018368:0:57770:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b513baa00 x1874004626443776/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191350 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191334.018376:0:57770:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc884839057 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601afd expref: -99 pid: 57770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.018383:0:57770:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:2.0:1787191334.018388:0:57770:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc884839057 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601afd expref: -99 pid: 57770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.018395:0:57770:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc884839057 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601afd expref: -99 pid: 57770 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:2.0:1787191334.018419:0:57770:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191334.018429:0:57770:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 102 lru_type: 1 00010000:00010000:2.0:1787191334.018440:0:57770:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 102 lru_type: 1 00010000:00010000:2.0:1787191334.018449:0:57770:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 102 lru_type: 1 00010000:00010000:2.0:1787191334.018456:0:57770:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 103 lru_type: 1 00000080:00200000:2.0:1787191334.018466:0:57770:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1787191334.018473:0:57770:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:2.0:1787191334.018477:0:57770:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:2.0:1787191334.018482:0:57770:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb42023cb8 00010000:00010000:2.0:1787191334.018485:0:57770:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 51 lru_type: 1 00010000:00010000:2.0:1787191334.018493:0:57770:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 52 lru_type: 1 00000002:00010000:2.0:1787191334.018508:0:57770:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191334.018514:0:57770:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc884839057 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601afd expref: -99 pid: 57770 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.018522:0:57770:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc884839057 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601afd expref: -99 pid: 57770 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.018531:0:57770:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc884839057 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601afd expref: -99 pid: 57770 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.018537:0:57770:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc884839057 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601afd expref: -99 pid: 57770 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:2.0:1787191334.018545:0:57770:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191334.018550:0:57770:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 103 lru_type: 1 00010000:00010000:2.0:1787191334.018557:0:57770:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 103 lru_type: 1 00010000:00010000:2.0:1787191334.018569:0:57770:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 103 lru_type: 1 00010000:00010000:2.0:1787191334.018575:0:57770:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 104 lru_type: 1 00000080:00200008:2.0:1787191334.019146:0:57770:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:2.0:1787191334.019152:0:57770:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191334.019162:0:57770:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191334.019170:0:57770:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191334.019186:0:57770:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191334.019191:0:57770:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191334.019195:0:57770:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191334.019197:0:57770:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191334.019199:0:57770:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42023cb8 00010000:00010000:2.0:1787191334.019202:0:57770:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191334.019207:0:57770:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191334.019287:0:57770:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191334.019294:0:57770:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191334.019299:0:57770:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191334.019305:0:57770:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191334.019309:0:57770:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191334.019311:0:57770:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191334.019313:0:57770:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191334.019316:0:57770:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42023b58 00010000:00010000:2.0:1787191334.019317:0:57770:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191334.019322:0:57770:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191334.019327:0:57770:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191334.019331:0:57770:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191334.019335:0:57770:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191334.019340:0:57770:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:2.0:1787191334.019343:0:57770:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191334.019352:0:57770:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191334.019384:0:57770:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc884839065 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.019389:0:57770:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc884839065 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.019398:0:57770:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc884839065 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191334.019421:0:57770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57770:1874004626444032:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191334.019507:0:57770:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359f00 going to sleep for 11 seconds 00000080:00200000:2.0:1787191334.029730:0:57771:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:2.0:1787191334.029736:0:57771:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x9f:0x0](ffff936b5395d348), inode mode 81a4 mask 44 00000080:00200008:2.0:1787191334.029741:0:57771:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0x9f:0x0](ffff936b5395d348), flags 154400 00000002:00010000:2.0:1787191334.029759:0:57771:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x9f:0x0]) in obj [0x200000405:0x9f:0x0], intent: open flags 0100240114401 00010000:00010000:2.0:1787191334.029806:0:57771:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884839073 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x9f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.029812:0:57771:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884839073 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x9f:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57771 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191334.029818:0:57771:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:2.0:1787191334.029823:0:57771:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8000 x1874004626444800/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191334.029911:0:57771:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884839073 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x9f:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191334.029930:0:57771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57771:1874004626444800:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191334.030165:0:57771:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359000 going to sleep for 11 seconds 00000100:00100000:2.0:1787191334.037065:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191334.037105:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634816640 00000100:00100000:3.0:1787191334.037116:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634816640 00000100:00100000:3.0:1787191334.037167:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1114 00000100:00100000:3.0:1787191334.037189:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634816640:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191334.037209:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e400/0xe5129dc88483906c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4601b43 expref: -99 pid: 57770 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191334.037289:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191334.037422:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634816640:12345-192.168.202.101@tcp:104: Request processed in 236us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191334.037494:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1114 00010000:00010000:2.0:1787191334.038139:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787191334.038148:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e400/0xe5129dc88483906c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4601b43 expref: -99 pid: 57770 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.038157:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b4801e400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191334.038160:0:40929:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e400/0xe5129dc88483906c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x9f:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4601b43 expref: -99 pid: 57770 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.038170:0:40929:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e400/0xe5129dc88483906c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x9f:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4601b43 expref: -99 pid: 57770 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.038179:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e400/0xe5129dc88483906c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x9f:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4601b43 expref: -99 pid: 57770 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191334.038195:0:40929:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0x9f:0x0]: losing layout lock 00010000:00010000:2.0:1787191334.038230:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e400/0xe5129dc88483906c lrc: 2/0,0 mode: --/PR res: [0x200000405:0x9f:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4601b43 expref: -99 pid: 57770 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.038237:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191334.038263:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e400/0xe5129dc88483906c lrc: 1/0,0 mode: --/PR res: [0x200000405:0x9f:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4601b43 expref: -99 pid: 57770 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.038270:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e400/0xe5129dc88483906c lrc: 0/0,0 mode: --/PR res: [0x200000405:0x9f:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4601b43 expref: -99 pid: 57770 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.038282:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191334.038284:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191334.038286:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191334.038514:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626445184:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191334.043170:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626445184:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191334.056894:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626446848:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191334.056998:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839096 lrc: 4/0,1 mode: --/CW res: [0x200000405:0x9f:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601bb3 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.057004:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839096 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x9f:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601bb3 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.057010:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839096 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x9f:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601bb3 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191334.057018:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x200002b, status=0 req@ffff936b6a474a80 x1874004626446848/t8589936308(8589936308) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191350 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191334.057028:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474a80 x1874004626446848/t8589936308(8589936308) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191350 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191334.057037:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839096 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x9f:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601bb3 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191334.057046:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839096 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x9f:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601bb3 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.057054:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483908f lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x9f:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601bba expref: -99 pid: 57771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.057062:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483908f lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x9f:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601bba expref: -99 pid: 57771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.057067:0:57570:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839096 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x9f:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601bb3 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.057072:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839096 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x9f:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x7130d520e4601bb3 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.057076:0:57570:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839096 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x9f:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x7130d520e4601bb3 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.057101:0:57570:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000080:00200000:3.0:1787191334.057107:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000405:0x9f:0x0] suppgids 0 0: rc 0 00010000:00010000:2.0:1787191334.057126:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787191334.057134:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839096 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x9f:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x7130d520e4601bb3 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.057141:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51fe0000 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191334.057146:0:57627:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839096 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x9f:0x0].0x0 bits 0x1f/0x1f rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x7130d520e4601bb3 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.057158:0:57627:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839096 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x9f:0x0].0x0 bits 0x1f/0x1f rrc: 3 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x7130d520e4601bb3 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.057167:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839096 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x9f:0x0].0x0 bits 0x1f/0x1f rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4601bb3 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1787191334.057168:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0x9f:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:3.0:1787191334.057173:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x9f:0x0](ffff936b5395d348) for lock 0xe5129dc88483908f 00000080:00010000:3.0:1787191334.057178:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483908f from it ffffa3fb41cabbf0 00010000:00010000:3.0:1787191334.057181:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483908f lrc: 6/1,1 mode: CW/CW res: [0x200000405:0x9f:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4601bba expref: -99 pid: 57771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.057189:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483908f lrc: 5/1,0 mode: CW/CW res: [0x200000405:0x9f:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4601bba expref: -99 pid: 57771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.057200:0:57627:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483908f lrc: 5/1,0 mode: CW/CW res: [0x200000405:0x9f:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4601bba expref: -99 pid: 57771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191334.057217:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474a80 x1874004626446848/t8589936308(8589936308) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191350 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1787191334.057237:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839096 lrc: 2/0,0 mode: --/CW res: [0x200000405:0x9f:0x0].0x0 bits 0x1f/0x1f rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4601bb3 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.057243:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191334.057272:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839096 lrc: 1/0,0 mode: --/CW res: [0x200000405:0x9f:0x0].0x0 bits 0x1f/0x1f rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4601bb3 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.057279:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839096 lrc: 0/0,0 mode: --/CW res: [0x200000405:0x9f:0x0].0x0 bits 0x1f/0x1f rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4601bb3 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191334.057283:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626446976:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787191334.057292:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191334.057294:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191334.057295:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000002:00010000:3.0:1787191334.057390:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0x9f:0x0], intent: getxattr flags 0 00010000:00010000:3.0:1787191334.057432:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483909d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.057439:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483909d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.057448:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483909d lrc: 3/1,0 mode: --/PR res: [0x200000405:0x9f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191334.057461:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626447104:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191334.057487:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191334.064162:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626447104:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191334.064199:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483909d lrc: 4/1,0 mode: --/PR res: [0x200000405:0x9f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601bd6 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.064216:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483909d lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x9f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601bd6 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.064232:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483909d lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x9f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601bd6 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191334.064245:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b51d1df80 x1874004626447104/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191350 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191334.064257:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483909d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601bd6 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.064268:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/159 (0 0) 00000080:00200000:3.0:1787191334.064274:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0x9f:0x0] suppgids 0 -1: rc 0 00000080:00010000:3.0:1787191334.064300:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x9f:0x0](ffff936b5395d348) for lock 0xe5129dc88483909d 00000080:00010000:3.0:1787191334.064308:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483909d from it ffffa3fb41caba38 00010000:00010000:3.0:1787191334.064313:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483909d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601bd6 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.064321:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483909d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x9f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601bd6 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:3.0:1787191334.064357:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0x9f:0x0](ffff936b5395d348) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191334.000000000, mtime 1787191334.000000000, ctime 1787191334.000000000 00010000:00010000:3.0:1787191334.064383:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483908f lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x9f:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4601bba expref: -99 pid: 57771 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1787191334.065320:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626446976:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00200000:3.0:1787191334.065600:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0x9f:0x0]: losing layout lock 00010000:00010000:3.0:1787191334.065637:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483908f lrc: 1/0,0 mode: --/CW res: [0x200000405:0x9f:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4601bba expref: -99 pid: 57771 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191334.065646:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191334.065649:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483908f lrc: 0/0,0 mode: --/CW res: [0x200000405:0x9f:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4601bba expref: -99 pid: 57771 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:3.0:1787191334.065667:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1787191334.065674:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1df80 x1874004626447744/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191334.065693:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626447744:192.168.202.101@tcp:36:bash.0 00000100:00100000:3.0:1787191334.065716:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191334.069755:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626447744:192.168.202.101@tcp:36:bash.0 00000080:00200000:3.0:1787191334.069787:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:3.0:1787191334.069793:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x9f:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00010000:00010000:3.0:1787191334.069802:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/159 (0 0) 00000080:00010000:3.0:1787191334.069812:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x9f:0x0](ffff936b5395d348) 00000002:00010000:3.0:1787191334.069822:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x9f:0x0]) in obj [0x200000405:0x9f:0x0], intent: layout flags 0 00010000:00010000:3.0:1787191334.069892:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848390a4 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x9f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.069904:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848390a4 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x9f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.069915:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848390a4 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x9f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191334.070142:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626447872:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191334.070236:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359600 going to sleep for 11 seconds 00000100:00100000:3.0:1787191334.074882:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626447872:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191334.074921:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848390a4 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x9f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601be4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.074937:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848390a4 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x9f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601be4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191334.074953:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b51d1dc00 x1874004626447872/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191350 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191334.074965:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848390a4 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x9f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601be4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191334.075122:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848390a4 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x9f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601be4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.075140:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/159 (0 0) 00000080:00200000:2.0:1787191334.075146:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x9f:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1787191334.075165:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x9f:0x0](ffff936b5395d348) for lock 0xe5129dc8848390a4 00000080:00010000:2.0:1787191334.075174:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848390a4 from it ffffa3fb41cab8c8 00010000:00010000:2.0:1787191334.075178:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848390a4 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x9f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601be4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.075188:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848390a4 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x9f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601be4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.075215:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848390a4 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x9f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601be4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.075227:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848390a4 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x9f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601be4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:2.0:1787191334.075234:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0x9f:0x0](000000001d24cd79) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848390a4 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x9f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601be4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191334.075279:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0x9f:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:2.0:1787191334.075285:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848390a4 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x9f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4601be4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.075292:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848390a4 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x9f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4601be4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:2.0:1787191334.075306:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0x9f:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:2.0:1787191334.075315:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x9f:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191334.075319:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0x9f:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:2.0:1787191334.075329:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0x9f:0x0](ffff936b5395d348) 00000002:00010000:2.0:1787191334.075339:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x9f:0x0]) in obj [0x200000405:0x9f:0x0], intent: layout flags 02 00010000:00010000:2.0:1787191334.075356:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848390a4 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x9f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4601be4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191334.075369:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0x9f:0x0]: losing layout lock 00010000:00010000:2.0:1787191334.075400:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848390a4 lrc: 1/0,0 mode: --/CR res: [0x200000405:0x9f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4601be4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191334.075407:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191334.075410:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848390a4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x9f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4601be4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191334.075433:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc8848390ab lrc: 3/0,1 mode: --/EX res: [0x200000405:0x9f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.075440:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc8848390ab lrc: 3/0,1 mode: --/EX res: [0x200000405:0x9f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191334.075450:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191334.075457:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bad80 x1874004626448128/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191334.075466:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc8848390ab lrc: 3/0,1 mode: --/EX res: [0x200000405:0x9f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191334.075486:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626448128:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191334.075621:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b523599c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191334.088825:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191334.088875:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191334.088946:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634817280 00000100:00100000:2.0:1787191334.088954:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634817280 00000100:00100000:2.0:1787191334.088996:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634817920 00000100:00100000:2.0:1787191334.088997:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634817920 00000100:00100000:2.0:1787191334.089008:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1115 00000100:00100000:2.0:1787191334.089015:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30510:x1874004634817280:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191334.089029:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000eb2ebc95/0xe5129dc884839003 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x178:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080030000 nid: local remote: 0x7130d520e46019ec expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191334.089107:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191334.089114:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30510:x1874004634817280:12345-192.168.202.101@tcp:104: Request processed in 99us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191334.089121:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1115 00000100:00100000:2.0:1787191334.089142:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1116 00000100:00100000:2.0:1787191334.089148:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8422:x1874004634817920:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191334.089157:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007a412388/0xe5129dc884839011 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4601a08 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.089202:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787191334.089208:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8422:x1874004634817920:12345-192.168.202.101@tcp:104: Request processed in 60us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191334.089213:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1116 00000100:00100000:2.0:1787191334.089263:0:57570:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589936312 gen 1 00000100:00100000:2.0:1787191334.089343:0:57570:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b6a474a80 x1874004626446848/t8589936308(8589936308) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191350 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787191334.089363:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626448128:192.168.202.101@tcp:101:bash.0 00010000:00010000:2.0:1787191334.089384:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc8848390ab lrc: 4/0,1 mode: --/EX res: [0x200000405:0x9f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601bf2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.089394:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc8848390ab lrc: 4/0,1 mode: --/CR res: [0x200000405:0x9f:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601bf2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.089405:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc8848390ab lrc: 4/0,1 mode: CR/CR res: [0x200000405:0x9f:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601bf2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.089417:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc8848390ab lrc: 4/0,1 mode: CR/CR res: [0x200000405:0x9f:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601bf2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.089429:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc8848390ab lrc: 5/1,1 mode: CR/CR res: [0x200000405:0x9f:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601bf2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.089438:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc8848390ab lrc: 5/1,1 mode: CR/CR res: [0x200000405:0x9f:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601bf2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.089446:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc8848390ab lrc: 4/1,0 mode: CR/CR res: [0x200000405:0x9f:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601bf2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191334.089456:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b513bad80 x1874004626448128/t8589936312(8589936312) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191350 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191334.089472:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc8848390ab lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x9f:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601bf2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191334.089483:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc8848390ab lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x9f:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601bf2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.089494:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/159 (0 0) 00000080:00200000:2.0:1787191334.089501:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0x9f:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1787191334.089514:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x9f:0x0](ffff936b5395d348) for lock 0xe5129dc8848390ab 00000080:00010000:2.0:1787191334.089522:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848390ab from it ffffa3fb41cab930 00010000:00010000:2.0:1787191334.089525:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc8848390ab lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x9f:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601bf2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.089534:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc8848390ab lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x9f:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601bf2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191334.089556:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:2.0:1787191334.089563:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x9f:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:2.0:1787191334.089576:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc8848390ab lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x9f:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601bf2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.089588:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc8848390ab lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x9f:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601bf2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:2.0:1787191334.089596:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0x9f:0x0](000000001d24cd79) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc8848390ab lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x9f:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601bf2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.089635:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc8848390ab lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x9f:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601bf2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.089643:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc8848390ab lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x9f:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601bf2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191334.089661:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x9f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191334.089670:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x9f:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191334.089674:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191334.089680:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191334.089690:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191334.089708:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x9f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:2.0:1787191334.089720:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc8848390ab lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x9f:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601bf2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191334.089729:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc8848390ab lrc: 2/1,0 mode: CR/CR res: [0x200000405:0x9f:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601bf2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:2.0:1787191334.089736:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0x9f:0x0](000000001d24cd79) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc8848390ab lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x9f:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601bf2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191334.089753:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x9f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191334.089757:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x9f:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191334.089760:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191334.089762:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191334.089766:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191334.089772:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x9f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:2.0:1787191334.089783:0:57570:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc884839088 lrc: 1/0,0 mode: PR/PR res: [0x2c0000401:0x17d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4601b9e expref: -99 pid: 57771 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191334.089894:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0x9f:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:2.0:1787191334.089899:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc8848390ab lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x9f:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4601bf2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191334.089908:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc8848390ab lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x9f:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4601bf2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00020000:00200000:2.0:1787191334.089920:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0x9f:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:2.0:1787191334.089922:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x9f:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191334.089924:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191334.089929:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191334.089937:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191334.089940:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:2.0:1787191334.089949:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:2.0:1787191334.089952:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b523599f0, osc lock ffff936b44e631d0, flags 0x80000000 00000008:00010000:2.0:1787191334.089955:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:2.0:1787191334.089956:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b52359a30, osc lock ffff936b44e62be0, flags 0x80000000 00010000:00010000:2.0:1787191334.089964:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b52373000 type 11 mode 2 res 11811161089/381 (0 1048575) 00010000:00010000:2.0:1787191334.089990:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848390b9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.089996:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848390b9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.090003:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848390b9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191334.090018:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626448512:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191334.090056:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787191334.092780:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191334.092866:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634818048 00000100:00100000:3.0:1787191334.092875:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634818048 00000100:00100000:3.0:1787191334.092933:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1117 00000100:00100000:3.0:1787191334.092943:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30353:x1874004634818048:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191334.092960:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc884839088 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x17d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4601b9e expref: -99 pid: 57771 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191334.093031:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191334.093039:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30353:x1874004634818048:12345-192.168.202.101@tcp:104: Request processed in 98us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191334.093045:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1117 00000100:00100000:3.0:1787191334.100139:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626448512:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191334.100169:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848390b9 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x17d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e4601c15 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.100190:0:57570:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848390b9 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x17d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4601c15 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.100199:0:57570:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848390b9 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x17d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4601c15 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191334.101070:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191334.101133:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634818176 00000100:00100000:2.0:1787191334.101141:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634818176 00000100:00100000:2.0:1787191334.101196:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1118 00000100:00100000:2.0:1787191334.101206:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:37090:x1874004634818176:12345-192.168.202.101@tcp:105: 00010000:00010000:2.0:1787191334.101219:0:51131:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848390b9 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x17d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4601c15 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.101230:0:51131:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848390b9 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x17d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4601c15 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.101239:0:51131:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848390b9 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x17d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e4601c15 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.101250:0:51131:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848390b9 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x17d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080080020000 nid: local remote: 0x7130d520e4601c15 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.101259:0:51131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848390b9 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x17d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080080020000 nid: local remote: 0x7130d520e4601c15 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.101269:0:51131:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848390b9 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x17d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80080020000 nid: local remote: 0x7130d520e4601c15 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.101295:0:51131:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b51dd4e00) 00000100:00100000:2.0:1787191334.101351:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:37090:x1874004634818176:12345-192.168.202.101@tcp:105: Request processed in 146us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191334.101359:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1118 00010000:00010000:3.0:1787191334.101435:0:57570:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848390b9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x17d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4601c15 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.101446:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848390b9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x17d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4601c15 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.101460:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848390b9 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x17d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e4601c15 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191334.101472:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848390b9 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x17d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080020000 nid: local remote: 0x7130d520e4601c15 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.101484:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848390b9 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x17d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4601c15 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.101491:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848390b9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x17d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4601c15 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.101565:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000729b914c/0xe5129dc8848390c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.101573:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000729b914c/0xe5129dc8848390c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.101583:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000729b914c/0xe5129dc8848390c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191334.101601:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ce00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626449152:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191334.101664:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c240 going to sleep for 11 seconds 00000100:00100000:3.0:1787191334.105032:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191334.105134:0:40921:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787191334.105153:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634818304 00000100:00100000:2.0:1787191334.105161:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634818304 00000100:00100000:2.0:1787191334.105308:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1119 00000100:00100000:2.0:1787191334.105320:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b50881c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:37089:x1874004634818304:12345-192.168.202.101@tcp:106: 00010000:00010000:2.0:1787191334.105336:0:40921:0:(ldlm_lockd.c:2541:ldlm_callback_handler()) ### glimpse ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848390b9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x17d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4601c15 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.105349:0:40921:0:(ldlm_lockd.c:2123:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848390b9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x17d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4601c15 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00010000:2.0:1787191334.105376:0:40921:0:(cl_object.c:322:cl_object_glimpse()) header@00000000e2389d26[0x110, 1, [0x200000405:0x9f:0x0] hash] 00000020:00010000:2.0:1787191334.105378:0:40921:0:(cl_object.c:322:cl_object_glimpse()) size: 0 mtime: 1787191334 atime: 1787191334 ctime: 1787191334 blocks: 0 00000020:00010000:2.0:1787191334.105382:0:40921:0:(cl_object.c:322:cl_object_glimpse()) header@0000000062726c49[0x110, 2, [0x2c0000401:0x17d:0x0] hash] 00000020:00010000:2.0:1787191334.105384:0:40921:0:(cl_object.c:322:cl_object_glimpse()) size: 0 mtime: 1787191334 atime: 1787191334 ctime: 1787191334 blocks: 0 00000100:00100000:2.0:1787191334.105440:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b50881c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:37089:x1874004634818304:12345-192.168.202.101@tcp:106: Request processed in 122us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191334.105448:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1119 00000100:00100000:3.0:1787191334.107775:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ce00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626449152:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191334.107800:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000729b914c/0xe5129dc8848390c7 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x17a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601c46 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.107819:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000729b914c/0xe5129dc8848390c7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x17a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4601c46 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.107905:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000729b914c/0xe5129dc8848390c7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x17a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4601c46 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.107923:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000729b914c/0xe5129dc8848390c7 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x17a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4601c46 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191334.107941:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000729b914c/0xe5129dc8848390c7 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x17a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4601c46 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.107953:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000729b914c/0xe5129dc8848390c7 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x17a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4601c46 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.107962:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000729b914c/0xe5129dc8848390c7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x17a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4601c46 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191334.108069:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626449280:192.168.202.101@tcp:10:bash.0 00000100:00100000:3.0:1787191334.108878:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626449408:192.168.202.101@tcp:10:bash.0 00000080:00200000:2.0:1787191334.109753:0:57772:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0x9f:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191334.109759:0:57772:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b48035e10 (ffff936b43ab8cf8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191334.109763:0:57772:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b48035e10 (ffff936b43ab8cf8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.109767:0:57772:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7df30 (ffff936b465cccf8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.109771:0:57772:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b48035e10 (ffff936b43ab8cf8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191334.109773:0:57772:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7df30 (ffff936b43ab8cf8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191334.109786:0:57772:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x9f:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191334.109867:0:57772:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0x9f:0x0](ffff936b5395d348), flags 154000 00000002:00100000:2.0:1787191334.109926:0:57772:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a9c00 x1874004626448384/t8589936313(8589936313) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191350 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191334.109938:0:57772:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191334.109944:0:57772:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8700 x1874004626449664/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191334.109969:0:57772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57772:1874004626449664:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191334.110023:0:57772:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787191334.110769:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626449280:192.168.202.101@tcp:10:bash.0 00000100:00100000:3.0:1787191334.112863:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626449408:192.168.202.101@tcp:10:bash.0 00000100:00100000:3.0:1787191334.118304:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191334.118386:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634818432 00000100:00100000:2.0:1787191334.118517:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634818432 00000100:00100000:2.0:1787191334.118798:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1120 00000100:00100000:2.0:1787191334.118810:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634818432:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191334.118827:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc8848390b2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4601c31 expref: -99 pid: 57772 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191334.118925:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191334.118932:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634818432:12345-192.168.202.101@tcp:104: Request processed in 124us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191334.118939:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1120 00000100:00100000:2.0:1787191334.126664:0:57772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57772:1874004626449920:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191334.126686:0:57772:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CW ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f400/0xe5129dc8848390ce lrc: 4/1,0 mode: --/CR res: [0x200000405:0x9f:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601c54 expref: -99 pid: 57772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.126699:0:57772:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f400/0xe5129dc8848390ce lrc: 4/1,0 mode: --/CW res: [0x200000405:0x9f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601c54 expref: -99 pid: 57772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.126712:0:57772:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f400/0xe5129dc8848390ce lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x9f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601c54 expref: -99 pid: 57772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.126722:0:57772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f400/0xe5129dc8848390ce lrc: 4/1,0 mode: CW/CW res: [0x200000405:0x9f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601c54 expref: -99 pid: 57772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.126736:0:57772:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f400/0xe5129dc8848390ce lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x9f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601c54 expref: -99 pid: 57772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.126745:0:57772:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f400/0xe5129dc8848390ce lrc: 5/1,1 mode: CW/CW res: [0x200000405:0x9f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601c54 expref: -99 pid: 57772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.126752:0:57772:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f400/0xe5129dc8848390ce lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x9f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601c54 expref: -99 pid: 57772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191334.126764:0:57772:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x200002b, status=0 req@ffff936b453a9c00 x1874004626449920/t8589936316(8589936316) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191350 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191334.126777:0:57772:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9c00 x1874004626449920/t8589936316(8589936316) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191350 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191334.126793:0:57772:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f400/0xe5129dc8848390ce lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x9f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601c54 expref: -99 pid: 57772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.126803:0:57772:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 8 res 8589935621/159 (0 0) 00000080:00200000:2.0:1787191334.126810:0:57772:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x9f:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1787191334.126901:0:57772:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x9f:0x0](ffff936b5395d348) for lock 0xe5129dc8848390ce 00000080:00010000:2.0:1787191334.126908:0:57772:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848390ce from it ffffa3fb42033bf0 00010000:00010000:2.0:1787191334.126912:0:57772:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f400/0xe5129dc8848390ce lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x9f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601c54 expref: -99 pid: 57772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.126921:0:57772:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f400/0xe5129dc8848390ce lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x9f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601c54 expref: -99 pid: 57772 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00100000:2.0:1787191334.126952:0:57772:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9c00 x1874004626449920/t8589936316(8589936316) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191350 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191334.127120:0:57772:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x9f:0x0](ffff936b5395d348), inode mode 81a4 mask 4 00000080:00200000:2.0:1787191334.127130:0:57772:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0x9f:0x0](ffff936b5395d348), xattr lov 00000080:00200008:2.0:1787191334.127156:0:57772:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0x9f:0x0](ffff936b5395d348), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191334.127164:0:57772:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x9f:0x0](ffff936b5395d348),name=f70.sanity-flr 00000002:00010000:2.0:1787191334.127189:0:57772:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x9f:0x0]) in obj [0x200000405:0x9f:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191334.127203:0:57772:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 30 res 8589935621/159 (0 0) 00010000:00010000:2.0:1787191334.127242:0:57772:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc8848390dc lrc: 3/1,0 mode: --/CR res: [0x200000405:0x9f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.127251:0:57772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc8848390dc lrc: 3/1,0 mode: --/CR res: [0x200000405:0x9f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.127260:0:57772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc8848390dc lrc: 3/1,0 mode: --/CR res: [0x200000405:0x9f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191334.127281:0:57772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57772:1874004626450560:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191334.127376:0:57772:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359600 going to sleep for 11 seconds 00000100:00100000:2.0:1787191334.131169:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191334.131410:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634818560 00000100:00100000:3.0:1787191334.131419:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634818560 00000100:00100000:3.0:1787191334.131510:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1121 00000100:00100000:3.0:1787191334.131521:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634818560:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191334.131540:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f400/0xe5129dc8848390ce lrc: 2/0,0 mode: CW/CW res: [0x200000405:0x9f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e4601c54 expref: -99 pid: 57772 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191334.131622:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191334.131630:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634818560:12345-192.168.202.101@tcp:104: Request processed in 111us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191334.131638:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1121 00000100:00100000:2.0:1787191334.135396:0:57772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57772:1874004626450560:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191334.135424:0:57772:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc8848390dc lrc: 4/1,0 mode: --/CR res: [0x200000405:0x9f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601c69 expref: -99 pid: 57772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.135440:0:57772:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc8848390dc lrc: 4/1,0 mode: --/PR res: [0x200000405:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601c69 expref: -99 pid: 57772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.135461:0:57772:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc8848390dc lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601c69 expref: -99 pid: 57772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.135475:0:57772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc8848390dc lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601c69 expref: -99 pid: 57772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.135488:0:57772:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc8848390dc lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601c69 expref: -99 pid: 57772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.135496:0:57772:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc8848390dc lrc: 5/2,0 mode: PR/PR res: [0x200000405:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601c69 expref: -99 pid: 57772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.135504:0:57772:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc8848390dc lrc: 4/1,0 mode: PR/PR res: [0x200000405:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601c69 expref: -99 pid: 57772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191334.135517:0:57772:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b513b9500 x1874004626450560/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/976 e 0 to 0 dl 1787191350 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191334.135530:0:57772:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc8848390dc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601c69 expref: -99 pid: 57772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191334.136024:0:57772:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc8848390dc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601c69 expref: -99 pid: 57772 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.136041:0:57772:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/159 (0 0) 00000080:00200000:2.0:1787191334.136049:0:57772:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0x9f:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1787191334.136139:0:57772:0:(file.c:6836:ll_layout_conf()) [0x200000405:0x9f:0x0]: layout version change: 4 -> 4 00000080:00010000:2.0:1787191334.136146:0:57772:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x9f:0x0](ffff936b5395d348) for lock 0xe5129dc8848390dc 00000080:00010000:2.0:1787191334.136152:0:57772:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x9f:0x0](ffff936b5395d348) 00000080:00010000:2.0:1787191334.136156:0:57772:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848390dc from it ffffa3fb42033cd8 00010000:00010000:2.0:1787191334.136160:0:57772:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc8848390dc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4601c69 expref: -99 pid: 57772 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.136170:0:57772:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc8848390dc lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4601c69 expref: -99 pid: 57772 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191334.136270:0:57772:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x9f:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:2.0:1787191334.136281:0:57772:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x9f:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191334.136285:0:57772:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191334.136289:0:57772:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0x9f:0x0] 00000008:00010000:2.0:1787191334.136311:0:57772:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191334.136314:0:57772:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1430, osc lock ffff936b44e63b50, flags 0x400000400001002 00010000:00010000:2.0:1787191334.136332:0:57772:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848390b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4601c15 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191334.136347:0:57772:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848390b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4601c15 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:2.0:1787191334.136359:0:57772:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191334.136364:0:57772:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848390b9 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x17d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4601c15 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191334.136372:0:57772:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848390b9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x17d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4601c15 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:2.0:1787191334.136388:0:57772:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191334.136410:0:57772:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0x9f:0x0] updating i_size 5 i_blocks 0 00000020:00010000:2.0:1787191334.136417:0:57772:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b48035e10 (ffff936b43ab8cf8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191334.136420:0:57772:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b48035e10 (ffff936b43ab8cf8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.136423:0:57772:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1430 (ffff936b465cccf8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.136427:0:57772:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b48035e10 (ffff936b43ab8cf8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191334.136430:0:57772:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1430 (ffff936b43ab8cf8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191334.136440:0:57772:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0x9f:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200080:2.0:1787191334.136528:0:57772:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0x9f:0x0](ffff936b5395d348) cmd=c00c66f3 arg=24222e0 00000002:00010000:2.0:1787191334.137289:0:57772:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x9f:0x0]) in obj [0x200000405:0x9f:0x0], intent: open flags 05004040000002 00010000:00010000:2.0:1787191334.137350:0:57772:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc8848390e3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x9f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.137360:0:57772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc8848390e3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x9f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57772 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191334.137372:0:57772:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191334.137383:0:57772:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9500 x1874004626450944/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191334.137407:0:57772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc8848390e3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0x9f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x81000000000000 pid: 57772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191334.137431:0:57772:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57772:1874004626450944:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191334.138430:0:57772:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359600 going to sleep for 11 seconds 00000100:00100000:2.0:1787191334.144504:0:57772:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57772:1874004626450944:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191334.144529:0:57772:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc8848390e3 lrc: 4/1,0 mode: --/CR res: [0x200000405:0x9f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4601c93 expref: -99 pid: 57772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.144542:0:57772:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc8848390e3 lrc: 4/1,0 mode: --/PW res: [0x200000405:0x9f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4601c93 expref: -99 pid: 57772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.145156:0:57772:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc8848390e3 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x9f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4601c93 expref: -99 pid: 57772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.145164:0:57772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc8848390e3 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0x9f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4601c93 expref: -99 pid: 57772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.145239:0:57772:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc8848390e3 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x9f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4601c93 expref: -99 pid: 57772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.145250:0:57772:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc8848390e3 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0x9f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4601c93 expref: -99 pid: 57772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.145257:0:57772:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc8848390e3 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x9f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4601c93 expref: -99 pid: 57772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191334.145267:0:57772:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x600002b, status=0 req@ffff936b513b9500 x1874004626450944/t8589936317(8589936317) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191350 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191334.145279:0:57772:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9500 x1874004626450944/t8589936317(8589936317) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191350 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191334.145292:0:57772:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc8848390e3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x9f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4601c93 expref: -99 pid: 57772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.145305:0:57772:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 2 res 8589935621/159 (0 0) 00000080:00200000:2.0:1787191334.145310:0:57772:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0x9f:0x0] suppgids 0 0: rc 0 00000002:00100000:2.0:1787191334.145326:0:57772:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9500 x1874004626450944/t8589936317(8589936317) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191350 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1787191334.145334:0:57772:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x9f:0x0](ffff936b5395d348) for lock 0xe5129dc8848390e3 00000080:00010000:2.0:1787191334.145337:0:57772:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848390e3 from it ffffa3fb42033cc0 00010000:00010000:2.0:1787191334.145340:0:57772:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc8848390e3 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x9f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4601c93 expref: -99 pid: 57772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.145347:0:57772:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc8848390e3 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x9f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4601c93 expref: -99 pid: 57772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00200000:2.0:1787191334.145411:0:57772:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0x9f:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:2.0:1787191334.145422:0:57772:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0x9f:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191334.145425:0:57772:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191334.145431:0:57772:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191334.145440:0:57772:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000100:00100000:3.0:1787191334.145537:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626451200:192.168.202.101@tcp:1:lfs.0 00000100:00100000:3.0:1787191334.148695:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191334.148887:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634818688 00000100:00100000:2.0:1787191334.148897:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634818688 00000100:00100000:2.0:1787191334.148960:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1122 00000100:00100000:2.0:1787191334.148970:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8420:x1874004634818688:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191334.148991:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848390b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420080020000 nid: local remote: 0x7130d520e4601c15 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1787191334.149071:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191334.149078:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8420:x1874004634818688:12345-192.168.202.101@tcp:104: Request processed in 110us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191334.149087:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1122 00000100:00100000:3.0:1787191334.166521:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626451200:192.168.202.101@tcp:1:lfs.0 00000080:00200000:2.0:1787191334.169793:0:57774:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191334.169829:0:57774:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191334.169865:0:57774:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191334.169883:0:57774:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191334.169892:0:57774:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191334.169901:0:57774:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191334.169905:0:57774:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191334.169915:0:57774:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41fd3b58 00010000:00010000:2.0:1787191334.169919:0:57774:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191334.169928:0:57774:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191334.169944:0:57774:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191334.169952:0:57774:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:2.0:1787191334.169957:0:57774:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191334.169968:0:57774:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:2.0:1787191334.169972:0:57774:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191334.169984:0:57774:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191334.170031:0:57774:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc8848390ea lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.170044:0:57774:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc8848390ea lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.170054:0:57774:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc8848390ea lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191334.170076:0:57774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57774:1874004626452096:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191334.171342:0:57774:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359000 going to sleep for 11 seconds 00000080:00200000:2.0:1787191334.212779:0:57775:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191334.212812:0:57775:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191334.212829:0:57775:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191334.213358:0:57775:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191334.213367:0:57775:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191334.213375:0:57775:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191334.213379:0:57775:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191334.213386:0:57775:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4203bbf8 00010000:00010000:2.0:1787191334.213390:0:57775:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191334.213398:0:57775:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191334.213413:0:57775:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191334.213422:0:57775:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191334.213428:0:57775:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191334.214577:0:57775:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:2.0:1787191334.214584:0:57775:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xa0:0x0](ffff936b5395a1c8), inode mode 81a4 mask 44 00000080:00200008:2.0:1787191334.214589:0:57775:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xa0:0x0](ffff936b5395a1c8), flags 154400 00000002:00010000:2.0:1787191334.214605:0:57775:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xa0:0x0]) in obj [0x200000405:0xa0:0x0], intent: open flags 0100240114401 00010000:00010000:2.0:1787191334.214651:0:57775:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc88483910d lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57775 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.214659:0:57775:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc88483910d lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57775 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191334.214669:0:57775:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191334.214676:0:57775:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9500 x1874004626453504/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191334.214685:0:57775:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc88483910d lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57775 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191334.214704:0:57775:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57775:1874004626453504:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191334.215323:0:57775:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359000 going to sleep for 11 seconds 00000100:00100000:3.0:1787191334.220821:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191334.222269:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634818816 00000100:00100000:2.0:1787191334.222276:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634818816 00000100:00100000:2.0:1787191334.222322:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1123 00000100:00100000:2.0:1787191334.222332:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634818816:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191334.222342:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e600/0xe5129dc884839106 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4601d26 expref: -99 pid: 57774 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191334.222381:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191334.222388:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634818816:12345-192.168.202.101@tcp:104: Request processed in 58us (1578us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191334.222396:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1123 00000100:00100000:3.0:1787191334.288382:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191334.288458:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634819968 00000100:00100000:2.0:1787191334.288466:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634819968 00000100:00100000:2.0:1787191334.288518:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1124 00000100:00100000:2.0:1787191334.288527:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30353:x1874004634819968:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191334.288539:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000729b914c/0xe5129dc8848390c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4601c46 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.288609:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191334.288615:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30353:x1874004634819968:12345-192.168.202.101@tcp:104: Request processed in 89us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191334.288623:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1124 00000100:00100000:2.0:1787191334.294388:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191334.294436:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634820096 00000100:00100000:2.0:1787191334.294446:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634820096 00000100:00100000:2.0:1787191334.294493:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1125 00000100:00100000:2.0:1787191334.294502:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8420:x1874004634820096:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191334.294516:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc884839122 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x17c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4601d81 expref: -99 pid: 57775 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.294570:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191334.294576:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8420:x1874004634820096:12345-192.168.202.101@tcp:104: Request processed in 76us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191334.294583:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1125 00000100:00100000:3.0:1787191334.297907:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191334.298126:0:40921:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787191334.298145:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634820224 00000100:00100000:2.0:1787191334.298152:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634820224 00000100:00100000:2.0:1787191334.298210:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1126 00000100:00100000:2.0:1787191334.298221:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b50881450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:6490:x1874004634820224:12345-192.168.202.101@tcp:105: 00010000:00010000:2.0:1787191334.298233:0:40921:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000cfb66679/0xe5129dc88483914c lrc: 5/0,1 mode: --/PW res: [0x280000401:0x17c:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4601e06 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.298245:0:40921:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000cfb66679/0xe5129dc88483914c lrc: 5/0,1 mode: --/PW res: [0x280000401:0x17c:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4601e06 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.298255:0:40921:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000cfb66679/0xe5129dc88483914c lrc: 5/0,1 mode: --/PW res: [0x280000401:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e4601e06 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.298265:0:40921:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000cfb66679/0xe5129dc88483914c lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080080020000 nid: local remote: 0x7130d520e4601e06 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.298274:0:40921:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000cfb66679/0xe5129dc88483914c lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080080020000 nid: local remote: 0x7130d520e4601e06 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.298284:0:40921:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000cfb66679/0xe5129dc88483914c lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80080020000 nid: local remote: 0x7130d520e4601e06 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.298305:0:40921:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b51fe1a00) 00000100:00100000:2.0:1787191334.298363:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b50881450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:6490:x1874004634820224:12345-192.168.202.101@tcp:105: Request processed in 144us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191334.298371:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1126 00000100:00100000:3.0:1787191334.341358:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191334.341414:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634820352 00000100:00100000:3.0:1787191334.341423:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634820352 00000100:00100000:3.0:1787191334.341477:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1127 00000100:00100000:3.0:1787191334.341489:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634820352:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191334.341507:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e600/0xe5129dc884839153 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4601e22 expref: -99 pid: 57776 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00010000:00010000:3.0:1787191334.341588:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191334.341595:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634820352:12345-192.168.202.101@tcp:104: Request processed in 108us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191334.341602:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1127 00000080:00200000:2.0:1787191334.344583:0:57778:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191334.344615:0:57778:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191334.344631:0:57778:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191334.344647:0:57778:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191334.344655:0:57778:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191334.345377:0:57778:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191334.345382:0:57778:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191334.345386:0:57778:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4201bb58 00010000:00010000:2.0:1787191334.345389:0:57778:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191334.345538:0:57778:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191334.345548:0:57778:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191334.345556:0:57778:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191334.345563:0:57778:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191334.345575:0:57778:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:2.0:1787191334.345579:0:57778:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191334.345592:0:57778:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191334.345633:0:57778:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483916f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.345642:0:57778:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483916f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57778 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.345654:0:57778:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483916f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57778 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191334.345735:0:57778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57778:1874004626459392:192.168.202.101@tcp:101:rm.0 00000100:00100000:2.0:1787191334.345762:0:57778:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191334.347503:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191334.347642:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634820480 00000100:00100000:2.0:1787191334.347651:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634820480 00000100:00100000:2.0:1787191334.347737:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1128 00000100:00100000:2.0:1787191334.347748:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634820480:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191334.347766:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839168 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xa0:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e4601e53 expref: -99 pid: 57777 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.347878:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191334.347885:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634820480:12345-192.168.202.101@tcp:104: Request processed in 139us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191334.347892:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1128 00000100:00100000:2.0:1787191334.368419:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191334.372160:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634820608 00000100:00100000:3.0:1787191334.372245:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634820608 00000100:00100000:2.0:1787191334.375268:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1129 00000100:00100000:2.0:1787191334.375284:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:37089:x1874004634820608:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191334.375304:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000cfb66679/0xe5129dc88483914c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420080020000 nid: local remote: 0x7130d520e4601e06 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 1 00010000:00010000:2.0:1787191334.377974:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191334.377992:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:37089:x1874004634820608:12345-192.168.202.101@tcp:104: Request processed in 2706us (9579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191334.378004:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1129 00000100:00100000:2.0:1787191334.379802:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191334.379859:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634820736 00000100:00100000:2.0:1787191334.379869:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634820736 00000100:00100000:2.0:1787191334.379924:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1130 00000100:00100000:2.0:1787191334.379934:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634820736:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191334.379955:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc884839176 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4601e76 expref: -99 pid: 57777 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191334.380023:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787191334.380030:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634820736:12345-192.168.202.101@tcp:104: Request processed in 97us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191334.380037:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1130 00000080:00200000:3.0:1787191334.399675:0:40929:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa0:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1787191334.399857:0:40929:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa0:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:2.0:1787191334.399931:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000cfb66679/0xe5129dc88483914c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69480020020 nid: local remote: 0x7130d520e4601e06 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 1 00010000:00010000:2.0:1787191334.399945:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191334.399984:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000cfb66679/0xe5129dc88483914c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69480020020 nid: local remote: 0x7130d520e4601e06 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 1 00010000:00010000:2.0:1787191334.399993:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000cfb66679/0xe5129dc88483914c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69480020020 nid: local remote: 0x7130d520e4601e06 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 1 00010000:00010000:2.0:1787191334.400012:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191334.400015:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191334.400017:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191334.400078:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626460928:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191334.405229:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626460928:192.168.202.101@tcp:103:ldlm_bl.0 00000020:00100000:2.0:1787191334.405379:0:57777:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1787191334.405390:0:57777:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8700 x1874004626461184/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 472/440 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787191334.405426:0:57777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57777:1874004626461184:192.168.202.101@tcp:36:lfs.0 00000100:00100000:2.0:1787191334.405509:0:57777:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b523599c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191334.417962:0:57777:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589936343 gen 1 00000100:00100000:2.0:1787191334.417982:0:57777:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b6a476a00 x1874004626459136/t8589936339(8589936339) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191350 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787191334.417993:0:57777:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b6a475500 x1874004626460160/t8589936341(8589936341) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191350 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787191334.418013:0:57777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57777:1874004626461184:192.168.202.101@tcp:36:lfs.0 00010000:00010000:2.0:1787191334.418045:0:57777:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/160 (0 0) 00000080:00010000:2.0:1787191334.418056:0:57777:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xa0:0x0](ffff936b5395a1c8) 00000002:00010000:2.0:1787191334.418064:0:57777:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xa0:0x0]) in obj [0x200000405:0xa0:0x0], intent: layout flags 0 00010000:00010000:2.0:1787191334.418115:0:57777:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839192 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.418124:0:57777:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839192 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57777 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.418133:0:57777:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839192 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57777 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191334.418152:0:57777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57777:1874004626461568:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191334.418233:0:57777:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b523599c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191334.426441:0:57779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57779:1874004626461952:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191334.426453:0:57779:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b821e8400/0xe5129dc8848391a7 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.426464:0:57779:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b821e8400/0xe5129dc8848391a7 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.426471:0:57779:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b821e8400/0xe5129dc8848391a7 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.426478:0:57779:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b821e8400/0xe5129dc8848391a7 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.426486:0:57779:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b821e8400/0xe5129dc8848391a7 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.426492:0:57779:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b821e8400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191334.426497:0:57779:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b821e8400/0xe5129dc8848391a7 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.426505:0:57779:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b821e8400/0xe5129dc8848391a7 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.426512:0:57779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b821e8400/0xe5129dc8848391a7 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.426520:0:57779:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191334.426526:0:57779:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b821e8400/0xe5129dc8848391a7 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.426607:0:57779:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b821e8400/0xe5129dc8848391a7 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57779 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191334.426623:0:57779:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b6a476680 x1874004626461952/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191350 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191334.426634:0:57779:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1787191334.426653:0:57779:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b821e9c00/0xe5129dc884839199 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601efb expref: -99 pid: 57779 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191334.426663:0:57779:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b821e9c00/0xe5129dc884839199 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601efb expref: -99 pid: 57779 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:3.0:1787191334.426670:0:57779:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839199 from it ffffa3fb42053930 00010000:00010000:3.0:1787191334.426674:0:57779:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b821e9c00/0xe5129dc884839199 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601efb expref: -99 pid: 57779 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191334.426681:0:57779:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b821e9c00/0xe5129dc884839199 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601efb expref: -99 pid: 57779 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787191334.426736:0:57779:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191334.426748:0:57779:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191334.426757:0:57779:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191334.426766:0:57779:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191334.426773:0:57779:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191334.426777:0:57779:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191334.426780:0:57779:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191334.426785:0:57779:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42053bf8 00010000:00010000:3.0:1787191334.426789:0:57779:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191334.426796:0:57779:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191334.426805:0:57779:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191334.426811:0:57779:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191334.426816:0:57779:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191334.426821:0:57779:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:3.0:1787191334.426824:0:57779:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:3.0:1787191334.426828:0:57779:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b51dd7e00, open_flags a141, mode 81b6 opened 0 00000080:00200000:3.0:1787191334.426858:0:57779:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:3.0:1787191334.426875:0:57779:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xa1:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:3.0:1787191334.426885:0:57779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b821e9c00/0xe5129dc884839199 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4601efb expref: -99 pid: 57779 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191334.426922:0:57779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b821e9c00/0xe5129dc884839199 lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4601efb expref: -99 pid: 57779 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191334.426929:0:57779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191334.426931:0:57779:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b821e9c00/0xe5129dc884839199 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4601efb expref: -99 pid: 57779 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191334.426956:0:57779:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc8848391b5 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.426962:0:57779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc8848391b5 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57779 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191334.426971:0:57779:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191334.426978:0:57779:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1d880 x1874004626462336/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191334.426987:0:57779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc8848391b5 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191334.427000:0:57779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57779:1874004626462336:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191334.427105:0:57779:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787191334.430363:0:57779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57779:1874004626462336:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191334.430386:0:57779:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc8848391b5 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601f41 expref: -99 pid: 57779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.430499:0:57779:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc8848391b5 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xa1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601f41 expref: -99 pid: 57779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.430510:0:57779:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc8848391b5 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601f41 expref: -99 pid: 57779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.430520:0:57779:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc8848391b5 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601f41 expref: -99 pid: 57779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.430595:0:57779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc8848391b5 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601f41 expref: -99 pid: 57779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.430610:0:57779:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc8848391b5 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601f41 expref: -99 pid: 57779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.430617:0:57779:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc8848391b5 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601f41 expref: -99 pid: 57779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.430624:0:57779:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc8848391b5 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601f41 expref: -99 pid: 57779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191334.430635:0:57779:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b51d1d880 x1874004626462336/t8589936344(8589936344) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191350 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191334.430648:0:57779:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1d880 x1874004626462336/t8589936344(8589936344) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191350 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191334.430659:0:57779:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc8848391b5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601f41 expref: -99 pid: 57779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.430674:0:57779:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/161 (0 0) 00000080:00200000:2.0:1787191334.430740:0:57779:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191334.430752:0:57779:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:2.0:1787191334.430778:0:57779:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xa1:0x0](ffff936b4898b248) 00000080:00200000:2.0:1787191334.430784:0:57779:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xa1:0x0], updating i_size 0 00000080:00200000:2.0:1787191334.430814:0:57779:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xa1:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:2.0:1787191334.430818:0:57779:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xa1:0x0](ffff936b4898b248) 00000080:00010000:2.0:1787191334.430821:0:57779:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xa1:0x0](ffff936b4898b248) for lock 0xe5129dc8848391b5 00000080:00010000:2.0:1787191334.430896:0:57779:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xa1:0x0](ffff936b4898b248) 00000080:00200008:2.0:1787191334.430912:0:57779:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xa1:0x0](ffff936b4898b248), flags 120501 00000002:00100000:2.0:1787191334.430933:0:57779:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1d880 x1874004626462336/t8589936344(8589936344) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191350 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1787191334.430964:0:57779:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848391b5 from it ffff936b460332a0 00010000:00010000:2.0:1787191334.430968:0:57779:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc8848391b5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4601f41 expref: -99 pid: 57779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.430976:0:57779:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc8848391b5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4601f41 expref: -99 pid: 57779 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191334.430997:0:57779:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xa1:0x0](ffff936b4898b248), inode mode 81a4 mask 40 00000080:00200000:2.0:1787191334.431048:0:57779:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xa1:0x0](ffff936b4898b248), inode mode 81a4 mask 2 00000080:00200000:2.0:1787191334.431057:0:57779:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xa1:0x0](ffff936b4898b248), xattr lov 00000002:00010000:2.0:1787191334.431073:0:57779:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xa1:0x0]) in obj [0x200000405:0xa1:0x0], intent: open flags 040000002 00010000:00010000:2.0:1787191334.431128:0:57779:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc8848391bc lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.431139:0:57779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc8848391bc lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57779 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191334.431148:0:57779:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191334.431154:0:57779:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bad80 x1874004626462592/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191334.431162:0:57779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc8848391bc lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57779 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191334.431301:0:57779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57779:1874004626462592:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191334.431515:0:57779:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359600 going to sleep for 11 seconds 00000100:00100000:2.0:1787191334.434897:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191334.435025:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634821376 00000100:00100000:3.0:1787191334.435036:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634821376 00000100:00100000:3.0:1787191334.435080:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1131 00000100:00100000:3.0:1787191334.435109:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634821376:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191334.435125:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc8848391b5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4601f41 expref: -99 pid: 57779 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191334.435208:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191334.435215:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634821376:12345-192.168.202.101@tcp:104: Request processed in 127us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191334.435222:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1131 00000100:00100000:2.0:1787191334.447745:0:57779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57779:1874004626462592:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191334.447772:0:57779:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc8848391bc lrc: 4/1,0 mode: --/CR res: [0x200000405:0xa1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.447787:0:57779:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc8848391bc lrc: 4/1,0 mode: --/CR res: [0x200000405:0xa1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.447795:0:57779:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc8848391bc lrc: 4/1,0 mode: --/CR res: [0x200000405:0xa1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.447802:0:57779:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc8848391bc lrc: 3/0,0 mode: --/CR res: [0x200000405:0xa1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.447811:0:57779:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc8848391bc lrc: 4/0,0 mode: --/CR res: [0x200000405:0xa1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.447821:0:57779:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd4e00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191334.447827:0:57779:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc8848391bc lrc: 4/0,0 mode: --/CR res: [0x200000405:0xa1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.447860:0:57779:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc8848391bc lrc: 4/0,0 mode: --/CR res: [0x200000405:0xa1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.447868:0:57779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc8848391bc lrc: 5/0,0 mode: --/CR res: [0x200000405:0xa1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.447876:0:57779:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191334.447884:0:57779:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc8848391bc lrc: 3/0,0 mode: --/CR res: [0x200000405:0xa1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57779 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.447891:0:57779:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc8848391bc lrc: 0/0,0 mode: --/CR res: [0x200000405:0xa1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57779 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191334.447918:0:57779:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b513bad80 x1874004626462592/t8589936345(8589936345) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191350 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191334.447932:0:57779:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bad80 x1874004626462592/t8589936345(8589936345) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191350 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191334.447950:0:57779:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xa1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1787191334.448008:0:57779:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa1:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1787191334.448020:0:57779:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa1:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191334.448076:0:57779:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xa1:0x0], updating i_size 0 00000002:00100000:2.0:1787191334.448117:0:57779:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bad80 x1874004626462592/t8589936345(8589936345) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191350 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191334.448166:0:57779:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513bad80 x1874004626462592/t8589936345(8589936345) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191350 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191334.448189:0:57779:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191334.448195:0:57779:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9c00 x1874004626462976/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191334.448220:0:57779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57779:1874004626462976:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191334.448311:0:57779:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359600 going to sleep for 11 seconds 00000100:00100000:2.0:1787191334.450867:0:57779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57779:1874004626462976:192.168.202.101@tcp:35:lfs.0 00000002:00100000:2.0:1787191334.450905:0:57779:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513bad80 x1874004626462592/t8589936345(8589936345) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191350 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:2.0:1787191334.450980:0:57779:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xa1:0x0](ffff936b4898b248), flags 100001 00000002:00100000:2.0:1787191334.451029:0:57779:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1d880 x1874004626462336/t8589936344(8589936344) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191350 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191334.451040:0:57779:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191334.451047:0:57779:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513baa00 x1874004626463232/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191334.451070:0:57779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57779:1874004626463232:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191334.451168:0:57779:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359600 going to sleep for 11 seconds 00000100:00100000:2.0:1787191334.457826:0:57779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57779:1874004626463232:192.168.202.101@tcp:35:lfs.0 00000002:00100000:2.0:1787191334.458010:0:57779:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1d880 x1874004626462336/t8589936344(8589936344) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191350 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787191334.470010:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626463488:192.168.202.101@tcp:101:bash.0 00010000:00010000:2.0:1787191334.470036:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e600/0xe5129dc8848391c3 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601f79 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.470064:0:57570:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e600/0xe5129dc8848391c3 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xa1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601f79 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.470073:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e600/0xe5129dc8848391c3 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601f79 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.470154:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e600/0xe5129dc8848391c3 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601f79 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.470170:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e600/0xe5129dc8848391c3 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601f79 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.470249:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e600/0xe5129dc8848391c3 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601f79 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.470257:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e600/0xe5129dc8848391c3 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601f79 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.470264:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e600/0xe5129dc8848391c3 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601f79 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191334.470277:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x2b, status=0 req@ffff936b453a8a80 x1874004626463488/t8589936348(8589936348) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191350 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191334.470291:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8a80 x1874004626463488/t8589936348(8589936348) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191350 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191334.470304:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e600/0xe5129dc8848391c3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601f79 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191334.470317:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e600/0xe5129dc8848391c3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601f79 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.470326:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/161 (0 0) 00000080:00200000:2.0:1787191334.470332:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191334.470381:0:57570:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xa1:0x0](ffff936b4898b248): rc = 0 00000080:00200000:2.0:1787191334.470397:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xa1:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:2.0:1787191334.470402:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xa1:0x0](ffff936b4898b248) for lock 0xe5129dc8848391c3 00000080:00010000:2.0:1787191334.470414:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xa1:0x0](ffff936b4898b248) 00000080:00200008:2.0:1787191334.470429:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xa1:0x0](ffff936b4898b248), flags 101101 00000002:00100000:2.0:1787191334.470451:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8a80 x1874004626463488/t8589936348(8589936348) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191350 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1787191334.470486:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848391c3 from it ffff936b5339fcc0 00010000:00010000:2.0:1787191334.470490:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e600/0xe5129dc8848391c3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4601f79 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.470499:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e600/0xe5129dc8848391c3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4601f79 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191334.470521:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xa1:0x0](ffff936b4898b248), inode mode 81a4 mask 42 00000002:00010000:2.0:1787191334.470554:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xa1:0x0], intent: getxattr flags 0 00010000:00010000:2.0:1787191334.470593:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc8848391ca lrc: 3/1,0 mode: --/PR res: [0x200000405:0xa1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.470606:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc8848391ca lrc: 3/1,0 mode: --/PR res: [0x200000405:0xa1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.470614:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc8848391ca lrc: 3/1,0 mode: --/PR res: [0x200000405:0xa1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191334.470634:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626463744:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191334.470868:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359600 going to sleep for 11 seconds 00000100:00100000:2.0:1787191334.474466:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626463744:192.168.202.101@tcp:101:bash.0 00010000:00010000:2.0:1787191334.474493:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc8848391ca lrc: 4/1,0 mode: --/PR res: [0x200000405:0xa1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601f8e expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.474510:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc8848391ca lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xa1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601f8e expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.474523:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc8848391ca lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xa1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601f8e expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191334.474539:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b513b9180 x1874004626463744/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191350 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191334.474551:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc8848391ca lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601f8e expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.474561:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/161 (0 0) 00000080:00200000:2.0:1787191334.474567:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xa1:0x0] suppgids 0 -1: rc 0 00000080:00010000:2.0:1787191334.474594:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xa1:0x0](ffff936b4898b248) for lock 0xe5129dc8848391ca 00000080:00010000:2.0:1787191334.474603:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848391ca from it ffffa3fb41caba38 00010000:00010000:2.0:1787191334.474607:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc8848391ca lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4601f8e expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.474616:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc8848391ca lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4601f8e expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:2.0:1787191334.474652:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xa1:0x0](ffff936b4898b248) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191334.000000000, mtime 1787191334.000000000, ctime 1787191334.000000000 00010000:00010000:2.0:1787191334.474694:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e600/0xe5129dc8848391c3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4601f79 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191334.474715:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xa1:0x0]: losing layout lock 00010000:00010000:2.0:1787191334.474757:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e600/0xe5129dc8848391c3 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4601f79 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.474764:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191334.474767:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e600/0xe5129dc8848391c3 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4601f79 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:2.0:1787191334.474789:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1787191334.474796:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9180 x1874004626464000/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787191334.474822:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626464000:192.168.202.101@tcp:36:bash.0 00000100:00100000:2.0:1787191334.474935:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359600 going to sleep for 11 seconds 00000020:00010000:2.0:1787191334.478245:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b53cc5a88 (ffff936b47a17368/0) at cl_lock_release():245 00000020:00010000:2.0:1787191334.478250:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b53cc5a88 (ffff936b47a17368/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.478256:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b46b50930 (ffff936b47a17908/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191334.478266:0:57777:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000aecbdbca/0xe5129dc8848391ae lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4601f25 expref: -99 pid: 57777 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191334.478282:0:57777:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000aecbdbca/0xe5129dc8848391ae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4601f25 expref: -99 pid: 57777 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00010000:2.0:1787191334.478299:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b53cc5a88 (ffff936b47a17368/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191334.478302:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b46b50930 (ffff936b47a17368/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191334.478344:0:57777:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa0:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191334.478363:0:57777:0:(file.c:5244:ll_file_seek()) COMPLETED file f70.sanity-flr:[0x200000405:0xa0:0x0], offset: 0, type: SEEK_HOLE, rc = 5 00000080:00200080:2.0:1787191334.478379:0:57777:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xa0:0x0](ffff936b5395a1c8) cmd=400866b1 arg=0 00000080:00200080:2.0:1787191334.478390:0:57777:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xa0:0x0](ffff936b5395a1c8) cmd=400866b1 arg=1 00000080:00200008:2.0:1787191334.478396:0:57777:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xa0:0x0](ffff936b5395a1c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191334.478406:0:57777:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xa0:0x0](ffff936b5395a1c8),name=f70.sanity-flr 00000002:00010000:2.0:1787191334.478429:0:57777:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xa0:0x0]) in obj [0x200000405:0xa0:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191334.478444:0:57777:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b821e8e00/0xe5129dc8848391a0 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xa0:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4601f09 expref: -99 pid: 57777 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191334.478457:0:57777:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b821e8e00/0xe5129dc8848391a0 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xa0:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4601f09 expref: -99 pid: 57777 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191334.478464:0:57777:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xa0:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191334.478472:0:57777:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xa0:0x0](ffff936b5395a1c8) 00000080:00010000:2.0:1787191334.478475:0:57777:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xa0:0x0](ffff936b5395a1c8) for lock 0xe5129dc8848391a0 00000080:00010000:2.0:1787191334.478481:0:57777:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848391a0 from it ffffa3fb4204bcd8 00010000:00010000:2.0:1787191334.478484:0:57777:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b821e8e00/0xe5129dc8848391a0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa0:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4601f09 expref: -99 pid: 57777 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191334.478497:0:57777:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b821e8e00/0xe5129dc8848391a0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa0:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4601f09 expref: -99 pid: 57777 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191334.478516:0:57777:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa0:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:2.0:1787191334.478526:0:57777:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xa0:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191334.478530:0:57777:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191334.478533:0:57777:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xa0:0x0] 00000008:00010000:2.0:1787191334.478551:0:57777:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191334.478553:0:57777:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d10b0, osc lock ffff936b44e63b50, flags 0x400000400001002 00010000:00010000:2.0:1787191334.478568:0:57777:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000aecbdbca/0xe5129dc8848391ae lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x17c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4601f25 expref: -99 pid: 57777 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191334.478577:0:57777:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000aecbdbca/0xe5129dc8848391ae lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4601f25 expref: -99 pid: 57777 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:2.0:1787191334.478589:0:57777:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191334.478593:0:57777:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000aecbdbca/0xe5129dc8848391ae lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4601f25 expref: -99 pid: 57777 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191334.478601:0:57777:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000aecbdbca/0xe5129dc8848391ae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4601f25 expref: -99 pid: 57777 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000020:00200000:2.0:1787191334.478610:0:57777:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191334.478619:0:57777:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xa0:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191334.478621:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c3bc20 (ffff936b47a17c68/0) at cl_lock_release():245 00000020:00010000:2.0:1787191334.478624:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c3bc20 (ffff936b47a17c68/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.478627:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d10b0 (ffff936b465cc518/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.478630:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c3bc20 (ffff936b47a17c68/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191334.478632:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d10b0 (ffff936b47a17c68/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191334.478640:0:57777:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa0:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191334.478673:0:57777:0:(file.c:2483:do_file_read_iter()) START file f70.sanity-flr:[0x200000405:0xa0:0x0], ppos: 0, count: 4096 00000080:00200000:2.0:1787191334.478681:0:57777:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: read ppos: 0, bytes: 4096 00000080:00200000:2.0:1787191334.478689:0:57777:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000020:00200000:2.0:1787191334.478695:0:57777:0:(cl_io.c:214:cl_io_rw_init()) header@0000000017a04194[0x110, 2, [0x200000405:0xa0:0x0] hash] 00000020:00200000:2.0:1787191334.478697:0:57777:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 4096) 2048 0 00000080:00200000:2.0:1787191334.478700:0:57777:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa0:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00000080:00200000:2.0:1787191334.478708:0:57777:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1787191334.478716:0:57777:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:2.0:1787191334.478720:0:57777:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1787191334.478732:0:57777:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:2.0:1787191334.478740:0:57777:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:2.0:1787191334.478743:0:57777:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d10b0, osc lock ffff936b44e63b50, flags 0x40000 00000080:00200000:2.0:1787191334.478748:0:57777:0:(vvp_io.c:835:vvp_io_read_start()) f70.sanity-flr: read [0, 4096) 00000001:00010000:2.0:1787191334.478755:0:57777:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xa0:0x0] 00000008:00010000:2.0:1787191334.478759:0:57777:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191334.478761:0:57777:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d17b0, osc lock ffff936b44e63c80, flags 0x400001002 00010000:00010000:2.0:1787191334.478768:0:57777:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000aecbdbca/0xe5129dc8848391ae lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x17c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4601f25 expref: -99 pid: 57777 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1787191334.478777:0:57777:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000aecbdbca/0xe5129dc8848391ae lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4601f25 expref: -99 pid: 57777 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000020:00200000:2.0:1787191334.478785:0:57777:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191334.478787:0:57777:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000aecbdbca/0xe5129dc8848391ae lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4601f25 expref: -99 pid: 57777 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1787191334.478800:0:57777:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000aecbdbca/0xe5129dc8848391ae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4601f25 expref: -99 pid: 57777 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 1 00000020:00200000:2.0:1787191334.478809:0:57777:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191334.478812:0:57777:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xa0:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191334.478815:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c3bc20 (ffff936b47a17c68/0) at cl_lock_release():245 00000020:00010000:2.0:1787191334.478817:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c3bc20 (ffff936b47a17c68/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.478819:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d17b0 (ffff936b465cc518/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.478821:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c3bc20 (ffff936b47a17c68/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191334.478824:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d17b0 (ffff936b47a17c68/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191334.478864:0:57777:0:(vvp_io.c:893:vvp_io_read_start()) count:4096 iocb pos:0 00000080:00200000:2.0:1787191334.478871:0:57777:0:(rw26.c:362:ll_direct_IO()) VFS Op:inode=[0x200000405:0xa0:0x0](ffff936b5395a1c8), size=4096 (max 536870912), offset=0=0x0, pages 1 (max 131072), lockless, parallel 00000020:00200000:2.0:1787191334.478923:0:57777:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1787191334.478925:0:57777:0:(rw26.c:544:ll_direct_IO()) result 0 tot_bytes 5 count 5 file_offset 5 00000020:00010000:2.0:1787191334.478930:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b53cc5f38 (ffff936b47a17c68/0) at cl_lock_release():245 00000020:00010000:2.0:1787191334.478933:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b53cc5f38 (ffff936b47a17c68/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.478935:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d10b0 (ffff936b465cc518/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.478938:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b53cc5f38 (ffff936b47a17c68/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191334.478940:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d10b0 (ffff936b47a17c68/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191334.478944:0:57777:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000020:00200000:2.0:1787191334.478949:0:57777:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1787191334.478973:0:25580:0:(osc_cache.c:2029:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff936b46699600 00000008:00100000:2.0:1787191334.479016:0:25580:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff936b513b8a80 - object 0x280000401:380 offset 0<>5 00000100:00100000:2.0:1787191334.479057:0:2392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787191334.479070:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626464256:192.168.202.101@tcp:3:lfs.0 00000100:00100000:2.0:1787191334.480628:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626464000:192.168.202.101@tcp:36:bash.0 00000080:00200000:2.0:1787191334.480670:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:2.0:1787191334.480676:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa1:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00010000:00010000:2.0:1787191334.480690:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/161 (0 0) 00000080:00010000:2.0:1787191334.480701:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xa1:0x0](ffff936b4898b248) 00000002:00010000:2.0:1787191334.480711:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xa1:0x0]) in obj [0x200000405:0xa1:0x0], intent: layout flags 0 00010000:00010000:2.0:1787191334.480755:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc8848391d1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.480763:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc8848391d1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.480773:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc8848391d1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191334.480790:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626464384:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191334.481034:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359600 going to sleep for 11 seconds 00000008:00010000:2.0:1787191334.483987:0:2392:0:(osc_cache.c:917:osc_extent_finish()) ### no dlm lock: extent: ffff936b46699600 00000020:00200000:2.0:1787191334.484001:0:2392:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:2.0:1787191334.484009:0:2392:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:2.0:1787191334.484022:0:2392:0:(osc_cache.c:497:__osc_extent_remove()) ### no dlm lock: extent: ffff936b46699600 00000100:00100000:2.0:1787191334.484048:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626464256:192.168.202.101@tcp:3:lfs.0 00000080:00200000:2.0:1787191334.508802:0:57777:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1787191334.508814:0:57777:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa0:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191334.508818:0:57777:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:2.0:1787191334.508827:0:57777:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xa0:0x0] updating i_size 5 i_blocks 8 00000020:00200000:2.0:1787191334.508851:0:57777:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191334.508860:0:57777:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200080:2.0:1787191334.508878:0:57777:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xa0:0x0](ffff936b5395a1c8) cmd=400866b1 arg=0 00000080:00200080:2.0:1787191334.508884:0:57777:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xa0:0x0](ffff936b5395a1c8) cmd=400866b1 arg=1 00000080:00200008:2.0:1787191334.508891:0:57777:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xa0:0x0](ffff936b5395a1c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191334.508897:0:57777:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xa0:0x0](ffff936b5395a1c8),name=f70.sanity-flr 00000002:00010000:2.0:1787191334.508915:0:57777:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xa0:0x0]) in obj [0x200000405:0xa0:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191334.508929:0:57777:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b821e8e00/0xe5129dc8848391a0 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xa0:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4601f09 expref: -99 pid: 57777 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191334.508940:0:57777:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b821e8e00/0xe5129dc8848391a0 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xa0:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4601f09 expref: -99 pid: 57777 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:2.0:1787191334.508945:0:57777:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xa0:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191334.508951:0:57777:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xa0:0x0](ffff936b5395a1c8) 00000080:00010000:2.0:1787191334.508953:0:57777:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xa0:0x0](ffff936b5395a1c8) for lock 0xe5129dc8848391a0 00000080:00010000:2.0:1787191334.508960:0:57777:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848391a0 from it ffffa3fb4204bcd8 00010000:00010000:2.0:1787191334.508963:0:57777:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b821e8e00/0xe5129dc8848391a0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa0:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4601f09 expref: -99 pid: 57777 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191334.508968:0:57777:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b821e8e00/0xe5129dc8848391a0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa0:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4601f09 expref: -99 pid: 57777 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00000080:00200000:2.0:1787191334.508988:0:57777:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa0:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:2.0:1787191334.508995:0:57777:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xa0:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191334.508997:0:57777:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191334.509000:0:57777:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xa0:0x0] 00000008:00010000:2.0:1787191334.509016:0:57777:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191334.509018:0:57777:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d10b0, osc lock ffff936b44e63b50, flags 0x400000400001002 00010000:00010000:2.0:1787191334.509030:0:57777:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000aecbdbca/0xe5129dc8848391ae lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x17c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4601f25 expref: -99 pid: 57777 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 1 00010000:00010000:2.0:1787191334.509042:0:57777:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000aecbdbca/0xe5129dc8848391ae lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4601f25 expref: -99 pid: 57777 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 1 00000020:00200000:2.0:1787191334.509049:0:57777:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191334.509051:0:57777:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000aecbdbca/0xe5129dc8848391ae lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4601f25 expref: -99 pid: 57777 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 1 00010000:00010000:2.0:1787191334.509055:0:57777:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000aecbdbca/0xe5129dc8848391ae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4601f25 expref: -99 pid: 57777 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00000020:00200000:2.0:1787191334.509061:0:57777:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191334.509064:0:57777:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xa0:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191334.509067:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c3bc20 (ffff936b47a17c68/0) at cl_lock_release():245 00000020:00010000:2.0:1787191334.509069:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c3bc20 (ffff936b47a17c68/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.509071:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d10b0 (ffff936b465cc518/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.509074:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c3bc20 (ffff936b47a17c68/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191334.509075:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d10b0 (ffff936b47a17c68/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191334.509082:0:57777:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa0:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191334.509103:0:57777:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xa0:0x0], offset: 5, type: SEEK_DATA 00000080:00200000:2.0:1787191334.509108:0:57777:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa0:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:2.0:1787191334.509112:0:57777:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xa0:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191334.509114:0:57777:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191334.509119:0:57777:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191334.509125:0:57777:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191334.509138:0:57777:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xa0:0x0] updating i_size 5 i_blocks 8 00000080:00200000:2.0:1787191334.509146:0:57777:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa0:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191334.509151:0:57777:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000080:00200000:2.0:1787191334.509153:0:57777:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa0:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191334.509157:0:57777:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191334.509161:0:57777:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191334.509163:0:57777:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:2.0:1787191334.509168:0:57777:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:2.0:1787191334.509170:0:57777:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d10b0, osc lock ffff936b44e63b50, flags 0x0 00010000:00010000:2.0:1787191334.509178:0:57777:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000aecbdbca/0xe5129dc8848391ae lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x17c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4601f25 expref: -99 pid: 57777 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:2.0:1787191334.509187:0:57777:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000aecbdbca/0xe5129dc8848391ae lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4601f25 expref: -99 pid: 57777 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:2.0:1787191334.509195:0:57777:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000aecbdbca/0xe5129dc8848391ae lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4601f25 expref: -99 pid: 57777 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:2.0:1787191334.509203:0:57777:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000aecbdbca/0xe5129dc8848391ae lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4601f25 expref: -99 pid: 57777 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:2.0:1787191334.509210:0:57777:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000aecbdbca/0xe5129dc8848391ae lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4601f25 expref: -99 pid: 57777 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00000080:00200000:2.0:1787191334.509220:0:57777:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xa0:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191334.509225:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b53cc5f38 (ffff936b47a17c68/0) at cl_lock_release():245 00000020:00010000:2.0:1787191334.509227:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b53cc5f38 (ffff936b47a17c68/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.509228:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d10b0 (ffff936b465cc518/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191334.509231:0:57777:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000aecbdbca/0xe5129dc8848391ae lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4601f25 expref: -99 pid: 57777 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:2.0:1787191334.509240:0:57777:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000aecbdbca/0xe5129dc8848391ae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4601f25 expref: -99 pid: 57777 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00000020:00010000:2.0:1787191334.509246:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b53cc5f38 (ffff936b47a17c68/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191334.509248:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d10b0 (ffff936b47a17c68/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191334.509252:0:57777:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa0:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191334.509257:0:57777:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xa0:0x0], offset: 0, type: (null) 00000080:00200000:2.0:1787191334.509260:0:57777:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa0:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:2.0:1787191334.509263:0:57777:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xa0:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191334.509264:0:57777:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191334.509266:0:57777:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xa0:0x0] 00000008:00010000:2.0:1787191334.509270:0:57777:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191334.509271:0:57777:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d10b0, osc lock ffff936b44e63b50, flags 0x400000400001002 00010000:00010000:2.0:1787191334.509276:0:57777:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000aecbdbca/0xe5129dc8848391ae lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x17c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4601f25 expref: -99 pid: 57777 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00010000:00010000:2.0:1787191334.509282:0:57777:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000aecbdbca/0xe5129dc8848391ae lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4601f25 expref: -99 pid: 57777 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00000020:00200000:2.0:1787191334.509287:0:57777:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191334.509288:0:57777:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000aecbdbca/0xe5129dc8848391ae lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4601f25 expref: -99 pid: 57777 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00010000:00010000:2.0:1787191334.509292:0:57777:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000aecbdbca/0xe5129dc8848391ae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4601f25 expref: -99 pid: 57777 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00000020:00200000:2.0:1787191334.509301:0:57777:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191334.509303:0:57777:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xa0:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191334.509305:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c3bc20 (ffff936b47a17c68/0) at cl_lock_release():245 00000020:00010000:2.0:1787191334.509306:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c3bc20 (ffff936b47a17c68/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.509308:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d10b0 (ffff936b465cc518/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.509309:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c3bc20 (ffff936b47a17c68/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191334.509310:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d10b0 (ffff936b47a17c68/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191334.509313:0:57777:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa0:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191334.509317:0:57777:0:(file.c:5244:ll_file_seek()) COMPLETED file f70.sanity-flr:[0x200000405:0xa0:0x0], offset: 0, type: (null), rc = 5 00000080:00200080:2.0:1787191334.509321:0:57777:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xa0:0x0](ffff936b5395a1c8) cmd=400866b1 arg=0 00000080:00200000:3.0:1787191334.516148:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xa1:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1787191334.516156:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b42ff6e48 (ffff936b465cce18/0) at cl_lock_release():245 00000020:00010000:3.0:1787191334.516160:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42ff6e48 (ffff936b465cce18/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191334.516165:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f994b0 (ffff936b47a17e18/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191334.516175:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000702e59bb/0xe5129dc8848391e6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4601fcd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.516191:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000702e59bb/0xe5129dc8848391e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4601fcd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1787191334.516211:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f994f0 (ffff936b47a17248/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191334.516216:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000009c2d9724/0xe5129dc8848391ed lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x17e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4601fd4 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.516224:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000009c2d9724/0xe5129dc8848391ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4601fd4 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1787191334.516233:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42ff6e48 (ffff936b465cce18/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191334.516236:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f994b0 (ffff936b465cce18/1) at cl_lock_fini():72 00000020:00010000:3.0:1787191334.516241:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f994f0 (ffff936b465cce18/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191334.516259:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa1:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191334.516273:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xa1:0x0](ffff936b4898b248) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191334.000000000, mtime 1787191334.000000000, ctime 1787191334.000000000, rc 0 00000080:00200008:3.0:1787191334.516387:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xa1:0x0], ppos: 0, count: 5 00000080:00200000:3.0:1787191334.516400:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:3.0:1787191334.516406:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:3.0:1787191334.516411:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:3.0:1787191334.516415:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:3.0:1787191334.516421:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@000000009f28380a[0x110, 1, [0x200000405:0xa1:0x0] hash] 00000020:00200000:3.0:1787191334.516424:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:3.0:1787191334.516428:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa1:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:3.0:1787191334.516441:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xa1:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:3.0:1787191334.516446:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xa1:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191334.516449:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:3.0:1787191334.516453:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1787191334.516460:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:3.0:1787191334.516463:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1787191334.516479:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:3.0:1787191334.516493:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:3.0:1787191334.516498:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667ab0, osc lock ffff936b44f65c80, flags 0x0 00010000:00010000:3.0:1787191334.516515:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000702e59bb/0xe5129dc8848391e6 lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x181:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4601fcd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191334.516525:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000702e59bb/0xe5129dc8848391e6 lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4601fcd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191334.516539:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000702e59bb/0xe5129dc8848391e6 lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4601fcd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191334.516547:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000702e59bb/0xe5129dc8848391e6 lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4601fcd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191334.516554:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000702e59bb/0xe5129dc8848391e6 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4601fcd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191334.516566:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:3.0:1787191334.516574:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:3.0:1787191334.516615:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:3.0:1787191334.516623:0:57570:0:(rw26.c:927:ll_write_end()) page@000000000b871629[3 0000000032b09121 2 1 00000000a7c7c335 0 0 0] 00000080:00200000:3.0:1787191334.516626:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @00000000867f2304 17ffffc0001001 3:0 ffff936b50842c40 0 lru 00000080:00200000:3.0:1787191334.516634:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@00000000e74af4ba 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000ef00a996 00000000fb8354e6 > 3< 0 0 > 4< 0 0 8 394571776 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1787191334.516636:0:57570:0:(rw26.c:927:ll_write_end()) end page@000000000b871629 00000080:00200000:3.0:1787191334.516637:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1787191334.516641:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:3.0:1787191334.516662:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 0000000055ad0488 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000702e59bb/0xe5129dc8848391e6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4601fcd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191334.516680:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b4898b3f8, count 1, dirtied 1 00000080:00200000:3.0:1787191334.516684:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:3.0:1787191334.516687:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:3.0:1787191334.516699:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b42ff6e48 (ffff936b465cce18/0) at cl_lock_release():245 00000020:00010000:3.0:1787191334.516703:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42ff6e48 (ffff936b465cce18/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191334.516705:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667ab0 (ffff936b47a17248/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191334.516709:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000702e59bb/0xe5129dc8848391e6 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4601fcd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191334.516717:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000702e59bb/0xe5129dc8848391e6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4601fcd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:3.0:1787191334.516726:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42ff6e48 (ffff936b465cce18/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191334.516729:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667ab0 (ffff936b465cce18/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191334.516735:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:3.0:1787191334.516739:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1787191334.516744:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa1:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191334.516748:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:3.0:1787191334.516753:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xa1:0x0] updating i_size 5 i_blocks 0 00000080:00200000:3.0:1787191334.516756:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:3.0:1787191334.516774:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xa1:0x0](ffff936b4898b248), flags 100001 00000002:00100000:3.0:1787191334.516826:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a8a80 x1874004626463488/t8589936348(8589936348) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191350 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191334.516857:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191334.516861:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1ea00 x1874004626465664/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191334.516877:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626465664:192.168.202.101@tcp:35:bash.0 00000100:00100000:3.0:1787191334.517033:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cd80 going to sleep for 11 seconds 00000080:00200080:2.0:1787191334.524078:0:57777:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xa0:0x0](ffff936b5395a1c8) cmd=400866b1 arg=2 00000080:00200008:2.0:1787191334.524100:0:57777:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xa0:0x0](ffff936b5395a1c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191334.524105:0:57777:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xa0:0x0](ffff936b5395a1c8),name=f70.sanity-flr 00000002:00010000:2.0:1787191334.524115:0:57777:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xa0:0x0]) in obj [0x200000405:0xa0:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191334.524126:0:57777:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b821e8e00/0xe5129dc8848391a0 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xa0:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4601f09 expref: -99 pid: 57777 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00010000:00010000:2.0:1787191334.524134:0:57777:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b821e8e00/0xe5129dc8848391a0 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xa0:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4601f09 expref: -99 pid: 57777 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00000080:00200000:2.0:1787191334.524140:0:57777:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xa0:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191334.524145:0:57777:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xa0:0x0](ffff936b5395a1c8) 00000080:00010000:2.0:1787191334.524147:0:57777:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xa0:0x0](ffff936b5395a1c8) for lock 0xe5129dc8848391a0 00000080:00010000:2.0:1787191334.524152:0:57777:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848391a0 from it ffffa3fb4204bcd8 00010000:00010000:2.0:1787191334.524155:0:57777:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b821e8e00/0xe5129dc8848391a0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa0:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4601f09 expref: -99 pid: 57777 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00010000:00010000:2.0:1787191334.524163:0:57777:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b821e8e00/0xe5129dc8848391a0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa0:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4601f09 expref: -99 pid: 57777 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00000080:00200000:2.0:1787191334.524186:0:57777:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa0:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:2.0:1787191334.524198:0:57777:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xa0:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191334.524202:0:57777:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191334.524205:0:57777:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xa0:0x0] 00000008:00010000:2.0:1787191334.524225:0:57777:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191334.524230:0:57777:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d10b0, osc lock ffff936b44e63b50, flags 0x400000400001002 00010000:00010000:2.0:1787191334.524246:0:57777:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000aecbdbca/0xe5129dc8848391ae lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x17c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4601f25 expref: -99 pid: 57777 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00010000:00010000:2.0:1787191334.524257:0:57777:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000aecbdbca/0xe5129dc8848391ae lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4601f25 expref: -99 pid: 57777 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00000020:00200000:2.0:1787191334.524268:0:57777:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191334.524271:0:57777:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000aecbdbca/0xe5129dc8848391ae lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4601f25 expref: -99 pid: 57777 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00010000:00010000:2.0:1787191334.524279:0:57777:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000aecbdbca/0xe5129dc8848391ae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4601f25 expref: -99 pid: 57777 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00000020:00200000:2.0:1787191334.524290:0:57777:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191334.524302:0:57777:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xa0:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191334.524306:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c3bc20 (ffff936b47a17c68/0) at cl_lock_release():245 00000020:00010000:2.0:1787191334.524309:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c3bc20 (ffff936b47a17c68/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.524312:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d10b0 (ffff936b465cc518/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.524315:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c3bc20 (ffff936b47a17c68/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191334.524319:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d10b0 (ffff936b47a17c68/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191334.524331:0:57777:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa0:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191334.524358:0:57777:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xa0:0x0](ffff936b5395a1c8) current size 5, valid attrs 2068, mode 0, uid -1322410190, gid -1, new size 5, atime 1787191334.000000000, mtime 1787191334.000000000, ctime 1787191334.000000000 00010000:00010000:2.0:1787191334.524380:0:57777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b821e8e00/0xe5129dc8848391a0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa0:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4601f09 expref: -99 pid: 57777 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00010000:00010000:2.0:1787191334.524396:0:57777:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839192 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xa0:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4601eed expref: -99 pid: 57777 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191334.524429:0:57777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b821e8e00/0xe5129dc8848391a0 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xa0:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4601f09 expref: -99 pid: 57777 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00010000:00010000:2.0:1787191334.524436:0:57777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191334.524439:0:57777:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b821e8e00/0xe5129dc8848391a0 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xa0:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4601f09 expref: -99 pid: 57777 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00000020:00100000:2.0:1787191334.524456:0:57777:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1787191334.524466:0:57777:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8a80 x1874004626466048/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787191334.524483:0:57777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57777:1874004626466048:192.168.202.101@tcp:36:lfs.0 00000100:00100000:2.0:1787191334.524649:0:57777:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359000 going to sleep for 11 seconds 00000080:00200000:2.0:1787191334.544645:0:57777:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xa0:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191334.544652:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b53cc57b8 (ffff936b47a17f38/0) at cl_lock_release():245 00000020:00010000:2.0:1787191334.544656:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b53cc57b8 (ffff936b47a17f38/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.544661:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99870 (ffff936b47a17098/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191334.544673:0:57777:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000885072ec/0xe5129dc8848391fb lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460201a expref: -99 pid: 57777 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.544688:0:57777:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000885072ec/0xe5129dc8848391fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460201a expref: -99 pid: 57777 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191334.544706:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f998b0 (ffff936b47a17488/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191334.544711:0:57777:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000018d79f65/0xe5129dc884839202 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x17d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4602021 expref: -99 pid: 57777 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.544719:0:57777:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000018d79f65/0xe5129dc884839202 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4602021 expref: -99 pid: 57777 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191334.544727:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b53cc57b8 (ffff936b47a17f38/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191334.544730:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99870 (ffff936b47a17f38/1) at cl_lock_fini():72 00000020:00010000:2.0:1787191334.544734:0:57777:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f998b0 (ffff936b47a17f38/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191334.544789:0:57777:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa0:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191334.544811:0:57777:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xa0:0x0](ffff936b5395a1c8) current size 5, valid attrs 10002168, mode 0, uid -1322410190, gid -1, new size 5, atime 1787191334.000000000, mtime 1787191334.000000000, ctime 1787191334.000000000, rc 0 00000080:00200080:2.0:1787191334.544828:0:57777:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xa0:0x0](ffff936b5395a1c8) cmd=400866b1 arg=0 00000080:00200008:2.0:1787191334.544964:0:57777:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xa0:0x0](ffff936b5395a1c8) current size 5, valid attrs 101f0, mode a3fb, uid 1108043024, gid -27797, new size 18446624687905939912, atime 1787191334.000000000, mtime 1787191334.000000000, ctime 1787191334.000000000 00000020:00100000:2.0:1787191334.545020:0:57777:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1787191334.545029:0:57777:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb480 x1874004626467072/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787191334.545057:0:57777:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57777:1874004626467072:192.168.202.101@tcp:36:lfs.0 00000100:00100000:2.0:1787191334.545314:0:57777:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359000 going to sleep for 11 seconds 00000100:00100000:3.0:1787191334.547794:0:57777:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57777:1874004626467072:192.168.202.101@tcp:36:lfs.0 00000080:00200000:3.0:1787191334.547830:0:57777:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa0:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:3.0:1787191334.547871:0:57777:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xa0:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191334.547875:0:57777:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191334.547881:0:57777:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191334.547893:0:57777:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000100:00100000:3.0:1787191334.547934:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787191334.547944:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626467328:192.168.202.101@tcp:2:lfs.0 00000100:00100000:3.0:1787191334.550379:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626467328:192.168.202.101@tcp:2:lfs.0 00000100:00100000:3.0:1787191334.556105:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191334.556224:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634822016 00000100:00100000:2.0:1787191334.556233:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634822016 00000100:00100000:2.0:1787191334.556288:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1132 00000100:00100000:2.0:1787191334.556299:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:15323:x1874004634822016:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191334.556313:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839192 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xa0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4601eed expref: -99 pid: 57777 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191334.556387:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191334.556393:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:15323:x1874004634822016:12345-192.168.202.101@tcp:104: Request processed in 96us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191334.556400:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1132 00000100:00100000:3.0:1787191334.566774:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191334.567550:0:51131:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787191334.567576:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634823168 00000100:00100000:2.0:1787191334.567582:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634823168 00000100:00100000:2.0:1787191334.567627:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1133 00000100:00100000:2.0:1787191334.567635:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b50882850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:37089:x1874004634823168:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191334.567656:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000702e59bb/0xe5129dc8848391e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4601fcd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191334.567716:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191334.567722:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b50882850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:37089:x1874004634823168:12345-192.168.202.101@tcp:104: Request processed in 88us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191334.567730:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1133 00010000:00010000:2.0:1787191334.567768:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787191334.567773:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000702e59bb/0xe5129dc8848391e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4601fcd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191334.567781:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b821e9a00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:2.0:1787191334.567785:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000702e59bb/0xe5129dc8848391e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4601fcd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191334.567811:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000702e59bb/0xe5129dc8848391e6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4601fcd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191334.567818:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191334.567857:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000702e59bb/0xe5129dc8848391e6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4601fcd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191334.567866:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000702e59bb/0xe5129dc8848391e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4601fcd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191334.567882:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191334.567884:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191334.567885:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191334.567896:0:2392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787191334.567909:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626468480:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191334.576854:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191334.576877:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626468480:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191334.576910:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634823296 00000100:00100000:2.0:1787191334.576917:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634823296 00000100:00100000:2.0:1787191334.576959:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1134 00000100:00100000:2.0:1787191334.576968:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8422:x1874004634823296:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191334.576985:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000009c2d9724/0xe5129dc8848391ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4601fd4 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.577045:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191334.577051:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8422:x1874004634823296:12345-192.168.202.101@tcp:104: Request processed in 85us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191334.577058:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1134 00010000:00010000:2.0:1787191334.577765:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787191334.577773:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000009c2d9724/0xe5129dc8848391ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4601fd4 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.577783:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b821e8200 already unused, calling callback (ffffffffc1208790) 00010000:00010000:2.0:1787191334.577789:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000009c2d9724/0xe5129dc8848391ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4601fd4 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.577824:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000009c2d9724/0xe5129dc8848391ed lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4601fd4 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.577853:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191334.577867:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000009c2d9724/0xe5129dc8848391ed lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4601fd4 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.577875:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000009c2d9724/0xe5129dc8848391ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4601fd4 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.577891:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191334.577892:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191334.577894:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191334.577901:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787191334.577911:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626469248:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191334.582623:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626469248:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191334.583309:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191334.583425:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634823424 00000100:00100000:3.0:1787191334.583433:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634823424 00000100:00100000:3.0:1787191334.583488:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1135 00000100:00100000:3.0:1787191334.583498:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634823424:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191334.583517:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e400/0xe5129dc88483922c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46020ad expref: -99 pid: 57781 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191334.583728:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191334.583735:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634823424:12345-192.168.202.101@tcp:104: Request processed in 239us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191334.583742:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1135 00000080:00200000:3.0:1787191334.605322:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191334.605345:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191334.605362:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191334.605376:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191334.605384:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191334.605390:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191334.605405:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191334.605413:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:3.0:1787191334.605417:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191334.605425:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191334.605440:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191334.605447:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191334.605452:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191334.607035:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:3.0:1787191334.607044:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xa3:0x0](ffff936b5395aa08), inode mode 81a4 mask 42 00000080:00200008:3.0:1787191334.607050:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xa3:0x0](ffff936b5395aa08), flags 101101 00000002:00010000:3.0:1787191334.607065:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xa3:0x0]) in obj [0x200000405:0xa3:0x0], intent: open|creat flags 04240101102 00010000:00010000:3.0:1787191334.607076:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b821e8200/0xe5129dc884839241 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e460210f expref: -99 pid: 57782 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191334.607102:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xa3:0x0]: losing layout lock 00010000:00010000:3.0:1787191334.607130:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b821e8200/0xe5129dc884839241 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460210f expref: -99 pid: 57782 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191334.607136:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191334.607140:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b821e8200/0xe5129dc884839241 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460210f expref: -99 pid: 57782 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191334.607163:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884839256 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xa3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.607168:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884839256 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xa3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191334.607177:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191334.607183:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1d500 x1874004626471296/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191334.607191:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884839256 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xa3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191334.607207:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626471296:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191334.607332:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c240 going to sleep for 11 seconds 00000080:00200000:2.0:1787191334.610938:0:57782:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xa3:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191334.610943:0:57782:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51654b90 (ffff936b465cce18/0) at cl_lock_release():245 00000020:00010000:2.0:1787191334.610945:0:57782:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51654b90 (ffff936b465cce18/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.610950:0:57782:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99b70 (ffff936b47a17248/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.610953:0:57782:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99bb0 (ffff936b47a177e8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.610955:0:57782:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51654b90 (ffff936b465cce18/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191334.610956:0:57782:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99b70 (ffff936b465cce18/1) at cl_lock_fini():72 00000020:00010000:2.0:1787191334.610960:0:57782:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99bb0 (ffff936b465cce18/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191334.610996:0:57782:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa3:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:2.0:1787191334.611013:0:57782:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/163 (0 0) 00000080:00010000:2.0:1787191334.611022:0:57782:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xa3:0x0](ffff936b5395aa08) 00000002:00010000:2.0:1787191334.611031:0:57782:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xa3:0x0]) in obj [0x200000405:0xa3:0x0], intent: layout flags 0 00010000:00010000:2.0:1787191334.611067:0:57782:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483925d lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.611072:0:57782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483925d lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.611079:0:57782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483925d lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191334.611107:0:57782:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57782:1874004626471424:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191334.611190:0:57782:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359300 going to sleep for 11 seconds 00000100:00100000:2.0:1787191334.613138:0:57782:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57782:1874004626471424:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191334.613154:0:57782:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483925d lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xa3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602140 expref: -99 pid: 57782 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.613165:0:57782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483925d lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xa3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602140 expref: -99 pid: 57782 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191334.613237:0:57782:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b513b9f80 x1874004626471424/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191350 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191334.613247:0:57782:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483925d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602140 expref: -99 pid: 57782 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191334.613258:0:57782:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483925d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602140 expref: -99 pid: 57782 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.613267:0:57782:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/163 (0 0) 00000080:00200000:2.0:1787191334.613272:0:57782:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xa3:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1787191334.613285:0:57782:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xa3:0x0](ffff936b5395aa08) for lock 0xe5129dc88483925d 00000080:00010000:2.0:1787191334.613291:0:57782:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483925d from it ffffa3fb42053bc8 00010000:00010000:2.0:1787191334.613294:0:57782:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483925d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602140 expref: -99 pid: 57782 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.613303:0:57782:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483925d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xa3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602140 expref: -99 pid: 57782 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.613321:0:57782:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884839256 lrc: 2/0,1 mode: CW/CW res: [0x200000405:0xa3:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602132 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.613332:0:57782:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884839256 lrc: 2/0,1 mode: CW/CW res: [0x200000405:0xa3:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602132 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:2.0:1787191334.613341:0:57782:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xa3:0x0](000000008454039f) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884839256 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xa3:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602132 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.613351:0:57782:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884839256 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xa3:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4602132 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.613358:0:57782:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884839256 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xa3:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602132 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200008:2.0:1787191334.613440:0:57782:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xa3:0x0](ffff936b5395aa08), flags 154000 00000002:00100000:2.0:1787191334.613475:0:57782:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a475500 x1874004626470784/t8589936364(8589936364) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191350 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191334.613485:0:57782:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191334.613490:0:57782:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9f80 x1874004626471808/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191334.613506:0:57782:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57782:1874004626471808:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191334.613587:0:57782:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359300 going to sleep for 11 seconds 00000100:00100000:2.0:1787191334.616320:0:57782:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57782:1874004626471808:192.168.202.101@tcp:35:lfs.0 00000002:00100000:2.0:1787191334.616344:0:57782:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a475500 x1874004626470784/t8589936364(8589936364) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191350 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191334.616512:0:57782:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191334.616529:0:57782:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191334.616541:0:57782:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191334.616559:0:57782:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191334.616565:0:57782:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191334.616571:0:57782:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191334.616575:0:57782:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191334.616582:0:57782:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42053bf8 00010000:00010000:2.0:1787191334.616585:0:57782:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191334.616593:0:57782:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191334.616606:0:57782:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191334.616613:0:57782:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191334.616619:0:57782:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191334.616632:0:57782:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b522dbe00, open_flags d900, mode 0 opened 0 00000080:00200000:2.0:1787191334.616639:0:57782:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:2.0:1787191334.616653:0:57782:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:2.0:1787191334.616708:0:57782:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483926b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.616716:0:57782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483926b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57782 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191334.616725:0:57782:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191334.616731:0:57782:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9f80 x1874004626472320/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191334.616741:0:57782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483926b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191334.616755:0:57782:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57782:1874004626472320:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191334.616935:0:57782:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359300 going to sleep for 11 seconds 00000100:00100000:3.0:1787191334.620984:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191334.621055:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634823552 00000100:00100000:2.0:1787191334.621062:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634823552 00000100:00100000:2.0:1787191334.621114:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1136 00000100:00100000:2.0:1787191334.621124:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634823552:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191334.621140:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483926b lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e4602171 expref: -99 pid: 57782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.621229:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191334.621234:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634823552:12345-192.168.202.101@tcp:104: Request processed in 114us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191334.621239:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1136 00000100:00100000:2.0:1787191334.621963:0:57782:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57782:1874004626472320:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191334.621978:0:57782:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483926b lrc: 5/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e4602171 expref: -99 pid: 57782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.621994:0:57782:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483926b lrc: 5/1,0 mode: --/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e4602171 expref: -99 pid: 57782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.621999:0:57782:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483926b lrc: 5/1,0 mode: --/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e4602171 expref: -99 pid: 57782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.622011:0:57782:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483926b lrc: 5/1,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10400000000000 nid: local remote: 0x7130d520e4602171 expref: -99 pid: 57782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.622018:0:57782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483926b lrc: 5/1,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e4602171 expref: -99 pid: 57782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.622025:0:57782:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483926b lrc: 6/2,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10400000000000 nid: local remote: 0x7130d520e4602171 expref: -99 pid: 57782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.622031:0:57782:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483926b lrc: 6/2,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10400000000000 nid: local remote: 0x7130d520e4602171 expref: -99 pid: 57782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.622035:0:57782:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483926b lrc: 5/1,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10400000000000 nid: local remote: 0x7130d520e4602171 expref: -99 pid: 57782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191334.622042:0:57782:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b513b9f80 x1874004626472320/t8589936369(8589936369) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191350 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191334.622051:0:57782:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9f80 x1874004626472320/t8589936369(8589936369) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191350 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191334.622060:0:57782:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483926b lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e4602171 expref: -99 pid: 57782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191334.622068:0:57782:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483926b lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e4602171 expref: -99 pid: 57782 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.622078:0:57782:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/163 (0 0) 00000080:00200000:2.0:1787191334.622082:0:57782:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191334.622142:0:57782:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xa3:0x0](ffff936b5395aa08): rc = 0 00000080:00200000:2.0:1787191334.622158:0:57782:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xa3:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:2.0:1787191334.622162:0:57782:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xa3:0x0](ffff936b5395aa08) for lock 0xe5129dc88483926b 00000080:00010000:2.0:1787191334.622183:0:57782:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xa3:0x0](ffff936b5395aa08) 00000080:00200008:2.0:1787191334.622196:0:57782:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xa3:0x0](ffff936b5395aa08), flags 154400 00000002:00100000:2.0:1787191334.622214:0:57782:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9f80 x1874004626472320/t8589936369(8589936369) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191350 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1787191334.622256:0:57782:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483926b from it ffff936b60dc4900 00010000:00010000:2.0:1787191334.622260:0:57782:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483926b lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10420000000000 nid: local remote: 0x7130d520e4602171 expref: -99 pid: 57782 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.622268:0:57782:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483926b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10420000000000 nid: local remote: 0x7130d520e4602171 expref: -99 pid: 57782 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000080:00200000:2.0:1787191334.622283:0:57782:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xa3:0x0](ffff936b5395aa08), inode mode 81a4 mask 44 00000080:00200000:2.0:1787191334.622340:0:57782:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xa3:0x0](ffff936b5395aa08), inode mode 81a4 mask 4 00000080:00200000:2.0:1787191334.622346:0:57782:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xa3:0x0](ffff936b5395aa08), xattr lov 00000080:00200008:2.0:1787191334.622363:0:57782:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xa3:0x0](ffff936b5395aa08), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191334.622367:0:57782:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xa3:0x0](ffff936b5395aa08),name=f70.sanity-flr 00000002:00010000:2.0:1787191334.622384:0:57782:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xa3:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191334.622392:0:57782:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483926b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4602171 expref: -99 pid: 57782 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.622409:0:57782:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483926b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4602171 expref: -99 pid: 57782 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000080:00200000:2.0:1787191334.622416:0:57782:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191334.622421:0:57782:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xa3:0x0](ffff936b5395aa08) 00000080:00010000:2.0:1787191334.622424:0:57782:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xa3:0x0](ffff936b5395aa08) for lock 0xe5129dc88483926b 00000080:00010000:2.0:1787191334.622428:0:57782:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483926b from it ffffa3fb42053cd8 00010000:00010000:2.0:1787191334.622431:0:57782:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483926b lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10420000000000 nid: local remote: 0x7130d520e4602171 expref: -99 pid: 57782 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.622437:0:57782:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483926b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10420000000000 nid: local remote: 0x7130d520e4602171 expref: -99 pid: 57782 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000080:00200000:2.0:1787191334.622453:0:57782:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa3:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:2.0:1787191334.622463:0:57782:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xa3:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191334.622466:0:57782:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191334.622469:0:57782:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xa3:0x0] 00000008:00010000:2.0:1787191334.622486:0:57782:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191334.622488:0:57782:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b52359330, osc lock ffff936b44e63b50, flags 0x400000400001002 00000008:00010000:2.0:1787191334.622492:0:57782:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191334.622493:0:57782:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b52359370, osc lock ffff936b44e63c80, flags 0x400000400001002 00010000:00010000:2.0:1787191334.622506:0:57782:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000702e59bb/0xe5129dc884839248 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x184:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460211d expref: -99 pid: 57782 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.622514:0:57782:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000702e59bb/0xe5129dc884839248 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460211d expref: -99 pid: 57782 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:2.0:1787191334.622527:0:57782:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191334.622529:0:57782:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000702e59bb/0xe5129dc884839248 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460211d expref: -99 pid: 57782 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.622534:0:57782:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000702e59bb/0xe5129dc884839248 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460211d expref: -99 pid: 57782 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191334.622550:0:57782:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342209ac/0xe5129dc88483924f lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x181:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4602124 expref: -99 pid: 57782 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.622558:0:57782:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342209ac/0xe5129dc88483924f lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4602124 expref: -99 pid: 57782 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:2.0:1787191334.622565:0:57782:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191334.622567:0:57782:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342209ac/0xe5129dc88483924f lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4602124 expref: -99 pid: 57782 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.622574:0:57782:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342209ac/0xe5129dc88483924f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4602124 expref: -99 pid: 57782 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:2.0:1787191334.622583:0:57782:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191334.622593:0:57782:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xa3:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191334.622596:0:57782:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c39280 (ffff936b47a17098/0) at cl_lock_release():245 00000020:00010000:2.0:1787191334.622598:0:57782:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c39280 (ffff936b47a17098/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.622601:0:57782:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b52359330 (ffff936b47a17c68/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.622604:0:57782:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b52359370 (ffff936b465cc518/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.622605:0:57782:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c39280 (ffff936b47a17098/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191334.622607:0:57782:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b52359330 (ffff936b47a17098/1) at cl_lock_fini():72 00000020:00010000:2.0:1787191334.622610:0:57782:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b52359370 (ffff936b47a17098/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191334.622617:0:57782:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa3:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191334.622639:0:57782:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xa3:0x0](ffff936b5395aa08), flags 154000 00000002:00100000:2.0:1787191334.622676:0:57782:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513b9f80 x1874004626472320/t8589936369(8589936369) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191350 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191334.622686:0:57782:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191334.622691:0:57782:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb480 x1874004626472832/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191334.622711:0:57782:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57782:1874004626472832:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191334.622769:0:57782:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359300 going to sleep for 11 seconds 00000100:00100000:2.0:1787191334.625200:0:57782:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57782:1874004626472832:192.168.202.101@tcp:35:lfs.0 00000002:00100000:2.0:1787191334.625234:0:57782:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513b9f80 x1874004626472320/t8589936369(8589936369) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191350 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191334.625345:0:57782:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191334.625364:0:57782:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191334.625379:0:57782:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191334.625393:0:57782:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191334.625401:0:57782:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191334.625407:0:57782:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191334.625411:0:57782:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191334.625417:0:57782:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42053bf8 00010000:00010000:2.0:1787191334.625421:0:57782:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191334.625430:0:57782:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191334.625445:0:57782:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191334.625452:0:57782:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191334.625457:0:57782:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191334.625461:0:57782:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:2.0:1787191334.625465:0:57782:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xa3:0x0](ffff936b5395aa08), inode mode 81a4 mask 46 00000080:00200008:2.0:1787191334.625472:0:57782:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xa3:0x0](ffff936b5395aa08), flags 154402 00000080:00200080:2.0:1787191334.625525:0:57782:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xa3:0x0](ffff936b5395aa08) cmd=800466af arg=7fffaa30ae9c 00000080:00200080:2.0:1787191334.625538:0:57782:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xa3:0x0](ffff936b5395aa08) cmd=80086601 arg=7fffaa30ae38 00000100:00100000:2.0:1787191334.625573:0:57782:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57782:1874004626472960:192.168.202.101@tcp:33:lfs.0 00000100:00100000:2.0:1787191334.625631:0:57782:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359300 going to sleep for 11 seconds 00000100:00100000:2.0:1787191334.640361:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191334.640414:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191334.640439:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634824192 00000100:00100000:2.0:1787191334.640447:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634824192 00000100:00100000:3.0:1787191334.640466:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634824320 00000100:00100000:3.0:1787191334.640470:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634824320 00000100:00100000:3.0:1787191334.640493:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1137 00000100:00100000:2.0:1787191334.640499:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1138 00000100:00100000:3.0:1787191334.640501:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+5:8422:x1874004634824192:12345-192.168.202.101@tcp:104: 00000100:00100000:2.0:1787191334.640505:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+5:8420:x1874004634824320:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191334.640517:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483915a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4601e30 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191334.640517:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000885072ec/0xe5129dc8848391fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e460201a expref: -99 pid: 57777 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191334.640579:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787191334.640585:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+5:8422:x1874004634824192:12345-192.168.202.101@tcp:104: Request processed in 85us (233us total) trans 0 rc 0/0 00010000:00010000:2.0:1787191334.640587:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787191334.640592:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+5:8420:x1874004634824320:12345-192.168.202.101@tcp:104: Request processed in 88us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191334.640593:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1137 00000100:00100000:2.0:1787191334.640597:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1138 00000100:00100000:2.0:1787191334.643918:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191334.643943:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634824832 00000100:00100000:2.0:1787191334.643949:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634824832 00000100:00100000:2.0:1787191334.643985:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1139 00000100:00100000:2.0:1787191334.643993:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30353:x1874004634824832:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191334.644006:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000aecbdbca/0xe5129dc8848391ae lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x17c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4601f25 expref: -99 pid: 57777 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:2.0:1787191334.644058:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191334.644064:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30353:x1874004634824832:12345-192.168.202.101@tcp:104: Request processed in 72us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191334.644071:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1139 00000100:00100000:2.0:1787191334.644163:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626472576:192.168.202.101@tcp:101:bash.0 00010000:00010000:2.0:1787191334.644175:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839272 lrc: 4/0,1 mode: --/EX res: [0x200000405:0xa3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602186 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.644183:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839272 lrc: 4/0,1 mode: --/CR res: [0x200000405:0xa3:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602186 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.644192:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839272 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xa3:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602186 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.644205:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839272 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xa3:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602186 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.644213:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839272 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xa3:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602186 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.644220:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839272 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xa3:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602186 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.644226:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839272 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xa3:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602186 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191334.644233:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b6a477100 x1874004626472576/t8589936371(8589936371) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191350 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191334.644247:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839272 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa3:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602186 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191334.644254:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839272 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa3:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602186 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.644273:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/163 (0 0) 00000080:00200000:2.0:1787191334.644277:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xa3:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1787191334.644286:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xa3:0x0](ffff936b5395aa08) for lock 0xe5129dc884839272 00000080:00010000:2.0:1787191334.644291:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839272 from it ffffa3fb41cab930 00010000:00010000:2.0:1787191334.644294:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839272 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa3:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602186 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.644306:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839272 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xa3:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602186 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191334.644317:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:2.0:1787191334.644320:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa3:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00020000:00200000:2.0:1787191334.644327:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xa3:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:2.0:1787191334.644331:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xa3:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191334.644333:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191334.644339:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191334.644350:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191334.644353:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:2.0:1787191334.644363:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:2.0:1787191334.644367:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b52359330, osc lock ffff936b44e63c80, flags 0x80000000 00000008:00010000:2.0:1787191334.644746:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:2.0:1787191334.644749:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b52359370, osc lock ffff936b44e63b50, flags 0x80000000 00010000:00010000:2.0:1787191334.644797:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839287 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x180:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.644805:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839287 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x180:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.644815:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839287 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x180:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191334.644858:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626473728:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191334.644906:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191334.644935:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191334.644967:0:40921:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787191334.644977:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634824960 00000100:00100000:2.0:1787191334.644982:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634824960 00000100:00100000:2.0:1787191334.645014:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1140 00000100:00100000:2.0:1787191334.645021:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b50881c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8720:x1874004634824960:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191334.645031:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000018d79f65/0xe5129dc884839202 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4602021 expref: -99 pid: 57777 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.645068:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787191334.645075:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b50881c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8720:x1874004634824960:12345-192.168.202.101@tcp:104: Request processed in 54us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191334.645082:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1140 00000100:00100000:3.0:1787191334.651110:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191334.651136:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634825216 00000100:00100000:3.0:1787191334.651142:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634825216 00000100:00100000:3.0:1787191334.651190:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1141 00000100:00100000:3.0:1787191334.651200:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:37089:x1874004634825216:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191334.651211:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839280 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000010000 nid: local remote: 0x7130d520e46021cc expref: -99 pid: 57783 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191334.651265:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191334.651272:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:37089:x1874004634825216:12345-192.168.202.101@tcp:104: Request processed in 74us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191334.651280:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1141 00000100:00100000:3.0:1787191334.654236:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626473728:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191334.654274:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839287 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e46021d3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.654333:0:57570:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839287 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e46021d3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.654342:0:57570:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839287 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e46021d3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191334.656615:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191334.656869:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634825344 00000100:00100000:2.0:1787191334.656875:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634825344 00000100:00100000:2.0:1787191334.656917:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1142 00000100:00100000:2.0:1787191334.656926:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:6491:x1874004634825344:12345-192.168.202.101@tcp:105: 00010000:00010000:2.0:1787191334.656939:0:51131:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839287 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e46021d3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.656952:0:51131:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839287 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e46021d3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.656962:0:51131:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839287 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e46021d3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.656972:0:51131:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839287 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080080020000 nid: local remote: 0x7130d520e46021d3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.656982:0:51131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839287 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080080020000 nid: local remote: 0x7130d520e46021d3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.656989:0:51131:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839287 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80080020000 nid: local remote: 0x7130d520e46021d3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.657007:0:51131:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b51dd4400) 00010000:00010000:3.0:1787191334.657033:0:57570:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839287 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e46021d3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.657043:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839287 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e46021d3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.657057:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839287 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e46021d3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191334.657060:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:6491:x1874004634825344:12345-192.168.202.101@tcp:105: Request processed in 135us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191334.657067:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1142 00000008:00010000:3.0:1787191334.657071:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839287 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080020000 nid: local remote: 0x7130d520e46021d3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.657082:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839287 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e46021d3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.657104:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839287 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e46021d3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.657171:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000008763ad1f/0xe5129dc88483928e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x183:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.657180:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000008763ad1f/0xe5129dc88483928e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x183:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.657189:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000008763ad1f/0xe5129dc88483928e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x183:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191334.657207:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f800 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626474624:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191334.658069:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ce40 going to sleep for 11 seconds 00000080:00200000:2.0:1787191334.671230:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xa3:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191334.671237:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b53cc5998 (ffff936b47a17518/0) at cl_lock_release():245 00000020:00010000:2.0:1787191334.671240:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b53cc5998 (ffff936b47a17518/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.671244:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b52359330 (ffff936b47a17098/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191334.671254:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839287 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e46021d3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.671278:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839287 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e46021d3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191334.671293:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b52359370 (ffff936b465cc518/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191334.671298:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000008763ad1f/0xe5129dc88483928e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46021da expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.671306:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000008763ad1f/0xe5129dc88483928e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46021da expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191334.671314:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b53cc5998 (ffff936b47a17518/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191334.671317:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b52359330 (ffff936b47a17518/1) at cl_lock_fini():72 00000020:00010000:2.0:1787191334.671321:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b52359370 (ffff936b47a17518/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191334.671337:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa3:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191334.671371:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xa3:0x0](ffff936b5395aa08) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191334.000000000, mtime 1787191334.000000000, ctime 1787191334.000000000, rc 0 00000080:00200008:2.0:1787191334.671457:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xa3:0x0], ppos: 0, count: 5 00000080:00200000:2.0:1787191334.671470:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191334.671475:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:2.0:1787191334.671480:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:2.0:1787191334.671485:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1787191334.671490:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@00000000cd1998af[0x110, 1, [0x200000405:0xa3:0x0] hash] 00000020:00200000:2.0:1787191334.671492:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:2.0:1787191334.671497:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa3:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191334.671508:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xa3:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:2.0:1787191334.671513:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xa3:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191334.671516:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1787191334.671521:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1787191334.671527:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:2.0:1787191334.671530:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1787191334.671545:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:2.0:1787191334.671557:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1787191334.671561:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d17b0, osc lock ffff936b44e63b50, flags 0x0 00010000:00010000:2.0:1787191334.671578:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839287 lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x180:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e46021d3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.671589:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839287 lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e46021d3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.671604:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839287 lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e46021d3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.671612:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839287 lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e46021d3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.671618:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839287 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e46021d3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191334.671628:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:2.0:1787191334.671636:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191334.671693:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:2.0:1787191334.671701:0:57570:0:(rw26.c:927:ll_write_end()) page@00000000a29b94d0[3 00000000efd11dd1 2 1 000000004521ffda 0 0 0] 00000080:00200000:2.0:1787191334.671704:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @000000008156f003 17ffffc0001001 3:0 ffff936b43a1e620 0 lru 00000080:00200000:2.0:1787191334.671711:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@000000000a8fb213 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000a2a44f55 00000000a9621480 > 3< 0 0 > 4< 0 0 8 328380416 - | - - - - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1787191334.671713:0:57570:0:(rw26.c:927:ll_write_end()) end page@00000000a29b94d0 00000080:00200000:2.0:1787191334.671714:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:2.0:1787191334.671719:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:2.0:1787191334.671737:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 00000000a1af3917 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839287 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e46021d3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191334.671756:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b5395abb8, count 1, dirtied 1 00000080:00200000:2.0:1787191334.671761:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:2.0:1787191334.671763:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:2.0:1787191334.671777:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b42ff66c8 (ffff936b465cc518/0) at cl_lock_release():245 00000020:00010000:2.0:1787191334.671780:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42ff66c8 (ffff936b465cc518/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.671783:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d17b0 (ffff936b47a17098/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191334.671787:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839287 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e46021d3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.671796:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839287 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e46021d3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:2.0:1787191334.671805:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42ff66c8 (ffff936b465cc518/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191334.671808:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d17b0 (ffff936b465cc518/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191334.671815:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:2.0:1787191334.671819:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1787191334.671824:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa3:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191334.671827:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:2.0:1787191334.671855:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xa3:0x0] updating i_size 5 i_blocks 0 00000080:00200000:2.0:1787191334.671859:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:2.0:1787191334.672360:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xa3:0x0](ffff936b5395aa08), flags 100001 00000002:00100000:2.0:1787191334.672739:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1d500 x1874004626471296/t8589936365(8589936365) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191350 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191334.672748:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:2.0:1787191334.672752:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9880 x1874004626475392/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191334.672767:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626475392:192.168.202.101@tcp:35:bash.0 00000100:00100000:2.0:1787191334.672857:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359300 going to sleep for 11 seconds 00000100:00100000:3.0:1787191334.675232:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626475392:192.168.202.101@tcp:35:bash.0 00000002:00100000:3.0:1787191334.675257:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1d500 x1874004626471296/t8589936365(8589936365) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191350 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787191334.680293:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191334.680369:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634825472 00000100:00100000:3.0:1787191334.680378:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634825472 00000100:00100000:3.0:1787191334.680432:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1143 00000100:00100000:3.0:1787191334.680446:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634825472:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191334.680464:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc884839279 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46021be expref: -99 pid: 57783 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00010000:00010000:3.0:1787191334.680540:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191334.680547:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634825472:12345-192.168.202.101@tcp:104: Request processed in 107us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191334.680557:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1143 00000100:00100000:3.0:1787191334.688705:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191334.688785:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634825600 00000100:00100000:2.0:1787191334.688793:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634825600 00000100:00100000:2.0:1787191334.688875:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1144 00000100:00100000:2.0:1787191334.688886:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634825600:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191334.688898:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483929c lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xa3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e46021fd expref: -99 pid: 57784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.688970:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191334.688976:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634825600:12345-192.168.202.101@tcp:104: Request processed in 93us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191334.688984:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1144 00000100:00100000:2.0:1787191334.694515:0:57784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57784:1874004626476544:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191334.694547:0:57784:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf400/0xe5129dc8848392a3 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xa3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602227 expref: -99 pid: 57784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.694560:0:57784:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf400/0xe5129dc8848392a3 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602227 expref: -99 pid: 57784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.694572:0:57784:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf400/0xe5129dc8848392a3 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602227 expref: -99 pid: 57784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.694583:0:57784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf400/0xe5129dc8848392a3 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602227 expref: -99 pid: 57784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.694597:0:57784:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf400/0xe5129dc8848392a3 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602227 expref: -99 pid: 57784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.694605:0:57784:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf400/0xe5129dc8848392a3 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602227 expref: -99 pid: 57784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.694613:0:57784:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf400/0xe5129dc8848392a3 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602227 expref: -99 pid: 57784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191334.694625:0:57784:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b6a476680 x1874004626476544/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/976 e 0 to 0 dl 1787191350 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191334.694637:0:57784:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf400/0xe5129dc8848392a3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602227 expref: -99 pid: 57784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191334.694660:0:57784:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf400/0xe5129dc8848392a3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602227 expref: -99 pid: 57784 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.694671:0:57784:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/163 (0 0) 00000080:00200000:2.0:1787191334.694677:0:57784:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xa3:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1787191334.694737:0:57784:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xa3:0x0]: layout version change: 4294967294 -> 4 00000080:00010000:2.0:1787191334.694743:0:57784:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xa3:0x0](ffff936b5395aa08) for lock 0xe5129dc8848392a3 00000080:00010000:2.0:1787191334.694750:0:57784:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xa3:0x0](ffff936b5395aa08) 00000080:00010000:2.0:1787191334.694753:0:57784:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848392a3 from it ffffa3fb42063cd8 00010000:00010000:2.0:1787191334.694756:0:57784:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf400/0xe5129dc8848392a3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4602227 expref: -99 pid: 57784 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.694765:0:57784:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf400/0xe5129dc8848392a3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602227 expref: -99 pid: 57784 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191334.694798:0:57784:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa3:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:2.0:1787191334.694808:0:57784:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xa3:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191334.694811:0:57784:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191334.694814:0:57784:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xa3:0x0] 00000008:00010000:2.0:1787191334.694864:0:57784:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191334.694868:0:57784:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d17b0, osc lock ffff936b44e63b50, flags 0x400000400001002 00010000:00010000:2.0:1787191334.694887:0:57784:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839287 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x180:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e46021d3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1787191334.694902:0:57784:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839287 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e46021d3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000020:00200000:2.0:1787191334.694912:0:57784:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191334.694916:0:57784:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839287 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e46021d3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1787191334.694923:0:57784:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839287 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e46021d3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00000020:00200000:2.0:1787191334.694933:0:57784:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191334.694941:0:57784:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xa3:0x0] updating i_size 5 i_blocks 0 00000020:00010000:2.0:1787191334.694947:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51656500 (ffff936b465cc518/0) at cl_lock_release():245 00000020:00010000:2.0:1787191334.694950:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51656500 (ffff936b465cc518/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.694953:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d17b0 (ffff936b47a17098/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.694956:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51656500 (ffff936b465cc518/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191334.694959:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d17b0 (ffff936b465cc518/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191334.694971:0:57784:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa3:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200080:2.0:1787191334.695058:0:57784:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xa3:0x0](ffff936b5395aa08) cmd=c00c66f3 arg=1d642e0 00000002:00010000:2.0:1787191334.695082:0:57784:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xa3:0x0]) in obj [0x200000405:0xa3:0x0], intent: open flags 05004040000002 00010000:00010000:2.0:1787191334.695142:0:57784:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848392aa lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.695147:0:57784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848392aa lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57784 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191334.695155:0:57784:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191334.695160:0:57784:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8a80 x1874004626476800/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191334.695166:0:57784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848392aa lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x81000000000000 pid: 57784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191334.695183:0:57784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57784:1874004626476800:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191334.695341:0:57784:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359000 going to sleep for 11 seconds 00000100:00100000:2.0:1787191334.698027:0:57784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57784:1874004626476800:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191334.698055:0:57784:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848392aa lrc: 4/1,0 mode: --/CR res: [0x200000405:0xa3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4602235 expref: -99 pid: 57784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.698067:0:57784:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848392aa lrc: 4/1,0 mode: --/PW res: [0x200000405:0xa3:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4602235 expref: -99 pid: 57784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.698079:0:57784:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848392aa lrc: 4/1,0 mode: PW/PW res: [0x200000405:0xa3:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4602235 expref: -99 pid: 57784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.698106:0:57784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848392aa lrc: 4/1,0 mode: PW/PW res: [0x200000405:0xa3:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4602235 expref: -99 pid: 57784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.698119:0:57784:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848392aa lrc: 5/1,1 mode: PW/PW res: [0x200000405:0xa3:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4602235 expref: -99 pid: 57784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.698125:0:57784:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848392aa lrc: 5/1,1 mode: PW/PW res: [0x200000405:0xa3:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4602235 expref: -99 pid: 57784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.698133:0:57784:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848392aa lrc: 4/0,1 mode: PW/PW res: [0x200000405:0xa3:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4602235 expref: -99 pid: 57784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191334.698141:0:57784:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x600002b, status=0 req@ffff936b513b8a80 x1874004626476800/t8589936379(8589936379) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191350 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191334.698150:0:57784:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b8a80 x1874004626476800/t8589936379(8589936379) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191350 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191334.698161:0:57784:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848392aa lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xa3:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4602235 expref: -99 pid: 57784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.698170:0:57784:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 2 res 8589935621/163 (0 0) 00000080:00200000:2.0:1787191334.698176:0:57784:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xa3:0x0] suppgids 0 0: rc 0 00000002:00100000:2.0:1787191334.698195:0:57784:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b8a80 x1874004626476800/t8589936379(8589936379) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191350 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1787191334.698203:0:57784:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xa3:0x0](ffff936b5395aa08) for lock 0xe5129dc8848392aa 00000080:00010000:2.0:1787191334.698210:0:57784:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848392aa from it ffffa3fb42063cc0 00010000:00010000:2.0:1787191334.698213:0:57784:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848392aa lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xa3:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4602235 expref: -99 pid: 57784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.698221:0:57784:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848392aa lrc: 2/0,0 mode: PW/PW res: [0x200000405:0xa3:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4602235 expref: -99 pid: 57784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00200000:2.0:1787191334.699355:0:57784:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa3:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:2.0:1787191334.699381:0:57784:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xa3:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191334.699385:0:57784:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191334.699391:0:57784:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191334.699403:0:57784:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000100:00100000:3.0:1787191334.702279:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626476928:192.168.202.101@tcp:1:lfs.0 00000100:00100000:3.0:1787191334.705635:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191334.705883:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634825728 00000100:00100000:2.0:1787191334.705894:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634825728 00000100:00100000:2.0:1787191334.705954:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1145 00000100:00100000:2.0:1787191334.705965:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8420:x1874004634825728:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191334.705984:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839287 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420080020000 nid: local remote: 0x7130d520e46021d3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00010000:00010000:2.0:1787191334.706067:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191334.706074:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8420:x1874004634825728:12345-192.168.202.101@tcp:104: Request processed in 112us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191334.706080:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1145 00000100:00100000:2.0:1787191334.718275:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626476928:192.168.202.101@tcp:1:lfs.0 00000080:00200008:2.0:1787191334.722798:0:57786:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:2.0:1787191334.722807:0:57786:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191334.722824:0:57786:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191334.722896:0:57786:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191334.722908:0:57786:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191334.722915:0:57786:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191334.722921:0:57786:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191334.722924:0:57786:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191334.722929:0:57786:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42073cb8 00010000:00010000:2.0:1787191334.722933:0:57786:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191334.722941:0:57786:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191334.723050:0:57786:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191334.723058:0:57786:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191334.723064:0:57786:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191334.723073:0:57786:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191334.723079:0:57786:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191334.723149:0:57786:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191334.723152:0:57786:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191334.723157:0:57786:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42073b58 00010000:00010000:2.0:1787191334.723160:0:57786:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191334.723167:0:57786:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191334.723246:0:57786:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191334.723253:0:57786:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191334.723258:0:57786:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191334.723335:0:57786:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:2.0:1787191334.723341:0:57786:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191334.723353:0:57786:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191334.723506:0:57786:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc8848392c6 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.723514:0:57786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc8848392c6 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.723524:0:57786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc8848392c6 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191334.723612:0:57786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57786:1874004626477952:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191334.723702:0:57786:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359300 going to sleep for 11 seconds 00000100:00100000:2.0:1787191334.728109:0:57786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57786:1874004626477952:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191334.728133:0:57786:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc8848392c6 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.728146:0:57786:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc8848392c6 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.728152:0:57786:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc8848392c6 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.728159:0:57786:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc8848392c6 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.728167:0:57786:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc8848392c6 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.728173:0:57786:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd5200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191334.728178:0:57786:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc8848392c6 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.728185:0:57786:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc8848392c6 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.728193:0:57786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc8848392c6 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.728199:0:57786:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191334.728205:0:57786:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc8848392c6 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.728211:0:57786:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc8848392c6 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57786 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191334.728231:0:57786:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513b9f80 x1874004626477952/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191350 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191334.728246:0:57786:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1787191334.728285:0:57786:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caec00/0xe5129dc8848392bf lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460227b expref: -99 pid: 57786 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191334.728297:0:57786:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caec00/0xe5129dc8848392bf lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460227b expref: -99 pid: 57786 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:2.0:1787191334.728305:0:57786:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848392bf from it ffffa3fb42073930 00010000:00010000:2.0:1787191334.728310:0:57786:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caec00/0xe5129dc8848392bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460227b expref: -99 pid: 57786 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191334.728317:0:57786:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caec00/0xe5129dc8848392bf lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460227b expref: -99 pid: 57786 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191334.728407:0:57786:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191334.728423:0:57786:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191334.728432:0:57786:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191334.728440:0:57786:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191334.728447:0:57786:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191334.728452:0:57786:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191334.728454:0:57786:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191334.728459:0:57786:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42073bf8 00010000:00010000:2.0:1787191334.728462:0:57786:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191334.728469:0:57786:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191334.728478:0:57786:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191334.728485:0:57786:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191334.728490:0:57786:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191334.728496:0:57786:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:2.0:1787191334.728499:0:57786:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:2.0:1787191334.728504:0:57786:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b522dac00, open_flags a141, mode 81b6 opened 0 00000080:00200000:2.0:1787191334.728514:0:57786:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:2.0:1787191334.728533:0:57786:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xa4:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:2.0:1787191334.728551:0:57786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caec00/0xe5129dc8848392bf lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e460227b expref: -99 pid: 57786 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191334.728594:0:57786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caec00/0xe5129dc8848392bf lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e460227b expref: -99 pid: 57786 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191334.728601:0:57786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191334.728604:0:57786:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caec00/0xe5129dc8848392bf lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e460227b expref: -99 pid: 57786 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191334.728635:0:57786:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc8848392cd lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.728643:0:57786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc8848392cd lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57786 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191334.728653:0:57786:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:2.0:1787191334.728661:0:57786:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9f80 x1874004626478208/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191334.728670:0:57786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc8848392cd lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191334.728688:0:57786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57786:1874004626478208:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191334.729154:0:57786:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359300 going to sleep for 11 seconds 00000100:00100000:2.0:1787191334.736161:0:57786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57786:1874004626478208:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191334.736191:0:57786:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc8848392cd lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46022b3 expref: -99 pid: 57786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.736221:0:57786:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc8848392cd lrc: 4/0,1 mode: --/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46022b3 expref: -99 pid: 57786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.736231:0:57786:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc8848392cd lrc: 4/0,1 mode: --/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46022b3 expref: -99 pid: 57786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.736243:0:57786:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc8848392cd lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46022b3 expref: -99 pid: 57786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.736254:0:57786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc8848392cd lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46022b3 expref: -99 pid: 57786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.736279:0:57786:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc8848392cd lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46022b3 expref: -99 pid: 57786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.736288:0:57786:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc8848392cd lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46022b3 expref: -99 pid: 57786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.736296:0:57786:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc8848392cd lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46022b3 expref: -99 pid: 57786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191334.736308:0:57786:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b513b9f80 x1874004626478208/t8589936381(8589936381) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191350 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191334.736320:0:57786:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9f80 x1874004626478208/t8589936381(8589936381) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191350 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191334.736331:0:57786:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc8848392cd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46022b3 expref: -99 pid: 57786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.736341:0:57786:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/164 (0 0) 00000080:00200000:2.0:1787191334.736347:0:57786:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191334.736358:0:57786:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:2.0:1787191334.736440:0:57786:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xa4:0x0](ffff936b4898b248) 00000080:00200000:2.0:1787191334.736448:0:57786:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xa4:0x0], updating i_size 0 00000080:00200000:2.0:1787191334.736484:0:57786:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xa4:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:2.0:1787191334.736489:0:57786:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xa4:0x0](ffff936b4898b248) 00000080:00010000:2.0:1787191334.736492:0:57786:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xa4:0x0](ffff936b4898b248) for lock 0xe5129dc8848392cd 00000080:00010000:2.0:1787191334.736501:0:57786:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xa4:0x0](ffff936b4898b248) 00000080:00200008:2.0:1787191334.736517:0:57786:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xa4:0x0](ffff936b4898b248), flags 120501 00000002:00100000:2.0:1787191334.736726:0:57786:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9f80 x1874004626478208/t8589936381(8589936381) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191350 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1787191334.736767:0:57786:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848392cd from it ffff936b60dc4900 00010000:00010000:2.0:1787191334.736773:0:57786:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc8848392cd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46022b3 expref: -99 pid: 57786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.736782:0:57786:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc8848392cd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46022b3 expref: -99 pid: 57786 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191334.736805:0:57786:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xa4:0x0](ffff936b4898b248), inode mode 81a4 mask 40 00000080:00200000:2.0:1787191334.737420:0:57786:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xa4:0x0](ffff936b4898b248), inode mode 81a4 mask 2 00000080:00200000:2.0:1787191334.737432:0:57786:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xa4:0x0](ffff936b4898b248), xattr lov 00000002:00010000:2.0:1787191334.737452:0:57786:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xa4:0x0]) in obj [0x200000405:0xa4:0x0], intent: open flags 040000002 00010000:00010000:2.0:1787191334.737506:0:57786:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc8848392d4 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.737515:0:57786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc8848392d4 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57786 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191334.737530:0:57786:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191334.737535:0:57786:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb100 x1874004626478464/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191334.737556:0:57786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc8848392d4 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191334.737577:0:57786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57786:1874004626478464:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191334.737758:0:57786:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359300 going to sleep for 11 seconds 00000100:00100000:3.0:1787191334.746319:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191334.746532:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634826368 00000100:00100000:3.0:1787191334.746541:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634826368 00000100:00100000:3.0:1787191334.746585:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1146 00000100:00100000:3.0:1787191334.746595:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634826368:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191334.746608:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc8848392cd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46022b3 expref: -99 pid: 57786 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191334.747006:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191334.747013:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634826368:12345-192.168.202.101@tcp:104: Request processed in 420us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191334.747022:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1146 00000100:00100000:2.0:1787191334.760111:0:57786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57786:1874004626478464:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191334.760131:0:57786:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc8848392d4 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xa4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.760144:0:57786:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc8848392d4 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xa4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.760151:0:57786:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc8848392d4 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xa4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.760158:0:57786:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc8848392d4 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xa4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.760166:0:57786:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc8848392d4 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xa4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.760171:0:57786:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd5c00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191334.760187:0:57786:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc8848392d4 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xa4:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.760199:0:57786:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc8848392d4 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xa4:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.760206:0:57786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc8848392d4 lrc: 5/0,0 mode: --/CR res: [0x200000405:0xa4:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.760214:0:57786:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191334.760219:0:57786:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc8848392d4 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xa4:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.760226:0:57786:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc8848392d4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xa4:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57786 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191334.760252:0:57786:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b513bb100 x1874004626478464/t8589936382(8589936382) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191350 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191334.760266:0:57786:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bb100 x1874004626478464/t8589936382(8589936382) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191350 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191334.760282:0:57786:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xa4:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1787191334.760327:0:57786:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa4:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1787191334.760334:0:57786:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191334.760515:0:57786:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xa4:0x0], updating i_size 0 00000002:00100000:2.0:1787191334.760536:0:57786:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bb100 x1874004626478464/t8589936382(8589936382) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191350 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191334.760572:0:57786:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513bb100 x1874004626478464/t8589936382(8589936382) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191350 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191334.760582:0:57786:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191334.760588:0:57786:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8e00 x1874004626479232/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191334.760611:0:57786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57786:1874004626479232:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191334.761015:0:57786:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359300 going to sleep for 11 seconds 00000080:00200000:2.0:1787191334.778593:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191334.778627:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191334.778646:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191334.778663:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191334.778670:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191334.778678:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191334.778681:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191334.778691:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:2.0:1787191334.778695:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191334.778704:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191334.778720:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191334.778727:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191334.778732:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191334.778744:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:2.0:1787191334.778749:0:57570:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b522daf00, open_flags 8241, mode 81b6 opened 0 00000080:00200000:2.0:1787191334.778756:0:57570:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:2.0:1787191334.778776:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xa5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0101102 00010000:00010000:2.0:1787191334.779002:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc8848392f0 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.779012:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc8848392f0 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191334.779027:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191334.779039:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9180 x1874004626479744/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191334.779049:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc8848392f0 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191334.779072:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626479744:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191334.779355:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787191334.785608:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626479744:192.168.202.101@tcp:101:bash.0 00010000:00010000:2.0:1787191334.785639:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc8848392f0 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602307 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.785680:0:57570:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc8848392f0 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602307 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.785688:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc8848392f0 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602307 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.785700:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc8848392f0 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602307 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.785716:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc8848392f0 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602307 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.785729:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc8848392f0 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602307 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.785738:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc8848392f0 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602307 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.785746:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc8848392f0 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602307 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191334.785758:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x2b, status=0 req@ffff936b513b9180 x1874004626479744/t8589936385(8589936385) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191350 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191334.785772:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9180 x1874004626479744/t8589936385(8589936385) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191350 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191334.785785:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc8848392f0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602307 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191334.785799:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc8848392f0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602307 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.785809:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/164 (0 0) 00000080:00200000:2.0:1787191334.785816:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191334.785908:0:57570:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xa4:0x0](ffff936b4898b248): rc = 0 00000080:00200000:2.0:1787191334.785926:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xa4:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:2.0:1787191334.785934:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xa4:0x0](ffff936b4898b248) for lock 0xe5129dc8848392f0 00000080:00010000:2.0:1787191334.785946:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xa4:0x0](ffff936b4898b248) 00000080:00200008:2.0:1787191334.785963:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xa4:0x0](ffff936b4898b248), flags 101101 00000002:00100000:2.0:1787191334.785992:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9180 x1874004626479744/t8589936385(8589936385) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191350 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1787191334.786024:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848392f0 from it ffff936b60dc4ba0 00010000:00010000:2.0:1787191334.786029:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc8848392f0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4602307 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.786038:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc8848392f0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602307 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191334.786058:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xa4:0x0](ffff936b4898b248), inode mode 81a4 mask 42 00000002:00010000:2.0:1787191334.786095:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xa4:0x0], intent: getxattr flags 0 00010000:00010000:2.0:1787191334.786135:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc8848392f7 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.786143:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc8848392f7 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.786152:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc8848392f7 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191334.786183:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626479872:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191334.786257:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787191334.791561:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626479872:192.168.202.101@tcp:101:bash.0 00010000:00010000:2.0:1787191334.791590:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc8848392f7 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460231c expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.791611:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc8848392f7 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460231c expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.791622:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc8848392f7 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460231c expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191334.791637:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b513baa00 x1874004626479872/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191350 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191334.791649:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc8848392f7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460231c expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.791659:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/164 (0 0) 00000080:00200000:2.0:1787191334.791665:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xa4:0x0] suppgids 0 -1: rc 0 00000080:00010000:2.0:1787191334.791702:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xa4:0x0](ffff936b4898b248) for lock 0xe5129dc8848392f7 00000080:00010000:2.0:1787191334.791711:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848392f7 from it ffffa3fb41caba38 00010000:00010000:2.0:1787191334.791715:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc8848392f7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460231c expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.791724:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc8848392f7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460231c expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:2.0:1787191334.791758:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xa4:0x0](ffff936b4898b248) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191334.000000000, mtime 1787191334.000000000, ctime 1787191334.000000000 00010000:00010000:2.0:1787191334.791785:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc8848392f0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4602307 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191334.791808:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xa4:0x0]: losing layout lock 00010000:00010000:2.0:1787191334.791879:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc8848392f0 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4602307 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.791888:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191334.791891:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc8848392f0 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4602307 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:2.0:1787191334.791913:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1787191334.791921:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513baa00 x1874004626480128/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787191334.791943:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626480128:192.168.202.101@tcp:36:bash.0 00000100:00100000:2.0:1787191334.792018:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787191334.802001:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626480128:192.168.202.101@tcp:36:bash.0 00000080:00200000:2.0:1787191334.802054:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:2.0:1787191334.802061:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa4:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00010000:00010000:2.0:1787191334.802079:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/164 (0 0) 00000080:00010000:2.0:1787191334.802346:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xa4:0x0](ffff936b4898b248) 00000002:00010000:2.0:1787191334.802427:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xa4:0x0]) in obj [0x200000405:0xa4:0x0], intent: layout flags 0 00010000:00010000:2.0:1787191334.802485:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc8848392fe lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.802495:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc8848392fe lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.802506:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc8848392fe lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191334.802528:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626480256:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191334.803488:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787191334.808496:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626480256:192.168.202.101@tcp:101:bash.0 00010000:00010000:2.0:1787191334.808526:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc8848392fe lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xa4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460232a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.809184:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc8848392fe lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xa4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460232a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191334.809203:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b513b9c00 x1874004626480256/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191350 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191334.809215:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc8848392fe lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460232a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191334.809229:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc8848392fe lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460232a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.809239:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/164 (0 0) 00000080:00200000:2.0:1787191334.809245:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xa4:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1787191334.809343:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xa4:0x0](ffff936b4898b248) for lock 0xe5129dc8848392fe 00000080:00010000:2.0:1787191334.809352:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848392fe from it ffffa3fb41cab8c8 00010000:00010000:2.0:1787191334.809356:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc8848392fe lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460232a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.809433:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc8848392fe lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xa4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460232a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.809459:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc8848392fe lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xa4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460232a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.809470:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc8848392fe lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xa4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460232a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:2.0:1787191334.809478:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xa4:0x0](00000000489bfe0c) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc8848392fe lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460232a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191334.809521:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xa4:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:2.0:1787191334.809526:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc8848392fe lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460232a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191334.809533:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc8848392fe lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xa4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460232a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:2.0:1787191334.809684:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xa4:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:2.0:1787191334.809690:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa4:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191334.809694:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xa4:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:2.0:1787191334.809701:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xa4:0x0](ffff936b4898b248) 00000002:00010000:2.0:1787191334.809711:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xa4:0x0]) in obj [0x200000405:0xa4:0x0], intent: layout flags 02 00010000:00010000:2.0:1787191334.809724:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc8848392fe lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xa4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e460232a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191334.809737:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xa4:0x0]: losing layout lock 00010000:00010000:2.0:1787191334.809766:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc8848392fe lrc: 1/0,0 mode: --/CR res: [0x200000405:0xa4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460232a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191334.809772:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191334.809775:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc8848392fe lrc: 0/0,0 mode: --/CR res: [0x200000405:0xa4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460232a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191334.809797:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839305 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xa4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.809804:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839305 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xa4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191334.809815:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191334.809822:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9c00 x1874004626480512/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191334.809849:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839305 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xa4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191334.809871:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626480512:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191334.809958:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191334.833643:0:57570:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589936388 gen 1 00000100:00100000:3.0:1787191334.833721:0:57570:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b513b9180 x1874004626479744/t8589936385(8589936385) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191350 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787191334.833740:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626480512:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191334.833761:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839305 lrc: 4/0,1 mode: --/EX res: [0x200000405:0xa4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602338 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.833774:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839305 lrc: 4/0,1 mode: --/CR res: [0x200000405:0xa4:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602338 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.833789:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839305 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xa4:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602338 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.833802:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839305 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xa4:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602338 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.833816:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839305 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xa4:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602338 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.833825:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839305 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xa4:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602338 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.833865:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839305 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xa4:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602338 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191334.833877:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b513b9c00 x1874004626480512/t8589936388(8589936388) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191350 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191334.833899:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839305 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa4:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602338 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191334.833911:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839305 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa4:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602338 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.833924:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/164 (0 0) 00000080:00200000:3.0:1787191334.833931:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xa4:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1787191334.833943:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xa4:0x0](ffff936b4898b248) for lock 0xe5129dc884839305 00000080:00010000:3.0:1787191334.833952:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839305 from it ffffa3fb41cab930 00010000:00010000:3.0:1787191334.833956:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839305 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa4:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602338 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.833965:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839305 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xa4:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602338 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191334.833985:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:3.0:1787191334.833992:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa4:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:3.0:1787191334.834008:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839305 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xa4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602338 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191334.834019:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839305 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xa4:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602338 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:3.0:1787191334.834028:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xa4:0x0](00000000489bfe0c) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839305 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa4:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602338 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191334.834069:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839305 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa4:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602338 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191334.834078:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839305 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xa4:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602338 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191334.834106:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa4:0x0] ignore/verify layout 1/0, layout version 3 restore needed 0 00020000:00200000:3.0:1787191334.834117:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xa4:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191334.834121:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191334.834128:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:3.0:1787191334.834168:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:3.0:1787191334.834182:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839305 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xa4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602338 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191334.834190:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839305 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xa4:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602338 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:3.0:1787191334.834197:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xa4:0x0](00000000489bfe0c) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839305 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa4:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602338 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191334.834214:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa4:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1787191334.834219:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xa4:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191334.834221:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191334.834224:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:3.0:1787191334.834234:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191334.834540:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xa4:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:3.0:1787191334.834546:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839305 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa4:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4602338 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191334.834554:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839305 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xa4:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602338 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00020000:00200000:3.0:1787191334.834568:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xa4:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:3.0:1787191334.834571:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xa4:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191334.834573:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191334.834579:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191334.834589:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1787191334.834592:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:3.0:1787191334.834603:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:3.0:1787191334.834607:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b5235cc30, osc lock ffff936b44f65c80, flags 0x80000000 00000008:00010000:3.0:1787191334.834611:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:3.0:1787191334.834613:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b5235cc70, osc lock ffff936b44f65300, flags 0x80000000 00010000:00010000:3.0:1787191334.834655:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000574ec6f8/0xe5129dc88483930c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x185:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.834665:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000574ec6f8/0xe5129dc88483930c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x185:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.834675:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000574ec6f8/0xe5129dc88483930c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x185:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191334.834696:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626480640:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191334.834778:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787191334.838460:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626480640:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191334.838489:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000574ec6f8/0xe5129dc88483930c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e460233f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.838508:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000574ec6f8/0xe5129dc88483930c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e460233f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.838522:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000574ec6f8/0xe5129dc88483930c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e460233f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.838537:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000574ec6f8/0xe5129dc88483930c lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e460233f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191334.838549:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000574ec6f8/0xe5129dc88483930c lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e460233f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.838561:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000574ec6f8/0xe5129dc88483930c lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460233f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.838569:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000574ec6f8/0xe5129dc88483930c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460233f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.838638:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc884839313 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x182:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.838648:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc884839313 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x182:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.838658:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc884839313 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x182:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191334.838678:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626480768:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191334.838762:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787191334.850154:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626480768:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191334.850194:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc884839313 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602346 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.850220:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc884839313 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4602346 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.850238:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc884839313 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4602346 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.850252:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc884839313 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4602346 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191334.850264:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc884839313 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4602346 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.850274:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc884839313 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4602346 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.850281:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc884839313 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4602346 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191334.850500:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626481024:192.168.202.101@tcp:10:bash.0 00000100:00100000:3.0:1787191334.850601:0:2392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787191334.850609:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626481152:192.168.202.101@tcp:10:bash.0 00000020:00010000:2.0:1787191334.850952:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b42ff66c8 (ffff936b465cc518/0) at cl_lock_release():245 00000020:00010000:2.0:1787191334.850957:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42ff66c8 (ffff936b465cc518/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.850962:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b46b503b0 (ffff936b47a17098/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191334.850971:0:57784:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc8848392e9 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46022e4 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191334.850983:0:57784:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc8848392e9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46022e4 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00010000:2.0:1787191334.851005:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42ff66c8 (ffff936b465cc518/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191334.851008:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b46b503b0 (ffff936b465cc518/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191334.851022:0:57784:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa3:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191334.851160:0:57784:0:(file.c:5244:ll_file_seek()) COMPLETED file f70.sanity-flr:[0x200000405:0xa3:0x0], offset: 0, type: SEEK_DATA, rc = 0 00000080:00200008:2.0:1787191334.851174:0:57784:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xa3:0x0], offset: 0, type: SEEK_HOLE 00000080:00200000:2.0:1787191334.851181:0:57784:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa3:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:2.0:1787191334.851189:0:57784:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xa3:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191334.851192:0:57784:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191334.851198:0:57784:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191334.851206:0:57784:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191334.851222:0:57784:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xa3:0x0] updating i_size 5 i_blocks 8 00000080:00200000:2.0:1787191334.851227:0:57784:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa3:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191334.851232:0:57784:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000080:00200000:2.0:1787191334.851235:0:57784:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa3:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191334.851239:0:57784:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191334.851242:0:57784:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191334.851245:0:57784:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:2.0:1787191334.851255:0:57784:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:2.0:1787191334.851653:0:57784:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d17b0, osc lock ffff936b44e63b50, flags 0x0 00010000:00010000:2.0:1787191334.851674:0:57784:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc8848392e9 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46022e4 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191334.851688:0:57784:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc8848392e9 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46022e4 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191334.851700:0:57784:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc8848392e9 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46022e4 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191334.851715:0:57784:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc8848392e9 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46022e4 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191334.851724:0:57784:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc8848392e9 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46022e4 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191334.851734:0:57784:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xa3:0x0] updating i_size 5 i_blocks 8 00000100:00100000:2.0:1787191334.851768:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787191334.851780:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626481280:192.168.202.101@tcp:23:lfs.0 00000100:00100000:3.0:1787191334.858673:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626481280:192.168.202.101@tcp:23:lfs.0 00000100:00100000:3.0:1787191334.858718:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626481152:192.168.202.101@tcp:10:bash.0 00000100:00100000:3.0:1787191334.858730:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626481024:192.168.202.101@tcp:10:bash.0 00000020:00010000:2.0:1787191334.858779:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b42ff66c8 (ffff936b465cc518/0) at cl_lock_release():245 00000020:00010000:2.0:1787191334.858784:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42ff66c8 (ffff936b465cc518/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.858790:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d17b0 (ffff936b47a17098/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191334.858800:0:57784:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc8848392e9 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46022e4 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191334.858816:0:57784:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc8848392e9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46022e4 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00010000:2.0:1787191334.858901:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42ff66c8 (ffff936b465cc518/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191334.858905:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d17b0 (ffff936b465cc518/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191334.858922:0:57784:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa3:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191334.858934:0:57784:0:(file.c:5244:ll_file_seek()) COMPLETED file f70.sanity-flr:[0x200000405:0xa3:0x0], offset: 0, type: SEEK_HOLE, rc = 5 00000080:00200080:2.0:1787191334.858949:0:57784:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xa3:0x0](ffff936b5395aa08) cmd=400866b1 arg=0 00000080:00200080:2.0:1787191334.858959:0:57784:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xa3:0x0](ffff936b5395aa08) cmd=400866b1 arg=1 00000080:00200008:2.0:1787191334.858966:0:57784:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xa3:0x0](ffff936b5395aa08), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191334.858973:0:57784:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xa3:0x0](ffff936b5395aa08),name=f70.sanity-flr 00000002:00010000:2.0:1787191334.858994:0:57784:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xa3:0x0]) in obj [0x200000405:0xa3:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191334.859009:0:57784:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e400/0xe5129dc8848392e2 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46022dd expref: -99 pid: 57784 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191334.859022:0:57784:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e400/0xe5129dc8848392e2 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46022dd expref: -99 pid: 57784 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191334.859029:0:57784:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xa3:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191334.859036:0:57784:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xa3:0x0](ffff936b5395aa08) 00000080:00010000:2.0:1787191334.859040:0:57784:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xa3:0x0](ffff936b5395aa08) for lock 0xe5129dc8848392e2 00000080:00010000:2.0:1787191334.859046:0:57784:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848392e2 from it ffffa3fb42063cd8 00010000:00010000:2.0:1787191334.859049:0:57784:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e400/0xe5129dc8848392e2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46022dd expref: -99 pid: 57784 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191334.859056:0:57784:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e400/0xe5129dc8848392e2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46022dd expref: -99 pid: 57784 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191334.859075:0:57784:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa3:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:2.0:1787191334.859098:0:57784:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xa3:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191334.859102:0:57784:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191334.859106:0:57784:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xa3:0x0] 00000008:00010000:2.0:1787191334.859123:0:57784:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191334.859126:0:57784:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d17b0, osc lock ffff936b44e63b50, flags 0x400000400001002 00010000:00010000:2.0:1787191334.859139:0:57784:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc8848392e9 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46022e4 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191334.859153:0:57784:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc8848392e9 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46022e4 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:2.0:1787191334.859163:0:57784:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191334.859364:0:57784:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc8848392e9 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46022e4 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191334.859375:0:57784:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc8848392e9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46022e4 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000020:00200000:2.0:1787191334.859386:0:57784:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191334.859396:0:57784:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xa3:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191334.859399:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51656500 (ffff936b465cc518/0) at cl_lock_release():245 00000020:00010000:2.0:1787191334.859402:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51656500 (ffff936b465cc518/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.859404:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d17b0 (ffff936b47a17098/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.859407:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51656500 (ffff936b465cc518/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191334.859410:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d17b0 (ffff936b465cc518/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191334.859417:0:57784:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa3:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191334.859439:0:57784:0:(file.c:2483:do_file_read_iter()) START file f70.sanity-flr:[0x200000405:0xa3:0x0], ppos: 0, count: 4096 00000080:00200000:2.0:1787191334.859447:0:57784:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: read ppos: 0, bytes: 4096 00000080:00200000:2.0:1787191334.859456:0:57784:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000020:00200000:2.0:1787191334.859461:0:57784:0:(cl_io.c:214:cl_io_rw_init()) header@00000000cd1998af[0x110, 2, [0x200000405:0xa3:0x0] hash] 00000020:00200000:2.0:1787191334.859463:0:57784:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 4096) 2048 0 00000080:00200000:2.0:1787191334.859467:0:57784:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa3:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00000080:00200000:2.0:1787191334.859475:0:57784:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1787191334.859482:0:57784:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:2.0:1787191334.860260:0:57784:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1787191334.860280:0:57784:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:2.0:1787191334.860292:0:57784:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:2.0:1787191334.860297:0:57784:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d17b0, osc lock ffff936b44e63b50, flags 0x40000 00000080:00200000:2.0:1787191334.860307:0:57784:0:(vvp_io.c:835:vvp_io_read_start()) f70.sanity-flr: read [0, 4096) 00000001:00010000:2.0:1787191334.860315:0:57784:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xa3:0x0] 00000008:00010000:2.0:1787191334.860322:0:57784:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191334.860326:0:57784:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1a30, osc lock ffff936b44e63c80, flags 0x400001002 00010000:00010000:2.0:1787191334.860341:0:57784:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc8848392e9 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46022e4 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1787191334.860360:0:57784:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc8848392e9 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46022e4 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000020:00200000:2.0:1787191334.860382:0:57784:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191334.860388:0:57784:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc8848392e9 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46022e4 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1787191334.860400:0:57784:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc8848392e9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46022e4 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00000020:00200000:2.0:1787191334.860416:0:57784:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191334.860423:0:57784:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xa3:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191334.860426:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51656500 (ffff936b465cc518/0) at cl_lock_release():245 00000020:00010000:2.0:1787191334.860431:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51656500 (ffff936b465cc518/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.860436:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1a30 (ffff936b47a17098/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.860440:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51656500 (ffff936b465cc518/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191334.860444:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1a30 (ffff936b465cc518/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191334.860456:0:57784:0:(vvp_io.c:893:vvp_io_read_start()) count:4096 iocb pos:0 00000080:00200000:2.0:1787191334.860464:0:57784:0:(rw26.c:362:ll_direct_IO()) VFS Op:inode=[0x200000405:0xa3:0x0](ffff936b5395aa08), size=4096 (max 536870912), offset=0=0x0, pages 1 (max 131072), lockless, parallel 00000020:00200000:2.0:1787191334.860612:0:57784:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1787191334.860618:0:57784:0:(rw26.c:544:ll_direct_IO()) result 0 tot_bytes 5 count 5 file_offset 5 00000020:00010000:2.0:1787191334.860625:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b42ff66c8 (ffff936b465cc518/0) at cl_lock_release():245 00000020:00010000:2.0:1787191334.860630:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42ff66c8 (ffff936b465cc518/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.860635:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d17b0 (ffff936b47a17098/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.860638:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42ff66c8 (ffff936b465cc518/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191334.860642:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d17b0 (ffff936b465cc518/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191334.860651:0:57784:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000020:00200000:2.0:1787191334.860656:0:57784:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1787191334.860675:0:25580:0:(osc_cache.c:2029:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff936b46699c00 00000008:00100000:2.0:1787191334.860718:0:25580:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff936b513ba680 - object 0x280000401:384 offset 0<>5 00000100:00100000:3.0:1787191334.860904:0:2392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787191334.860923:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626481408:192.168.202.101@tcp:3:lfs.0 00000008:00010000:3.0:1787191334.864039:0:2392:0:(osc_cache.c:917:osc_extent_finish()) ### no dlm lock: extent: ffff936b46699c00 00000020:00200000:3.0:1787191334.864051:0:2392:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1787191334.864060:0:2392:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1787191334.864078:0:2392:0:(osc_cache.c:497:__osc_extent_remove()) ### no dlm lock: extent: ffff936b46699c00 00000100:00100000:3.0:1787191334.864113:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626481408:192.168.202.101@tcp:3:lfs.0 00000080:00200000:2.0:1787191334.864289:0:57784:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1787191334.864301:0:57784:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa3:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191334.864307:0:57784:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 1 io complete with rc: 0, result: 5, restart: 0 00000020:00200000:2.0:1787191334.864310:0:57784:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191334.864318:0:57784:0:(file.c:2324:ll_file_io_generic()) iot: 1, result: 5 00000080:00200080:2.0:1787191334.864333:0:57784:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xa3:0x0](ffff936b5395aa08) cmd=400866b1 arg=0 00000080:00200080:2.0:1787191334.864342:0:57784:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xa3:0x0](ffff936b5395aa08) cmd=400866b1 arg=2 00000080:00200008:2.0:1787191334.864348:0:57784:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xa3:0x0](ffff936b5395aa08), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191334.864356:0:57784:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xa3:0x0](ffff936b5395aa08),name=f70.sanity-flr 00000002:00010000:2.0:1787191334.864375:0:57784:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xa3:0x0]) in obj [0x200000405:0xa3:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191334.864391:0:57784:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e400/0xe5129dc8848392e2 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46022dd expref: -99 pid: 57784 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191334.864405:0:57784:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e400/0xe5129dc8848392e2 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46022dd expref: -99 pid: 57784 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191334.864412:0:57784:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xa3:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191334.864420:0:57784:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xa3:0x0](ffff936b5395aa08) 00000080:00010000:2.0:1787191334.864424:0:57784:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xa3:0x0](ffff936b5395aa08) for lock 0xe5129dc8848392e2 00000080:00010000:2.0:1787191334.864431:0:57784:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848392e2 from it ffffa3fb42063cd8 00010000:00010000:2.0:1787191334.864436:0:57784:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e400/0xe5129dc8848392e2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46022dd expref: -99 pid: 57784 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191334.864444:0:57784:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e400/0xe5129dc8848392e2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46022dd expref: -99 pid: 57784 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:2.0:1787191334.864464:0:57784:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa3:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:2.0:1787191334.864474:0:57784:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xa3:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191334.864477:0:57784:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191334.864480:0:57784:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xa3:0x0] 00000008:00010000:2.0:1787191334.864507:0:57784:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191334.864511:0:57784:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d17b0, osc lock ffff936b44e63b50, flags 0x400000400001002 00010000:00010000:2.0:1787191334.864527:0:57784:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc8848392e9 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46022e4 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00010000:00010000:2.0:1787191334.864537:0:57784:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc8848392e9 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46022e4 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00000020:00200000:2.0:1787191334.864547:0:57784:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191334.864550:0:57784:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc8848392e9 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46022e4 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00010000:00010000:2.0:1787191334.864556:0:57784:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc8848392e9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46022e4 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 1 00000020:00200000:2.0:1787191334.864565:0:57784:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191334.864572:0:57784:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xa3:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191334.864576:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51656500 (ffff936b465cc518/0) at cl_lock_release():245 00000020:00010000:2.0:1787191334.864579:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51656500 (ffff936b465cc518/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.864581:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d17b0 (ffff936b47a17098/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.864585:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51656500 (ffff936b465cc518/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191334.864588:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d17b0 (ffff936b465cc518/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191334.864596:0:57784:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa3:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191334.864616:0:57784:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xa3:0x0], ppos: 0, count: 4096 00000080:00200000:2.0:1787191334.864621:0:57784:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 4096 00000080:00200000:2.0:1787191334.864628:0:57784:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 2 00000020:00200000:2.0:1787191334.864633:0:57784:0:(cl_io.c:214:cl_io_rw_init()) header@00000000cd1998af[0x110, 2, [0x200000405:0xa3:0x0] hash] 00000020:00200000:2.0:1787191334.864635:0:57784:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 4096) 2048 0 00000080:00200000:2.0:1787191334.864637:0:57784:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa3:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00000080:00200000:2.0:1787191334.864645:0:57784:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1787191334.864651:0:57784:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:2.0:1787191334.864654:0:57784:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x11 00000080:00200000:2.0:1787191334.864665:0:57784:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:2.0:1787191334.864672:0:57784:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:2.0:1787191334.864675:0:57784:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d17b0, osc lock ffff936b44e63b50, flags 0x40000 00000080:00200000:2.0:1787191334.864681:0:57784:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 4096) append 0 append lockpos 0 00000002:00010000:2.0:1787191334.864700:0:57784:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xa3:0x0], intent: getxattr flags 0 00010000:00010000:2.0:1787191334.864735:0:57784:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc88483931a lrc: 3/1,0 mode: --/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.864743:0:57784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc88483931a lrc: 3/1,0 mode: --/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.864752:0:57784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4c00/0xe5129dc88483931a lrc: 3/1,0 mode: --/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191334.864769:0:57784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57784:1874004626481792:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191334.864874:0:57784:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359600 going to sleep for 11 seconds 00000100:00100000:2.0:1787191334.873308:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191334.873348:0:40921:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787191334.873365:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634827008 00000080:00200000:3.0:1787191334.873965:0:57787:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191334.873989:0:57787:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191334.874004:0:57787:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191334.874018:0:57787:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191334.874025:0:57787:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191334.874033:0:57787:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191334.874036:0:57787:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191334.874043:0:57787:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42033b58 00010000:00010000:3.0:1787191334.874047:0:57787:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191334.874055:0:57787:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191334.874070:0:57787:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191334.874093:0:57787:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:3.0:1787191334.874099:0:57787:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191334.874112:0:57787:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:3.0:1787191334.874116:0:57787:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:3.0:1787191334.874127:0:57787:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1787191334.874186:0:57787:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839321 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.874194:0:57787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839321 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.874204:0:57787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839321 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191334.874226:0:57787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57787:1874004626482048:192.168.202.101@tcp:101:rm.0 00000100:00100000:3.0:1787191334.874295:0:57787:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787191334.874364:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634827008 00000100:00100000:2.0:1787191334.874430:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1147 00000100:00100000:2.0:1787191334.874440:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b50882850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30143:x1874004634827008:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191334.874453:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000702e59bb/0xe5129dc884839248 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e460211d expref: -99 pid: 57782 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191334.874625:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191334.874632:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b50882850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30143:x1874004634827008:12345-192.168.202.101@tcp:104: Request processed in 194us (1334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191334.874640:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1147 00000100:00100000:3.0:1787191334.878037:0:57787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57787:1874004626482048:192.168.202.101@tcp:101:rm.0 00010000:00010000:3.0:1787191334.878061:0:57787:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839321 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460237e expref: -99 pid: 57787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.878101:0:57787:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839321 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460237e expref: -99 pid: 57787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.878109:0:57787:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839321 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460237e expref: -99 pid: 57787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.878119:0:57787:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839321 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460237e expref: -99 pid: 57787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.878129:0:57787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839321 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460237e expref: -99 pid: 57787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.878145:0:57787:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839321 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460237e expref: -99 pid: 57787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.878153:0:57787:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839321 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460237e expref: -99 pid: 57787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.878160:0:57787:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839321 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460237e expref: -99 pid: 57787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191334.878177:0:57787:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b51d1c700 x1874004626482048/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/976 e 0 to 0 dl 1787191350 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191334.878189:0:57787:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839321 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460237e expref: -99 pid: 57787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191334.878202:0:57787:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839321 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460237e expref: -99 pid: 57787 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.878211:0:57787:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/164 (0 0) 00000080:00200000:3.0:1787191334.878217:0:57787:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191334.878265:0:57787:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xa4:0x0](ffff936b4898b248): rc = 0 00000080:00200000:3.0:1787191334.878279:0:57787:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xa4:0x0]: layout version change: 4 -> 4 00000080:00010000:3.0:1787191334.878284:0:57787:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xa4:0x0](ffff936b4898b248) for lock 0xe5129dc884839321 00000080:00010000:3.0:1787191334.878295:0:57787:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xa4:0x0](ffff936b4898b248) 00000080:00010000:3.0:1787191334.878298:0:57787:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839321 from it ffffa3fb42033b20 00010000:00010000:3.0:1787191334.878301:0:57787:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839321 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460237e expref: -99 pid: 57787 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.878315:0:57787:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839321 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460237e expref: -99 pid: 57787 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200008:3.0:1787191334.878353:0:57787:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xa4:0x0](ffff936b4898b248), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191334.878360:0:57787:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xa4:0x0](ffff936b4898b248),name=f70.sanity-flr 00000002:00010000:3.0:1787191334.878391:0:57787:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xa4:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191334.878400:0:57787:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839321 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460237e expref: -99 pid: 57787 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191334.878420:0:57787:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839321 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460237e expref: -99 pid: 57787 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191334.878427:0:57787:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191334.878432:0:57787:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xa4:0x0](ffff936b4898b248) 00000080:00010000:3.0:1787191334.878435:0:57787:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xa4:0x0](ffff936b4898b248) for lock 0xe5129dc884839321 00000080:00010000:3.0:1787191334.878439:0:57787:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839321 from it ffffa3fb42033cb8 00010000:00010000:3.0:1787191334.878442:0:57787:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839321 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460237e expref: -99 pid: 57787 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191334.878450:0:57787:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839321 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460237e expref: -99 pid: 57787 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191334.878475:0:57787:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa4:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:3.0:1787191334.878485:0:57787:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xa4:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191334.878488:0:57787:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191334.878492:0:57787:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xa4:0x0] 00000008:00010000:3.0:1787191334.878510:0:57787:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191334.878514:0:57787:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b506676b0, osc lock ffff936b44f64130, flags 0x400000400001002 00010000:00010000:3.0:1787191334.878530:0:57787:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000574ec6f8/0xe5129dc88483930c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x185:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460233f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191334.878542:0:57787:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000574ec6f8/0xe5129dc88483930c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460233f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:3.0:1787191334.878554:0:57787:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191334.878558:0:57787:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000574ec6f8/0xe5129dc88483930c lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460233f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191334.878566:0:57787:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000574ec6f8/0xe5129dc88483930c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460233f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:3.0:1787191334.878577:0:57787:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191334.878587:0:57787:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xa4:0x0] updating i_size 5 i_blocks 0 00000020:00010000:3.0:1787191334.878593:0:57787:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51656750 (ffff936b465ccbd8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191334.878596:0:57787:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51656750 (ffff936b465ccbd8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191334.878599:0:57787:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b506676b0 (ffff936b465cc488/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191334.878603:0:57787:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51656750 (ffff936b465ccbd8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191334.878606:0:57787:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b506676b0 (ffff936b465ccbd8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191334.878616:0:57787:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa4:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191334.878659:0:57787:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191334.878670:0:57787:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191334.878677:0:57787:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191334.878689:0:57787:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191334.878695:0:57787:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191334.878698:0:57787:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191334.878701:0:57787:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191334.878704:0:57787:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42033c10 00010000:00010000:3.0:1787191334.878707:0:57787:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191334.878713:0:57787:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191334.878722:0:57787:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191334.878728:0:57787:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:3.0:1787191334.878732:0:57787:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191334.878738:0:57787:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:3.0:1787191334.878742:0:57787:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:3.0:1787191334.878746:0:57787:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:3.0:1787191334.878766:0:57787:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839305 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xa4:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4602338 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787191334.878778:0:57787:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xa4:0x0]: losing layout lock 00010000:00010000:3.0:1787191334.878789:0:57787:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839321 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e460237e expref: -99 pid: 57787 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191334.878796:0:57787:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xa4:0x0]: losing layout lock 00010000:00010000:3.0:1787191334.878802:0:57787:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc8848392f7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e460231c expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191334.878867:0:57787:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839305 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xa4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4602338 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191334.878874:0:57787:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839321 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460237e expref: -99 pid: 57787 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191334.878880:0:57787:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc8848392f7 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e460231c expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191334.878885:0:57787:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:3.0:1787191334.878888:0:57787:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839305 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xa4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4602338 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191334.878900:0:57787:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839321 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460237e expref: -99 pid: 57787 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191334.878908:0:57787:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc8848392f7 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xa4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e460231c expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:3.0:1787191334.878926:0:57787:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1787191334.878934:0:57787:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1c700 x1874004626482432/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191334.878956:0:57787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57787:1874004626482432:192.168.202.101@tcp:36:rm.0 00000100:00100000:3.0:1787191334.879038:0:57787:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787191334.885882:0:57787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57787:1874004626482432:192.168.202.101@tcp:36:rm.0 00000080:00200000:3.0:1787191334.885943:0:57787:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa4:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00020000:00200000:3.0:1787191334.885956:0:57787:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xa4:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191334.885960:0:57787:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191334.885967:0:57787:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191334.885978:0:57787:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000008:00010000:3.0:1787191334.885999:0:57787:0:(osc_cache.c:1183:osc_extent_make_ready()) ### extent: 00000000fe3c1a14 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000574ec6f8/0xe5129dc88483930c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460233f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1787191334.886028:0:57787:0:(osc_cache.c:917:osc_extent_finish()) ### extent: 00000000fe3c1a14 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000574ec6f8/0xe5129dc88483930c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460233f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1787191334.886050:0:57787:0:(osc_cache.c:497:__osc_extent_remove()) ### extent: 00000000fe3c1a14 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000574ec6f8/0xe5129dc88483930c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460233f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787191334.886090:0:57787:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191334.886139:0:57787:0:(llite_lib.c:2066:ll_clear_inode()) VFS Op:inode=[0x200000405:0xa4:0x0](ffff936b4898b248) 00000008:00010000:3.0:1787191334.886177:0:57787:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 5 blocks 0 [cma]time 1787191334 1787191334 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000574ec6f8/0xe5129dc88483930c lrc: 1/0,0 mode: PW/PW res: [0x2c0000401:0x185:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460233f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1787191334.886199:0:57787:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191334 1787191334 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc884839313 lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x182:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4602346 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191334.893634:0:57784:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1787191334.893649:0:57784:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa3:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191334.893654:0:57784:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:2.0:1787191334.893664:0:57784:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xa3:0x0] updating i_size 5 i_blocks 8 00000020:00200000:2.0:1787191334.893668:0:57784:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191334.893677:0:57784:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200080:2.0:1787191334.893693:0:57784:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xa3:0x0](ffff936b5395aa08) cmd=400866b1 arg=0 00000080:00200080:2.0:1787191334.893702:0:57784:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xa3:0x0](ffff936b5395aa08) cmd=400866b1 arg=1 00000080:00200008:2.0:1787191334.893708:0:57784:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xa3:0x0](ffff936b5395aa08), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191334.893714:0:57784:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xa3:0x0](ffff936b5395aa08),name=f70.sanity-flr 00000002:00010000:2.0:1787191334.893733:0:57784:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xa3:0x0]) in obj [0x200000405:0xa3:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191334.893749:0:57784:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e400/0xe5129dc8848392e2 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46022dd expref: -99 pid: 57784 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191334.893768:0:57784:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e400/0xe5129dc8848392e2 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46022dd expref: -99 pid: 57784 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:2.0:1787191334.893775:0:57784:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xa3:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191334.893784:0:57784:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xa3:0x0](ffff936b5395aa08) 00000080:00010000:2.0:1787191334.893787:0:57784:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xa3:0x0](ffff936b5395aa08) for lock 0xe5129dc8848392e2 00000080:00010000:2.0:1787191334.893795:0:57784:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848392e2 from it ffffa3fb42063cd8 00010000:00010000:2.0:1787191334.893799:0:57784:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e400/0xe5129dc8848392e2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46022dd expref: -99 pid: 57784 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191334.893808:0:57784:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e400/0xe5129dc8848392e2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46022dd expref: -99 pid: 57784 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:2.0:1787191334.893889:0:57784:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa3:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:2.0:1787191334.893898:0:57784:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xa3:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191334.893902:0:57784:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191334.893905:0:57784:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xa3:0x0] 00000008:00010000:2.0:1787191334.893922:0:57784:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191334.893925:0:57784:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1a30, osc lock ffff936b44e63c80, flags 0x400000400001002 00010000:00010000:2.0:1787191334.893941:0:57784:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc8848392e9 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46022e4 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 1 00010000:00010000:2.0:1787191334.893953:0:57784:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc8848392e9 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46022e4 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 1 00000020:00200000:2.0:1787191334.893963:0:57784:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191334.893967:0:57784:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc8848392e9 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46022e4 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 1 00010000:00010000:2.0:1787191334.893975:0:57784:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc8848392e9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46022e4 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00000020:00200000:2.0:1787191334.893984:0:57784:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191334.893988:0:57784:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xa3:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191334.893991:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51656500 (ffff936b465cc518/0) at cl_lock_release():245 00000020:00010000:2.0:1787191334.893994:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51656500 (ffff936b465cc518/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.893997:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1a30 (ffff936b47a17098/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.894000:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51656500 (ffff936b465cc518/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191334.894003:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1a30 (ffff936b465cc518/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191334.894010:0:57784:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa3:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191334.894020:0:57784:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xa3:0x0], offset: 5, type: SEEK_DATA 00000080:00200000:2.0:1787191334.894024:0:57784:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa3:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:2.0:1787191334.894028:0:57784:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xa3:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191334.894031:0:57784:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191334.894035:0:57784:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191334.894039:0:57784:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191334.894051:0:57784:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xa3:0x0] updating i_size 5 i_blocks 8 00000080:00200000:2.0:1787191334.894057:0:57784:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa3:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191334.894061:0:57784:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000080:00200000:2.0:1787191334.894063:0:57784:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa3:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191334.894067:0:57784:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191334.894069:0:57784:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191334.894438:0:57784:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:2.0:1787191334.894451:0:57784:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:2.0:1787191334.894453:0:57784:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1a30, osc lock ffff936b44e63c80, flags 0x0 00010000:00010000:2.0:1787191334.894464:0:57784:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc8848392e9 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46022e4 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:2.0:1787191334.894541:0:57784:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc8848392e9 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46022e4 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:2.0:1787191334.894551:0:57784:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc8848392e9 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46022e4 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:2.0:1787191334.894558:0:57784:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc8848392e9 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46022e4 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:2.0:1787191334.894564:0:57784:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc8848392e9 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46022e4 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00000080:00200000:2.0:1787191334.894576:0:57784:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xa3:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191334.894580:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b42ff66c8 (ffff936b465cc518/0) at cl_lock_release():245 00000020:00010000:2.0:1787191334.894583:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42ff66c8 (ffff936b465cc518/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.894586:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1a30 (ffff936b47a17098/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191334.894590:0:57784:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc8848392e9 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46022e4 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:2.0:1787191334.894598:0:57784:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc8848392e9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46022e4 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00000020:00010000:2.0:1787191334.894607:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42ff66c8 (ffff936b465cc518/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191334.894609:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1a30 (ffff936b465cc518/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191334.894619:0:57784:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa3:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191334.894627:0:57784:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xa3:0x0], offset: 0, type: (null) 00000080:00200000:2.0:1787191334.894631:0:57784:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa3:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:2.0:1787191334.894635:0:57784:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xa3:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191334.894638:0:57784:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191334.894640:0:57784:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xa3:0x0] 00000008:00010000:2.0:1787191334.894647:0:57784:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191334.894649:0:57784:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1a30, osc lock ffff936b44e63c80, flags 0x400000400001002 00010000:00010000:2.0:1787191334.894657:0:57784:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc8848392e9 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46022e4 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00010000:00010000:2.0:1787191334.894666:0:57784:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc8848392e9 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46022e4 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00000020:00200000:2.0:1787191334.894673:0:57784:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191334.894676:0:57784:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc8848392e9 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46022e4 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00010000:00010000:2.0:1787191334.894684:0:57784:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc8848392e9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46022e4 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00000020:00200000:2.0:1787191334.894693:0:57784:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191334.894697:0:57784:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xa3:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191334.894700:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51656500 (ffff936b465cc518/0) at cl_lock_release():245 00000020:00010000:2.0:1787191334.894702:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51656500 (ffff936b465cc518/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.894705:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1a30 (ffff936b47a17098/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.894708:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51656500 (ffff936b465cc518/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191334.894710:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1a30 (ffff936b465cc518/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191334.894716:0:57784:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa3:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191334.894724:0:57784:0:(file.c:5244:ll_file_seek()) COMPLETED file f70.sanity-flr:[0x200000405:0xa3:0x0], offset: 0, type: (null), rc = 5 00000080:00200080:2.0:1787191334.894729:0:57784:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xa3:0x0](ffff936b5395aa08) cmd=400866b1 arg=0 00000080:00200000:3.0:1787191334.899463:0:57788:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191334.899558:0:57788:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191334.899574:0:57788:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191334.899594:0:57788:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191334.899601:0:57788:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191334.899608:0:57788:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191334.899611:0:57788:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191334.899618:0:57788:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4204bb58 00010000:00010000:3.0:1787191334.899622:0:57788:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191334.899631:0:57788:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191334.899648:0:57788:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191334.900156:0:57788:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:3.0:1787191334.900164:0:57788:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191334.900178:0:57788:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:3.0:1787191334.900182:0:57788:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:3.0:1787191334.900198:0:57788:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1787191334.900252:0:57788:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839328 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.900260:0:57788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839328 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.900270:0:57788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839328 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191334.900299:0:57788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57788:1874004626482560:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191334.900754:0:57788:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cf00 going to sleep for 11 seconds 00000080:00200080:2.0:1787191334.919606:0:57784:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xa3:0x0](ffff936b5395aa08) cmd=400866b1 arg=2 00000080:00200008:2.0:1787191334.919620:0:57784:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xa3:0x0](ffff936b5395aa08), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191334.919627:0:57784:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xa3:0x0](ffff936b5395aa08),name=f70.sanity-flr 00000002:00010000:2.0:1787191334.919643:0:57784:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xa3:0x0]) in obj [0x200000405:0xa3:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191334.919665:0:57784:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e400/0xe5129dc8848392e2 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46022dd expref: -99 pid: 57784 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1787191334.919677:0:57784:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e400/0xe5129dc8848392e2 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46022dd expref: -99 pid: 57784 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:2.0:1787191334.919684:0:57784:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xa3:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191334.919692:0:57784:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xa3:0x0](ffff936b5395aa08) 00000080:00010000:2.0:1787191334.919695:0:57784:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xa3:0x0](ffff936b5395aa08) for lock 0xe5129dc8848392e2 00000080:00010000:2.0:1787191334.919702:0:57784:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848392e2 from it ffffa3fb42063cd8 00010000:00010000:2.0:1787191334.919706:0:57784:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e400/0xe5129dc8848392e2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46022dd expref: -99 pid: 57784 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1787191334.919715:0:57784:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e400/0xe5129dc8848392e2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46022dd expref: -99 pid: 57784 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 0 00000080:00200000:2.0:1787191334.919741:0:57784:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa3:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:2.0:1787191334.919752:0:57784:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xa3:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191334.919756:0:57784:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191334.919759:0:57784:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xa3:0x0] 00000008:00010000:2.0:1787191334.919779:0:57784:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191334.919782:0:57784:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1a30, osc lock ffff936b44e63c80, flags 0x400000400001002 00010000:00010000:2.0:1787191334.919797:0:57784:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc8848392e9 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46022e4 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00010000:00010000:2.0:1787191334.919807:0:57784:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc8848392e9 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46022e4 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00000020:00200000:2.0:1787191334.919819:0:57784:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191334.919823:0:57784:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc8848392e9 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46022e4 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00010000:00010000:2.0:1787191334.919848:0:57784:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc8848392e9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46022e4 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00000020:00200000:2.0:1787191334.919859:0:57784:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191334.919867:0:57784:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xa3:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191334.919871:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51656500 (ffff936b465cc518/0) at cl_lock_release():245 00000020:00010000:2.0:1787191334.919874:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51656500 (ffff936b465cc518/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.919876:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1a30 (ffff936b47a17098/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191334.919880:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51656500 (ffff936b465cc518/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191334.919883:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1a30 (ffff936b465cc518/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191334.919893:0:57784:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa3:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191334.919919:0:57784:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xa3:0x0](ffff936b5395aa08) current size 5, valid attrs 2068, mode 0, uid -1322410190, gid -1, new size 5, atime 1787191334.000000000, mtime 1787191334.000000000, ctime 1787191334.000000000 00010000:00010000:2.0:1787191334.919939:0:57784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e400/0xe5129dc8848392e2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46022dd expref: -99 pid: 57784 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 0 00010000:00010000:2.0:1787191334.919959:0:57784:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc8848392db lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xa3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46022c8 expref: -99 pid: 57784 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191334.919994:0:57784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e400/0xe5129dc8848392e2 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46022dd expref: -99 pid: 57784 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 0 00010000:00010000:2.0:1787191334.920002:0:57784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191334.920005:0:57784:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e400/0xe5129dc8848392e2 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xa3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46022dd expref: -99 pid: 57784 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 0 00000020:00100000:2.0:1787191334.920024:0:57784:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1787191334.920033:0:57784:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb800 x1874004626483200/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787191334.920050:0:57784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57784:1874004626483200:192.168.202.101@tcp:36:lfs.0 00000100:00100000:2.0:1787191334.920511:0:57784:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b523599c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191334.925733:0:57784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57784:1874004626483200:192.168.202.101@tcp:36:lfs.0 00000080:00200000:2.0:1787191334.925777:0:57784:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 2 00000080:00200000:2.0:1787191334.925785:0:57784:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa3:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:2.0:1787191334.925805:0:57784:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x11 00000080:00200000:2.0:1787191334.925827:0:57784:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:2.0:1787191334.925875:0:57784:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1787191334.925879:0:57784:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b523599f0, osc lock ffff936b44e63c80, flags 0x0 00000008:00010000:2.0:1787191334.925883:0:57784:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1787191334.925884:0:57784:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b52359a30, osc lock ffff936b44e63690, flags 0x0 00010000:00010000:2.0:1787191334.925940:0:57784:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc884839344 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.925960:0:57784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc884839344 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.925970:0:57784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc884839344 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191334.925991:0:57784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57784:1874004626483328:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191334.926071:0:57784:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787191334.941465:0:57784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57784:1874004626483328:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191334.941511:0:57784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc884839344 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46023f5 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.941530:0:57784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc884839344 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46023f5 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.941546:0:57784:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc884839344 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46023f5 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1787191334.941559:0:57784:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 4096, setting rss=4096; kms=4096, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc884839344 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46023f5 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.941571:0:57784:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc884839344 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46023f5 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.941583:0:57784:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc884839344 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46023f5 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.941613:0:57784:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b52377800 type 11 mode 2 res 10737419265/385 (0 18446744073709551615) 00010000:00010000:2.0:1787191334.941648:0:57784:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008d34baf3/0xe5129dc884839352 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x181:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.941655:0:57784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008d34baf3/0xe5129dc884839352 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x181:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.941665:0:57784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008d34baf3/0xe5129dc884839352 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x181:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191334.941686:0:57784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57784:1874004626483712:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191334.941755:0:57784:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787191334.944557:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191334.944754:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634828544 00000100:00100000:2.0:1787191334.944764:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634828544 00000100:00100000:2.0:1787191334.945656:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1148 00000100:00100000:2.0:1787191334.945668:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30511:x1874004634828544:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191334.945682:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342209ac/0xe5129dc88483924f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x181:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4602124 expref: -99 pid: 57782 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191334.945739:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191334.945745:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30511:x1874004634828544:12345-192.168.202.101@tcp:104: Request processed in 80us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191334.945753:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1148 00000100:00100000:3.0:1787191334.955998:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191334.956702:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191334.956735:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634828672 00000100:00100000:3.0:1787191334.956744:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634828672 00000100:00100000:3.0:1787191334.956792:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634828800 00000100:00100000:3.0:1787191334.956795:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634828800 00000100:00100000:3.0:1787191334.956811:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1149 00000100:00100000:3.0:1787191334.956820:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634828672:12345-192.168.202.101@tcp:104: 00000100:00100000:2.0:1787191334.956964:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1150 00000100:00100000:2.0:1787191334.956975:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:6491:x1874004634828800:12345-192.168.202.101@tcp:105: 00010000:00010000:2.0:1787191334.956987:0:40922:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008d34baf3/0xe5129dc884839352 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e460241f expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.957002:0:40922:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008d34baf3/0xe5129dc884839352 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e460241f expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.957012:0:40922:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008d34baf3/0xe5129dc884839352 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460241f expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.957024:0:40922:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008d34baf3/0xe5129dc884839352 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10080000000000 nid: local remote: 0x7130d520e460241f expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.957034:0:40922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008d34baf3/0xe5129dc884839352 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10080000000000 nid: local remote: 0x7130d520e460241f expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.957045:0:40922:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008d34baf3/0xe5129dc884839352 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x80000000000 nid: local remote: 0x7130d520e460241f expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.957062:0:40922:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b51dd5a00) 00000100:00100000:2.0:1787191334.957138:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:6491:x1874004634828800:12345-192.168.202.101@tcp:105: Request processed in 165us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191334.957145:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1150 00010000:00010000:3.0:1787191334.957322:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf400/0xe5129dc88483934b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4602411 expref: -99 pid: 57788 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191334.957355:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191334.957361:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634828672:12345-192.168.202.101@tcp:104: Request processed in 543us (1375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191334.957368:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1149 00000100:00100000:2.0:1787191334.963778:0:57784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57784:1874004626483712:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191334.963807:0:57784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008d34baf3/0xe5129dc884839352 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e460241f expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.963826:0:57784:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008d34baf3/0xe5129dc884839352 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000020000 nid: local remote: 0x7130d520e460241f expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1787191334.964097:0:57784:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008d34baf3/0xe5129dc884839352 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000020000 nid: local remote: 0x7130d520e460241f expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.964111:0:57784:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008d34baf3/0xe5129dc884839352 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e460241f expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191334.964119:0:57784:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008d34baf3/0xe5129dc884839352 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e460241f expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191334.964222:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787191334.964238:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626484352:192.168.202.101@tcp:10:lfs.0 00000100:00100000:2.0:1787191334.964342:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626484480:192.168.202.101@tcp:10:lfs.0 00000100:00100000:2.0:1787191334.970717:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626484352:192.168.202.101@tcp:10:lfs.0 00000100:00100000:2.0:1787191334.972504:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626484480:192.168.202.101@tcp:10:lfs.0 00000080:00200000:3.0:1787191334.978644:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191334.978669:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191334.978690:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191334.978705:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191334.978719:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191334.978727:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191334.978730:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191334.978738:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:3.0:1787191334.978742:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191334.978750:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191334.978766:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191334.978773:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191334.978780:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191334.978794:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:3.0:1787191334.978799:0:57570:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b45579680, open_flags 8241, mode 81b6 opened 0 00000080:00200000:3.0:1787191334.978807:0:57570:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:3.0:1787191334.978828:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xa7:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0101102 00010000:00010000:3.0:1787191334.978927:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839360 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.978935:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839360 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191334.978947:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191334.978958:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1e300 x1874004626485504/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191334.978972:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839360 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191334.978992:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626485504:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191334.980201:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c540 going to sleep for 11 seconds 00000100:00100000:3.0:1787191334.984237:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626485504:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191334.984263:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839360 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602457 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.984294:0:57570:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839360 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602457 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.984302:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839360 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xa6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602457 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.984314:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839360 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xa6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602457 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.984326:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839360 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xa6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602457 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.984339:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839360 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xa6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602457 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.984346:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839360 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xa6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602457 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.984358:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839360 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xa6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602457 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191334.984370:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x2b, status=0 req@ffff936b51d1e300 x1874004626485504/t8589936397(8589936397) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191350 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191334.984383:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1e300 x1874004626485504/t8589936397(8589936397) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191350 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191334.984396:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839360 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602457 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191334.984408:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839360 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602457 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.984417:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/166 (0 0) 00000080:00200000:3.0:1787191334.984422:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191334.984488:0:57570:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xa6:0x0](ffff936b5395f448): rc = 0 00000080:00200000:3.0:1787191334.984506:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xa6:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:3.0:1787191334.984512:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xa6:0x0](ffff936b5395f448) for lock 0xe5129dc884839360 00000080:00010000:3.0:1787191334.984524:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xa6:0x0](ffff936b5395f448) 00000080:00200008:3.0:1787191334.984537:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xa6:0x0](ffff936b5395f448), flags 101101 00000002:00100000:3.0:1787191334.984560:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1e300 x1874004626485504/t8589936397(8589936397) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191350 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1787191334.984596:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839360 from it ffff936b460333c0 00010000:00010000:3.0:1787191334.984601:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839360 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4602457 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.984616:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839360 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602457 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191334.984639:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xa6:0x0](ffff936b5395f448), inode mode 81a4 mask 42 00000002:00010000:3.0:1787191334.984668:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xa6:0x0], intent: getxattr flags 0 00010000:00010000:3.0:1787191334.984711:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884839367 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xa6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.984719:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884839367 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xa6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.984728:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884839367 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xa6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191334.984748:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626485760:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191334.985152:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c540 going to sleep for 11 seconds 00000100:00100000:3.0:1787191334.991297:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626485760:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191334.991319:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884839367 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xa6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460246c expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.991335:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884839367 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xa6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460246c expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.991346:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884839367 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xa6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460246c expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191334.991359:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b51d1ea00 x1874004626485760/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191350 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191334.991370:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884839367 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460246c expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.991380:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/166 (0 0) 00000080:00200000:3.0:1787191334.991385:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xa6:0x0] suppgids 0 -1: rc 0 00000080:00010000:3.0:1787191334.991408:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xa6:0x0](ffff936b5395f448) for lock 0xe5129dc884839367 00000080:00010000:3.0:1787191334.991416:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839367 from it ffffa3fb41caba38 00010000:00010000:3.0:1787191334.991420:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884839367 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460246c expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191334.991428:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884839367 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460246c expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:3.0:1787191334.991478:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xa6:0x0](ffff936b5395f448) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191334.000000000, mtime 1787191334.000000000, ctime 1787191334.000000000 00010000:00010000:3.0:1787191334.991503:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839360 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4602457 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191334.991522:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xa6:0x0]: losing layout lock 00010000:00010000:3.0:1787191334.991557:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839360 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xa6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4602457 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191334.991565:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191334.991568:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839360 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xa6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4602457 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:3.0:1787191334.991582:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 36, max 7 00000100:00100000:3.0:1787191334.991590:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1ea00 x1874004626486272/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191334.991609:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626486272:192.168.202.101@tcp:36:bash.0 00000100:00100000:3.0:1787191334.991964:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c540 going to sleep for 11 seconds 00000100:00100000:2.0:1787191334.997005:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191334.997188:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634828928 00000100:00100000:3.0:1787191334.997198:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634828928 00000100:00100000:3.0:1787191334.997257:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1151 00000100:00100000:3.0:1787191334.997267:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:15323:x1874004634828928:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191334.997285:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc8848392db lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xa3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46022c8 expref: -99 pid: 57784 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191334.997364:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191334.997371:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:15323:x1874004634828928:12345-192.168.202.101@tcp:104: Request processed in 106us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191334.997378:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1151 00000100:00100000:3.0:1787191335.004122:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626486528:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191335.004147:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f400/0xe5129dc88483936e lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xa6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602481 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.004161:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f400/0xe5129dc88483936e lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xa6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602481 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191335.004185:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b453a9c00 x1874004626486528/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191350 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191335.004197:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f400/0xe5129dc88483936e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602481 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191335.004216:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f400/0xe5129dc88483936e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602481 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.004227:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/166 (0 0) 00000080:00200000:3.0:1787191335.004234:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xa6:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1787191335.004247:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xa6:0x0](ffff936b5395f448) for lock 0xe5129dc88483936e 00000080:00010000:3.0:1787191335.004254:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483936e from it ffffa3fb41cab8c8 00010000:00010000:3.0:1787191335.004259:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f400/0xe5129dc88483936e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602481 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.004268:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f400/0xe5129dc88483936e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xa6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602481 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.004297:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f400/0xe5129dc88483936e lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xa6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602481 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.004318:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f400/0xe5129dc88483936e lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xa6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602481 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:3.0:1787191335.004327:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xa6:0x0](00000000d13126ac) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f400/0xe5129dc88483936e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602481 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191335.004371:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xa6:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:3.0:1787191335.004376:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f400/0xe5129dc88483936e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4602481 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.004383:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f400/0xe5129dc88483936e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xa6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602481 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:3.0:1787191335.004398:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xa6:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:3.0:1787191335.004406:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa6:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191335.004410:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xa6:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:3.0:1787191335.004418:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xa6:0x0](ffff936b5395f448) 00000002:00010000:3.0:1787191335.004428:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xa6:0x0]) in obj [0x200000405:0xa6:0x0], intent: layout flags 02 00010000:00010000:3.0:1787191335.004441:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f400/0xe5129dc88483936e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xa6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4602481 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191335.004813:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xa6:0x0]: losing layout lock 00010000:00010000:3.0:1787191335.004872:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f400/0xe5129dc88483936e lrc: 1/0,0 mode: --/CR res: [0x200000405:0xa6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4602481 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191335.004881:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191335.004884:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f400/0xe5129dc88483936e lrc: 0/0,0 mode: --/CR res: [0x200000405:0xa6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4602481 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191335.004908:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839375 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xa6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.004914:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839375 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xa6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191335.004924:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:3.0:1787191335.004932:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1dc00 x1874004626486784/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191335.004940:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839375 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xa6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191335.004961:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626486784:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191335.005049:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787191335.013506:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191335.013544:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191335.013738:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634829568 00000100:00100000:3.0:1787191335.013749:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634829568 00000100:00100000:3.0:1787191335.013804:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634830208 00000100:00100000:3.0:1787191335.013807:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634830208 00000100:00100000:3.0:1787191335.013825:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1152 00000100:00100000:3.0:1787191335.013870:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8419:x1874004634829568:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191335.013889:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc884839313 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x182:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4602346 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.013967:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191335.013974:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8419:x1874004634829568:12345-192.168.202.101@tcp:104: Request processed in 141us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191335.013981:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1152 00000100:00100000:3.0:1787191335.013999:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1153 00000100:00100000:3.0:1787191335.014006:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8720:x1874004634830208:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191335.014015:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000574ec6f8/0xe5129dc88483930c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x185:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e460233f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191335.014045:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787191335.014051:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8720:x1874004634830208:12345-192.168.202.101@tcp:104: Request processed in 46us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191335.014057:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1153 00000100:00100000:3.0:1787191335.016571:0:57570:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589936401 gen 1 00000100:00100000:3.0:1787191335.016718:0:57570:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b51d1e300 x1874004626485504/t8589936397(8589936397) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191350 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787191335.016739:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626486784:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191335.016759:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839375 lrc: 4/0,1 mode: --/EX res: [0x200000405:0xa6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460248f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.016770:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839375 lrc: 4/0,1 mode: --/CR res: [0x200000405:0xa6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460248f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.016782:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839375 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xa6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460248f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.016793:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839375 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xa6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460248f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.016805:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839375 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xa6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460248f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.016813:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839375 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xa6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460248f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.016821:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839375 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xa6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460248f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191335.020355:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b51d1dc00 x1874004626486784/t8589936401(8589936401) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191351 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191335.020400:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839375 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460248f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191335.020421:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839375 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460248f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.020432:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/166 (0 0) 00000080:00200000:3.0:1787191335.020439:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xa6:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1787191335.020472:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xa6:0x0](ffff936b5395f448) for lock 0xe5129dc884839375 00000080:00010000:3.0:1787191335.020481:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839375 from it ffffa3fb41cab930 00010000:00010000:3.0:1787191335.020485:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839375 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460248f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.020494:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839375 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xa6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460248f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191335.020514:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:3.0:1787191335.020521:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa6:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:3.0:1787191335.020536:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839375 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xa6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460248f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.020546:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839375 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xa6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460248f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:3.0:1787191335.020555:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xa6:0x0](00000000d13126ac) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839375 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460248f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.020594:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839375 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460248f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.020608:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839375 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xa6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460248f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191335.020621:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1787191335.020631:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xa6:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191335.020635:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191335.020640:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191335.020650:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1787191335.020668:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:3.0:1787191335.020681:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839375 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xa6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460248f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191335.020691:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839375 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xa6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460248f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:3.0:1787191335.020698:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xa6:0x0](00000000d13126ac) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839375 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460248f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191335.020715:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1787191335.020720:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xa6:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191335.020723:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191335.020725:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191335.020729:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1787191335.020734:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191335.020807:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xa6:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:3.0:1787191335.020812:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839375 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460248f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191335.020824:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839375 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xa6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460248f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00020000:00200000:3.0:1787191335.020854:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xa6:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:3.0:1787191335.020857:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xa6:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191335.020859:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191335.020865:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191335.020876:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1787191335.020879:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:3.0:1787191335.020892:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:3.0:1787191335.020896:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b5235cc30, osc lock ffff936b44f64130, flags 0x80000000 00000008:00010000:3.0:1787191335.020899:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:3.0:1787191335.020900:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b5235cc70, osc lock ffff936b44f64d10, flags 0x80000000 00010000:00010000:3.0:1787191335.020947:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000df732e44/0xe5129dc88483937c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.020957:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000df732e44/0xe5129dc88483937c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.020967:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000df732e44/0xe5129dc88483937c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191335.020994:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626487168:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191335.021097:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1787191335.030910:0:57784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57784:1874004626487680:192.168.202.101@tcp:35:lfs.0 00000002:00100000:2.0:1787191335.030954:0:57784:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a475180 x1874004626475648/t8589936377(8589936377) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191350 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191335.031013:0:57784:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa3:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191335.031025:0:57784:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xa3:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191335.031029:0:57784:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191335.031035:0:57784:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:2.0:1787191335.031069:0:57784:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa3:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191335.031093:0:57784:0:(llite_lib.c:2066:ll_clear_inode()) VFS Op:inode=[0x200000405:0xa3:0x0](ffff936b5395aa08) 00000080:00200000:2.0:1787191335.031221:0:57784:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191335.031237:0:57784:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191335.031249:0:57784:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191335.031263:0:57784:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191335.031270:0:57784:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191335.031276:0:57784:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191335.031278:0:57784:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191335.031286:0:57784:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42063bf8 00010000:00010000:2.0:1787191335.031290:0:57784:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191335.031300:0:57784:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191335.031334:0:57784:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191335.031341:0:57784:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191335.031347:0:57784:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191335.031361:0:57784:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b522dbb00, open_flags d900, mode 0 opened 0 00000080:00200000:2.0:1787191335.031368:0:57784:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:2.0:1787191335.031382:0:57784:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:2.0:1787191335.031434:0:57784:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839391 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.031442:0:57784:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839391 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57784 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191335.031465:0:57784:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191335.031698:0:57784:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bad80 x1874004626487936/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191335.031708:0:57784:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839391 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191335.031734:0:57784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57784:1874004626487936:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191335.032046:0:57784:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787191335.039684:0:57784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57784:1874004626487936:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191335.039711:0:57784:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839391 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46024e3 expref: -99 pid: 57784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.039736:0:57784:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839391 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xa6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46024e3 expref: -99 pid: 57784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.039751:0:57784:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839391 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xa6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46024e3 expref: -99 pid: 57784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.039763:0:57784:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839391 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xa6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46024e3 expref: -99 pid: 57784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.039774:0:57784:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839391 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xa6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46024e3 expref: -99 pid: 57784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.039787:0:57784:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839391 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xa6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46024e3 expref: -99 pid: 57784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.039796:0:57784:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839391 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xa6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46024e3 expref: -99 pid: 57784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.039804:0:57784:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839391 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xa6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46024e3 expref: -99 pid: 57784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191335.039816:0:57784:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b513bad80 x1874004626487936/t8589936403(8589936403) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191351 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191335.039829:0:57784:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bad80 x1874004626487936/t8589936403(8589936403) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191351 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191335.039879:0:57784:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839391 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46024e3 expref: -99 pid: 57784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191335.039896:0:57784:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839391 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46024e3 expref: -99 pid: 57784 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.039907:0:57784:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/166 (0 0) 00000080:00200000:2.0:1787191335.039913:0:57784:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191335.039963:0:57784:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xa6:0x0](ffff936b5395f448): rc = 0 00000080:00200000:2.0:1787191335.039977:0:57784:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xa6:0x0]: layout version change: 4 -> 4 00000080:00010000:2.0:1787191335.039983:0:57784:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xa6:0x0](ffff936b5395f448) for lock 0xe5129dc884839391 00000080:00010000:2.0:1787191335.039998:0:57784:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xa6:0x0](ffff936b5395f448) 00000080:00200008:2.0:1787191335.040014:0:57784:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xa6:0x0](ffff936b5395f448), flags 154400 00000002:00100000:2.0:1787191335.040036:0:57784:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bad80 x1874004626487936/t8589936403(8589936403) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191351 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1787191335.040102:0:57784:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839391 from it ffff936b60dc4d20 00010000:00010000:2.0:1787191335.040108:0:57784:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839391 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46024e3 expref: -99 pid: 57784 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.040117:0:57784:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839391 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46024e3 expref: -99 pid: 57784 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191335.040141:0:57784:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xa6:0x0](ffff936b5395f448), inode mode 81a4 mask 44 00000080:00200000:2.0:1787191335.040203:0:57784:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xa6:0x0](ffff936b5395f448), inode mode 81a4 mask 4 00000080:00200000:2.0:1787191335.040211:0:57784:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xa6:0x0](ffff936b5395f448), xattr lov 00000080:00200008:2.0:1787191335.040233:0:57784:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xa6:0x0](ffff936b5395f448), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191335.040238:0:57784:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xa6:0x0](ffff936b5395f448),name=f70.sanity-flr 00000002:00010000:2.0:1787191335.040257:0:57784:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xa6:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191335.040266:0:57784:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839391 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xa6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46024e3 expref: -99 pid: 57784 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191335.040281:0:57784:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839391 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xa6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46024e3 expref: -99 pid: 57784 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191335.040288:0:57784:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191335.040294:0:57784:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xa6:0x0](ffff936b5395f448) 00000080:00010000:2.0:1787191335.040297:0:57784:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xa6:0x0](ffff936b5395f448) for lock 0xe5129dc884839391 00000080:00010000:2.0:1787191335.040301:0:57784:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839391 from it ffffa3fb42063cd8 00010000:00010000:2.0:1787191335.040303:0:57784:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839391 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46024e3 expref: -99 pid: 57784 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191335.040310:0:57784:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839391 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46024e3 expref: -99 pid: 57784 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191335.040328:0:57784:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa6:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:2.0:1787191335.040339:0:57784:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xa6:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191335.040342:0:57784:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191335.040345:0:57784:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xa6:0x0] 00000008:00010000:2.0:1787191335.040362:0:57784:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191335.040365:0:57784:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1a30, osc lock ffff936b44e630a0, flags 0x400000400001002 00010000:00010000:2.0:1787191335.040380:0:57784:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000df732e44/0xe5129dc88483937c lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x184:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46024b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.040391:0:57784:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000df732e44/0xe5129dc88483937c lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46024b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:2.0:1787191335.040403:0:57784:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191335.040408:0:57784:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000df732e44/0xe5129dc88483937c lrc: 7/0,2 mode: PW/PW res: [0x280000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46024b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.040431:0:57784:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000df732e44/0xe5129dc88483937c lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46024b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:2.0:1787191335.040438:0:57784:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191335.040450:0:57784:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xa6:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191335.040454:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51655bc0 (ffff936b465cc758/0) at cl_lock_release():245 00000020:00010000:2.0:1787191335.040457:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51655bc0 (ffff936b465cc758/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191335.040460:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1a30 (ffff936b43ab8128/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191335.040464:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51655bc0 (ffff936b465cc758/0) at cl_lock_fini():72 00000080:00200000:3.0:1787191335.042161:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xa6:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1787191335.042540:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b53cc58a8 (ffff936b47a17ab8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191335.042546:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b53cc58a8 (ffff936b47a17ab8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191335.042552:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b5235cc30 (ffff936b465ccbd8/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191335.042563:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000df732e44/0xe5129dc88483937c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46024b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.042578:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000df732e44/0xe5129dc88483937c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46024b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1787191335.042594:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b5235cc70 (ffff936b465cc488/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191335.042600:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483938a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46024c0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.042609:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483938a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46024c0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1787191335.042618:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b53cc58a8 (ffff936b47a17ab8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191335.042621:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b5235cc30 (ffff936b47a17ab8/1) at cl_lock_fini():72 00000020:00010000:3.0:1787191335.042626:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b5235cc70 (ffff936b47a17ab8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191335.042646:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa6:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191335.042659:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xa6:0x0](ffff936b5395f448) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191334.000000000, mtime 1787191334.000000000, ctime 1787191334.000000000, rc 0 00000080:00200008:3.0:1787191335.042754:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xa6:0x0], ppos: 0, count: 5 00000080:00200000:3.0:1787191335.042769:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:3.0:1787191335.042776:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:3.0:1787191335.042781:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:3.0:1787191335.042786:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:3.0:1787191335.042794:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@00000000e2389d26[0x110, 1, [0x200000405:0xa6:0x0] hash] 00000020:00200000:3.0:1787191335.042796:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:3.0:1787191335.042801:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa6:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:3.0:1787191335.042816:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xa6:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:3.0:1787191335.042820:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xa6:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191335.042823:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:3.0:1787191335.042827:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00000020:00010000:2.0:1787191335.042948:0:57784:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1a30 (ffff936b465cc758/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191335.042960:0:57784:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa6:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191335.042995:0:57784:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xa6:0x0](ffff936b5395f448), flags 154000 00000002:00100000:2.0:1787191335.043058:0:57784:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513bad80 x1874004626487936/t8589936403(8589936403) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191351 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191335.043069:0:57784:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191335.043093:0:57784:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9c00 x1874004626488448/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191335.043114:0:57784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57784:1874004626488448:192.168.202.101@tcp:35:lfs.0 00020000:00200000:3.0:1787191335.047229:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:3.0:1787191335.047240:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1787191335.047270:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000100:00100000:2.0:1787191335.047961:0:57784:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359c00 going to sleep for 11 seconds 00000008:00010000:2.0:1787191335.049060:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1787191335.049069:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b506676b0, osc lock ffff936b44e630a0, flags 0x0 00010000:00010000:2.0:1787191335.050044:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000df732e44/0xe5129dc88483937c lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x184:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46024b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191335.050239:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000df732e44/0xe5129dc88483937c lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46024b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191335.050259:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000df732e44/0xe5129dc88483937c lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46024b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191335.050269:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000df732e44/0xe5129dc88483937c lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46024b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191335.050276:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000df732e44/0xe5129dc88483937c lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46024b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191335.050291:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:2.0:1787191335.050308:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191335.050362:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:2.0:1787191335.050370:0:57570:0:(rw26.c:927:ll_write_end()) page@000000004881a8a4[3 00000000ce8455bd 2 1 000000002bde12f5 0 0 0] 00000080:00200000:2.0:1787191335.050375:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @00000000e8abbda1 17ffffc0001001 3:0 ffff936b43a1e540 0 lru 00000080:00200000:2.0:1787191335.050382:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@00000000a833ae88 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000a2a44f55 0000000036273790 > 3< 0 0 > 4< 0 0 8 336789504 - | - - - - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1787191335.050384:0:57570:0:(rw26.c:927:ll_write_end()) end page@000000004881a8a4 00000080:00200000:2.0:1787191335.050385:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:2.0:1787191335.050390:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:2.0:1787191335.050408:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 0000000085e76a85 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000df732e44/0xe5129dc88483937c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46024b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191335.050427:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b5395f5f8, count 1, dirtied 1 00000080:00200000:2.0:1787191335.050432:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:2.0:1787191335.050435:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:2.0:1787191335.050454:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b53cc58a8 (ffff936b47a17ab8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191335.050457:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b53cc58a8 (ffff936b47a17ab8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191335.050460:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b506676b0 (ffff936b465cc488/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191335.051230:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000df732e44/0xe5129dc88483937c lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46024b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191335.051247:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000df732e44/0xe5129dc88483937c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46024b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:2.0:1787191335.051265:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b53cc58a8 (ffff936b47a17ab8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191335.051268:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b506676b0 (ffff936b47a17ab8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191335.051278:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:2.0:1787191335.051287:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1787191335.051296:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa6:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191335.051300:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:2.0:1787191335.051311:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xa6:0x0] updating i_size 5 i_blocks 0 00000080:00200000:2.0:1787191335.051318:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:2.0:1787191335.051356:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xa6:0x0](ffff936b5395f448), flags 100001 00000002:00100000:2.0:1787191335.051428:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1e300 x1874004626485504/t8589936397(8589936397) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191350 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191335.051439:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:2.0:1787191335.051445:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513baa00 x1874004626488704/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191335.051718:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626488704:192.168.202.101@tcp:35:bash.0 00000100:00100000:2.0:1787191335.051802:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787191335.055175:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626488704:192.168.202.101@tcp:35:bash.0 00000002:00100000:2.0:1787191335.055213:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1e300 x1874004626485504/t8589936397(8589936397) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191350 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787191335.058884:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191335.058919:0:51131:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787191335.058933:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634830848 00000100:00100000:3.0:1787191335.059815:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634830848 00000100:00100000:3.0:1787191335.059894:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1154 00000100:00100000:3.0:1787191335.059905:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b50880850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634830848:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191335.059922:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839391 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46024e3 expref: -99 pid: 57784 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191335.060000:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191335.060006:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b50880850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634830848:12345-192.168.202.101@tcp:104: Request processed in 103us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191335.060013:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1154 00000080:00200000:2.0:1787191335.064157:0:57789:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191335.064194:0:57789:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191335.064212:0:57789:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191335.064230:0:57789:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191335.064238:0:57789:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191335.064247:0:57789:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191335.064251:0:57789:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191335.064258:0:57789:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4207bb58 00010000:00010000:2.0:1787191335.064263:0:57789:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191335.064272:0:57789:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191335.064288:0:57789:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191335.064296:0:57789:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191335.064302:0:57789:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191335.064313:0:57789:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:2.0:1787191335.064318:0:57789:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191335.064331:0:57789:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191335.064379:0:57789:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc88483939f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.064388:0:57789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc88483939f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.064397:0:57789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc88483939f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191335.064422:0:57789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57789:1874004626489216:192.168.202.101@tcp:101:rm.0 00000100:00100000:2.0:1787191335.064534:0:57789:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359e40 going to sleep for 11 seconds 00000080:00200000:2.0:1787191335.109986:0:57790:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191335.110018:0:57790:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191335.110035:0:57790:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191335.110051:0:57790:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191335.110059:0:57790:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191335.110067:0:57790:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191335.110070:0:57790:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191335.110077:0:57790:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4204bb58 00010000:00010000:2.0:1787191335.110091:0:57790:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191335.110101:0:57790:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191335.110116:0:57790:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191335.110126:0:57790:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:2.0:1787191335.110133:0:57790:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191335.110144:0:57790:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:2.0:1787191335.110148:0:57790:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191335.110160:0:57790:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191335.110226:0:57790:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc8848393b4 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.110234:0:57790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc8848393b4 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.110244:0:57790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc8848393b4 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191335.110551:0:57790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57790:1874004626490752:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191335.110689:0:57790:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359300 going to sleep for 11 seconds 00000100:00100000:2.0:1787191335.116814:0:57790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57790:1874004626490752:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191335.116873:0:57790:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc8848393b4 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.116889:0:57790:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc8848393b4 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.116896:0:57790:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc8848393b4 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.116903:0:57790:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc8848393b4 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.116912:0:57790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc8848393b4 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.116920:0:57790:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd5400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191335.116925:0:57790:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc8848393b4 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.116931:0:57790:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc8848393b4 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.116938:0:57790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc8848393b4 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.116945:0:57790:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191335.116950:0:57790:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc8848393b4 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.116957:0:57790:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc8848393b4 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191335.116983:0:57790:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513b8e00 x1874004626490752/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191351 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191335.116996:0:57790:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191335.117090:0:57790:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191335.117106:0:57790:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191335.117116:0:57790:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191335.117128:0:57790:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191335.117135:0:57790:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191335.117141:0:57790:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191335.117144:0:57790:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191335.117149:0:57790:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4204bbe8 00010000:00010000:2.0:1787191335.117152:0:57790:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191335.117160:0:57790:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191335.117174:0:57790:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191335.117181:0:57790:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000080:00200000:2.0:1787191335.117187:0:57790:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191335.117197:0:57790:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:2.0:1787191335.117201:0:57790:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191335.117213:0:57790:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191335.117265:0:57790:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848393bb lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.117273:0:57790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848393bb lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.117284:0:57790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848393bb lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191335.117303:0:57790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57790:1874004626490880:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191335.117559:0:57790:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359300 going to sleep for 11 seconds 00000100:00100000:2.0:1787191335.122138:0:57790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57790:1874004626490880:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191335.122175:0:57790:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848393bb lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.122192:0:57790:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848393bb lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.122198:0:57790:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848393bb lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.122205:0:57790:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848393bb lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.122214:0:57790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848393bb lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.122220:0:57790:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd4200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191335.122225:0:57790:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848393bb lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.122232:0:57790:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848393bb lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.122240:0:57790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848393bb lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.122246:0:57790:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191335.122263:0:57790:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848393bb lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.122270:0:57790:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848393bb lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191335.122295:0:57790:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513b8e00 x1874004626490880/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191351 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191335.122317:0:57790:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191335.122426:0:57790:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191335.122441:0:57790:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191335.122452:0:57790:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191335.122464:0:57790:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191335.122471:0:57790:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191335.122476:0:57790:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191335.122490:0:57790:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191335.122502:0:57790:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4204bb58 00010000:00010000:2.0:1787191335.122506:0:57790:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191335.122514:0:57790:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191335.122528:0:57790:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191335.122536:0:57790:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:2.0:1787191335.122546:0:57790:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:2.0:1787191335.122551:0:57790:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:2.0:1787191335.122563:0:57790:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191335.122570:0:57790:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 57 lru_type: 1 00010000:00010000:2.0:1787191335.122583:0:57790:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 57 lru_type: 1 00000002:00010000:2.0:1787191335.122592:0:57790:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191335.122633:0:57790:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848393c2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.122640:0:57790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848393c2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.122650:0:57790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848393c2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191335.122672:0:57790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57790:1874004626491008:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191335.122745:0:57790:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359300 going to sleep for 11 seconds 00000100:00100000:2.0:1787191335.125953:0:57790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57790:1874004626491008:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191335.125978:0:57790:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848393c2 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602592 expref: -99 pid: 57790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.125991:0:57790:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848393c2 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602592 expref: -99 pid: 57790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.126003:0:57790:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848393c2 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602592 expref: -99 pid: 57790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.126014:0:57790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848393c2 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602592 expref: -99 pid: 57790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.126030:0:57790:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848393c2 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602592 expref: -99 pid: 57790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.126037:0:57790:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848393c2 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602592 expref: -99 pid: 57790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.126045:0:57790:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848393c2 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602592 expref: -99 pid: 57790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191335.126056:0:57790:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b513b8e00 x1874004626491008/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191351 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191335.126069:0:57790:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848393c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602592 expref: -99 pid: 57790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.126079:0:57790:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:2.0:1787191335.126101:0:57790:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848393c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602592 expref: -99 pid: 57790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.126110:0:57790:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848393c2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602592 expref: -99 pid: 57790 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:2.0:1787191335.126139:0:57790:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191335.126149:0:57790:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 114 lru_type: 1 00010000:00010000:2.0:1787191335.126160:0:57790:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 114 lru_type: 1 00010000:00010000:2.0:1787191335.126170:0:57790:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 114 lru_type: 1 00010000:00010000:2.0:1787191335.126180:0:57790:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 115 lru_type: 1 00000080:00200000:2.0:1787191335.126193:0:57790:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1787191335.126202:0:57790:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:2.0:1787191335.126206:0:57790:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:2.0:1787191335.126212:0:57790:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb4204bcb8 00010000:00010000:2.0:1787191335.126215:0:57790:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 57 lru_type: 1 00010000:00010000:2.0:1787191335.126223:0:57790:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 58 lru_type: 1 00000002:00010000:2.0:1787191335.126237:0:57790:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191335.126243:0:57790:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848393c2 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602592 expref: -99 pid: 57790 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191335.126264:0:57790:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848393c2 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602592 expref: -99 pid: 57790 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191335.126272:0:57790:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848393c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602592 expref: -99 pid: 57790 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191335.126279:0:57790:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848393c2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602592 expref: -99 pid: 57790 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:2.0:1787191335.126287:0:57790:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191335.126292:0:57790:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 115 lru_type: 1 00010000:00010000:2.0:1787191335.126299:0:57790:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 115 lru_type: 1 00010000:00010000:2.0:1787191335.126306:0:57790:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 115 lru_type: 1 00010000:00010000:2.0:1787191335.126312:0:57790:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 116 lru_type: 1 00000080:00200008:2.0:1787191335.126898:0:57790:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:2.0:1787191335.126906:0:57790:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191335.126923:0:57790:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191335.126933:0:57790:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191335.126944:0:57790:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191335.126950:0:57790:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191335.126955:0:57790:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191335.126958:0:57790:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191335.126963:0:57790:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4204bcb8 00010000:00010000:2.0:1787191335.126967:0:57790:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191335.126976:0:57790:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191335.127100:0:57790:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191335.127109:0:57790:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191335.127116:0:57790:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191335.127124:0:57790:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191335.127131:0:57790:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191335.127135:0:57790:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191335.127138:0:57790:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191335.127142:0:57790:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4204bb58 00010000:00010000:2.0:1787191335.127145:0:57790:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191335.127153:0:57790:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191335.127162:0:57790:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191335.127168:0:57790:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191335.127173:0:57790:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191335.127182:0:57790:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:2.0:1787191335.127186:0:57790:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191335.127198:0:57790:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191335.127238:0:57790:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc8848393c9 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.127246:0:57790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc8848393c9 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.127255:0:57790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc8848393c9 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191335.127277:0:57790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57790:1874004626491136:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191335.127360:0:57790:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359300 going to sleep for 11 seconds 00000100:00100000:2.0:1787191335.132396:0:57790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57790:1874004626491136:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191335.132421:0:57790:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc8848393c9 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.132435:0:57790:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc8848393c9 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.132444:0:57790:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc8848393c9 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.132451:0:57790:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc8848393c9 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.132459:0:57790:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc8848393c9 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.132466:0:57790:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd5c00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191335.132472:0:57790:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc8848393c9 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.132480:0:57790:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc8848393c9 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.132487:0:57790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc8848393c9 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.132662:0:57790:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191335.132671:0:57790:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc8848393c9 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.132679:0:57790:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc8848393c9 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191335.132697:0:57790:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513b8e00 x1874004626491136/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191351 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191335.132712:0:57790:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1787191335.132747:0:57790:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848393c2 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602592 expref: -99 pid: 57790 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191335.132760:0:57790:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848393c2 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602592 expref: -99 pid: 57790 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:2.0:1787191335.132768:0:57790:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848393c2 from it ffffa3fb4204b930 00010000:00010000:2.0:1787191335.132771:0:57790:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848393c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602592 expref: -99 pid: 57790 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191335.132779:0:57790:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848393c2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602592 expref: -99 pid: 57790 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191335.133940:0:57790:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191335.133955:0:57790:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191335.133963:0:57790:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191335.133973:0:57790:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191335.133980:0:57790:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191335.133985:0:57790:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191335.133988:0:57790:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191335.133992:0:57790:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4204bbf8 00010000:00010000:2.0:1787191335.133995:0:57790:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191335.134003:0:57790:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191335.134013:0:57790:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191335.134017:0:57790:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191335.134020:0:57790:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191335.134025:0:57790:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:2.0:1787191335.134027:0:57790:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:2.0:1787191335.134030:0:57790:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b62ae8480, open_flags a141, mode 81b6 opened 0 00000080:00200000:2.0:1787191335.134038:0:57790:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:2.0:1787191335.134055:0:57790:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xa8:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:2.0:1787191335.134066:0:57790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848393c2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4602592 expref: -99 pid: 57790 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191335.134121:0:57790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848393c2 lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4602592 expref: -99 pid: 57790 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191335.134128:0:57790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191335.134131:0:57790:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848393c2 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4602592 expref: -99 pid: 57790 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191335.134165:0:57790:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848393d0 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.134171:0:57790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848393d0 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191335.134181:0:57790:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191335.134190:0:57790:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8e00 x1874004626491392/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191335.134200:0:57790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848393d0 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191335.134219:0:57790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57790:1874004626491392:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191335.134344:0:57790:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359300 going to sleep for 11 seconds 00000100:00100000:2.0:1787191335.138053:0:57790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57790:1874004626491392:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191335.138077:0:57790:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848393d0 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46025c3 expref: -99 pid: 57790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.138119:0:57790:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848393d0 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xa8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46025c3 expref: -99 pid: 57790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.138129:0:57790:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848393d0 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xa8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46025c3 expref: -99 pid: 57790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.138140:0:57790:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848393d0 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xa8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46025c3 expref: -99 pid: 57790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.138152:0:57790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848393d0 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xa8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46025c3 expref: -99 pid: 57790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.138166:0:57790:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848393d0 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xa8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46025c3 expref: -99 pid: 57790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.138174:0:57790:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848393d0 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xa8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46025c3 expref: -99 pid: 57790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.138182:0:57790:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848393d0 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xa8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46025c3 expref: -99 pid: 57790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191335.138193:0:57790:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b513b8e00 x1874004626491392/t8589936411(8589936411) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191351 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191335.138206:0:57790:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b8e00 x1874004626491392/t8589936411(8589936411) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191351 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191335.138220:0:57790:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848393d0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46025c3 expref: -99 pid: 57790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.138229:0:57790:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/168 (0 0) 00000080:00200000:2.0:1787191335.138236:0:57790:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191335.138260:0:57790:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:2.0:1787191335.138289:0:57790:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xa8:0x0](ffff936b4898aa08) 00000080:00200000:2.0:1787191335.138295:0:57790:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xa8:0x0], updating i_size 0 00000080:00200000:2.0:1787191335.138328:0:57790:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xa8:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:2.0:1787191335.138333:0:57790:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xa8:0x0](ffff936b4898aa08) 00000080:00010000:2.0:1787191335.138336:0:57790:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xa8:0x0](ffff936b4898aa08) for lock 0xe5129dc8848393d0 00000080:00010000:2.0:1787191335.138346:0:57790:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xa8:0x0](ffff936b4898aa08) 00000080:00200008:2.0:1787191335.138361:0:57790:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xa8:0x0](ffff936b4898aa08), flags 120501 00000002:00100000:2.0:1787191335.139015:0:57790:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b8e00 x1874004626491392/t8589936411(8589936411) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191351 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1787191335.139047:0:57790:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848393d0 from it ffff936b60dc4d20 00010000:00010000:2.0:1787191335.139052:0:57790:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848393d0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46025c3 expref: -99 pid: 57790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.139063:0:57790:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848393d0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46025c3 expref: -99 pid: 57790 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191335.139095:0:57790:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xa8:0x0](ffff936b4898aa08), inode mode 81a4 mask 40 00000080:00200000:2.0:1787191335.139141:0:57790:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xa8:0x0](ffff936b4898aa08), inode mode 81a4 mask 2 00000080:00200000:2.0:1787191335.139150:0:57790:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xa8:0x0](ffff936b4898aa08), xattr lov 00000002:00010000:2.0:1787191335.139167:0:57790:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xa8:0x0]) in obj [0x200000405:0xa8:0x0], intent: open flags 040000002 00010000:00010000:2.0:1787191335.139208:0:57790:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc8848393d7 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.139215:0:57790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc8848393d7 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191335.139229:0:57790:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191335.139235:0:57790:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb100 x1874004626491648/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191335.139243:0:57790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc8848393d7 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191335.139276:0:57790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57790:1874004626491648:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191335.143150:0:57790:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359300 going to sleep for 11 seconds 00000100:00100000:3.0:1787191335.149451:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191335.149528:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634830976 00000100:00100000:2.0:1787191335.149537:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634830976 00000100:00100000:2.0:1787191335.149589:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1155 00000100:00100000:2.0:1787191335.149598:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634830976:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191335.149613:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848393d0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46025c3 expref: -99 pid: 57790 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191335.150849:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191335.150860:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634830976:12345-192.168.202.101@tcp:104: Request processed in 1262us (1414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191335.150868:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1155 00000080:00200000:2.0:1787191335.164918:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191335.164939:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191335.164953:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191335.164966:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191335.164979:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191335.164985:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191335.164991:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191335.164997:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:2.0:1787191335.165001:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191335.165010:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191335.165021:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191335.165029:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191335.165037:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191335.165045:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:2.0:1787191335.165051:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xa8:0x0](ffff936b4898aa08), inode mode 81a4 mask 42 00000080:00200008:2.0:1787191335.165058:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xa8:0x0](ffff936b4898aa08), flags 101101 00000002:00010000:2.0:1787191335.165077:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xa8:0x0]) in obj [0x200000405:0xa8:0x0], intent: open|creat flags 04240101102 00010000:00010000:2.0:1787191335.165138:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848393ec lrc: 3/0,1 mode: --/CW res: [0x200000405:0xa8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.165151:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848393ec lrc: 3/0,1 mode: --/CW res: [0x200000405:0xa8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191335.165176:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191335.165185:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9f80 x1874004626493312/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191335.165200:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848393ec lrc: 3/0,1 mode: --/CW res: [0x200000405:0xa8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191335.165222:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626493312:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191335.165426:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359300 going to sleep for 11 seconds 00000100:00100000:2.0:1787191335.173364:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191335.173459:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634831104 00000100:00100000:3.0:1787191335.173468:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634831104 00000100:00100000:3.0:1787191335.173518:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1156 00000100:00100000:3.0:1787191335.173527:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634831104:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191335.173550:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc8848393e5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4602610 expref: -99 pid: 57792 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191335.173625:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191335.173631:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634831104:12345-192.168.202.101@tcp:104: Request processed in 105us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191335.173646:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1156 00000100:00100000:3.0:1787191335.193257:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191335.193388:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634831232 00000100:00100000:2.0:1787191335.193403:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634831232 00000100:00100000:2.0:1787191335.193465:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1157 00000100:00100000:2.0:1787191335.193475:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634831232:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191335.193489:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf400/0xe5129dc884839408 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4602664 expref: -99 pid: 57792 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191335.193548:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191335.193555:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634831232:12345-192.168.202.101@tcp:104: Request processed in 82us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191335.193563:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1157 00000100:00100000:2.0:1787191335.234727:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191335.241452:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634832896 00000100:00100000:3.0:1787191335.241466:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634832896 00000100:00100000:3.0:1787191335.241519:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1158 00000100:00100000:3.0:1787191335.241529:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30510:x1874004634832896:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191335.241547:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc8848392e9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x180:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e46022e4 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:3.0:1787191335.241624:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191335.241630:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30510:x1874004634832896:12345-192.168.202.101@tcp:104: Request processed in 103us (6912us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191335.241637:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1158 00000100:00100000:3.0:1787191335.242331:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191335.242358:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634833024 00000100:00100000:3.0:1787191335.242363:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634833024 00000100:00100000:3.0:1787191335.242389:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1159 00000100:00100000:3.0:1787191335.242395:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:37089:x1874004634833024:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191335.242405:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483938a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e46024c0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.242444:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191335.242450:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:37089:x1874004634833024:12345-192.168.202.101@tcp:104: Request processed in 56us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191335.242457:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1159 00000100:00100000:3.0:1787191335.242573:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191335.242585:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634833152 00000100:00100000:3.0:1787191335.242587:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634833152 00000100:00100000:3.0:1787191335.242600:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1160 00000100:00100000:3.0:1787191335.242603:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8720:x1874004634833152:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191335.242609:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008d34baf3/0xe5129dc884839352 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000030000 nid: local remote: 0x7130d520e460241f expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.242629:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787191335.242633:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8720:x1874004634833152:12345-192.168.202.101@tcp:104: Request processed in 30us (60us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191335.242637:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1160 00010000:00010000:3.0:1787191335.242645:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787191335.242649:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483938a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e46024c0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.242654:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b4801f200 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191335.242657:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483938a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e46024c0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.242679:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483938a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e46024c0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.242683:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191335.242696:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483938a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e46024c0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.242701:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483938a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x187:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e46024c0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.242711:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191335.242713:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008d34baf3/0xe5129dc884839352 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000030000 nid: local remote: 0x7130d520e460241f expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.242717:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd5a00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191335.242720:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008d34baf3/0xe5129dc884839352 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400030000 nid: local remote: 0x7130d520e460241f expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.242730:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008d34baf3/0xe5129dc884839352 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e460241f expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.242734:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191335.242737:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008d34baf3/0xe5129dc884839352 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e460241f expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.242741:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008d34baf3/0xe5129dc884839352 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x181:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e460241f expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.242749:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191335.242750:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191335.242751:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191335.242760:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626496000:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191335.242783:0:2392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787191335.242786:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626496128:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191335.242825:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191335.242876:0:40922:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787191335.242883:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634833280 00000100:00100000:3.0:1787191335.242885:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634833280 00000100:00100000:3.0:1787191335.242897:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1161 00000100:00100000:3.0:1787191335.242901:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b52588050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30511:x1874004634833280:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191335.242907:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000df732e44/0xe5129dc88483937c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e46024b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191335.242925:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191335.242928:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b52588050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30511:x1874004634833280:12345-192.168.202.101@tcp:104: Request processed in 27us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191335.242932:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1161 00010000:00010000:3.0:1787191335.242952:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191335.242955:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000df732e44/0xe5129dc88483937c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e46024b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191335.242960:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9a800 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191335.242962:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000df732e44/0xe5129dc88483937c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e46024b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191335.242975:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000df732e44/0xe5129dc88483937c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e46024b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191335.242983:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191335.242989:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000df732e44/0xe5129dc88483937c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e46024b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191335.242995:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000df732e44/0xe5129dc88483937c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e46024b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191335.243007:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191335.243009:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191335.243011:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191335.243019:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626496256:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191335.243070:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191335.243091:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634833408 00000100:00100000:3.0:1787191335.243094:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634833408 00000100:00100000:3.0:1787191335.243113:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1162 00000100:00100000:3.0:1787191335.243119:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8420:x1874004634833408:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191335.243126:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000008763ad1f/0xe5129dc88483928e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e46021da expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.243152:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191335.243157:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8420:x1874004634833408:12345-192.168.202.101@tcp:104: Request processed in 38us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191335.243164:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1162 00010000:00010000:3.0:1787191335.243177:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191335.243181:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000008763ad1f/0xe5129dc88483928e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e46021da expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.243188:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9a000 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191335.243192:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000008763ad1f/0xe5129dc88483928e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e46021da expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.243211:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000008763ad1f/0xe5129dc88483928e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e46021da expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.243217:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191335.243226:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000008763ad1f/0xe5129dc88483928e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e46021da expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.243234:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000008763ad1f/0xe5129dc88483928e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x183:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e46021da expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.243245:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191335.243248:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191335.243249:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191335.243256:0:2392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787191335.243263:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626496384:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191335.243330:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191335.243346:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634833536 00000100:00100000:3.0:1787191335.243349:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634833536 00000100:00100000:3.0:1787191335.243367:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1163 00000100:00100000:3.0:1787191335.243373:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30353:x1874004634833536:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191335.243381:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc884839344 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e46023f5 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.243409:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191335.243414:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30353:x1874004634833536:12345-192.168.202.101@tcp:104: Request processed in 42us (85us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191335.243420:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1163 00010000:00010000:3.0:1787191335.243433:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191335.243437:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc884839344 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e46023f5 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.243444:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd5200 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191335.243448:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc884839344 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e46023f5 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.243528:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc884839344 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e46023f5 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.243535:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191335.243545:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc884839344 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e46023f5 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.243552:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc884839344 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x184:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e46023f5 expref: -99 pid: 57784 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.243565:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191335.243567:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191335.243568:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191335.243579:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626496512:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191335.245764:0:57793:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787191335.248096:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626496256:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191335.248113:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626496128:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191335.248123:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626496000:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191335.251228:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626496384:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191335.252158:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626496512:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191335.252180:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191335.252245:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634833664 00000100:00100000:3.0:1787191335.252252:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634833664 00000100:00100000:3.0:1787191335.252291:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1164 00000100:00100000:3.0:1787191335.252298:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8422:x1874004634833664:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191335.252316:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc8848393f3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x189:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000010000 nid: local remote: 0x7130d520e460262c expref: -99 pid: 57792 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000100:00100000:2.0:1787191335.252383:0:57793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57793:1874004626496768:192.168.202.101@tcp:35:lfs.0 00000002:00100000:2.0:1787191335.252536:0:57793:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a476d80 x1874004626495616/t8589936425(8589936425) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191351 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1787191335.252677:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191335.252686:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8422:x1874004634833664:12345-192.168.202.101@tcp:104: Request processed in 386us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191335.252693:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1164 00010000:00010000:3.0:1787191335.252716:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191335.252722:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc8848393f3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x189:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000010000 nid: local remote: 0x7130d520e460262c expref: -99 pid: 57792 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191335.252732:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cafa00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191335.252738:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc8848393f3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x189:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800428400010000 nid: local remote: 0x7130d520e460262c expref: -99 pid: 57792 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191335.252761:0:57627:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa8:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1787191335.252776:0:57627:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa8:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00000080:00200000:2.0:1787191335.252792:0:57793:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191335.252814:0:57793:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191335.252818:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc8848393f3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x189:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400010020 nid: local remote: 0x7130d520e460262c expref: -99 pid: 57792 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191335.252828:0:57793:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191335.252828:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191335.252868:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc8848393f3 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x189:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400010020 nid: local remote: 0x7130d520e460262c expref: -99 pid: 57792 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191335.252876:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc8848393f3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x189:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400010020 nid: local remote: 0x7130d520e460262c expref: -99 pid: 57792 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191335.252888:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191335.252890:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191335.252892:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191335.252907:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626496896:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787191335.253390:0:57793:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191335.253399:0:57793:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191335.253407:0:57793:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191335.253410:0:57793:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191335.253417:0:57793:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42093b58 00010000:00010000:2.0:1787191335.253420:0:57793:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191335.253429:0:57793:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191335.253443:0:57793:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191335.253450:0:57793:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191335.253457:0:57793:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191335.253470:0:57793:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=9 00000080:00200000:2.0:1787191335.253473:0:57793:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191335.253486:0:57793:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191335.253524:0:57793:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839424 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.253532:0:57793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839424 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.253540:0:57793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839424 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191335.253560:0:57793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57793:1874004626497024:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191335.254971:0:57793:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191335.255280:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191335.255401:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634833792 00000100:00100000:3.0:1787191335.255408:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634833792 00000100:00100000:3.0:1787191335.255464:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1165 00000100:00100000:3.0:1787191335.255471:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:6489:x1874004634833792:12345-192.168.202.101@tcp:105: 00010000:00010000:3.0:1787191335.255482:0:51131:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483941d lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x189:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46026e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.255491:0:51131:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483941d lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x189:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46026e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.255498:0:51131:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483941d lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46026e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.255506:0:51131:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483941d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080000000000 nid: local remote: 0x7130d520e46026e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.255512:0:51131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483941d lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080000000000 nid: local remote: 0x7130d520e46026e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.255519:0:51131:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483941d lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000000000 nid: local remote: 0x7130d520e46026e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.255531:0:51131:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b51fe0a00) 00000100:00100000:3.0:1787191335.255577:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:6489:x1874004634833792:12345-192.168.202.101@tcp:105: Request processed in 107us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191335.255582:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1165 00000100:00100000:2.0:1787191335.257805:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191335.257926:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634833920 00000100:00100000:3.0:1787191335.257935:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634833920 00000100:00100000:3.0:1787191335.258018:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1166 00000100:00100000:3.0:1787191335.258029:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634833920:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191335.258045:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848393ec lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xa8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e4602625 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191335.258232:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191335.258239:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634833920:12345-192.168.202.101@tcp:104: Request processed in 212us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191335.258247:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1166 00010000:00010000:3.0:1787191335.258736:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191335.258742:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848393ec lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xa8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e4602625 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191335.258749:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd4a00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191335.258753:0:40929:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848393ec lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xa8:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4602625 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191335.258759:0:40929:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848393ec lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xa8:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4602625 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191335.258765:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848393ec lrc: 3/0,0 mode: CW/CW res: [0x200000405:0xa8:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x7130d520e4602625 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191335.258810:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848393ec lrc: 2/0,0 mode: --/CW res: [0x200000405:0xa8:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e4602625 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191335.258814:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191335.258846:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848393ec lrc: 1/0,0 mode: --/CW res: [0x200000405:0xa8:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e4602625 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191335.258851:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848393ec lrc: 0/0,0 mode: --/CW res: [0x200000405:0xa8:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e4602625 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191335.258861:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191335.258862:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191335.258863:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191335.258874:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787191335.258886:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626497152:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191335.260096:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626496896:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191335.263854:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626497152:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00200000:3.0:1787191335.274231:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xa8:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1787191335.274238:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b42ff6308 (ffff936b465ccc68/0) at cl_lock_release():245 00000020:00010000:3.0:1787191335.274241:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42ff6308 (ffff936b465ccc68/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191335.274245:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62893db0 (ffff936b465cc008/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191335.274255:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483941d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e46026e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.274268:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483941d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e46026e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1787191335.274282:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62893df0 (ffff936b465ccd88/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191335.274285:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000cfb66679/0xe5129dc88483942b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4602705 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.274291:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000cfb66679/0xe5129dc88483942b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4602705 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1787191335.274296:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42ff6308 (ffff936b465ccc68/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191335.274298:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62893db0 (ffff936b465ccc68/1) at cl_lock_fini():72 00000020:00010000:3.0:1787191335.274301:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62893df0 (ffff936b465ccc68/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191335.274319:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa8:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191335.274331:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xa8:0x0](ffff936b4898aa08) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191335.000000000, mtime 1787191335.000000000, ctime 1787191335.000000000, rc 0 00000080:00200008:3.0:1787191335.274429:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xa8:0x0], ppos: 0, count: 5 00000080:00200000:3.0:1787191335.274441:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:3.0:1787191335.274445:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:3.0:1787191335.274450:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:3.0:1787191335.274455:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:3.0:1787191335.274460:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@00000000368c9109[0x110, 1, [0x200000405:0xa8:0x0] hash] 00000020:00200000:3.0:1787191335.274462:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:3.0:1787191335.274466:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa8:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:3.0:1787191335.274475:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xa8:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:3.0:1787191335.274479:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xa8:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191335.274481:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:3.0:1787191335.274484:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1787191335.274490:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:3.0:1787191335.274493:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1787191335.274507:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:3.0:1787191335.274518:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:3.0:1787191335.274522:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667ab0, osc lock ffff936b44f64d10, flags 0x0 00010000:00010000:3.0:1787191335.274539:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483941d lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x189:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e46026e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.274552:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483941d lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e46026e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.274563:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483941d lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e46026e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.274571:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483941d lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e46026e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.274585:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483941d lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e46026e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191335.274597:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:3.0:1787191335.274604:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:3.0:1787191335.274642:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:3.0:1787191335.274650:0:57570:0:(rw26.c:927:ll_write_end()) page@000000009470357b[3 00000000e870821a 2 1 00000000d4478190 0 0 0] 00000080:00200000:3.0:1787191335.274654:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @000000002e8af1fe 17ffffc0001021 2:0 ffff936b50842540 0 lru 00000080:00200000:3.0:1787191335.274662:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@000000006fd8497c 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000ef00a996 00000000f5ddd5d2 > 3< 0 0 > 4< 0 0 8 402923520 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1787191335.274664:0:57570:0:(rw26.c:927:ll_write_end()) end page@000000009470357b 00000080:00200000:3.0:1787191335.274665:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1787191335.274669:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:3.0:1787191335.274688:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 00000000942721a7 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483941d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e46026e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191335.274709:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b4898abb8, count 1, dirtied 1 00000080:00200000:3.0:1787191335.274714:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:3.0:1787191335.274716:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:3.0:1787191335.274731:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b42ff6308 (ffff936b465ccc68/0) at cl_lock_release():245 00000020:00010000:3.0:1787191335.274734:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42ff6308 (ffff936b465ccc68/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191335.274737:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667ab0 (ffff936b465ccd88/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191335.274740:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483941d lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e46026e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.274746:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483941d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e46026e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:3.0:1787191335.274756:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42ff6308 (ffff936b465ccc68/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191335.274758:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667ab0 (ffff936b465ccc68/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191335.274763:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:3.0:1787191335.274766:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1787191335.274769:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa8:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191335.274771:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:3.0:1787191335.274775:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xa8:0x0] updating i_size 5 i_blocks 0 00000080:00200000:3.0:1787191335.274778:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:3.0:1787191335.274793:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xa8:0x0](ffff936b4898aa08), flags 100001 00000002:00100000:3.0:1787191335.274880:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513b9f80 x1874004626493312/t8589936418(8589936418) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191351 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191335.274890:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191335.274894:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1c700 x1874004626497792/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191335.274912:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626497792:192.168.202.101@tcp:35:bash.0 00000100:00100000:3.0:1787191335.274979:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cd80 going to sleep for 11 seconds 00000080:00200000:3.0:1787191335.280954:0:57795:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191335.280981:0:57795:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191335.280995:0:57795:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191335.281007:0:57795:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191335.281013:0:57795:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191335.281020:0:57795:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191335.281023:0:57795:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191335.281029:0:57795:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4207bb58 00010000:00010000:3.0:1787191335.281032:0:57795:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191335.281038:0:57795:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191335.281050:0:57795:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191335.281057:0:57795:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:3.0:1787191335.281061:0:57795:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191335.281064:0:57795:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=8 00000080:00200008:3.0:1787191335.281069:0:57795:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xa8:0x0](ffff936b4898aa08), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191335.281072:0:57795:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xa8:0x0](ffff936b4898aa08),name=f70.sanity-flr 00000002:00010000:3.0:1787191335.281098:0:57795:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xa8:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191335.281108:0:57795:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc884839416 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xa8:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46026d4 expref: -99 pid: 57793 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191335.281116:0:57795:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc884839416 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xa8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46026d4 expref: -99 pid: 57793 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:3.0:1787191335.281122:0:57795:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191335.281127:0:57795:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xa8:0x0](ffff936b4898aa08) 00000080:00010000:3.0:1787191335.281130:0:57795:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xa8:0x0](ffff936b4898aa08) for lock 0xe5129dc884839416 00000080:00010000:3.0:1787191335.281134:0:57795:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839416 from it ffffa3fb4207bcb8 00010000:00010000:3.0:1787191335.281137:0:57795:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc884839416 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46026d4 expref: -99 pid: 57793 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191335.281150:0:57795:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc884839416 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46026d4 expref: -99 pid: 57793 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:3.0:1787191335.281174:0:57795:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa8:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:3.0:1787191335.281189:0:57795:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xa8:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191335.281194:0:57795:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191335.281198:0:57795:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xa8:0x0] 00000008:00010000:3.0:1787191335.281225:0:57795:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191335.281228:0:57795:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667ab0, osc lock ffff936b44f64d10, flags 0x400000400001002 00010000:00010000:3.0:1787191335.281251:0:57795:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483941d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x189:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e46026e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191335.281262:0:57795:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483941d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e46026e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:3.0:1787191335.281276:0:57795:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191335.281280:0:57795:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483941d lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e46026e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191335.281287:0:57795:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483941d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e46026e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:3.0:1787191335.281295:0:57795:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191335.281303:0:57795:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xa8:0x0] updating i_size 5 i_blocks 0 00000020:00010000:3.0:1787191335.281307:0:57795:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51654940 (ffff936b465ccc68/0) at cl_lock_release():245 00000020:00010000:3.0:1787191335.281309:0:57795:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51654940 (ffff936b465ccc68/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191335.281312:0:57795:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667ab0 (ffff936b465ccd88/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191335.281315:0:57795:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51654940 (ffff936b465ccc68/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191335.281316:0:57795:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667ab0 (ffff936b465ccc68/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191335.281326:0:57795:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa8:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191335.281343:0:57795:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191335.281349:0:57795:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191335.281354:0:57795:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191335.281359:0:57795:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191335.281364:0:57795:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191335.281367:0:57795:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191335.281369:0:57795:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191335.281373:0:57795:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4207bc10 00010000:00010000:3.0:1787191335.281375:0:57795:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191335.281382:0:57795:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191335.281389:0:57795:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191335.281393:0:57795:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:3.0:1787191335.281396:0:57795:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191335.281402:0:57795:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:3.0:1787191335.281406:0:57795:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:3.0:1787191335.281411:0:57795:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:3.0:1787191335.281433:0:57795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483940f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xa8:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4602680 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787191335.281445:0:57795:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xa8:0x0]: losing layout lock 00010000:00010000:3.0:1787191335.281454:0:57795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839424 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46026fe expref: -99 pid: 57793 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191335.281459:0:57795:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xa8:0x0]: losing layout lock 00010000:00010000:3.0:1787191335.281464:0:57795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc884839416 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa8:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46026d4 expref: -99 pid: 57793 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:3.0:1787191335.281468:0:57795:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xa8:0x0]: losing layout lock 00010000:00010000:3.0:1787191335.281470:0:57795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e600/0xe5129dc884839401 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa8:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e460264f expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.281505:0:57795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483940f lrc: 1/0,0 mode: --/CR res: [0x200000405:0xa8:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4602680 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191335.281509:0:57795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839424 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xa8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46026fe expref: -99 pid: 57793 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.281512:0:57795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc884839416 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xa8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46026d4 expref: -99 pid: 57793 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1787191335.281516:0:57795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e600/0xe5129dc884839401 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xa8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e460264f expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.281520:0:57795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 4 locks packed 00010000:00010000:3.0:1787191335.281522:0:57795:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483940f lrc: 0/0,0 mode: --/CR res: [0x200000405:0xa8:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4602680 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191335.281544:0:57795:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839424 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xa8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46026fe expref: -99 pid: 57793 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.281557:0:57795:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc884839416 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xa8:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46026d4 expref: -99 pid: 57793 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1787191335.281566:0:57795:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801e600/0xe5129dc884839401 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xa8:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e460264f expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:3.0:1787191335.281586:0:57795:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1787191335.281598:0:57795:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1d500 x1874004626498048/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 512/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191335.281624:0:57795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d500 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57795:1874004626498048:192.168.202.101@tcp:36:rm.0 00000100:00100000:3.0:1787191335.281726:0:57795:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c840 going to sleep for 11 seconds 00000100:00100000:2.0:1787191335.300443:0:57794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57794:1874004626498304:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191335.300469:0:57794:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc884839432 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.300482:0:57794:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc884839432 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.300490:0:57794:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc884839432 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.300498:0:57794:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc884839432 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.300507:0:57794:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc884839432 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.300514:0:57794:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51fe1e00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191335.300520:0:57794:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc884839432 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.300527:0:57794:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc884839432 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.300534:0:57794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc884839432 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.300545:0:57794:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191335.300552:0:57794:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc884839432 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.300558:0:57794:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc884839432 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57794 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191335.300577:0:57794:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x7, status=0 req@ffff936b453a9880 x1874004626498304/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/608 e 0 to 0 dl 1787191351 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191335.300591:0:57794:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191335.300862:0:57794:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191335.300880:0:57794:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191335.300890:0:57794:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191335.300900:0:57794:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191335.300905:0:57794:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191335.300910:0:57794:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191335.300912:0:57794:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191335.300916:0:57794:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42033b58 00010000:00010000:3.0:1787191335.300919:0:57794:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191335.300924:0:57794:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191335.300935:0:57794:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191335.300940:0:57794:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191335.300944:0:57794:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191335.300951:0:57794:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=9 00000080:00200000:3.0:1787191335.300954:0:57794:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:3.0:1787191335.300963:0:57794:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1787191335.300998:0:57794:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839439 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.301006:0:57794:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839439 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.301015:0:57794:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839439 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191335.301036:0:57794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57794:1874004626498432:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191335.301137:0:57794:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c840 going to sleep for 11 seconds 00000080:00200000:3.0:1787191335.303783:0:57796:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191335.303813:0:57796:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191335.303828:0:57796:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191335.303871:0:57796:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191335.303878:0:57796:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191335.303886:0:57796:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191335.303890:0:57796:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191335.303897:0:57796:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4209bb58 00010000:00010000:3.0:1787191335.303901:0:57796:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191335.303909:0:57796:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191335.303925:0:57796:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191335.303932:0:57796:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:3.0:1787191335.303937:0:57796:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191335.311232:0:57796:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:3.0:1787191335.311240:0:57796:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:3.0:1787191335.311266:0:57796:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1787191335.311316:0:57796:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884839440 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.311325:0:57796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884839440 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.311335:0:57796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884839440 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191335.311362:0:57796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ed80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57796:1874004626498560:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191335.311439:0:57796:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787191335.329483:0:57797:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191335.341362:0:57797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57797:1874004626498944:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191335.341373:0:57797:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc88483944e lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.341382:0:57797:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc88483944e lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.341388:0:57797:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc88483944e lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.341394:0:57797:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc88483944e lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.341401:0:57797:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc88483944e lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.341407:0:57797:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cae800 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191335.341411:0:57797:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc88483944e lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.341418:0:57797:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc88483944e lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.341425:0:57797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc88483944e lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.341431:0:57797:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191335.341436:0:57797:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc88483944e lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.341442:0:57797:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc88483944e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57797 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191335.341456:0:57797:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x7, status=0 req@ffff936b6a475180 x1874004626498944/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/608 e 0 to 0 dl 1787191351 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191335.341467:0:57797:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1787191335.341485:0:57797:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0e00/0xe5129dc884839455 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602798 expref: -99 pid: 57796 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191335.341507:0:57797:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0e00/0xe5129dc884839455 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602798 expref: -99 pid: 57796 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:2.0:1787191335.341515:0:57797:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839455 from it ffffa3fb420a39a0 00010000:00010000:2.0:1787191335.341518:0:57797:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0e00/0xe5129dc884839455 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602798 expref: -99 pid: 57796 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191335.341525:0:57797:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0e00/0xe5129dc884839455 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602798 expref: -99 pid: 57796 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191335.341732:0:57797:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191335.341745:0:57797:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191335.341752:0:57797:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191335.341761:0:57797:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191335.341767:0:57797:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191335.341772:0:57797:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191335.341775:0:57797:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191335.341779:0:57797:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb420a3b58 00010000:00010000:2.0:1787191335.341782:0:57797:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191335.341790:0:57797:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191335.341799:0:57797:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191335.341805:0:57797:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191335.341811:0:57797:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191335.341814:0:57797:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=9 00000080:00200000:2.0:1787191335.353722:0:57798:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191335.353761:0:57798:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191335.353781:0:57798:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191335.353805:0:57798:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191335.353813:0:57798:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191335.353822:0:57798:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191335.353825:0:57798:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191335.354328:0:57798:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb420abbf8 00010000:00010000:2.0:1787191335.354334:0:57798:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191335.354344:0:57798:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191335.354362:0:57798:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191335.354371:0:57798:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191335.354377:0:57798:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191335.354381:0:57798:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:2.0:1787191335.354386:0:57798:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xa9:0x0](ffff936b5395f448), inode mode 81a4 mask 44 00000080:00200008:2.0:1787191335.354392:0:57798:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xa9:0x0](ffff936b5395f448), flags 154400 00000002:00010000:2.0:1787191335.354409:0:57798:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xa9:0x0]) in obj [0x200000405:0xa9:0x0], intent: open flags 0100240114401 00010000:00010000:2.0:1787191335.354463:0:57798:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483946a lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.354471:0:57798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483946a lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57798 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191335.354483:0:57798:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:2.0:1787191335.354496:0:57798:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb100 x1874004626499840/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191335.354507:0:57798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483946a lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191335.354530:0:57798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57798:1874004626499840:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191335.354764:0:57798:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787191335.358650:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191335.358697:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634834048 00000100:00100000:3.0:1787191335.358707:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634834048 00000100:00100000:3.0:1787191335.358759:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1167 00000100:00100000:3.0:1787191335.358769:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634834048:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191335.358789:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0800/0xe5129dc88483945c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46027b4 expref: -99 pid: 57796 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.358917:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191335.358924:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634834048:12345-192.168.202.101@tcp:104: Request processed in 158us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191335.358932:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1167 00000100:00100000:3.0:1787191335.362710:0:57798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57798:1874004626499840:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191335.362736:0:57798:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483946a lrc: 4/1,0 mode: --/CR res: [0x200000405:0xa9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.362749:0:57798:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483946a lrc: 4/1,0 mode: --/CR res: [0x200000405:0xa9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.362756:0:57798:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483946a lrc: 4/1,0 mode: --/CR res: [0x200000405:0xa9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.362762:0:57798:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483946a lrc: 3/0,0 mode: --/CR res: [0x200000405:0xa9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.362773:0:57798:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483946a lrc: 4/0,0 mode: --/CR res: [0x200000405:0xa9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.362779:0:57798:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd5e00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191335.362783:0:57798:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483946a lrc: 4/0,0 mode: --/CR res: [0x200000405:0xa9:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.362790:0:57798:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483946a lrc: 4/0,0 mode: --/CR res: [0x200000405:0xa9:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.363033:0:57798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483946a lrc: 5/0,0 mode: --/CR res: [0x200000405:0xa9:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.363043:0:57798:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191335.363049:0:57798:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483946a lrc: 3/0,0 mode: --/CR res: [0x200000405:0xa9:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.363056:0:57798:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483946a lrc: 0/0,0 mode: --/CR res: [0x200000405:0xa9:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57798 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191335.363075:0:57798:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b513bb100 x1874004626499840/t8589936430(8589936430) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191351 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191335.363100:0:57798:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bb100 x1874004626499840/t8589936430(8589936430) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191351 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191335.363113:0:57798:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xa9:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1787191335.363134:0:57798:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xa9:0x0], updating i_size 0 00000002:00100000:3.0:1787191335.363153:0:57798:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bb100 x1874004626499840/t8589936430(8589936430) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191351 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191335.363427:0:57798:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xa9:0x0](ffff936b5395f448), inode mode 81a4 mask 4 00000080:00200000:3.0:1787191335.363437:0:57798:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xa9:0x0](ffff936b5395f448), xattr lov 00000080:00200008:3.0:1787191335.363479:0:57798:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xa9:0x0](ffff936b5395f448), flags 154000 00000002:00100000:3.0:1787191335.363529:0:57798:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513bb100 x1874004626499840/t8589936430(8589936430) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191351 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191335.363539:0:57798:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:3.0:1787191335.363545:0:57798:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1f480 x1874004626500224/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191335.363565:0:57798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57798:1874004626500224:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191335.363689:0:57798:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c300 going to sleep for 11 seconds 00000100:00100000:3.0:1787191335.374605:0:57798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57798:1874004626500224:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191335.374629:0:57798:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513bb100 x1874004626499840/t8589936430(8589936430) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191351 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191335.374794:0:57798:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191335.374813:0:57798:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191335.374828:0:57798:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191335.374896:0:57798:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191335.374904:0:57798:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191335.374911:0:57798:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191335.374914:0:57798:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191335.374921:0:57798:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb420abbf8 00010000:00010000:3.0:1787191335.374925:0:57798:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191335.374933:0:57798:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191335.374948:0:57798:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191335.374954:0:57798:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191335.374960:0:57798:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191335.374972:0:57798:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b62914000, open_flags d900, mode 0 opened 0 00000080:00200000:3.0:1787191335.374978:0:57798:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:3.0:1787191335.374992:0:57798:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:3.0:1787191335.375039:0:57798:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839471 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.375046:0:57798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839471 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57798 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191335.375056:0:57798:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191335.375063:0:57798:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1f800 x1874004626500480/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191335.375073:0:57798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839471 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191335.375102:0:57798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57798:1874004626500480:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191335.375438:0:57798:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c300 going to sleep for 11 seconds 00000100:00100000:2.0:1787191335.380949:0:57798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57798:1874004626500480:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191335.380980:0:57798:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839471 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602801 expref: -99 pid: 57798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.381009:0:57798:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839471 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xa9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602801 expref: -99 pid: 57798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.381017:0:57798:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839471 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602801 expref: -99 pid: 57798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.381028:0:57798:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839471 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602801 expref: -99 pid: 57798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.381040:0:57798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839471 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602801 expref: -99 pid: 57798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.381054:0:57798:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839471 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602801 expref: -99 pid: 57798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.381063:0:57798:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839471 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602801 expref: -99 pid: 57798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.381090:0:57798:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839471 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602801 expref: -99 pid: 57798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191335.381104:0:57798:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b51d1f800 x1874004626500480/t8589936434(8589936434) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191351 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191335.381117:0:57798:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1f800 x1874004626500480/t8589936434(8589936434) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191351 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191335.381131:0:57798:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839471 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602801 expref: -99 pid: 57798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191335.381144:0:57798:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839471 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602801 expref: -99 pid: 57798 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.381154:0:57798:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/169 (0 0) 00000080:00200000:2.0:1787191335.381161:0:57798:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191335.381211:0:57798:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xa9:0x0](ffff936b5395f448): rc = 0 00000080:00200000:2.0:1787191335.381229:0:57798:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xa9:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:2.0:1787191335.381235:0:57798:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xa9:0x0](ffff936b5395f448) for lock 0xe5129dc884839471 00000080:00010000:2.0:1787191335.381250:0:57798:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xa9:0x0](ffff936b5395f448) 00000080:00200008:2.0:1787191335.381889:0:57798:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xa9:0x0](ffff936b5395f448), flags 154400 00000002:00100000:2.0:1787191335.381923:0:57798:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1f800 x1874004626500480/t8589936434(8589936434) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191351 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1787191335.381982:0:57798:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839471 from it ffff936b46033900 00010000:00010000:2.0:1787191335.381989:0:57798:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839471 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4602801 expref: -99 pid: 57798 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.382003:0:57798:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839471 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602801 expref: -99 pid: 57798 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191335.382028:0:57798:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xa9:0x0](ffff936b5395f448), inode mode 81a4 mask 44 00000080:00200000:2.0:1787191335.382107:0:57798:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xa9:0x0](ffff936b5395f448), inode mode 81a4 mask 4 00000080:00200000:2.0:1787191335.382114:0:57798:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xa9:0x0](ffff936b5395f448), xattr lov 00000080:00200008:2.0:1787191335.382176:0:57798:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xa9:0x0](ffff936b5395f448), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191335.382183:0:57798:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xa9:0x0](ffff936b5395f448),name=f70.sanity-flr 00000002:00010000:2.0:1787191335.382206:0:57798:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xa9:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191335.382216:0:57798:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839471 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602801 expref: -99 pid: 57798 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191335.382226:0:57798:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839471 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602801 expref: -99 pid: 57798 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191335.382233:0:57798:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191335.382239:0:57798:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xa9:0x0](ffff936b5395f448) 00000080:00010000:2.0:1787191335.382242:0:57798:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xa9:0x0](ffff936b5395f448) for lock 0xe5129dc884839471 00000080:00010000:2.0:1787191335.382246:0:57798:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839471 from it ffffa3fb420abcd8 00010000:00010000:2.0:1787191335.382249:0:57798:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839471 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4602801 expref: -99 pid: 57798 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191335.383643:0:57798:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839471 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602801 expref: -99 pid: 57798 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191335.383674:0:57798:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa9:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:2.0:1787191335.383687:0:57798:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xa9:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191335.383690:0:57798:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191335.383694:0:57798:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xa9:0x0] 00000008:00010000:2.0:1787191335.383720:0:57798:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191335.383724:0:57798:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1e30, osc lock ffff936b44e630a0, flags 0x400000400001002 00010000:00010000:2.0:1787191335.383788:0:57798:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839478 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57798 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.383799:0:57798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839478 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57798 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.383814:0:57798:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b513b8e00 x1874004626501120/t0(0) o101->lustre-OST0000-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:2.0:1787191335.383858:0:57798:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:3.0:1787191335.384490:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626501120:192.168.202.101@tcp:101:lfs.0 00000080:00200000:3.0:1787191335.386062:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191335.386097:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191335.386113:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191335.386129:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191335.386138:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191335.386147:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191335.386150:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191335.386159:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:3.0:1787191335.386163:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191335.386172:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191335.386189:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191335.386196:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191335.386203:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191335.386209:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:3.0:1787191335.386215:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xa9:0x0](ffff936b5395f448), inode mode 81a4 mask 42 00000080:00200008:3.0:1787191335.386222:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xa9:0x0](ffff936b5395f448), flags 101101 00000002:00010000:3.0:1787191335.386237:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xa9:0x0]) in obj [0x200000405:0xa9:0x0], intent: open|creat flags 04240101102 00010000:00010000:3.0:1787191335.386249:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839471 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4602801 expref: -99 pid: 57798 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191335.386272:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xa9:0x0]: losing layout lock 00010000:00010000:3.0:1787191335.386313:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839471 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4602801 expref: -99 pid: 57798 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191335.386320:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191335.386323:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839471 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4602801 expref: -99 pid: 57798 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191335.386362:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483947f lrc: 3/0,1 mode: --/CW res: [0x200000405:0xa9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.386370:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483947f lrc: 3/0,1 mode: --/CW res: [0x200000405:0xa9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191335.386381:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191335.386392:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1ed80 x1874004626501376/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191335.386402:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483947f lrc: 3/0,1 mode: --/CW res: [0x200000405:0xa9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191335.386423:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ed80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626501376:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191335.387890:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ccc0 going to sleep for 11 seconds 00010000:00010000:3.0:1787191335.389321:0:2391:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839478 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57798 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.389344:0:2391:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839478 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e460280f expref: -99 pid: 57798 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.389362:0:2391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839478 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460280f expref: -99 pid: 57798 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.389373:0:2391:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839478 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e460280f expref: -99 pid: 57798 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191335.389388:0:2391:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839478 lrc: 5/2,0 mode: PR/PR res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460280f expref: -99 pid: 57798 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1787191335.389400:0:2391:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1787191335.389414:0:2391:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839478 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460280f expref: -99 pid: 57798 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.389422:0:2391:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839478 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460280f expref: -99 pid: 57798 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.389443:0:2391:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839478 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460280f expref: -99 pid: 57798 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:2.0:1787191335.389448:0:57798:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xa9:0x0] updating i_size 0 i_blocks 0 00010000:00010000:3.0:1787191335.389454:0:2391:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839478 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460280f expref: -99 pid: 57798 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191335.389455:0:57798:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c3a060 (ffff936b47a17ab8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191335.389462:0:57798:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c3a060 (ffff936b47a17ab8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191335.389470:0:57798:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1e30 (ffff936b465cc488/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191335.389475:0:57798:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c3a060 (ffff936b47a17ab8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191335.389477:0:57798:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1e30 (ffff936b47a17ab8/1) at cl_lock_fini():72 00000100:00100000:3.0:1787191335.389491:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626501120:192.168.202.101@tcp:101:lfs.0 00000080:00200000:2.0:1787191335.389510:0:57798:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa9:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:2.0:1787191335.389529:0:57798:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/169 (0 0) 00000080:00010000:2.0:1787191335.389540:0:57798:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xa9:0x0](ffff936b5395f448) 00000002:00010000:2.0:1787191335.389550:0:57798:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xa9:0x0]) in obj [0x200000405:0xa9:0x0], intent: layout flags 0 00010000:00010000:2.0:1787191335.389587:0:57798:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839486 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.389601:0:57798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839486 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.389611:0:57798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839486 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xa9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191335.389632:0:57798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57798:1874004626501504:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191335.389743:0:57798:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787191335.407728:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626501888:192.168.202.101@tcp:36:bash.0 00000080:00200000:2.0:1787191335.407761:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:2.0:1787191335.407767:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa9:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191335.407778:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xa9:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:2.0:1787191335.407784:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa9:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191335.407787:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xa9:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:2.0:1787191335.407794:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xa9:0x0](ffff936b5395f448) 00000002:00010000:2.0:1787191335.407801:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xa9:0x0]) in obj [0x200000405:0xa9:0x0], intent: layout flags 02 00010000:00010000:2.0:1787191335.407815:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839486 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xa9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e460282b expref: -99 pid: 57798 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191335.407857:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xa9:0x0]: losing layout lock 00010000:00010000:2.0:1787191335.407883:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839486 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xa9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460282b expref: -99 pid: 57798 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191335.407890:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191335.407893:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839486 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xa9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460282b expref: -99 pid: 57798 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191335.407915:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483949b lrc: 3/0,1 mode: --/EX res: [0x200000405:0xa9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.407922:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483949b lrc: 3/0,1 mode: --/EX res: [0x200000405:0xa9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191335.407929:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191335.407935:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8700 x1874004626502656/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191335.407943:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483949b lrc: 3/0,1 mode: --/EX res: [0x200000405:0xa9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191335.407956:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626502656:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191335.407986:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b523599c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191335.439530:0:57570:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589936442 gen 1 00000100:00100000:2.0:1787191335.439636:0:57570:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b51d1ed80 x1874004626501376/t8589936436(8589936436) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191351 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787191335.439658:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626502656:192.168.202.101@tcp:101:bash.0 00010000:00010000:2.0:1787191335.439686:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483949b lrc: 4/0,1 mode: --/EX res: [0x200000405:0xa9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602871 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.439699:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483949b lrc: 4/0,1 mode: --/CR res: [0x200000405:0xa9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602871 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.439714:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483949b lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xa9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602871 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.439731:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483949b lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xa9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602871 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.439748:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483949b lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xa9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602871 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.439757:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483949b lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xa9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602871 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.439765:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483949b lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xa9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602871 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191335.439775:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b513b8700 x1874004626502656/t8589936442(8589936442) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191351 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787191335.439792:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000002:00010000:2.0:1787191335.439795:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483949b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602871 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191335.439808:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483949b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602871 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.439819:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/169 (0 0) 00000080:00200000:2.0:1787191335.439825:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xa9:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1787191335.439859:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xa9:0x0](ffff936b5395f448) for lock 0xe5129dc88483949b 00000100:00100000:3.0:1787191335.439867:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000080:00010000:2.0:1787191335.439870:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483949b from it ffffa3fb41cab930 00010000:00010000:2.0:1787191335.439876:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483949b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602871 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.439891:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483949b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xa9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602871 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191335.439913:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000100:00100000:3.0:1787191335.439915:0:40921:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000080:00200000:2.0:1787191335.439922:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa9:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00000100:00100000:3.0:1787191335.439934:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634835200 00000100:00100000:3.0:1787191335.439943:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634835200 00010000:00010000:2.0:1787191335.439945:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483949b lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xa9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602871 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191335.439959:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483949b lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xa9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602871 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:2.0:1787191335.439969:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xa9:0x0](00000000d13126ac) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483949b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602871 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1787191335.439990:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1168 00000100:00100000:3.0:1787191335.440002:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b5258a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8422:x1874004634835200:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191335.440014:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483949b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602871 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.440017:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483941d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000030000 nid: local remote: 0x7130d520e46026e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191335.440033:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483949b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xa9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602871 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191335.440048:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa9:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191335.440060:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xa9:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191335.440064:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191335.440071:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00010000:00010000:3.0:1787191335.440102:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191335.440109:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b5258a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8422:x1874004634835200:12345-192.168.202.101@tcp:104: Request processed in 110us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191335.440116:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1168 00020000:00200000:2.0:1787191335.440130:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191335.440159:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa9:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:3.0:1787191335.440161:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787191335.440174:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483949b lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xa9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602871 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191335.440178:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483941d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000030000 nid: local remote: 0x7130d520e46026e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191335.440195:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483949b lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xa9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602871 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191335.440196:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51fe0a00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191335.440204:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483941d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428400030000 nid: local remote: 0x7130d520e46026e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00010000:2.0:1787191335.440207:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xa9:0x0](00000000d13126ac) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483949b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602871 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191335.440235:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa9:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191335.440241:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xa9:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191335.440243:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191335.440245:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00010000:00010000:3.0:1787191335.440249:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483941d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e46026e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00020000:00200000:2.0:1787191335.440250:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00010000:00010000:3.0:1787191335.440258:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191335.440285:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483941d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e46026e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191335.440299:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483941d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x189:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e46026e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191335.440319:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191335.440321:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191335.440323:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191335.440339:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626503296:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787191335.440491:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191335.440498:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000cfb66679/0xe5129dc88483942b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4602705 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.440513:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51fe1a00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191335.440517:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000cfb66679/0xe5129dc88483942b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4602705 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191335.441391:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa9:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:2.0:1787191335.441412:0:57570:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839478 lrc: 1/0,0 mode: PR/PR res: [0x280000401:0x188:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460280f expref: -99 pid: 57798 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191335.441521:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xa9:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:2.0:1787191335.441528:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483949b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xa9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4602871 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191335.441538:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483949b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xa9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602871 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00020000:00200000:2.0:1787191335.441554:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xa9:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:2.0:1787191335.441559:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xa9:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191335.441561:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191335.441566:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191335.441581:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191335.441585:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:2.0:1787191335.441599:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:2.0:1787191335.441604:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b523599f0, osc lock ffff936b44e630a0, flags 0x80000000 00000008:00010000:2.0:1787191335.441607:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:2.0:1787191335.441609:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b52359a30, osc lock ffff936b44e63430, flags 0x80000000 00010000:00010000:2.0:1787191335.441622:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b52377800 type 11 mode 2 res 10737419265/392 (0 1048575) 00010000:00010000:2.0:1787191335.441660:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc8848394a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x188:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.441670:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc8848394a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x188:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.441681:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc8848394a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x188:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191335.441701:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626503424:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191335.441757:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359600 going to sleep for 11 seconds 00010000:00010000:3.0:1787191335.444407:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000cfb66679/0xe5129dc88483942b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4602705 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.445323:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191335.445370:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000cfb66679/0xe5129dc88483942b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4602705 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.445381:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000cfb66679/0xe5129dc88483942b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x186:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4602705 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:2.0:1787191335.445452:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626503552:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787191335.446124:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191335.446130:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191335.446133:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191335.455212:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191335.455267:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634835712 00000100:00100000:3.0:1787191335.455278:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634835712 00000100:00100000:3.0:1787191335.455333:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1169 00000100:00100000:3.0:1787191335.455346:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8420:x1874004634835712:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191335.455365:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc884839478 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x188:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e460280f expref: -99 pid: 57798 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.455475:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191335.455483:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8420:x1874004634835712:12345-192.168.202.101@tcp:104: Request processed in 141us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191335.455491:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1169 00000100:00100000:3.0:1787191335.455563:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626503296:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191335.459186:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191335.459247:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626503552:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191335.459340:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634835968 00000100:00100000:3.0:1787191335.459348:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634835968 00000100:00100000:3.0:1787191335.459403:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1170 00000100:00100000:3.0:1787191335.459413:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:37090:x1874004634835968:12345-192.168.202.101@tcp:105: 00010000:00010000:3.0:1787191335.459429:0:40922:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc8848394a2 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602894 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.459445:0:40922:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc8848394a2 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602894 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.459461:0:40922:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc8848394a2 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602894 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.459472:0:40922:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc8848394a2 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080000000000 nid: local remote: 0x7130d520e4602894 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.459481:0:40922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc8848394a2 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080000000000 nid: local remote: 0x7130d520e4602894 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.459492:0:40922:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc8848394a2 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000000000 nid: local remote: 0x7130d520e4602894 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.459529:0:40922:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b51dd4600) 00000100:00100000:3.0:1787191335.459589:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:37090:x1874004634835968:12345-192.168.202.101@tcp:105: Request processed in 177us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191335.459597:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1170 00000100:00100000:3.0:1787191335.459639:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626503424:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191335.459656:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc8848394a2 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e4602894 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.459672:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc8848394a2 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000020000 nid: local remote: 0x7130d520e4602894 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191335.459683:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc8848394a2 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000020000 nid: local remote: 0x7130d520e4602894 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.459696:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc8848394a2 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4602894 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.459704:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc8848394a2 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4602894 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.459768:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000729b914c/0xe5129dc8848394a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.459777:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000729b914c/0xe5129dc8848394a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.459788:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000729b914c/0xe5129dc8848394a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191335.459807:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626503808:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191335.459892:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787191335.465426:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626503808:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191335.465456:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000729b914c/0xe5129dc8848394a9 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e460289b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.465474:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000729b914c/0xe5129dc8848394a9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e460289b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.465491:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000729b914c/0xe5129dc8848394a9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e460289b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.465506:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000729b914c/0xe5129dc8848394a9 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e460289b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191335.465518:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000729b914c/0xe5129dc8848394a9 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e460289b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.465530:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000729b914c/0xe5129dc8848394a9 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460289b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.465537:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000729b914c/0xe5129dc8848394a9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460289b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191335.466361:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626503936:192.168.202.101@tcp:10:bash.0 00000100:00100000:2.0:1787191335.466467:0:2392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787191335.466474:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626504064:192.168.202.101@tcp:10:bash.0 00000100:00100000:2.0:1787191335.472678:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626504064:192.168.202.101@tcp:10:bash.0 00000100:00100000:2.0:1787191335.472710:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626503936:192.168.202.101@tcp:10:bash.0 00000080:00200000:3.0:1787191335.472800:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xa9:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1787191335.472808:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b504216c8 (ffff936b465cc488/0) at cl_lock_release():245 00000020:00010000:3.0:1787191335.472812:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b504216c8 (ffff936b465cc488/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191335.472816:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b523599f0 (ffff936b465cc758/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191335.472829:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc8848394a2 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4602894 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.472953:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc8848394a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4602894 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1787191335.472978:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b52359a30 (ffff936b43ab8128/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191335.472983:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000729b914c/0xe5129dc8848394a9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460289b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.472991:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000729b914c/0xe5129dc8848394a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460289b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1787191335.473001:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b504216c8 (ffff936b465cc488/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191335.473003:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b523599f0 (ffff936b465cc488/1) at cl_lock_fini():72 00000020:00010000:3.0:1787191335.473008:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b52359a30 (ffff936b465cc488/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191335.473030:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa9:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191335.473044:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xa9:0x0](ffff936b5395f448) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191335.000000000, mtime 1787191335.000000000, ctime 1787191335.000000000, rc 0 00000080:00200008:3.0:1787191335.473157:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xa9:0x0], ppos: 0, count: 5 00000080:00200000:3.0:1787191335.473172:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:3.0:1787191335.473179:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:3.0:1787191335.473183:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:3.0:1787191335.473188:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:3.0:1787191335.473194:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@0000000021a95ec9[0x110, 1, [0x200000405:0xa9:0x0] hash] 00000020:00200000:3.0:1787191335.473197:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:3.0:1787191335.473202:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa9:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:3.0:1787191335.473217:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xa9:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:3.0:1787191335.473222:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xa9:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191335.473225:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:3.0:1787191335.473230:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1787191335.473237:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:3.0:1787191335.473241:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1787191335.473324:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:3.0:1787191335.473341:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:3.0:1787191335.473346:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667230, osc lock ffff936b44f64d10, flags 0x0 00010000:00010000:3.0:1787191335.473366:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc8848394a2 lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x188:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4602894 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.473384:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc8848394a2 lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4602894 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.473398:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc8848394a2 lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4602894 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.473407:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc8848394a2 lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4602894 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.473414:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc8848394a2 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4602894 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191335.473426:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:3.0:1787191335.473434:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:3.0:1787191335.473478:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:3.0:1787191335.473486:0:57570:0:(rw26.c:927:ll_write_end()) page@000000008df88a70[3 00000000fbffc1a2 2 1 000000000d5ce054 0 0 0] 00000080:00200000:3.0:1787191335.473490:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @0000000004521064 17ffffc0001001 3:0 ffff936b508421c0 0 lru 00000080:00200000:3.0:1787191335.473509:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@00000000f45b9c47 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000a2a44f55 0000000079fea6e5 > 3< 0 0 > 4< 0 0 8 336760832 - | - - - - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1787191335.473511:0:57570:0:(rw26.c:927:ll_write_end()) end page@000000008df88a70 00000080:00200000:3.0:1787191335.473512:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1787191335.473518:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:3.0:1787191335.473543:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 0000000010773d57 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc8848394a2 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4602894 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191335.473568:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b5395f5f8, count 1, dirtied 1 00000080:00200000:3.0:1787191335.473573:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:3.0:1787191335.473576:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:3.0:1787191335.473592:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b504216c8 (ffff936b465cc488/0) at cl_lock_release():245 00000020:00010000:3.0:1787191335.473595:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b504216c8 (ffff936b465cc488/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191335.473598:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667230 (ffff936b43ab8128/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191335.473602:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc8848394a2 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4602894 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.473610:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc8848394a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4602894 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:3.0:1787191335.473621:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b504216c8 (ffff936b465cc488/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191335.473624:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667230 (ffff936b465cc488/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191335.473631:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:3.0:1787191335.473636:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1787191335.473641:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa9:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191335.473645:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:3.0:1787191335.473651:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xa9:0x0] updating i_size 5 i_blocks 0 00000080:00200000:3.0:1787191335.473655:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:3.0:1787191335.473675:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xa9:0x0](ffff936b5395f448), flags 100001 00000002:00100000:3.0:1787191335.473745:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1ed80 x1874004626501376/t8589936436(8589936436) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191351 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191335.473759:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:3.0:1787191335.473764:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1fb80 x1874004626504576/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191335.473791:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626504576:192.168.202.101@tcp:35:bash.0 00000100:00100000:2.0:1787191335.476673:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cf00 going to sleep for 11 seconds 00000002:00010000:2.0:1787191335.484921:0:57799:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc8848394b0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46028b7 expref: -99 pid: 57799 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.484941:0:57799:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/169 (0 0) 00000080:00200000:2.0:1787191335.484949:0:57799:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191335.485018:0:57799:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xa9:0x0](ffff936b5395f448): rc = 0 00000080:00200000:2.0:1787191335.485034:0:57799:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xa9:0x0]: layout version change: 4 -> 4 00000080:00010000:2.0:1787191335.485040:0:57799:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xa9:0x0](ffff936b5395f448) for lock 0xe5129dc8848394b0 00000080:00010000:2.0:1787191335.485052:0:57799:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xa9:0x0](ffff936b5395f448) 00000080:00200008:2.0:1787191335.485069:0:57799:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xa9:0x0](ffff936b5395f448), flags 154400 00000002:00100000:2.0:1787191335.485107:0:57799:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a476680 x1874004626504320/t8589936443(8589936443) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191351 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1787191335.485158:0:57799:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848394b0 from it ffff936b495dcd80 00010000:00010000:2.0:1787191335.485164:0:57799:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc8848394b0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46028b7 expref: -99 pid: 57799 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.485175:0:57799:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc8848394b0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46028b7 expref: -99 pid: 57799 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191335.485200:0:57799:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xa9:0x0](ffff936b5395f448), inode mode 81a4 mask 44 00000080:00200000:2.0:1787191335.485935:0:57799:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xa9:0x0](ffff936b5395f448), inode mode 81a4 mask 4 00000080:00200000:2.0:1787191335.485945:0:57799:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xa9:0x0](ffff936b5395f448), xattr lov 00000080:00200008:2.0:1787191335.485974:0:57799:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xa9:0x0](ffff936b5395f448), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191335.485981:0:57799:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xa9:0x0](ffff936b5395f448),name=f70.sanity-flr 00000002:00010000:2.0:1787191335.486004:0:57799:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xa9:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191335.486016:0:57799:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc8848394b0 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46028b7 expref: -99 pid: 57799 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191335.486027:0:57799:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc8848394b0 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46028b7 expref: -99 pid: 57799 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191335.486034:0:57799:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191335.486040:0:57799:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xa9:0x0](ffff936b5395f448) 00000080:00010000:2.0:1787191335.486043:0:57799:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xa9:0x0](ffff936b5395f448) for lock 0xe5129dc8848394b0 00000080:00010000:2.0:1787191335.486047:0:57799:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848394b0 from it ffffa3fb420b3cd8 00010000:00010000:2.0:1787191335.486051:0:57799:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc8848394b0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46028b7 expref: -99 pid: 57799 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191335.486057:0:57799:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc8848394b0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46028b7 expref: -99 pid: 57799 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191335.486089:0:57799:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xa9:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:2.0:1787191335.486101:0:57799:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xa9:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191335.486104:0:57799:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191335.486107:0:57799:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xa9:0x0] 00000008:00010000:2.0:1787191335.486127:0:57799:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191335.486130:0:57799:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1830, osc lock ffff936b44e62390, flags 0x400000400001002 00010000:00010000:2.0:1787191335.486151:0:57799:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc8848394a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x188:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4602894 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191335.486162:0:57799:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc8848394a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4602894 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:2.0:1787191335.486181:0:57799:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191335.486186:0:57799:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc8848394a2 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4602894 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191335.486194:0:57799:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc8848394a2 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4602894 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:2.0:1787191335.486204:0:57799:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191335.486213:0:57799:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xa9:0x0] updating i_size 5 i_blocks 0 00000020:00010000:2.0:1787191335.486218:0:57799:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c39e10 (ffff936b47a17cf8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191335.486221:0:57799:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c39e10 (ffff936b47a17cf8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191335.486224:0:57799:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1830 (ffff936b5881c518/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191335.486227:0:57799:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c39e10 (ffff936b47a17cf8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191335.486230:0:57799:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1830 (ffff936b47a17cf8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191335.486240:0:57799:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xa9:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191335.486916:0:57799:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xa9:0x0](ffff936b5395f448), flags 154000 00000002:00100000:2.0:1787191335.486981:0:57799:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a476680 x1874004626504320/t8589936443(8589936443) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191351 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191335.486993:0:57799:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191335.486998:0:57799:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513ba680 x1874004626504832/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191335.487024:0:57799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57799:1874004626504832:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191335.489146:0:57799:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b523599c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191335.522126:0:57799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57799:1874004626505216:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191335.522147:0:57799:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc8848394b7 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.522160:0:57799:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc8848394b7 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.522168:0:57799:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc8848394b7 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.522175:0:57799:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc8848394b7 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.522184:0:57799:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc8848394b7 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.522190:0:57799:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51fe1200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191335.522194:0:57799:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc8848394b7 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.522200:0:57799:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc8848394b7 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.522207:0:57799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc8848394b7 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.522215:0:57799:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191335.522221:0:57799:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc8848394b7 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.522228:0:57799:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc8848394b7 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57799 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191335.522305:0:57799:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b453a8700 x1874004626505216/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191351 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191335.522321:0:57799:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191335.545648:0:57802:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191335.545679:0:57802:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191335.545696:0:57802:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191335.545712:0:57802:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191335.545719:0:57802:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191335.545727:0:57802:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191335.545730:0:57802:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191335.545737:0:57802:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb420bbbf8 00010000:00010000:2.0:1787191335.545741:0:57802:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191335.545750:0:57802:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191335.545765:0:57802:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191335.545772:0:57802:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191335.545779:0:57802:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191335.547184:0:57802:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b53067b00, open_flags d900, mode 0 opened 0 00000080:00200000:2.0:1787191335.547192:0:57802:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:2.0:1787191335.547209:0:57802:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:2.0:1787191335.547368:0:57802:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc8848394c5 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.547376:0:57802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc8848394c5 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57802 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191335.547392:0:57802:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191335.547400:0:57802:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9c00 x1874004626505600/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191335.547409:0:57802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc8848394c5 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191335.547428:0:57802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57802:1874004626505600:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191335.547596:0:57802:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359600 going to sleep for 11 seconds 00000080:00200000:3.0:1787191335.598220:0:57803:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:3.0:1787191335.598226:0:57803:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b43cd6300, open_flags d900, mode 0 opened 0 00000080:00200000:3.0:1787191335.598420:0:57803:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191335.598429:0:57803:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191335.598437:0:57803:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191335.598445:0:57803:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191335.598451:0:57803:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191335.598455:0:57803:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191335.598457:0:57803:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191335.598461:0:57803:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb420b3b58 00010000:00010000:3.0:1787191335.598464:0:57803:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191335.598471:0:57803:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191335.598479:0:57803:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191335.598484:0:57803:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191335.598556:0:57803:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191335.598560:0:57803:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=9 00000080:00200000:3.0:1787191335.612755:0:57804:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191335.612791:0:57804:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191335.612810:0:57804:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191335.612826:0:57804:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191335.612861:0:57804:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191335.612869:0:57804:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191335.612873:0:57804:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191335.612879:0:57804:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb420c3bf8 00010000:00010000:3.0:1787191335.612884:0:57804:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191335.612892:0:57804:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191335.612909:0:57804:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191335.612917:0:57804:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191335.612923:0:57804:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191335.614036:0:57804:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:3.0:1787191335.614042:0:57804:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xaa:0x0](ffff936b5395b248), inode mode 81a4 mask 44 00000080:00200008:3.0:1787191335.614046:0:57804:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xaa:0x0](ffff936b5395b248), flags 154400 00000002:00010000:3.0:1787191335.614059:0:57804:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xaa:0x0]) in obj [0x200000405:0xaa:0x0], intent: open flags 0100240114401 00010000:00010000:3.0:1787191335.614111:0:57804:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc8848394ef lrc: 3/1,0 mode: --/CR res: [0x200000405:0xaa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.614119:0:57804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc8848394ef lrc: 3/1,0 mode: --/CR res: [0x200000405:0xaa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57804 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191335.614127:0:57804:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191335.614133:0:57804:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1c700 x1874004626506624/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191335.614141:0:57804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc8848394ef lrc: 3/1,0 mode: --/CR res: [0x200000405:0xaa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191335.614158:0:57804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57804:1874004626506624:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191335.614619:0:57804:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787191335.618817:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191335.621065:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634836096 00000100:00100000:3.0:1787191335.621086:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634836096 00000100:00100000:3.0:1787191335.621419:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1171 00000100:00100000:3.0:1787191335.621431:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634836096:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191335.621447:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc8848394e8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xaa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4602982 expref: -99 pid: 57801 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.621547:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191335.621554:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634836096:12345-192.168.202.101@tcp:104: Request processed in 125us (2748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191335.621561:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1171 00000080:00200000:3.0:1787191335.641582:0:57804:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xaa:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1787191335.641588:0:57804:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c3a060 (ffff936b47a17ab8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191335.641592:0:57804:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c3a060 (ffff936b47a17ab8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191335.641597:0:57804:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f994b0 (ffff936b465cc368/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191335.641602:0:57804:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f994f0 (ffff936b43ab8cf8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191335.641605:0:57804:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c3a060 (ffff936b47a17ab8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191335.641607:0:57804:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f994b0 (ffff936b47a17ab8/1) at cl_lock_fini():72 00000020:00010000:3.0:1787191335.641612:0:57804:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f994f0 (ffff936b47a17ab8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191335.641624:0:57804:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xaa:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191335.641684:0:57804:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xaa:0x0](ffff936b5395b248), flags 154000 00000002:00100000:3.0:1787191335.641735:0:57804:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a474700 x1874004626507520/t8589936452(8589936452) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191351 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191335.641743:0:57804:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191335.641747:0:57804:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1e300 x1874004626508544/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191335.641762:0:57804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57804:1874004626508544:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191335.641824:0:57804:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c180 going to sleep for 11 seconds 00000080:00200000:2.0:1787191335.641879:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191335.641895:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191335.641908:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191335.641920:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191335.641928:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191335.641935:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191335.641938:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191335.641944:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:2.0:1787191335.641948:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191335.641957:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191335.641975:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191335.641981:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191335.641987:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191335.641994:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:2.0:1787191335.642001:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xaa:0x0](ffff936b5395b248), inode mode 81a4 mask 42 00000080:00200008:2.0:1787191335.642008:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xaa:0x0](ffff936b5395b248), flags 101101 00000002:00010000:2.0:1787191335.642022:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xaa:0x0]) in obj [0x200000405:0xaa:0x0], intent: open|creat flags 04240101102 00010000:00010000:2.0:1787191335.642034:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf400/0xe5129dc8848394fd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xaa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46029cf expref: -99 pid: 57804 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191335.642051:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xaa:0x0]: losing layout lock 00010000:00010000:2.0:1787191335.642091:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf400/0xe5129dc8848394fd lrc: 1/0,0 mode: --/PR res: [0x200000405:0xaa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46029cf expref: -99 pid: 57804 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191335.642099:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191335.642102:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf400/0xe5129dc8848394fd lrc: 0/0,0 mode: --/PR res: [0x200000405:0xaa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46029cf expref: -99 pid: 57804 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191335.642145:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839512 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xaa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.642153:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839512 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xaa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191335.642162:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:2.0:1787191335.642168:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8a80 x1874004626508800/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191335.642177:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839512 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xaa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191335.642190:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8a80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626508800:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191335.643187:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787191335.664160:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626509824:192.168.202.101@tcp:36:bash.0 00000080:00200000:2.0:1787191335.664207:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:2.0:1787191335.664214:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xaa:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00010000:00010000:2.0:1787191335.664231:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/170 (0 0) 00000080:00010000:2.0:1787191335.664240:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xaa:0x0](ffff936b5395b248) 00000002:00010000:2.0:1787191335.664264:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xaa:0x0]) in obj [0x200000405:0xaa:0x0], intent: layout flags 0 00010000:00010000:2.0:1787191335.664313:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839527 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xaa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.664323:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839527 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xaa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.664334:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839527 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xaa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191335.664354:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626509952:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191335.664448:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787191335.666436:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626509952:192.168.202.101@tcp:101:bash.0 00010000:00010000:2.0:1787191335.666462:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839527 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xaa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602a38 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.666477:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839527 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xaa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602a38 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191335.666498:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b513bb800 x1874004626509952/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191351 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191335.666510:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839527 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xaa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602a38 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191335.666522:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839527 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xaa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602a38 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.666532:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/170 (0 0) 00000080:00200000:2.0:1787191335.666537:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xaa:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1787191335.666553:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xaa:0x0](ffff936b5395b248) for lock 0xe5129dc884839527 00000080:00010000:2.0:1787191335.666561:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839527 from it ffffa3fb41cab8c8 00010000:00010000:2.0:1787191335.666565:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839527 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xaa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602a38 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.666575:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839527 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xaa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602a38 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191335.666599:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839527 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xaa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602a38 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191335.666611:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839527 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xaa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602a38 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:2.0:1787191335.666619:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xaa:0x0](000000003745bbc2) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839527 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xaa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602a38 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191335.666670:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xaa:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:2.0:1787191335.666675:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839527 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xaa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4602a38 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191335.666683:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839527 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xaa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602a38 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:2.0:1787191335.666698:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xaa:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:2.0:1787191335.666706:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xaa:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191335.666710:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xaa:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:2.0:1787191335.666718:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xaa:0x0](ffff936b5395b248) 00000002:00010000:2.0:1787191335.666728:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xaa:0x0]) in obj [0x200000405:0xaa:0x0], intent: layout flags 02 00010000:00010000:2.0:1787191335.666742:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839527 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xaa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4602a38 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191335.666754:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xaa:0x0]: losing layout lock 00010000:00010000:2.0:1787191335.666783:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839527 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xaa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4602a38 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191335.666790:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191335.666793:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839527 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xaa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4602a38 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191335.666814:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483952e lrc: 3/0,1 mode: --/EX res: [0x200000405:0xaa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.666821:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483952e lrc: 3/0,1 mode: --/EX res: [0x200000405:0xaa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191335.667025:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191335.667034:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb800 x1874004626510208/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191335.667044:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483952e lrc: 3/0,1 mode: --/EX res: [0x200000405:0xaa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191335.667064:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626510208:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191335.667618:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787191335.677470:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191335.677563:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634836736 00000100:00100000:3.0:1787191335.677572:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634836736 00000100:00100000:3.0:1787191335.677628:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1172 00000100:00100000:3.0:1787191335.677639:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8419:x1874004634836736:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191335.677802:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc8848394a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000030000 nid: local remote: 0x7130d520e4602894 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191335.678539:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191335.678551:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8419:x1874004634836736:12345-192.168.202.101@tcp:104: Request processed in 910us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191335.678565:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1172 00010000:00010000:3.0:1787191335.678599:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191335.678609:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc8848394a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000030000 nid: local remote: 0x7130d520e4602894 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191335.678627:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd4600 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191335.678634:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc8848394a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428400030000 nid: local remote: 0x7130d520e4602894 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191335.678685:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc8848394a2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e4602894 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191335.678694:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191335.678719:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc8848394a2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e4602894 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191335.678735:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc8848394a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x188:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e4602894 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191335.678762:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191335.678766:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191335.678768:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191335.678785:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626510592:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191335.680168:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191335.680527:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634837376 00000100:00100000:3.0:1787191335.680722:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634837376 00000100:00100000:3.0:1787191335.680786:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1173 00000100:00100000:3.0:1787191335.680801:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30511:x1874004634837376:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191335.680947:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000729b914c/0xe5129dc8848394a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e460289b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.681140:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191335.681150:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30511:x1874004634837376:12345-192.168.202.101@tcp:104: Request processed in 352us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191335.681158:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1173 00000100:00100000:3.0:1787191335.683711:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626510592:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191335.686385:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626511104:192.168.202.101@tcp:101:bash.0 00010000:00010000:2.0:1787191335.686404:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483954a lrc: 4/0,1 mode: --/PW res: [0x280000401:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602aa1 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.686421:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483954a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4602aa1 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.686433:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483954a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4602aa1 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.686448:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483954a lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4602aa1 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1787191335.686460:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483954a lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4602aa1 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.686478:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483954a lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4602aa1 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.686487:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483954a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4602aa1 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191335.686587:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626511232:192.168.202.101@tcp:10:bash.0 00000100:00100000:2.0:1787191335.686726:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787191335.686732:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626511360:192.168.202.101@tcp:10:bash.0 00000100:00100000:3.0:1787191335.689285:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626511232:192.168.202.101@tcp:10:bash.0 00000100:00100000:2.0:1787191335.689975:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626511360:192.168.202.101@tcp:10:bash.0 00000080:00200000:3.0:1787191335.690044:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xaa:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1787191335.690051:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b530e57b8 (ffff936b47a17cf8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191335.690054:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b530e57b8 (ffff936b47a17cf8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191335.690059:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62893db0 (ffff936b465ccf38/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191335.690071:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009bae9229/0xe5129dc88483953c lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4602a8c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.690091:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009bae9229/0xe5129dc88483953c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4602a8c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1787191335.690105:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62893df0 (ffff936b465cc878/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191335.690109:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483954a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4602aa1 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.690120:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483954a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4602aa1 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1787191335.690129:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b530e57b8 (ffff936b47a17cf8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191335.690135:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62893db0 (ffff936b47a17cf8/1) at cl_lock_fini():72 00000020:00010000:3.0:1787191335.690139:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62893df0 (ffff936b47a17cf8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191335.690154:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xaa:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191335.690200:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xaa:0x0](ffff936b5395b248) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191335.000000000, mtime 1787191335.000000000, ctime 1787191335.000000000, rc 0 00000080:00200008:3.0:1787191335.690278:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xaa:0x0], ppos: 0, count: 5 00000080:00200000:3.0:1787191335.690288:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:3.0:1787191335.690293:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:3.0:1787191335.690296:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:3.0:1787191335.690301:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:3.0:1787191335.690307:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@00000000941dcc66[0x110, 1, [0x200000405:0xaa:0x0] hash] 00000020:00200000:3.0:1787191335.690309:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:3.0:1787191335.690313:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xaa:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:3.0:1787191335.690325:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xaa:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:3.0:1787191335.690329:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xaa:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191335.690332:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:3.0:1787191335.690336:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1787191335.690343:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:3.0:1787191335.690346:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1787191335.690360:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:3.0:1787191335.690372:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:3.0:1787191335.690375:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667db0, osc lock ffff936b44f64d10, flags 0x0 00010000:00010000:3.0:1787191335.690386:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009bae9229/0xe5129dc88483953c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4602a8c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.690396:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009bae9229/0xe5129dc88483953c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4602a8c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.690409:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009bae9229/0xe5129dc88483953c lrc: 7/0,2 mode: PW/PW res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4602a8c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.690422:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009bae9229/0xe5129dc88483953c lrc: 7/0,2 mode: PW/PW res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4602a8c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.690429:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009bae9229/0xe5129dc88483953c lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4602a8c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191335.690440:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:3.0:1787191335.690450:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:3.0:1787191335.690495:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:3.0:1787191335.690503:0:57570:0:(rw26.c:927:ll_write_end()) page@00000000d5b30f9b[3 000000003fb0022a 2 1 00000000a7c7c335 0 0 0] 00000080:00200000:3.0:1787191335.690506:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @0000000037de44ca 17ffffc0001001 3:0 ffff936b508427e0 0 lru 00000080:00200000:3.0:1787191335.690514:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@000000004ca25fda 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000ef00a996 00000000fca7e965 > 3< 0 0 > 4< 0 0 8 402894848 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1787191335.690517:0:57570:0:(rw26.c:927:ll_write_end()) end page@00000000d5b30f9b 00000080:00200000:3.0:1787191335.690518:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1787191335.690523:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:3.0:1787191335.690541:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 00000000b331cccb ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009bae9229/0xe5129dc88483953c lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4602a8c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191335.690567:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b5395b3f8, count 1, dirtied 1 00000080:00200000:3.0:1787191335.690571:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:3.0:1787191335.690573:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:3.0:1787191335.690587:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b42ff6218 (ffff936b465cc878/0) at cl_lock_release():245 00000020:00010000:3.0:1787191335.690590:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42ff6218 (ffff936b465cc878/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191335.690593:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667db0 (ffff936b465ccf38/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191335.690596:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009bae9229/0xe5129dc88483953c lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4602a8c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.690610:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009bae9229/0xe5129dc88483953c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4602a8c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:3.0:1787191335.690618:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42ff6218 (ffff936b465cc878/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191335.690620:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667db0 (ffff936b465cc878/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191335.690625:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:3.0:1787191335.690628:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1787191335.690633:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xaa:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191335.690636:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:3.0:1787191335.690641:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xaa:0x0] updating i_size 5 i_blocks 0 00000080:00200000:3.0:1787191335.690644:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:3.0:1787191335.690659:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xaa:0x0](ffff936b5395b248), flags 100001 00000002:00100000:3.0:1787191335.690708:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513b8a80 x1874004626508800/t8589936455(8589936455) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191351 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191335.690719:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191335.690724:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1dc00 x1874004626511616/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191335.690741:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626511616:192.168.202.101@tcp:35:bash.0 00000100:00100000:3.0:1787191335.690821:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c300 going to sleep for 11 seconds 00000100:00100000:3.0:1787191335.697917:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626511616:192.168.202.101@tcp:35:bash.0 00000002:00100000:3.0:1787191335.697948:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513b8a80 x1874004626508800/t8589936455(8589936455) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191351 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1787191335.703484:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191335.703491:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc884839551 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xaa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x7130d520e4602abd expref: -99 pid: 57805 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.703499:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51fe1200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191335.703505:0:40930:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc884839551 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xaa:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x7130d520e4602abd expref: -99 pid: 57805 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.703513:0:40930:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc884839551 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xaa:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x7130d520e4602abd expref: -99 pid: 57805 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.703520:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc884839551 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xaa:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4602abd expref: -99 pid: 57805 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.703543:0:40930:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1a00/0xe5129dc884839543 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xaa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602a9a expref: -99 pid: 57805 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.703582:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc884839551 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xaa:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4602abd expref: -99 pid: 57805 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.703589:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787191335.704157:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626512128:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787191335.704349:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc884839551 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xaa:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4602abd expref: -99 pid: 57805 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.704358:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc884839551 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xaa:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4602abd expref: -99 pid: 57805 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.704371:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191335.704373:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191335.704375:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191335.707944:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191335.707978:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191335.707988:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634837504 00000100:00100000:3.0:1787191335.708006:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634837504 00000100:00100000:2.0:1787191335.708044:0:40922:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787191335.708053:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634837632 00000100:00100000:3.0:1787191335.708055:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634837632 00000100:00100000:2.0:1787191335.708062:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1174 00000100:00100000:3.0:1787191335.708070:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1175 00000100:00100000:2.0:1787191335.708071:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+6:7719:x1874004634837504:12345-192.168.202.101@tcp:104: 00000100:00100000:3.0:1787191335.708085:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b4121e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+6:7719:x1874004634837632:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191335.708093:0:40922:0:(ldlm_lockd.c:2455:ldlm_callback_handler()) callback on lock 0xe5129dc884839551 - lock disappeared 00010000:00010000:3.0:1787191335.708098:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1a00/0xe5129dc884839543 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xaa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4602a9a expref: -99 pid: 57805 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191335.708140:0:40922:0:(ldlm_lockd.c:2352:ldlm_callback_errmsg()) @@@ Operate with invalid parameter, NID=12345-192.168.202.101@tcp lock=0xe5129dc884839551: rc = 0 req@ffff936b513b8380 x1874004634837504/t0(0) o104->f10005b0-4ec5-4888-9c81-49c0b11e82c4@192.168.202.101@tcp:646/0 lens 328/224 e 0 to 0 dl 1787191346 ref 1 fl Interpret:/0/0 rc -22/-22 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:3.0:1787191335.708148:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191335.708152:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+6:7719:x1874004634837504:12345-192.168.202.101@tcp:104: Request processed in 83us (215us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787191335.708152:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b4121e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+6:7719:x1874004634837632:12345-192.168.202.101@tcp:104: Request processed in 78us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191335.708159:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1175 00000100:00100000:2.0:1787191335.708171:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1174 00000100:00100000:2.0:1787191335.708225:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626512128:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191335.711828:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191335.711875:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634837760 00000100:00100000:3.0:1787191335.711882:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634837760 00000100:00100000:3.0:1787191335.711920:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1176 00000100:00100000:3.0:1787191335.711928:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634837760:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191335.711943:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0800/0xe5129dc884839558 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xaa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e4602acb expref: -99 pid: 57805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.711995:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191335.712002:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634837760:12345-192.168.202.101@tcp:104: Request processed in 74us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191335.712009:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1176 00010000:00010000:3.0:1787191335.712788:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191335.712792:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0800/0xe5129dc884839558 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xaa:0x0].0x0 bits 0x5/0x3 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4602acb expref: -99 pid: 57805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.712801:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51fe0800 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191335.712804:0:40929:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0800/0xe5129dc884839558 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xaa:0x0].0x0 bits 0x5/0x5 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4602acb expref: -99 pid: 57805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.712872:0:40929:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0800/0xe5129dc884839558 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xaa:0x0].0x0 bits 0x5/0x5 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4602acb expref: -99 pid: 57805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.712882:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0800/0xe5129dc884839558 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0xaa:0x0].0x0 bits 0x5/0x5 rrc: 3 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x7130d520e4602acb expref: -99 pid: 57805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.712914:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0800/0xe5129dc884839558 lrc: 2/0,0 mode: --/CW res: [0x200000405:0xaa:0x0].0x0 bits 0x5/0x5 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e4602acb expref: -99 pid: 57805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.712920:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191335.712935:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0800/0xe5129dc884839558 lrc: 1/0,0 mode: --/CW res: [0x200000405:0xaa:0x0].0x0 bits 0x5/0x5 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e4602acb expref: -99 pid: 57805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.712942:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0800/0xe5129dc884839558 lrc: 0/0,0 mode: --/CW res: [0x200000405:0xaa:0x0].0x0 bits 0x5/0x5 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e4602acb expref: -99 pid: 57805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.712954:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191335.712956:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191335.712957:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191335.713139:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626513024:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191335.716355:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626513024:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191335.717611:0:57806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57806:1874004626512640:192.168.202.101@tcp:36:rm.0 00000100:00100000:3.0:1787191335.726068:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191335.726125:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634837888 00000100:00100000:3.0:1787191335.726135:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634837888 00000100:00100000:3.0:1787191335.726196:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1177 00000100:00100000:3.0:1787191335.726208:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30353:x1874004634837888:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191335.726226:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009bae9229/0xe5129dc88483953c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420080000000 nid: local remote: 0x7130d520e4602a8c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1787191335.726357:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191335.726364:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30353:x1874004634837888:12345-192.168.202.101@tcp:104: Request processed in 159us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191335.726372:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1177 00000080:00200000:2.0:1787191335.730042:0:57807:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191335.730070:0:57807:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191335.730099:0:57807:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191335.730119:0:57807:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191335.730128:0:57807:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191335.730135:0:57807:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191335.730138:0:57807:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191335.730144:0:57807:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb420d3b58 00010000:00010000:2.0:1787191335.730148:0:57807:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191335.730158:0:57807:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191335.730174:0:57807:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191335.730180:0:57807:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:2.0:1787191335.730186:0:57807:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191335.730208:0:57807:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:2.0:1787191335.730213:0:57807:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191335.730226:0:57807:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191335.730264:0:57807:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483956d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.730269:0:57807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483956d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.730276:0:57807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483956d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191335.730293:0:57807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57807:1874004626513664:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191335.730364:0:57807:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787191335.733229:0:57807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57807:1874004626513664:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191335.733249:0:57807:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483956d lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.733262:0:57807:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483956d lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.733269:0:57807:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483956d lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.733276:0:57807:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483956d lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.733284:0:57807:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483956d lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.733290:0:57807:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd4e00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191335.733294:0:57807:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483956d lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.733302:0:57807:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483956d lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.733309:0:57807:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483956d lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.733316:0:57807:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191335.733323:0:57807:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483956d lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.733329:0:57807:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483956d lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57807 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191335.733353:0:57807:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513bb100 x1874004626513664/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191351 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191335.733368:0:57807:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191335.733620:0:40930:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xaa:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00000080:00200000:3.0:1787191335.733680:0:40930:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xaa:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1787191335.733738:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009bae9229/0xe5129dc88483953c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69480000020 nid: local remote: 0x7130d520e4602a8c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1787191335.733745:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191335.733773:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009bae9229/0xe5129dc88483953c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69480000020 nid: local remote: 0x7130d520e4602a8c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1787191335.733781:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009bae9229/0xe5129dc88483953c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69480000020 nid: local remote: 0x7130d520e4602a8c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1787191335.733798:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191335.733800:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191335.733802:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191335.733808:0:2392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787191335.734008:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626513920:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191335.737544:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626513920:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787191335.737761:0:57805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483955f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xaa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4602af5 expref: -99 pid: 57805 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191335.737780:0:57805:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xaa:0x0]: losing layout lock 00010000:00010000:2.0:1787191335.737850:0:57805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483955f lrc: 1/0,0 mode: --/PR res: [0x200000405:0xaa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4602af5 expref: -99 pid: 57805 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191335.737859:0:57805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191335.737862:0:57805:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483955f lrc: 0/0,0 mode: --/PR res: [0x200000405:0xaa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4602af5 expref: -99 pid: 57805 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:2.0:1787191335.737876:0:57805:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1787191335.737883:0:57805:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9180 x1874004626514176/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 472/440 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787191335.737905:0:57805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57805:1874004626514176:192.168.202.101@tcp:36:lfs.0 00000100:00100000:2.0:1787191335.737975:0:57805:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787191335.756190:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191335.757061:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634838016 00000100:00100000:3.0:1787191335.757072:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634838016 00000100:00100000:3.0:1787191335.757215:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1178 00000100:00100000:3.0:1787191335.757227:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634838016:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191335.757248:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc884839589 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4602b81 expref: -99 pid: 57807 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.757334:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191335.757341:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634838016:12345-192.168.202.101@tcp:104: Request processed in 117us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191335.757349:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1178 00000080:00200000:3.0:1787191335.777025:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191335.777045:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191335.777058:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191335.777071:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191335.777089:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191335.777095:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191335.777098:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191335.777104:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:3.0:1787191335.777107:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191335.777115:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191335.777130:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191335.777137:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191335.777143:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191335.777156:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:3.0:1787191335.777166:0:57570:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b49716480, open_flags 8241, mode 81b6 opened 0 00000080:00200000:2.0:1787191335.777173:0:57805:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xaa:0x0] updating i_size 5 i_blocks 8 00000080:00200000:3.0:1787191335.777174:0:57570:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000020:00010000:2.0:1787191335.777178:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51655720 (ffff936b465cc998/0) at cl_lock_release():245 00000020:00010000:2.0:1787191335.777181:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51655720 (ffff936b465cc998/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191335.777186:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7df30 (ffff936b465cc1b8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191335.777189:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51655720 (ffff936b465cc998/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191335.777192:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7df30 (ffff936b465cc998/1) at cl_lock_fini():72 00000002:00010000:3.0:1787191335.777193:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xac:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0101102 00000080:00200000:2.0:1787191335.777207:0:57805:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xaa:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:3.0:1787191335.777242:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848395ac lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.777249:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848395ac lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191335.777259:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191335.777269:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1fb80 x1874004626516224/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191335.777278:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848395ac lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191335.777298:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626516224:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191335.777441:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c840 going to sleep for 11 seconds 00000080:00200000:3.0:1787191335.832709:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xab:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1787191335.832716:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b530e53f8 (ffff936b47a171b8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191335.832719:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b530e53f8 (ffff936b47a171b8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191335.832724:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99630 (ffff936b47a17e18/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191335.832731:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc8848395c8 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4602c0d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.832743:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc8848395c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4602c0d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1787191335.832758:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99670 (ffff936b465cccf8/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191335.832762:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000ed23fdcf/0xe5129dc8848395cf lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4602c14 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.832769:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000ed23fdcf/0xe5129dc8848395cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4602c14 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1787191335.832777:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b530e53f8 (ffff936b47a171b8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191335.832780:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99630 (ffff936b47a171b8/1) at cl_lock_fini():72 00000020:00010000:3.0:1787191335.832784:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99670 (ffff936b47a171b8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191335.832860:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xab:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191335.832884:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xab:0x0](ffff936b5396ec08) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191335.000000000, mtime 1787191335.000000000, ctime 1787191335.000000000, rc 0 00000080:00200008:3.0:1787191335.832968:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xab:0x0], ppos: 0, count: 5 00000080:00200000:3.0:1787191335.832981:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:3.0:1787191335.832987:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:3.0:1787191335.832992:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:3.0:1787191335.832996:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:3.0:1787191335.833001:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@0000000062999b9a[0x110, 1, [0x200000405:0xab:0x0] hash] 00000020:00200000:3.0:1787191335.833003:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:3.0:1787191335.833007:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xab:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:3.0:1787191335.833018:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xab:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:3.0:1787191335.833022:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xab:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191335.833025:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:3.0:1787191335.833030:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1787191335.833036:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:3.0:1787191335.833039:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1787191335.833052:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:3.0:1787191335.833063:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:3.0:1787191335.833577:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b506677b0, osc lock ffff936b44f64d10, flags 0x0 00010000:00010000:3.0:1787191335.833593:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc8848395c8 lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x18c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4602c0d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.833603:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc8848395c8 lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4602c0d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.833610:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc8848395c8 lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4602c0d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.833615:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc8848395c8 lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4602c0d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.833619:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc8848395c8 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4602c0d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191335.833627:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:3.0:1787191335.833687:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:3.0:1787191335.833727:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:3.0:1787191335.833735:0:57570:0:(rw26.c:927:ll_write_end()) page@00000000d5b30f9b[3 0000000083f0256f 2 1 00000000a7c7c335 0 0 0] 00000080:00200000:3.0:1787191335.833738:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @0000000037de44ca 17ffffc0001001 3:0 ffff936b508427e0 0 lru 00000080:00200000:3.0:1787191335.833746:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@000000004ca25fda 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000a2a44f55 00000000e7365a8f > 3< 0 0 > 4< 0 0 8 336732160 - | - - - - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1787191335.833748:0:57570:0:(rw26.c:927:ll_write_end()) end page@00000000d5b30f9b 00000080:00200000:3.0:1787191335.833750:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1787191335.833755:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:3.0:1787191335.833773:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 00000000b331cccb ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc8848395c8 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4602c0d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191335.833788:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b5396edb8, count 1, dirtied 1 00000080:00200000:3.0:1787191335.833792:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:3.0:1787191335.833794:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:3.0:1787191335.833807:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b42ff6218 (ffff936b465cc878/0) at cl_lock_release():245 00000020:00010000:3.0:1787191335.833810:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42ff6218 (ffff936b465cc878/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191335.833811:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b506677b0 (ffff936b465ccf38/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191335.833815:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc8848395c8 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4602c0d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.833824:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc8848395c8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4602c0d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:3.0:1787191335.833870:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42ff6218 (ffff936b465cc878/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191335.833874:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b506677b0 (ffff936b465cc878/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191335.833880:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:3.0:1787191335.833883:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1787191335.833888:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xab:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191335.833890:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:3.0:1787191335.833895:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xab:0x0] updating i_size 5 i_blocks 0 00000080:00200000:3.0:1787191335.833898:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:3.0:1787191335.833914:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xab:0x0](ffff936b5396ec08), flags 100001 00000002:00100000:3.0:1787191335.833958:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1fb80 x1874004626516224/t8589936472(8589936472) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191351 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191335.833965:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191335.833969:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1ed80 x1874004626518016/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191335.833983:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ed80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626518016:192.168.202.101@tcp:35:bash.0 00000100:00100000:3.0:1787191335.834239:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c840 going to sleep for 11 seconds 00000100:00100000:3.0:1787191335.837306:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ed80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626518016:192.168.202.101@tcp:35:bash.0 00000002:00100000:3.0:1787191335.837340:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1fb80 x1874004626516224/t8589936472(8589936472) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191351 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00010000:3.0:1787191335.839424:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b42ff65d8 (ffff936b465cce18/0) at cl_lock_release():245 00000020:00010000:3.0:1787191335.839429:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42ff65d8 (ffff936b465cce18/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191335.839436:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7d0b0 (ffff936b465cc6c8/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191335.839447:0:57805:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc8848395a5 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4602bb9 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191335.839465:0:57805:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc8848395a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4602bb9 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00010000:3.0:1787191335.839481:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42ff65d8 (ffff936b465cce18/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191335.839484:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7d0b0 (ffff936b465cce18/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191335.839525:0:57805:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xaa:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191335.839547:0:57805:0:(file.c:5244:ll_file_seek()) COMPLETED file f70.sanity-flr:[0x200000405:0xaa:0x0], offset: 0, type: SEEK_HOLE, rc = 5 00000080:00200080:3.0:1787191335.839562:0:57805:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xaa:0x0](ffff936b5395b248) cmd=400866b1 arg=0 00000080:00200080:3.0:1787191335.839572:0:57805:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xaa:0x0](ffff936b5395b248) cmd=400866b1 arg=1 00000080:00200008:3.0:1787191335.839578:0:57805:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xaa:0x0](ffff936b5395b248), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191335.839585:0:57805:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xaa:0x0](ffff936b5395b248),name=f70.sanity-flr 00000002:00010000:3.0:1787191335.839603:0:57805:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xaa:0x0]) in obj [0x200000405:0xaa:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191335.839616:0:57805:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1a00/0xe5129dc88483959e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xaa:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602bb2 expref: -99 pid: 57805 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191335.839638:0:57805:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1a00/0xe5129dc88483959e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xaa:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602bb2 expref: -99 pid: 57805 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191335.839749:0:57805:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xaa:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191335.839758:0:57805:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xaa:0x0](ffff936b5395b248) 00000080:00010000:3.0:1787191335.839762:0:57805:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xaa:0x0](ffff936b5395b248) for lock 0xe5129dc88483959e 00000080:00010000:3.0:1787191335.839768:0:57805:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483959e from it ffffa3fb420b3cd8 00010000:00010000:3.0:1787191335.839771:0:57805:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1a00/0xe5129dc88483959e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xaa:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4602bb2 expref: -99 pid: 57805 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191335.839779:0:57805:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1a00/0xe5129dc88483959e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xaa:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602bb2 expref: -99 pid: 57805 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787191335.839802:0:57805:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xaa:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:3.0:1787191335.839813:0:57805:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xaa:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191335.839815:0:57805:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191335.839819:0:57805:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xaa:0x0] 00000008:00010000:3.0:1787191335.839855:0:57805:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191335.839858:0:57805:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b506677b0, osc lock ffff936b44f64d10, flags 0x400000400001002 00010000:00010000:3.0:1787191335.839873:0:57805:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc8848395a5 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x18d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4602bb9 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191335.839883:0:57805:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc8848395a5 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4602bb9 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:3.0:1787191335.839899:0:57805:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191335.839903:0:57805:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc8848395a5 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4602bb9 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191335.839910:0:57805:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc8848395a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4602bb9 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000020:00200000:3.0:1787191335.839920:0:57805:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191335.839930:0:57805:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xaa:0x0] updating i_size 5 i_blocks 8 00000020:00010000:3.0:1787191335.839933:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51654b90 (ffff936b465cc878/0) at cl_lock_release():245 00000020:00010000:3.0:1787191335.839935:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51654b90 (ffff936b465cc878/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191335.839937:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b506677b0 (ffff936b465ccf38/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191335.839940:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51654b90 (ffff936b465cc878/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191335.839942:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b506677b0 (ffff936b465cc878/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191335.839950:0:57805:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xaa:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191335.839969:0:57805:0:(file.c:2483:do_file_read_iter()) START file f70.sanity-flr:[0x200000405:0xaa:0x0], ppos: 0, count: 4096 00000080:00200000:3.0:1787191335.839977:0:57805:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: read ppos: 0, bytes: 4096 00000080:00200000:3.0:1787191335.839984:0:57805:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000020:00200000:3.0:1787191335.839990:0:57805:0:(cl_io.c:214:cl_io_rw_init()) header@00000000941dcc66[0x110, 2, [0x200000405:0xaa:0x0] hash] 00000020:00200000:3.0:1787191335.839992:0:57805:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 4096) 2048 0 00000080:00200000:3.0:1787191335.839995:0:57805:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xaa:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00000080:00200000:3.0:1787191335.840003:0:57805:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1787191335.840009:0:57805:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:3.0:1787191335.840013:0:57805:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1787191335.840025:0:57805:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:3.0:1787191335.840032:0:57805:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:3.0:1787191335.840035:0:57805:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b506677b0, osc lock ffff936b44f64d10, flags 0x40000 00000080:00200000:3.0:1787191335.840040:0:57805:0:(vvp_io.c:835:vvp_io_read_start()) f70.sanity-flr: read [0, 4096) 00000001:00010000:3.0:1787191335.840046:0:57805:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xaa:0x0] 00000008:00010000:3.0:1787191335.840050:0:57805:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191335.840052:0:57805:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667eb0, osc lock ffff936b44f64130, flags 0x400001002 00010000:00010000:3.0:1787191335.840060:0:57805:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc8848395a5 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x18d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4602bb9 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1787191335.840281:0:57805:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc8848395a5 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4602bb9 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000020:00200000:3.0:1787191335.840290:0:57805:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191335.840293:0:57805:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc8848395a5 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4602bb9 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1787191335.840302:0:57805:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc8848395a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4602bb9 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 1 00000020:00200000:3.0:1787191335.840312:0:57805:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191335.840317:0:57805:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xaa:0x0] updating i_size 5 i_blocks 8 00000020:00010000:3.0:1787191335.840320:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51654b90 (ffff936b465cc878/0) at cl_lock_release():245 00000020:00010000:3.0:1787191335.840322:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51654b90 (ffff936b465cc878/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191335.840325:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667eb0 (ffff936b465ccf38/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191335.840328:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51654b90 (ffff936b465cc878/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191335.840330:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667eb0 (ffff936b465cc878/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191335.840336:0:57805:0:(vvp_io.c:893:vvp_io_read_start()) count:4096 iocb pos:0 00000080:00200000:3.0:1787191335.840341:0:57805:0:(rw26.c:362:ll_direct_IO()) VFS Op:inode=[0x200000405:0xaa:0x0](ffff936b5395b248), size=4096 (max 536870912), offset=0=0x0, pages 1 (max 131072), lockless, parallel 00000020:00200000:3.0:1787191335.840390:0:57805:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:3.0:1787191335.840393:0:57805:0:(rw26.c:544:ll_direct_IO()) result 0 tot_bytes 5 count 5 file_offset 5 00000020:00010000:3.0:1787191335.840399:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b42ff6218 (ffff936b465cc878/0) at cl_lock_release():245 00000020:00010000:3.0:1787191335.840401:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42ff6218 (ffff936b465cc878/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191335.840404:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b506677b0 (ffff936b465ccf38/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191335.840407:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42ff6218 (ffff936b465cc878/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191335.840409:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b506677b0 (ffff936b465cc878/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191335.840414:0:57805:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000020:00200000:3.0:1787191335.840418:0:57805:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:3.0:1787191335.840436:0:27559:0:(osc_cache.c:2029:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff936b5124bcc0 00000008:00100000:3.0:1787191335.840473:0:27559:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff936b51d1ed80 - object 0x2c0000401:397 offset 0<>5 00000100:00100000:3.0:1787191335.840514:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626518144:192.168.202.101@tcp:3:lfs.0 00000080:00200000:2.0:1787191335.841095:0:57808:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191335.841114:0:57808:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191335.841124:0:57808:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191335.841134:0:57808:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191335.841141:0:57808:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191335.841146:0:57808:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191335.841149:0:57808:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191335.841154:0:57808:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb420dbb58 00010000:00010000:2.0:1787191335.841157:0:57808:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191335.841170:0:57808:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191335.841181:0:57808:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191335.841188:0:57808:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191335.841194:0:57808:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191335.841203:0:57808:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:2.0:1787191335.841207:0:57808:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191335.841219:0:57808:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191335.841255:0:57808:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848395d6 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.841263:0:57808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848395d6 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.841272:0:57808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848395d6 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191335.841288:0:57808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57808:1874004626518272:192.168.202.101@tcp:101:rm.0 00000100:00100000:2.0:1787191335.841322:0:57808:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359000 going to sleep for 11 seconds 00000008:00010000:3.0:1787191335.845056:0:2392:0:(osc_cache.c:917:osc_extent_finish()) ### no dlm lock: extent: ffff936b5124bcc0 00000020:00200000:3.0:1787191335.845086:0:2392:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1787191335.845096:0:2392:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1787191335.845178:0:2392:0:(osc_cache.c:497:__osc_extent_remove()) ### no dlm lock: extent: ffff936b5124bcc0 00000100:00100000:3.0:1787191335.845207:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626518144:192.168.202.101@tcp:3:lfs.0 00000100:00100000:3.0:1787191335.846530:0:57808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57808:1874004626518272:192.168.202.101@tcp:101:rm.0 00010000:00010000:3.0:1787191335.846547:0:57808:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848395d6 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602c37 expref: -99 pid: 57808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.846604:0:57808:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848395d6 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602c37 expref: -99 pid: 57808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.846613:0:57808:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848395d6 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602c37 expref: -99 pid: 57808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.846624:0:57808:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848395d6 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602c37 expref: -99 pid: 57808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.846635:0:57808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848395d6 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602c37 expref: -99 pid: 57808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.846647:0:57808:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848395d6 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602c37 expref: -99 pid: 57808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.846655:0:57808:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848395d6 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602c37 expref: -99 pid: 57808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.846662:0:57808:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848395d6 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602c37 expref: -99 pid: 57808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191335.846685:0:57808:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b513b9c00 x1874004626518272/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/976 e 0 to 0 dl 1787191351 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191335.846697:0:57808:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848395d6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602c37 expref: -99 pid: 57808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191335.846710:0:57808:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848395d6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602c37 expref: -99 pid: 57808 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.846719:0:57808:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/171 (0 0) 00000080:00200000:3.0:1787191335.846724:0:57808:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191335.846767:0:57808:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xab:0x0](ffff936b5396ec08): rc = 0 00000080:00200000:3.0:1787191335.846782:0:57808:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xab:0x0]: layout version change: 4 -> 4 00000080:00010000:3.0:1787191335.846788:0:57808:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xab:0x0](ffff936b5396ec08) for lock 0xe5129dc8848395d6 00000080:00010000:3.0:1787191335.846797:0:57808:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xab:0x0](ffff936b5396ec08) 00000080:00010000:3.0:1787191335.846800:0:57808:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848395d6 from it ffffa3fb420dbb20 00010000:00010000:3.0:1787191335.846803:0:57808:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848395d6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4602c37 expref: -99 pid: 57808 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191335.846816:0:57808:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848395d6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602c37 expref: -99 pid: 57808 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200008:3.0:1787191335.846958:0:57808:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xab:0x0](ffff936b5396ec08), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191335.846964:0:57808:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xab:0x0](ffff936b5396ec08),name=f70.sanity-flr 00000002:00010000:3.0:1787191335.846981:0:57808:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xab:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191335.846988:0:57808:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848395d6 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602c37 expref: -99 pid: 57808 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.846996:0:57808:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848395d6 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602c37 expref: -99 pid: 57808 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191335.847002:0:57808:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191335.847006:0:57808:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xab:0x0](ffff936b5396ec08) 00000080:00010000:3.0:1787191335.847009:0:57808:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xab:0x0](ffff936b5396ec08) for lock 0xe5129dc8848395d6 00000080:00010000:3.0:1787191335.847013:0:57808:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848395d6 from it ffffa3fb420dbcb8 00010000:00010000:3.0:1787191335.847016:0:57808:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848395d6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4602c37 expref: -99 pid: 57808 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.847028:0:57808:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848395d6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602c37 expref: -99 pid: 57808 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191335.847044:0:57808:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xab:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00020000:00200000:3.0:1787191335.847051:0:57808:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xab:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191335.847054:0:57808:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191335.847057:0:57808:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xab:0x0] 00000008:00010000:3.0:1787191335.847087:0:57808:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191335.847090:0:57808:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b506677b0, osc lock ffff936b44f64d10, flags 0x400000400001002 00010000:00010000:3.0:1787191335.847102:0:57808:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc8848395c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4602c0d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191335.847111:0:57808:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc8848395c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4602c0d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:3.0:1787191335.847120:0:57808:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191335.847123:0:57808:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc8848395c8 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4602c0d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191335.847130:0:57808:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc8848395c8 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4602c0d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:3.0:1787191335.847139:0:57808:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191335.847144:0:57808:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xab:0x0] updating i_size 5 i_blocks 0 00000020:00010000:3.0:1787191335.847149:0:57808:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c3a060 (ffff936b47a17ab8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191335.847152:0:57808:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c3a060 (ffff936b47a17ab8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191335.847154:0:57808:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b506677b0 (ffff936b43ab8cf8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191335.847158:0:57808:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c3a060 (ffff936b47a17ab8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191335.847160:0:57808:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b506677b0 (ffff936b47a17ab8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191335.847169:0:57808:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xab:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191335.847210:0:57808:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191335.847219:0:57808:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191335.847226:0:57808:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191335.847238:0:57808:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191335.847244:0:57808:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191335.847248:0:57808:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191335.847251:0:57808:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191335.847254:0:57808:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb420dbc10 00010000:00010000:3.0:1787191335.847257:0:57808:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191335.847367:0:57808:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191335.847377:0:57808:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191335.847383:0:57808:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:3.0:1787191335.847388:0:57808:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191335.847393:0:57808:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:3.0:1787191335.847396:0:57808:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:3.0:1787191335.847402:0:57808:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:3.0:1787191335.847424:0:57808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc8848395c1 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xab:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4602c06 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787191335.847436:0:57808:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xab:0x0]: losing layout lock 00010000:00010000:3.0:1787191335.847447:0:57808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848395d6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4602c37 expref: -99 pid: 57808 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191335.847456:0:57808:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xab:0x0]: losing layout lock 00010000:00010000:3.0:1787191335.847463:0:57808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae000/0xe5129dc8848395b3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xab:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4602bea expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.847499:0:57808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc8848395c1 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xab:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4602c06 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191335.847506:0:57808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848395d6 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4602c37 expref: -99 pid: 57808 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191335.847512:0:57808:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae000/0xe5129dc8848395b3 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xab:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4602bea expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.847517:0:57808:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:3.0:1787191335.847520:0:57808:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc8848395c1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xab:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4602c06 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191335.847533:0:57808:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848395d6 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4602c37 expref: -99 pid: 57808 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191335.847541:0:57808:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae000/0xe5129dc8848395b3 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xab:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4602bea expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:3.0:1787191335.847560:0:57808:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1787191335.847574:0:57808:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1ed80 x1874004626518528/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191335.847599:0:57808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ed80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57808:1874004626518528:192.168.202.101@tcp:36:rm.0 00000100:00100000:3.0:1787191335.847727:0:57808:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c840 going to sleep for 11 seconds 00000100:00100000:3.0:1787191335.851525:0:57808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ed80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57808:1874004626518528:192.168.202.101@tcp:36:rm.0 00000080:00200000:3.0:1787191335.851591:0:57808:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xab:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00020000:00200000:3.0:1787191335.851605:0:57808:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xab:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191335.851608:0:57808:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191335.851615:0:57808:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191335.851626:0:57808:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000008:00010000:3.0:1787191335.851645:0:57808:0:(osc_cache.c:1183:osc_extent_make_ready()) ### extent: 00000000b331cccb ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc8848395c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4602c0d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1787191335.851690:0:57808:0:(osc_cache.c:917:osc_extent_finish()) ### extent: 00000000b331cccb ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc8848395c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4602c0d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1787191335.851713:0:57808:0:(osc_cache.c:497:__osc_extent_remove()) ### extent: 00000000b331cccb ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc8848395c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4602c0d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787191335.851738:0:57808:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xab:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191335.851787:0:57808:0:(llite_lib.c:2066:ll_clear_inode()) VFS Op:inode=[0x200000405:0xab:0x0](ffff936b5396ec08) 00000008:00010000:3.0:1787191335.851818:0:57808:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 5 blocks 0 [cma]time 1787191335 1787191335 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc8848395c8 lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x18c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4602c0d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1787191335.851881:0:57808:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191335 1787191335 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000ed23fdcf/0xe5129dc8848395cf lrc: 1/0,0 mode: PW/PW res: [0x2c0000401:0x18f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4602c14 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1787191335.863632:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191335.865997:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634839168 00000100:00100000:3.0:1787191335.866010:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634839168 00000100:00100000:3.0:1787191335.866142:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1179 00000100:00100000:3.0:1787191335.866254:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:25388:x1874004634839168:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191335.866268:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839504 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46029dd expref: -99 pid: 57804 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.866371:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191335.866378:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:25388:x1874004634839168:12345-192.168.202.101@tcp:104: Request processed in 225us (2753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191335.866385:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1179 00000080:00200000:2.0:1787191335.880879:0:57805:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1787191335.880893:0:57805:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xaa:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191335.880897:0:57805:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:2.0:1787191335.880907:0:57805:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xaa:0x0] updating i_size 5 i_blocks 8 00000020:00200000:2.0:1787191335.880910:0:57805:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191335.880917:0:57805:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200080:2.0:1787191335.880934:0:57805:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xaa:0x0](ffff936b5395b248) cmd=400866b1 arg=0 00000080:00200080:2.0:1787191335.880942:0:57805:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xaa:0x0](ffff936b5395b248) cmd=400866b1 arg=1 00000080:00200008:2.0:1787191335.880950:0:57805:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xaa:0x0](ffff936b5395b248), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191335.880954:0:57805:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xaa:0x0](ffff936b5395b248),name=f70.sanity-flr 00000002:00010000:2.0:1787191335.880962:0:57805:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xaa:0x0]) in obj [0x200000405:0xaa:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191335.880971:0:57805:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1a00/0xe5129dc88483959e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xaa:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602bb2 expref: -99 pid: 57805 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191335.880980:0:57805:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1a00/0xe5129dc88483959e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xaa:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602bb2 expref: -99 pid: 57805 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:2.0:1787191335.880986:0:57805:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xaa:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191335.880991:0:57805:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xaa:0x0](ffff936b5395b248) 00000080:00010000:2.0:1787191335.880994:0:57805:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xaa:0x0](ffff936b5395b248) for lock 0xe5129dc88483959e 00000080:00010000:2.0:1787191335.880997:0:57805:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483959e from it ffffa3fb420b3cd8 00010000:00010000:2.0:1787191335.881000:0:57805:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1a00/0xe5129dc88483959e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xaa:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4602bb2 expref: -99 pid: 57805 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191335.881008:0:57805:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1a00/0xe5129dc88483959e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xaa:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602bb2 expref: -99 pid: 57805 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00000080:00200000:2.0:1787191335.881025:0:57805:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xaa:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:2.0:1787191335.881036:0:57805:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xaa:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191335.881039:0:57805:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191335.881043:0:57805:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xaa:0x0] 00000008:00010000:2.0:1787191335.881064:0:57805:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191335.881068:0:57805:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1330, osc lock ffff936b44e62390, flags 0x400000400001002 00010000:00010000:2.0:1787191335.881094:0:57805:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc8848395a5 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x18d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4602bb9 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 1 00010000:00010000:2.0:1787191335.881111:0:57805:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc8848395a5 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4602bb9 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 1 00000020:00200000:2.0:1787191335.881121:0:57805:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191335.881125:0:57805:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc8848395a5 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4602bb9 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 1 00010000:00010000:2.0:1787191335.881134:0:57805:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc8848395a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4602bb9 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00000020:00200000:2.0:1787191335.881143:0:57805:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191335.881148:0:57805:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xaa:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191335.881152:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51654b90 (ffff936b465cc878/0) at cl_lock_release():245 00000020:00010000:2.0:1787191335.881155:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51654b90 (ffff936b465cc878/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191335.881168:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1330 (ffff936b465ccf38/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191335.881173:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51654b90 (ffff936b465cc878/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191335.881176:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1330 (ffff936b465cc878/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191335.881184:0:57805:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xaa:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191335.881196:0:57805:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xaa:0x0], offset: 5, type: SEEK_DATA 00000080:00200000:2.0:1787191335.881201:0:57805:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xaa:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:2.0:1787191335.881205:0:57805:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xaa:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191335.881208:0:57805:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191335.881213:0:57805:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191335.881218:0:57805:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191335.881233:0:57805:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xaa:0x0] updating i_size 5 i_blocks 8 00000080:00200000:2.0:1787191335.881241:0:57805:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xaa:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191335.881247:0:57805:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000080:00200000:2.0:1787191335.881249:0:57805:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xaa:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191335.881253:0:57805:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191335.881256:0:57805:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191335.881258:0:57805:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:2.0:1787191335.881265:0:57805:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:2.0:1787191335.881267:0:57805:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1330, osc lock ffff936b44e62390, flags 0x0 00010000:00010000:2.0:1787191335.881275:0:57805:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc8848395a5 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x18d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4602bb9 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:2.0:1787191335.881284:0:57805:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc8848395a5 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4602bb9 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:2.0:1787191335.881292:0:57805:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc8848395a5 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4602bb9 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:2.0:1787191335.881299:0:57805:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc8848395a5 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4602bb9 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:2.0:1787191335.881306:0:57805:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc8848395a5 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4602bb9 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00000080:00200000:2.0:1787191335.881315:0:57805:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xaa:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191335.881320:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b42ff6218 (ffff936b465cc878/0) at cl_lock_release():245 00000020:00010000:2.0:1787191335.881322:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42ff6218 (ffff936b465cc878/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191335.881325:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1330 (ffff936b465ccf38/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191335.881328:0:57805:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc8848395a5 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4602bb9 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:2.0:1787191335.881341:0:57805:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc8848395a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4602bb9 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00000020:00010000:2.0:1787191335.881349:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42ff6218 (ffff936b465cc878/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191335.881351:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1330 (ffff936b465cc878/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191335.881357:0:57805:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xaa:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191335.881363:0:57805:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xaa:0x0], offset: 0, type: (null) 00000080:00200000:2.0:1787191335.881366:0:57805:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xaa:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:2.0:1787191335.881370:0:57805:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xaa:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191335.881372:0:57805:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191335.881374:0:57805:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xaa:0x0] 00000008:00010000:2.0:1787191335.881379:0:57805:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191335.881381:0:57805:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1330, osc lock ffff936b44e62390, flags 0x400000400001002 00010000:00010000:2.0:1787191335.881389:0:57805:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc8848395a5 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x18d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4602bb9 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00010000:00010000:2.0:1787191335.881491:0:57805:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc8848395a5 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4602bb9 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00000020:00200000:2.0:1787191335.881500:0:57805:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191335.881503:0:57805:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc8848395a5 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4602bb9 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00010000:00010000:2.0:1787191335.881511:0:57805:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc8848395a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4602bb9 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00000020:00200000:2.0:1787191335.881526:0:57805:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191335.881531:0:57805:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xaa:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191335.881534:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51654b90 (ffff936b465cc878/0) at cl_lock_release():245 00000020:00010000:2.0:1787191335.881536:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51654b90 (ffff936b465cc878/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191335.881539:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1330 (ffff936b465ccf38/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191335.881542:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51654b90 (ffff936b465cc878/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191335.881544:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1330 (ffff936b465cc878/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191335.881550:0:57805:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xaa:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191335.881558:0:57805:0:(file.c:5244:ll_file_seek()) COMPLETED file f70.sanity-flr:[0x200000405:0xaa:0x0], offset: 0, type: (null), rc = 5 00000080:00200080:2.0:1787191335.881564:0:57805:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xaa:0x0](ffff936b5395b248) cmd=400866b1 arg=0 00000100:00100000:3.0:1787191335.897507:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191335.897549:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634839296 00000100:00100000:3.0:1787191335.897559:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634839296 00000100:00100000:3.0:1787191335.897610:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1180 00000100:00100000:3.0:1787191335.897619:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634839296:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191335.897637:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0800/0xe5129dc884839600 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4602cd1 expref: -99 pid: 57809 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191335.897720:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191335.897726:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634839296:12345-192.168.202.101@tcp:104: Request processed in 108us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191335.897733:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1180 00000080:00200080:2.0:1787191335.898636:0:57805:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xaa:0x0](ffff936b5395b248) cmd=400866b1 arg=2 00000080:00200008:2.0:1787191335.898650:0:57805:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xaa:0x0](ffff936b5395b248), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191335.898658:0:57805:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xaa:0x0](ffff936b5395b248),name=f70.sanity-flr 00000002:00010000:2.0:1787191335.900737:0:57805:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xaa:0x0]) in obj [0x200000405:0xaa:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191335.900768:0:57805:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1a00/0xe5129dc88483959e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xaa:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602bb2 expref: -99 pid: 57805 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00010000:00010000:2.0:1787191335.900792:0:57805:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1a00/0xe5129dc88483959e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xaa:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602bb2 expref: -99 pid: 57805 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00000080:00200000:2.0:1787191335.900801:0:57805:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xaa:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191335.900813:0:57805:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xaa:0x0](ffff936b5395b248) 00000080:00010000:2.0:1787191335.900816:0:57805:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xaa:0x0](ffff936b5395b248) for lock 0xe5129dc88483959e 00000080:00010000:2.0:1787191335.900824:0:57805:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483959e from it ffffa3fb420b3cd8 00010000:00010000:2.0:1787191335.900828:0:57805:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1a00/0xe5129dc88483959e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xaa:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4602bb2 expref: -99 pid: 57805 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00010000:00010000:2.0:1787191335.900852:0:57805:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1a00/0xe5129dc88483959e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xaa:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602bb2 expref: -99 pid: 57805 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00000080:00200000:2.0:1787191335.900884:0:57805:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xaa:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:2.0:1787191335.900897:0:57805:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xaa:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191335.900900:0:57805:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191335.900904:0:57805:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xaa:0x0] 00000008:00010000:2.0:1787191335.900927:0:57805:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191335.900932:0:57805:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1330, osc lock ffff936b44e62390, flags 0x400000400001002 00010000:00010000:2.0:1787191335.900950:0:57805:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc8848395a5 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x18d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4602bb9 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00010000:00010000:2.0:1787191335.900961:0:57805:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc8848395a5 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4602bb9 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00000020:00200000:2.0:1787191335.900974:0:57805:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191335.900977:0:57805:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc8848395a5 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4602bb9 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00010000:00010000:2.0:1787191335.900985:0:57805:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc8848395a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4602bb9 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00000020:00200000:2.0:1787191335.900994:0:57805:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191335.901003:0:57805:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xaa:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191335.901007:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51654b90 (ffff936b465cc878/0) at cl_lock_release():245 00000020:00010000:2.0:1787191335.901010:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51654b90 (ffff936b465cc878/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191335.901013:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1330 (ffff936b465ccf38/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191335.901017:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51654b90 (ffff936b465cc878/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191335.901020:0:57805:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1330 (ffff936b465cc878/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191335.901033:0:57805:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xaa:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191335.901068:0:57805:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xaa:0x0](ffff936b5395b248) current size 5, valid attrs 2068, mode 0, uid -1322410190, gid -1, new size 5, atime 1787191335.000000000, mtime 1787191335.000000000, ctime 1787191335.000000000 00010000:00010000:2.0:1787191335.901107:0:57805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1a00/0xe5129dc88483959e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xaa:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4602bb2 expref: -99 pid: 57805 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00010000:00010000:2.0:1787191335.901131:0:57805:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf800/0xe5129dc884839597 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xaa:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602b9d expref: -99 pid: 57805 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191335.901189:0:57805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1a00/0xe5129dc88483959e lrc: 1/0,0 mode: --/PR res: [0x200000405:0xaa:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4602bb2 expref: -99 pid: 57805 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00010000:00010000:2.0:1787191335.901203:0:57805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191335.901206:0:57805:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1a00/0xe5129dc88483959e lrc: 0/0,0 mode: --/PR res: [0x200000405:0xaa:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4602bb2 expref: -99 pid: 57805 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00000020:00100000:2.0:1787191335.901234:0:57805:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 36, max 7 00000100:00100000:2.0:1787191335.901246:0:57805:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513ba680 x1874004626520320/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787191335.901282:0:57805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57805:1874004626520320:192.168.202.101@tcp:36:lfs.0 00000100:00100000:2.0:1787191335.901359:0:57805:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359300 going to sleep for 11 seconds 00000100:00100000:2.0:1787191335.906325:0:57805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57805:1874004626520320:192.168.202.101@tcp:36:lfs.0 00000080:00200000:2.0:1787191335.906365:0:57805:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 2 00000080:00200000:2.0:1787191335.906372:0:57805:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xaa:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:2.0:1787191335.906392:0:57805:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x11 00000080:00200000:2.0:1787191335.906413:0:57805:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:2.0:1787191335.906429:0:57805:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1787191335.906433:0:57805:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b52359330, osc lock ffff936b44e62390, flags 0x0 00000008:00010000:2.0:1787191335.906436:0:57805:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1787191335.906438:0:57805:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b52359370, osc lock ffff936b44e62260, flags 0x0 00010000:00010000:2.0:1787191335.906497:0:57805:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a1aca85d/0xe5129dc88483960e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.906511:0:57805:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a1aca85d/0xe5129dc88483960e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.906521:0:57805:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a1aca85d/0xe5129dc88483960e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191335.906541:0:57805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57805:1874004626520704:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191335.906608:0:57805:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359000 going to sleep for 11 seconds 00000100:00100000:2.0:1787191335.910354:0:57805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57805:1874004626520704:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191335.910382:0:57805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a1aca85d/0xe5129dc88483960e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602cfb expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.910405:0:57805:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a1aca85d/0xe5129dc88483960e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602cfb expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.910419:0:57805:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a1aca85d/0xe5129dc88483960e lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602cfb expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1787191335.910430:0:57805:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 4096, setting rss=4096; kms=4096, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a1aca85d/0xe5129dc88483960e lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4602cfb expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.910443:0:57805:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a1aca85d/0xe5129dc88483960e lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4602cfb expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.910449:0:57805:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a1aca85d/0xe5129dc88483960e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4602cfb expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.910475:0:57805:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b52373000 type 11 mode 2 res 11811161089/398 (0 18446744073709551615) 00010000:00010000:2.0:1787191335.910510:0:57805:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884839615 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.910519:0:57805:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884839615 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.910529:0:57805:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884839615 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191335.910547:0:57805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57805:1874004626521088:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191335.910648:0:57805:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359000 going to sleep for 11 seconds 00000100:00100000:3.0:1787191335.918348:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191335.918464:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634839552 00000100:00100000:2.0:1787191335.918475:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634839552 00000100:00100000:2.0:1787191335.918527:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1181 00000100:00100000:2.0:1787191335.918537:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:37089:x1874004634839552:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191335.918555:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc88483950b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x18e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46029e4 expref: -99 pid: 57804 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191335.918636:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191335.918643:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:37089:x1874004634839552:12345-192.168.202.101@tcp:104: Request processed in 108us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191335.918657:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1181 00000100:00100000:3.0:1787191335.924492:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191335.924596:0:51131:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787191335.924615:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634839680 00000100:00100000:2.0:1787191335.924624:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634839680 00000100:00100000:2.0:1787191335.924686:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1182 00000100:00100000:2.0:1787191335.924695:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b50881050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:37090:x1874004634839680:12345-192.168.202.101@tcp:105: 00010000:00010000:2.0:1787191335.924712:0:51131:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884839615 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602d02 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.924726:0:51131:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884839615 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602d02 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.924736:0:51131:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884839615 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602d02 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.924746:0:51131:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884839615 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10080000000000 nid: local remote: 0x7130d520e4602d02 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.924755:0:51131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884839615 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10080000000000 nid: local remote: 0x7130d520e4602d02 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.924765:0:51131:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884839615 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x80000000000 nid: local remote: 0x7130d520e4602d02 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.924782:0:51131:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b51dd5c00) 00000100:00100000:2.0:1787191335.924849:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b50881050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:37090:x1874004634839680:12345-192.168.202.101@tcp:105: Request processed in 137us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191335.924858:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1182 00000100:00100000:2.0:1787191335.925984:0:57805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57805:1874004626521088:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191335.926005:0:57805:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884839615 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e4602d02 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.926021:0:57805:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884839615 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000020000 nid: local remote: 0x7130d520e4602d02 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1787191335.926034:0:57805:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884839615 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000020000 nid: local remote: 0x7130d520e4602d02 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.926046:0:57805:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884839615 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4602d02 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.926053:0:57805:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884839615 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4602d02 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191335.926308:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626521600:192.168.202.101@tcp:10:lfs.0 00000100:00100000:3.0:1787191335.926389:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787191335.926396:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626521728:192.168.202.101@tcp:10:lfs.0 00000100:00100000:2.0:1787191335.932355:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626521728:192.168.202.101@tcp:10:lfs.0 00000100:00100000:2.0:1787191335.932387:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626521600:192.168.202.101@tcp:10:lfs.0 00000100:00100000:3.0:1787191335.951492:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191335.951522:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634839808 00000100:00100000:3.0:1787191335.951528:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634839808 00000100:00100000:3.0:1787191335.951562:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1183 00000100:00100000:3.0:1787191335.951568:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6508:x1874004634839808:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191335.951578:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf800/0xe5129dc884839597 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xaa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4602b9d expref: -99 pid: 57805 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191335.951625:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191335.951631:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6508:x1874004634839808:12345-192.168.202.101@tcp:104: Request processed in 62us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191335.951635:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1183 00000100:00100000:2.0:1787191335.960669:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191335.960753:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191335.961858:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634840960 00000100:00100000:3.0:1787191335.961869:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634840960 00000100:00100000:3.0:1787191335.961954:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634841216 00000100:00100000:3.0:1787191335.961958:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634841216 00000100:00100000:3.0:1787191335.961981:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1184 00000100:00100000:3.0:1787191335.961991:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8422:x1874004634840960:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191335.962010:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc8848395c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4602c0d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191335.962457:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191335.962466:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8422:x1874004634840960:12345-192.168.202.101@tcp:104: Request processed in 476us (1807us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191335.962473:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1184 00000100:00100000:3.0:1787191335.962493:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1185 00000100:00100000:3.0:1787191335.962500:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30353:x1874004634841216:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191335.962510:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000ed23fdcf/0xe5129dc8848395cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4602c14 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:2.0:1787191335.963280:0:57570:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589936487 gen 1 00000100:00100000:2.0:1787191335.963350:0:57570:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b6a475500 x1874004626521344/t8589936483(8589936483) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191351 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787191335.963370:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626523136:192.168.202.101@tcp:101:bash.0 00010000:00010000:2.0:1787191335.963385:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839631 lrc: 4/0,1 mode: --/EX res: [0x200000405:0xad:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602d5d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.963407:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839631 lrc: 4/0,1 mode: --/CR res: [0x200000405:0xad:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602d5d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.963419:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839631 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xad:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602d5d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.963430:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839631 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xad:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602d5d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.963442:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839631 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xad:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602d5d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.963451:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839631 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xad:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602d5d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.963458:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839631 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xad:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602d5d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191335.963478:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b453aa300 x1874004626523136/t8589936487(8589936487) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191351 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191335.963495:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839631 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xad:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602d5d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191335.963506:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839631 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xad:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602d5d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.963516:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/173 (0 0) 00000080:00200000:2.0:1787191335.963522:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xad:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1787191335.963534:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xad:0x0](ffff936b539580c8) for lock 0xe5129dc884839631 00000080:00010000:2.0:1787191335.963543:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839631 from it ffffa3fb41cab930 00010000:00010000:2.0:1787191335.963546:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839631 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xad:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602d5d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.963554:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839631 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xad:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602d5d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191335.963570:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:2.0:1787191335.963576:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xad:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:2.0:1787191335.963591:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839631 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xad:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602d5d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191335.963600:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839631 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xad:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602d5d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:2.0:1787191335.963612:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xad:0x0](000000006e2576ea) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839631 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xad:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602d5d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191335.963649:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839631 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xad:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602d5d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191335.963656:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839631 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xad:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602d5d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191335.963669:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xad:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00020000:00200000:2.0:1787191335.963678:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xad:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191335.963682:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191335.963687:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:2.0:1787191335.963719:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xad:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:2.0:1787191335.963732:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839631 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xad:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602d5d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191335.963740:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839631 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xad:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602d5d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:2.0:1787191335.963748:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xad:0x0](000000006e2576ea) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839631 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xad:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602d5d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191335.963766:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xad:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191335.963770:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xad:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191335.963772:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191335.963775:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:2.0:1787191335.963786:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xad:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191335.963877:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xad:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:2.0:1787191335.963882:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839631 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xad:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4602d5d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191335.963889:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839631 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xad:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602d5d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00020000:00200000:2.0:1787191335.963900:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xad:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:2.0:1787191335.963903:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xad:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191335.963905:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191335.963910:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191335.963919:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191335.963923:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:2.0:1787191335.963935:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:2.0:1787191335.963939:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b52359030, osc lock ffff936b44e638f0, flags 0x80000000 00000008:00010000:2.0:1787191335.963943:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:2.0:1787191335.963944:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b52359070, osc lock ffff936b44e63300, flags 0x80000000 00010000:00010000:2.0:1787191335.963979:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000062a81d6a/0xe5129dc884839638 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x191:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.963988:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000062a81d6a/0xe5129dc884839638 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x191:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.963998:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000062a81d6a/0xe5129dc884839638 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x191:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191335.964014:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626523520:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191335.964097:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359a80 going to sleep for 11 seconds 00010000:00010000:3.0:1787191335.965313:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1787191335.965325:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30353:x1874004634841216:12345-192.168.202.101@tcp:104: Request processed in 2823us (4569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191335.965334:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1185 00000080:00200000:2.0:1787191335.978322:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xad:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191335.978328:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b42ff64e8 (ffff936b465cc3f8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191335.978332:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42ff64e8 (ffff936b465cc3f8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191335.978336:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b52359030 (ffff936b465cc1b8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191335.978344:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000062a81d6a/0xe5129dc884839638 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4602d80 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.978356:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000062a81d6a/0xe5129dc884839638 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4602d80 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191335.978367:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b52359070 (ffff936b465cc518/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191335.978372:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc88483963f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4602d87 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.978380:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc88483963f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4602d87 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191335.978389:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42ff64e8 (ffff936b465cc3f8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191335.978391:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b52359030 (ffff936b465cc3f8/1) at cl_lock_fini():72 00000020:00010000:2.0:1787191335.978396:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b52359070 (ffff936b465cc3f8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191335.978410:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xad:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191335.978422:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xad:0x0](ffff936b539580c8) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191335.000000000, mtime 1787191335.000000000, ctime 1787191335.000000000, rc 0 00000080:00200008:2.0:1787191335.978514:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xad:0x0], ppos: 0, count: 5 00000080:00200000:2.0:1787191335.978528:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191335.978535:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:2.0:1787191335.978540:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:2.0:1787191335.978544:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1787191335.978551:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@00000000ec6d8b31[0x110, 1, [0x200000405:0xad:0x0] hash] 00000020:00200000:2.0:1787191335.978553:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:2.0:1787191335.978558:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xad:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:2.0:1787191335.978569:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xad:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:2.0:1787191335.978574:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xad:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191335.978577:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1787191335.978581:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1787191335.978588:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:2.0:1787191335.978591:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1787191335.978603:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:2.0:1787191335.978615:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1787191335.978618:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1db0, osc lock ffff936b44e63300, flags 0x0 00010000:00010000:2.0:1787191335.978633:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000062a81d6a/0xe5129dc884839638 lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x191:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4602d80 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191335.978643:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000062a81d6a/0xe5129dc884839638 lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4602d80 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191335.978655:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000062a81d6a/0xe5129dc884839638 lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4602d80 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191335.978663:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000062a81d6a/0xe5129dc884839638 lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4602d80 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191335.978669:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000062a81d6a/0xe5129dc884839638 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4602d80 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191335.978685:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:2.0:1787191335.978692:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191335.978731:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:2.0:1787191335.978739:0:57570:0:(rw26.c:927:ll_write_end()) page@00000000a33bb335[3 00000000d465d5e5 2 1 00000000925f5fe7 0 0 0] 00000080:00200000:2.0:1787191335.978743:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @00000000eb534ca3 17ffffc0001001 3:0 ffff936b43a1e9a0 0 lru 00000080:00200000:2.0:1787191335.978750:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@00000000aa395305 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000ef00a996 0000000060a7a2dd > 3< 0 0 > 4< 0 0 8 411303936 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1787191335.978752:0:57570:0:(rw26.c:927:ll_write_end()) end page@00000000a33bb335 00000080:00200000:2.0:1787191335.978754:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:2.0:1787191335.978757:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:2.0:1787191335.978775:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 00000000d5dd2c13 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000062a81d6a/0xe5129dc884839638 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4602d80 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191335.978794:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b53958278, count 1, dirtied 1 00000080:00200000:2.0:1787191335.978798:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:2.0:1787191335.978801:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:2.0:1787191335.978813:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b42ff64e8 (ffff936b465cc3f8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191335.978816:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42ff64e8 (ffff936b465cc3f8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191335.978819:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1db0 (ffff936b465cc518/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191335.978824:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000062a81d6a/0xe5129dc884839638 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4602d80 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191335.978864:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000062a81d6a/0xe5129dc884839638 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4602d80 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:2.0:1787191335.978875:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42ff64e8 (ffff936b465cc3f8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191335.978878:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1db0 (ffff936b465cc3f8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191335.978885:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:2.0:1787191335.978889:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1787191335.978894:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xad:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191335.978898:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:2.0:1787191335.978903:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xad:0x0] updating i_size 5 i_blocks 0 00000080:00200000:2.0:1787191335.978907:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:2.0:1787191335.978923:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xad:0x0](ffff936b539580c8), flags 100001 00000002:00100000:2.0:1787191335.978967:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a475500 x1874004626521344/t8589936483(8589936483) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191351 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191335.978979:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:2.0:1787191335.978984:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9f80 x1874004626524928/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191335.979001:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626524928:192.168.202.101@tcp:35:bash.0 00000100:00100000:2.0:1787191335.979086:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359000 going to sleep for 11 seconds 00000100:00100000:2.0:1787191335.980968:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626524928:192.168.202.101@tcp:35:bash.0 00000002:00100000:2.0:1787191335.980983:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a475500 x1874004626521344/t8589936483(8589936483) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191351 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191335.985629:0:57810:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191335.985648:0:57810:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191335.985661:0:57810:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191335.985676:0:57810:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191335.985684:0:57810:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191335.985692:0:57810:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191335.985695:0:57810:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191335.985704:0:57810:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb420e3b58 00010000:00010000:2.0:1787191335.985708:0:57810:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191335.985717:0:57810:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191335.985732:0:57810:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191335.985740:0:57810:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191335.985745:0:57810:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191335.985749:0:57810:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=8 00000080:00200008:2.0:1787191335.985754:0:57810:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xad:0x0](ffff936b539580c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191335.985760:0:57810:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xad:0x0](ffff936b539580c8),name=f70.sanity-flr 00000002:00010000:2.0:1787191335.985773:0:57810:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xad:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191335.985780:0:57810:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf800/0xe5129dc88483964d lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602db1 expref: -99 pid: 57805 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191335.986009:0:57810:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf800/0xe5129dc88483964d lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602db1 expref: -99 pid: 57805 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191335.986018:0:57810:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191335.986022:0:57810:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xad:0x0](ffff936b539580c8) 00000080:00010000:2.0:1787191335.986025:0:57810:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xad:0x0](ffff936b539580c8) for lock 0xe5129dc88483964d 00000080:00010000:2.0:1787191335.986029:0:57810:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483964d from it ffffa3fb420e3cb8 00010000:00010000:2.0:1787191335.986032:0:57810:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf800/0xe5129dc88483964d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4602db1 expref: -99 pid: 57805 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191335.986039:0:57810:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf800/0xe5129dc88483964d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602db1 expref: -99 pid: 57805 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191335.986058:0:57810:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xad:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:2.0:1787191335.986070:0:57810:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xad:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191335.986083:0:57810:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191335.986087:0:57810:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xad:0x0] 00000008:00010000:2.0:1787191335.986108:0:57810:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191335.986112:0:57810:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1db0, osc lock ffff936b44e63300, flags 0x400000400001002 00010000:00010000:2.0:1787191335.986128:0:57810:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000062a81d6a/0xe5129dc884839638 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x191:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4602d80 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191335.986140:0:57810:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000062a81d6a/0xe5129dc884839638 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4602d80 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:2.0:1787191335.986151:0:57810:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191335.986154:0:57810:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000062a81d6a/0xe5129dc884839638 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4602d80 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191335.986162:0:57810:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000062a81d6a/0xe5129dc884839638 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x191:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4602d80 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:2.0:1787191335.986172:0:57810:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191335.986183:0:57810:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xad:0x0] updating i_size 5 i_blocks 0 00000020:00010000:2.0:1787191335.986189:0:57810:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51656060 (ffff936b465cc3f8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191335.986192:0:57810:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51656060 (ffff936b465cc3f8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191335.986195:0:57810:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1db0 (ffff936b465cc518/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191335.986199:0:57810:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51656060 (ffff936b465cc3f8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191335.986202:0:57810:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1db0 (ffff936b465cc3f8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191335.986213:0:57810:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xad:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191335.986235:0:57810:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191335.986244:0:57810:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191335.986250:0:57810:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191335.986259:0:57810:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191335.986265:0:57810:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191335.986270:0:57810:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191335.986272:0:57810:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191335.986276:0:57810:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb420e3c10 00010000:00010000:2.0:1787191335.986278:0:57810:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191335.986285:0:57810:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191335.986293:0:57810:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191335.986297:0:57810:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191335.986300:0:57810:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191335.986305:0:57810:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:2.0:1787191335.986308:0:57810:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:2.0:1787191335.986313:0:57810:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:2.0:1787191335.986335:0:57810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839631 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xad:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4602d5d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191335.986355:0:57810:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xad:0x0]: losing layout lock 00010000:00010000:2.0:1787191335.986368:0:57810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf800/0xe5129dc88483964d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xad:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4602db1 expref: -99 pid: 57805 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191335.986377:0:57810:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xad:0x0]: losing layout lock 00010000:00010000:2.0:1787191335.986384:0:57810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc884839623 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xad:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4602d33 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191335.986423:0:57810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839631 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xad:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4602d5d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191335.986430:0:57810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf800/0xe5129dc88483964d lrc: 1/0,0 mode: --/PR res: [0x200000405:0xad:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4602db1 expref: -99 pid: 57805 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191335.986436:0:57810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc884839623 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xad:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4602d33 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191335.986442:0:57810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:2.0:1787191335.986445:0:57810:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839631 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xad:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4602d5d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191335.986457:0:57810:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf800/0xe5129dc88483964d lrc: 0/0,0 mode: --/PR res: [0x200000405:0xad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4602db1 expref: -99 pid: 57805 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191335.986466:0:57810:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc884839623 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xad:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4602d33 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:2.0:1787191335.986485:0:57810:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 36, max 7 00000100:00100000:2.0:1787191335.986495:0:57810:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9f80 x1874004626525440/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787191335.986514:0:57810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57810:1874004626525440:192.168.202.101@tcp:36:rm.0 00000100:00100000:2.0:1787191335.986576:0:57810:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359000 going to sleep for 11 seconds 00010000:00010000:2.0:1787191335.992483:0:57805:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191335.992497:0:57805:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191335.992503:0:57805:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191335.992507:0:57805:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191335.992514:0:57805:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb420b3bf8 00010000:00010000:2.0:1787191335.992518:0:57805:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191335.992530:0:57805:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191335.992544:0:57805:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191335.992551:0:57805:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191335.992557:0:57805:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191335.996544:0:57805:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b50ce6000, open_flags d902, mode 0 opened 0 00000080:00200000:2.0:1787191335.996552:0:57805:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:2.0:1787191335.996577:0:57805:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154403 00010000:00010000:2.0:1787191335.996640:0:57805:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839654 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191335.996649:0:57805:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839654 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57805 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191335.996661:0:57805:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191335.996669:0:57805:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9880 x1874004626525696/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191335.996680:0:57805:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839654 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191335.996703:0:57805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57805:1874004626525696:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191335.996903:0:57805:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359600 going to sleep for 11 seconds 00000080:00200000:2.0:1787191336.003588:0:57811:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191336.003612:0:57811:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191336.003625:0:57811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.003639:0:57811:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.003647:0:57811:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191336.003654:0:57811:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191336.003658:0:57811:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191336.003664:0:57811:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb420a3b58 00010000:00010000:2.0:1787191336.003668:0:57811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.003677:0:57811:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.003694:0:57811:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.003702:0:57811:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:2.0:1787191336.003707:0:57811:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.003717:0:57811:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:2.0:1787191336.003721:0:57811:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191336.003731:0:57811:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191336.003774:0:57811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483965b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.003781:0:57811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483965b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.003791:0:57811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483965b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191336.003813:0:57811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57811:1874004626525824:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191336.003916:0:57811:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b523599c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191336.009732:0:57811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57811:1874004626525824:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191336.009759:0:57811:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483965b lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.009773:0:57811:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483965b lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.009780:0:57811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483965b lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.009786:0:57811:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483965b lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.009794:0:57811:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483965b lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.009800:0:57811:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd4600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191336.009805:0:57811:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483965b lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.009813:0:57811:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483965b lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.009820:0:57811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483965b lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.009826:0:57811:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191336.009942:0:57811:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483965b lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.009950:0:57811:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483965b lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57811 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191336.009978:0:57811:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513b9880 x1874004626525824/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191352 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191336.009995:0:57811:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191336.010099:0:57811:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191336.010113:0:57811:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191336.010123:0:57811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.010135:0:57811:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.010142:0:57811:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191336.010147:0:57811:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191336.010150:0:57811:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191336.010155:0:57811:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb420a3be8 00010000:00010000:2.0:1787191336.010169:0:57811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.010177:0:57811:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.010191:0:57811:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.010199:0:57811:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000080:00200000:2.0:1787191336.010204:0:57811:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.010213:0:57811:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:2.0:1787191336.010217:0:57811:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191336.010227:0:57811:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191336.010265:0:57811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839662 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.010271:0:57811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839662 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.010280:0:57811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839662 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191336.010298:0:57811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57811:1874004626525952:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191336.010382:0:57811:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b523599c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191336.013534:0:57811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57811:1874004626525952:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191336.013556:0:57811:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839662 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.013569:0:57811:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839662 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.013576:0:57811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839662 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.013583:0:57811:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839662 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.013591:0:57811:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839662 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.013598:0:57811:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd5400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191336.013603:0:57811:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839662 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.013610:0:57811:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839662 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.013619:0:57811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839662 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.013625:0:57811:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191336.013631:0:57811:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839662 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.013639:0:57811:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839662 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57811 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191336.013659:0:57811:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513b9880 x1874004626525952/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191352 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191336.013679:0:57811:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191336.013758:0:57811:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191336.013772:0:57811:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191336.013783:0:57811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.013795:0:57811:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.013802:0:57811:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191336.013808:0:57811:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191336.013812:0:57811:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191336.013818:0:57811:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb420a3b58 00010000:00010000:2.0:1787191336.013821:0:57811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.013860:0:57811:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.013878:0:57811:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.013887:0:57811:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:2.0:1787191336.013897:0:57811:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:2.0:1787191336.013902:0:57811:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:2.0:1787191336.013915:0:57811:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191336.013923:0:57811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 62 lru_type: 1 00010000:00010000:2.0:1787191336.013936:0:57811:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 62 lru_type: 1 00000002:00010000:2.0:1787191336.013946:0:57811:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191336.013987:0:57811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839669 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.013995:0:57811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839669 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.014004:0:57811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839669 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191336.014025:0:57811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57811:1874004626526080:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191336.014121:0:57811:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b523599c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191336.016353:0:57811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57811:1874004626526080:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191336.016380:0:57811:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839669 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602e21 expref: -99 pid: 57811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.016486:0:57811:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839669 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602e21 expref: -99 pid: 57811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.016500:0:57811:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839669 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602e21 expref: -99 pid: 57811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.016512:0:57811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839669 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602e21 expref: -99 pid: 57811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.016530:0:57811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839669 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602e21 expref: -99 pid: 57811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.016538:0:57811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839669 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602e21 expref: -99 pid: 57811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.016546:0:57811:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839669 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602e21 expref: -99 pid: 57811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191336.016557:0:57811:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b513b9880 x1874004626526080/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191352 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191336.016571:0:57811:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839669 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602e21 expref: -99 pid: 57811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.016589:0:57811:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:2.0:1787191336.016597:0:57811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839669 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602e21 expref: -99 pid: 57811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.016605:0:57811:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839669 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602e21 expref: -99 pid: 57811 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:2.0:1787191336.016632:0:57811:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191336.016641:0:57811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 124 lru_type: 1 00010000:00010000:2.0:1787191336.016649:0:57811:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 124 lru_type: 1 00010000:00010000:2.0:1787191336.016658:0:57811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 124 lru_type: 1 00010000:00010000:2.0:1787191336.016665:0:57811:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 125 lru_type: 1 00000080:00200000:2.0:1787191336.016675:0:57811:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1787191336.016679:0:57811:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:2.0:1787191336.016682:0:57811:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:2.0:1787191336.016686:0:57811:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb420a3cb8 00010000:00010000:2.0:1787191336.016689:0:57811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 62 lru_type: 1 00010000:00010000:2.0:1787191336.016698:0:57811:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 63 lru_type: 1 00000002:00010000:2.0:1787191336.016711:0:57811:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191336.016716:0:57811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839669 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602e21 expref: -99 pid: 57811 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191336.016724:0:57811:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839669 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602e21 expref: -99 pid: 57811 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191336.016731:0:57811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839669 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602e21 expref: -99 pid: 57811 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191336.016738:0:57811:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839669 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602e21 expref: -99 pid: 57811 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:2.0:1787191336.016746:0:57811:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191336.016751:0:57811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 125 lru_type: 1 00010000:00010000:2.0:1787191336.016758:0:57811:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 125 lru_type: 1 00010000:00010000:2.0:1787191336.016764:0:57811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 125 lru_type: 1 00010000:00010000:2.0:1787191336.016770:0:57811:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 126 lru_type: 1 00000080:00200008:2.0:1787191336.017756:0:57811:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:2.0:1787191336.017761:0:57811:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191336.017772:0:57811:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191336.017780:0:57811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.017788:0:57811:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.017792:0:57811:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191336.017796:0:57811:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191336.017798:0:57811:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191336.017802:0:57811:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb420a3cb8 00010000:00010000:2.0:1787191336.017804:0:57811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.017809:0:57811:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.019774:0:57811:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191336.019803:0:57811:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191336.019818:0:57811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.019846:0:57811:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.019855:0:57811:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191336.019862:0:57811:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191336.019865:0:57811:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191336.019872:0:57811:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb420a3b58 00010000:00010000:2.0:1787191336.019876:0:57811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.019885:0:57811:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.019899:0:57811:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.019907:0:57811:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191336.019912:0:57811:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.020665:0:57811:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=8 00000080:00200000:2.0:1787191336.020693:0:57811:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191336.020701:0:57811:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191336.020718:0:57811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.020727:0:57811:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.020733:0:57811:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191336.020737:0:57811:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191336.020740:0:57811:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191336.020743:0:57811:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb420a3bf8 00010000:00010000:2.0:1787191336.020746:0:57811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.020758:0:57811:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.020767:0:57811:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.020771:0:57811:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191336.020774:0:57811:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.020779:0:57811:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:2.0:1787191336.020782:0:57811:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:2.0:1787191336.020786:0:57811:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b51c6aa80, open_flags a141, mode 81b6 opened 0 00000080:00200000:2.0:1787191336.020797:0:57811:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:2.0:1787191336.020816:0:57811:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xaf:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:2.0:1787191336.020826:0:57811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839669 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4602e21 expref: -99 pid: 57811 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191336.020895:0:57811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839669 lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4602e21 expref: -99 pid: 57811 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191336.020903:0:57811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191336.020905:0:57811:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839669 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4602e21 expref: -99 pid: 57811 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191336.020938:0:57811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839677 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.020944:0:57811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839677 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57811 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191336.020955:0:57811:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191336.020962:0:57811:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9880 x1874004626526592/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191336.020971:0:57811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839677 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191336.020989:0:57811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57811:1874004626526592:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191336.021129:0:57811:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b523599c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191336.023444:0:57811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57811:1874004626526592:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191336.023468:0:57811:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839677 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602e52 expref: -99 pid: 57811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.023506:0:57811:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839677 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602e52 expref: -99 pid: 57811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.023515:0:57811:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839677 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602e52 expref: -99 pid: 57811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.023532:0:57811:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839677 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602e52 expref: -99 pid: 57811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.023541:0:57811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839677 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602e52 expref: -99 pid: 57811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.023553:0:57811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839677 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602e52 expref: -99 pid: 57811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.023560:0:57811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839677 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602e52 expref: -99 pid: 57811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.023567:0:57811:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839677 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602e52 expref: -99 pid: 57811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191336.023578:0:57811:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b513b9880 x1874004626526592/t8589936494(8589936494) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191352 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191336.023592:0:57811:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9880 x1874004626526592/t8589936494(8589936494) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191352 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191336.023603:0:57811:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839677 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602e52 expref: -99 pid: 57811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.023612:0:57811:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/175 (0 0) 00000080:00200000:2.0:1787191336.023618:0:57811:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191336.023640:0:57811:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:2.0:1787191336.023673:0:57811:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xaf:0x0](ffff936b4898d348) 00000080:00200000:2.0:1787191336.023681:0:57811:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xaf:0x0], updating i_size 0 00000080:00200000:2.0:1787191336.023715:0:57811:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xaf:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:2.0:1787191336.023720:0:57811:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xaf:0x0](ffff936b4898d348) 00000080:00010000:2.0:1787191336.023725:0:57811:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xaf:0x0](ffff936b4898d348) for lock 0xe5129dc884839677 00000080:00010000:2.0:1787191336.023735:0:57811:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xaf:0x0](ffff936b4898d348) 00000080:00200008:2.0:1787191336.023754:0:57811:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xaf:0x0](ffff936b4898d348), flags 120501 00000002:00100000:2.0:1787191336.023777:0:57811:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9880 x1874004626526592/t8589936494(8589936494) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191352 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1787191336.023817:0:57811:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839677 from it ffff936b60dc4900 00010000:00010000:2.0:1787191336.023822:0:57811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839677 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4602e52 expref: -99 pid: 57811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.023847:0:57811:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839677 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602e52 expref: -99 pid: 57811 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191336.023871:0:57811:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xaf:0x0](ffff936b4898d348), inode mode 81a4 mask 40 00000080:00200000:2.0:1787191336.023928:0:57811:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xaf:0x0](ffff936b4898d348), inode mode 81a4 mask 2 00000080:00200000:2.0:1787191336.023938:0:57811:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xaf:0x0](ffff936b4898d348), xattr lov 00000002:00010000:2.0:1787191336.023956:0:57811:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xaf:0x0]) in obj [0x200000405:0xaf:0x0], intent: open flags 040000002 00010000:00010000:2.0:1787191336.023999:0:57811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc88483967e lrc: 3/1,0 mode: --/CR res: [0x200000405:0xaf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.024006:0:57811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc88483967e lrc: 3/1,0 mode: --/CR res: [0x200000405:0xaf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57811 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191336.024017:0:57811:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191336.024023:0:57811:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513ba680 x1874004626526848/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191336.024038:0:57811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc88483967e lrc: 3/1,0 mode: --/CR res: [0x200000405:0xaf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191336.024057:0:57811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57811:1874004626526848:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191336.024228:0:57811:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b523599c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191336.028976:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191336.029036:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634841856 00000100:00100000:3.0:1787191336.029046:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634841856 00000100:00100000:3.0:1787191336.029250:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1186 00000100:00100000:3.0:1787191336.029262:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634841856:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191336.029285:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839677 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4602e52 expref: -99 pid: 57811 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.029390:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191336.029397:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634841856:12345-192.168.202.101@tcp:104: Request processed in 138us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191336.029405:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1186 00000080:00200000:2.0:1787191336.053119:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191336.053138:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191336.053150:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.053161:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.053167:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191336.053172:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191336.053175:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191336.053180:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:2.0:1787191336.053183:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.053191:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.053202:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.053208:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191336.053213:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.053219:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:2.0:1787191336.053224:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xaf:0x0](ffff936b4898d348), inode mode 81a4 mask 42 00000080:00200008:2.0:1787191336.053229:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xaf:0x0](ffff936b4898d348), flags 101101 00000002:00010000:2.0:1787191336.053241:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xaf:0x0]) in obj [0x200000405:0xaf:0x0], intent: open|creat flags 04240101102 00010000:00010000:2.0:1787191336.053252:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caec00/0xe5129dc88483968c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4602ead expref: -99 pid: 57813 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191336.053266:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xaf:0x0]: losing layout lock 00010000:00010000:2.0:1787191336.053294:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caec00/0xe5129dc88483968c lrc: 1/0,0 mode: --/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4602ead expref: -99 pid: 57813 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191336.053301:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191336.053304:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caec00/0xe5129dc88483968c lrc: 0/0,0 mode: --/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4602ead expref: -99 pid: 57813 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191336.053331:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483969a lrc: 3/0,1 mode: --/CW res: [0x200000405:0xaf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.053337:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483969a lrc: 3/0,1 mode: --/CW res: [0x200000405:0xaf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191336.053345:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191336.053352:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9500 x1874004626528640/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191336.053360:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483969a lrc: 3/0,1 mode: --/CW res: [0x200000405:0xaf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191336.053374:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626528640:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191336.053516:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359540 going to sleep for 11 seconds 00000100:00100000:2.0:1787191336.055370:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626528640:192.168.202.101@tcp:101:bash.0 00010000:00010000:2.0:1787191336.055386:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483969a lrc: 4/0,1 mode: --/CW res: [0x200000405:0xaf:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602ec9 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.055395:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483969a lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xaf:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602ec9 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.055404:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483969a lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xaf:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602ec9 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191336.055418:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x200002b, status=0 req@ffff936b513b9500 x1874004626528640/t8589936501(8589936501) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191352 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191336.055430:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9500 x1874004626528640/t8589936501(8589936501) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191352 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191336.055442:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483969a lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xaf:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602ec9 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191336.055455:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483969a lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xaf:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602ec9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.055466:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 8 res 8589935621/175 (0 0) 00000080:00200000:2.0:1787191336.055472:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000405:0xaf:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1787191336.055515:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xaf:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:2.0:1787191336.055519:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xaf:0x0](ffff936b4898d348) for lock 0xe5129dc88483969a 00000080:00010000:2.0:1787191336.055524:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483969a from it ffffa3fb41cabbf0 00010000:00010000:2.0:1787191336.055527:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483969a lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xaf:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4602ec9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.055537:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483969a lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xaf:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602ec9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000002:00100000:2.0:1787191336.055556:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9500 x1874004626528640/t8589936501(8589936501) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191352 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191336.055601:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xaf:0x0], intent: getxattr flags 0 00010000:00010000:2.0:1787191336.055627:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc8848396a1 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.055631:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc8848396a1 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.055637:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc8848396a1 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191336.055659:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626528768:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191336.055708:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359540 going to sleep for 11 seconds 00000100:00100000:2.0:1787191336.057333:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626528768:192.168.202.101@tcp:101:bash.0 00010000:00010000:2.0:1787191336.057350:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc8848396a1 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602ede expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.057362:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc8848396a1 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602ede expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.057372:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc8848396a1 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602ede expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191336.057389:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b513bbb80 x1874004626528768/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191352 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191336.057399:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc8848396a1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602ede expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.057409:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/175 (0 0) 00000080:00200000:2.0:1787191336.057414:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xaf:0x0] suppgids 0 -1: rc 0 00000080:00010000:2.0:1787191336.057439:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xaf:0x0](ffff936b4898d348) for lock 0xe5129dc8848396a1 00000080:00010000:2.0:1787191336.057446:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848396a1 from it ffffa3fb41caba38 00010000:00010000:2.0:1787191336.057450:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc8848396a1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602ede expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.057459:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc8848396a1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602ede expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:2.0:1787191336.057494:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xaf:0x0](ffff936b4898d348) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191336.000000000, mtime 1787191336.000000000, ctime 1787191336.000000000 00010000:00010000:2.0:1787191336.057517:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483969a lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xaf:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4602ec9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191336.057536:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xaf:0x0]: losing layout lock 00010000:00010000:2.0:1787191336.057569:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483969a lrc: 1/0,0 mode: --/CW res: [0x200000405:0xaf:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4602ec9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191336.057576:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191336.057578:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483969a lrc: 0/0,0 mode: --/CW res: [0x200000405:0xaf:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4602ec9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:2.0:1787191336.057602:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 36, max 7 00000100:00100000:2.0:1787191336.057608:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bbb80 x1874004626529280/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787191336.057624:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626529280:192.168.202.101@tcp:36:bash.0 00000100:00100000:2.0:1787191336.057726:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359540 going to sleep for 11 seconds 00000100:00100000:2.0:1787191336.061276:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626529280:192.168.202.101@tcp:36:bash.0 00000080:00200000:2.0:1787191336.061327:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:2.0:1787191336.061334:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xaf:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00010000:00010000:2.0:1787191336.061348:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/175 (0 0) 00000080:00010000:2.0:1787191336.061360:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xaf:0x0](ffff936b4898d348) 00000002:00010000:2.0:1787191336.061368:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xaf:0x0]) in obj [0x200000405:0xaf:0x0], intent: layout flags 0 00010000:00010000:2.0:1787191336.061404:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848396af lrc: 3/1,0 mode: --/CR res: [0x200000405:0xaf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.061412:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848396af lrc: 3/1,0 mode: --/CR res: [0x200000405:0xaf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.061421:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848396af lrc: 3/1,0 mode: --/CR res: [0x200000405:0xaf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191336.061436:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626529664:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191336.061485:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359540 going to sleep for 11 seconds 00000100:00100000:2.0:1787191336.065370:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626529664:192.168.202.101@tcp:101:bash.0 00010000:00010000:2.0:1787191336.065399:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848396af lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xaf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602f0f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.065419:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848396af lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xaf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602f0f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191336.065432:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b513b9c00 x1874004626529664/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191352 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191336.065442:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848396af lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xaf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602f0f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191336.065454:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848396af lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xaf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602f0f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.065464:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/175 (0 0) 00000080:00200000:2.0:1787191336.065470:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xaf:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1787191336.065485:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xaf:0x0](ffff936b4898d348) for lock 0xe5129dc8848396af 00000080:00010000:2.0:1787191336.065492:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848396af from it ffffa3fb41cab8c8 00010000:00010000:2.0:1787191336.065495:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848396af lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xaf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602f0f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.065502:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848396af lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xaf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602f0f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191336.065522:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc8848396a8 lrc: 3/2,0 mode: PR/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602f01 expref: -99 pid: 57813 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.065531:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc8848396a8 lrc: 3/2,0 mode: PR/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602f01 expref: -99 pid: 57813 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000080:00010000:2.0:1787191336.065540:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xaf:0x0](00000000245d7afe) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc8848396a8 lrc: 4/2,0 mode: PR/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602f01 expref: -99 pid: 57813 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.065546:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc8848396a8 lrc: 4/2,0 mode: PR/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4602f01 expref: -99 pid: 57813 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.065550:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc8848396a8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4602f01 expref: -99 pid: 57813 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00020000:00200000:2.0:1787191336.065561:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xaf:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:2.0:1787191336.065567:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xaf:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191336.065569:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xaf:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:2.0:1787191336.065575:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xaf:0x0](ffff936b4898d348) 00000002:00010000:2.0:1787191336.065581:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xaf:0x0]) in obj [0x200000405:0xaf:0x0], intent: layout flags 02 00010000:00010000:2.0:1787191336.065590:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848396af lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xaf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4602f0f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191336.065601:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc8848396a8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602f01 expref: -99 pid: 57813 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.065621:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848396af lrc: 1/0,0 mode: --/CR res: [0x200000405:0xaf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4602f0f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191336.065625:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191336.065627:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc8848396af lrc: 0/0,0 mode: --/CR res: [0x200000405:0xaf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4602f0f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191336.065646:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc8848396b6 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xaf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.065650:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc8848396b6 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xaf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191336.065657:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:2.0:1787191336.065660:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9c00 x1874004626530176/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191336.065666:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc8848396b6 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xaf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191336.065679:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626530176:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191336.065733:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359540 going to sleep for 11 seconds 00000100:00100000:3.0:1787191336.069702:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191336.073825:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634841984 00000100:00100000:2.0:1787191336.073928:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634841984 00000100:00100000:2.0:1787191336.073978:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1187 00000100:00100000:2.0:1787191336.073986:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634841984:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191336.074000:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc8848396a8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4602f01 expref: -99 pid: 57813 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191336.076706:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191336.076724:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634841984:12345-192.168.202.101@tcp:104: Request processed in 2733us (7019us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191336.076733:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1187 00000100:00100000:3.0:1787191336.085270:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191336.085322:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191336.085358:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191336.085403:0:40922:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787191336.085425:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634842880 00000100:00100000:3.0:1787191336.085436:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634842880 00000100:00100000:3.0:1787191336.085484:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634843008 00000100:00100000:3.0:1787191336.085487:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634843008 00000100:00100000:3.0:1787191336.085504:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1188 00000100:00100000:3.0:1787191336.085513:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+5:29543:x1874004634842880:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191336.085531:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc8848395a5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4602bb9 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:3.0:1787191336.085601:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191336.085608:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+5:29543:x1874004634842880:12345-192.168.202.101@tcp:104: Request processed in 97us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191336.085616:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1188 00000100:00100000:3.0:1787191336.085633:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1189 00000100:00100000:3.0:1787191336.085639:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b50881850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30511:x1874004634843008:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191336.085647:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884839615 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000030000 nid: local remote: 0x7130d520e4602d02 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.085678:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787191336.085684:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b50881850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30511:x1874004634843008:12345-192.168.202.101@tcp:104: Request processed in 46us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191336.085691:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1189 00010000:00010000:3.0:1787191336.085725:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787191336.085731:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc8848395a5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4602bb9 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:3.0:1787191336.085740:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51fe1e00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191336.085747:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc8848395a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e4602bb9 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:3.0:1787191336.085792:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc8848395a5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4602bb9 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:3.0:1787191336.085805:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191336.085828:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc8848395a5 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4602bb9 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:3.0:1787191336.085865:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc8848395a5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x18d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4602bb9 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:3.0:1787191336.085887:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191336.085890:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884839615 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000030000 nid: local remote: 0x7130d520e4602d02 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.085897:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd5c00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191336.085900:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884839615 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400030000 nid: local remote: 0x7130d520e4602d02 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.085919:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884839615 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e4602d02 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.085925:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191336.085932:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884839615 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e4602d02 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.085939:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884839615 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e4602d02 expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.085956:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191336.085958:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191336.085959:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191336.085975:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626530944:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191336.086029:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787191336.086036:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626531072:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191336.087363:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191336.087388:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191336.087416:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634844032 00000100:00100000:3.0:1787191336.087420:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634844032 00000100:00100000:3.0:1787191336.087436:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634844160 00000100:00100000:3.0:1787191336.087439:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634844160 00000100:00100000:3.0:1787191336.087450:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1190 00000100:00100000:3.0:1787191336.087457:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+5:30353:x1874004634844032:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191336.087466:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a1aca85d/0xe5129dc88483960e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4602cfb expref: -99 pid: 57805 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:2.0:1787191336.087618:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1191 00000100:00100000:2.0:1787191336.087626:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+5:30510:x1874004634844160:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191336.087635:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc88483963f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4602d87 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191336.087825:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191336.087858:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+5:30510:x1874004634844160:12345-192.168.202.101@tcp:104: Request processed in 206us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191336.087865:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1191 00010000:00010000:3.0:1787191336.088347:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1787191336.088355:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30353:x1874004634844032:12345-192.168.202.101@tcp:104: Request processed in 898us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191336.088362:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1190 00000100:00100000:3.0:1787191336.089528:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191336.092171:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626531072:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191336.092186:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626530944:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191336.093991:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191336.094051:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634844288 00000100:00100000:3.0:1787191336.094056:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634844288 00000100:00100000:2.0:1787191336.094571:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634844416 00000100:00100000:2.0:1787191336.094576:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634844416 00000100:00100000:3.0:1787191336.094607:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1192 00000100:00100000:3.0:1787191336.094617:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+5:8420:x1874004634844288:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191336.094631:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483954a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4602aa1 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.094705:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191336.094713:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+5:8420:x1874004634844288:12345-192.168.202.101@tcp:104: Request processed in 98us (5189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191336.094944:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1193 00000100:00100000:2.0:1787191336.094954:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+5:8720:x1874004634844416:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191336.094962:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc884839693 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x190:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000010000 nid: local remote: 0x7130d520e4602ebb expref: -99 pid: 57813 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191336.094995:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191336.095001:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+5:8720:x1874004634844416:12345-192.168.202.101@tcp:104: Request processed in 50us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191336.095008:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1193 00010000:00010000:2.0:1787191336.095033:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787191336.095038:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc884839693 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x190:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000010000 nid: local remote: 0x7130d520e4602ebb expref: -99 pid: 57813 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191336.095045:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cafa00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:2.0:1787191336.095049:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc884839693 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x190:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800428400010000 nid: local remote: 0x7130d520e4602ebb expref: -99 pid: 57813 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191336.095069:0:40929:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xaf:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1787191336.095091:0:40929:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xaf:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:2.0:1787191336.095115:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc884839693 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x190:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400010020 nid: local remote: 0x7130d520e4602ebb expref: -99 pid: 57813 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191336.095122:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191336.095137:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc884839693 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x190:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400010020 nid: local remote: 0x7130d520e4602ebb expref: -99 pid: 57813 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191336.095143:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc884839693 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x190:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400010020 nid: local remote: 0x7130d520e4602ebb expref: -99 pid: 57813 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191336.095157:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191336.095158:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191336.095160:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191336.095166:0:2392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787191336.095177:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626532096:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191336.095300:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1192 00000100:00100000:3.0:1787191336.100140:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191336.100228:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634844544 00000100:00100000:2.0:1787191336.100237:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634844544 00000100:00100000:2.0:1787191336.100301:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1194 00000100:00100000:2.0:1787191336.100314:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30131:x1874004634844544:12345-192.168.202.101@tcp:105: 00010000:00010000:2.0:1787191336.100335:0:40921:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc8848396cb lrc: 4/0,1 mode: --/PW res: [0x280000401:0x190:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602f7f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.100348:0:40921:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc8848396cb lrc: 4/0,1 mode: --/PW res: [0x280000401:0x190:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602f7f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.100359:0:40921:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc8848396cb lrc: 4/0,1 mode: --/PW res: [0x280000401:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602f7f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.100370:0:40921:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc8848396cb lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080000000000 nid: local remote: 0x7130d520e4602f7f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.100381:0:40921:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc8848396cb lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080000000000 nid: local remote: 0x7130d520e4602f7f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.100392:0:40921:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc8848396cb lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000000000 nid: local remote: 0x7130d520e4602f7f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.100409:0:40921:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b44cafc00) 00000100:00100000:2.0:1787191336.100455:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30131:x1874004634844544:12345-192.168.202.101@tcp:105: Request processed in 144us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191336.100463:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1194 00000100:00100000:2.0:1787191336.104265:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626532096:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00200000:2.0:1787191336.110033:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xaf:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191336.110041:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b42ff64e8 (ffff936b465cc3f8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191336.110045:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42ff64e8 (ffff936b465cc3f8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191336.110050:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99b70 (ffff936b465ccf38/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191336.110061:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc8848396cb lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4602f7f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.110092:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc8848396cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4602f7f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191336.110110:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99bb0 (ffff936b47a17d88/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191336.110115:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc8848396d9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4602fa9 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.110123:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc8848396d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4602fa9 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191336.110131:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42ff64e8 (ffff936b465cc3f8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191336.110134:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99b70 (ffff936b465cc3f8/1) at cl_lock_fini():72 00000020:00010000:2.0:1787191336.110138:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99bb0 (ffff936b465cc3f8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191336.110158:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xaf:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191336.110169:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xaf:0x0](ffff936b4898d348) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191336.000000000, mtime 1787191336.000000000, ctime 1787191336.000000000, rc 0 00000080:00200008:2.0:1787191336.110234:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xaf:0x0], ppos: 0, count: 5 00000080:00200000:2.0:1787191336.110247:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191336.110252:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:2.0:1787191336.110256:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:2.0:1787191336.110260:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1787191336.110265:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@00000000a360ba6c[0x110, 1, [0x200000405:0xaf:0x0] hash] 00000020:00200000:2.0:1787191336.110268:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:2.0:1787191336.110272:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xaf:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:2.0:1787191336.110284:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xaf:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:2.0:1787191336.110288:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xaf:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191336.110292:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1787191336.110296:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1787191336.110302:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:2.0:1787191336.110305:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1787191336.110321:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:2.0:1787191336.110332:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1787191336.110336:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d12b0, osc lock ffff936b44e63300, flags 0x0 00010000:00010000:2.0:1787191336.110351:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc8848396cb lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x190:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4602f7f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191336.110363:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc8848396cb lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4602f7f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191336.110373:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc8848396cb lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4602f7f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191336.110381:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc8848396cb lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4602f7f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191336.110388:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc8848396cb lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4602f7f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191336.110398:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:2.0:1787191336.110407:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191336.110443:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:2.0:1787191336.110451:0:57570:0:(rw26.c:927:ll_write_end()) page@00000000fa770166[3 000000004231c313 2 1 00000000925f5fe7 0 0 0] 00000080:00200000:2.0:1787191336.110455:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @000000007254124a 17ffffc0001001 3:0 ffff936b43a1e2a0 0 lru 00000080:00200000:2.0:1787191336.110462:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@0000000049655646 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000a2a44f55 00000000cdfa062a > 3< 0 0 > 4< 0 0 8 345112576 - | - - - - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1787191336.110464:0:57570:0:(rw26.c:927:ll_write_end()) end page@00000000fa770166 00000080:00200000:2.0:1787191336.110466:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:2.0:1787191336.110470:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:2.0:1787191336.110488:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 0000000039264f0c ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc8848396cb lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4602f7f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191336.110507:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b4898d4f8, count 1, dirtied 1 00000080:00200000:2.0:1787191336.110511:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:2.0:1787191336.110514:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:2.0:1787191336.110527:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b42ff64e8 (ffff936b465cc3f8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191336.110530:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42ff64e8 (ffff936b465cc3f8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191336.110533:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d12b0 (ffff936b47a17d88/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191336.110537:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc8848396cb lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4602f7f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191336.110545:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc8848396cb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4602f7f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:2.0:1787191336.110554:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42ff64e8 (ffff936b465cc3f8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191336.110557:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d12b0 (ffff936b465cc3f8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191336.110562:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:2.0:1787191336.110566:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1787191336.110571:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xaf:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191336.110574:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:2.0:1787191336.110579:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xaf:0x0] updating i_size 5 i_blocks 0 00000080:00200000:2.0:1787191336.110582:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:2.0:1787191336.110596:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xaf:0x0](ffff936b4898d348), flags 100001 00000002:00100000:2.0:1787191336.110657:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513b9500 x1874004626528640/t8589936501(8589936501) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191352 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191336.110671:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191336.110678:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9180 x1874004626533248/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191336.110701:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626533248:192.168.202.101@tcp:35:bash.0 00000100:00100000:2.0:1787191336.110802:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b523599c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191336.115945:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626533248:192.168.202.101@tcp:35:bash.0 00000002:00100000:2.0:1787191336.115979:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513b9500 x1874004626528640/t8589936501(8589936501) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191352 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191336.119203:0:57816:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191336.119218:0:57816:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191336.119228:0:57816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191336.119237:0:57816:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191336.119244:0:57816:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191336.119249:0:57816:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191336.119252:0:57816:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191336.119257:0:57816:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42103b58 00010000:00010000:3.0:1787191336.119260:0:57816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191336.119274:0:57816:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191336.119285:0:57816:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191336.119291:0:57816:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:3.0:1787191336.119295:0:57816:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191336.119299:0:57816:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=8 00000080:00200008:3.0:1787191336.119303:0:57816:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xaf:0x0](ffff936b4898d348), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191336.119307:0:57816:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xaf:0x0](ffff936b4898d348),name=f70.sanity-flr 00000002:00010000:3.0:1787191336.119315:0:57816:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xaf:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191336.119321:0:57816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0e00/0xe5129dc8848396c4 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602f78 expref: -99 pid: 57814 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191336.119328:0:57816:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0e00/0xe5129dc8848396c4 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602f78 expref: -99 pid: 57814 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:3.0:1787191336.119334:0:57816:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191336.119338:0:57816:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xaf:0x0](ffff936b4898d348) 00000080:00010000:3.0:1787191336.119340:0:57816:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xaf:0x0](ffff936b4898d348) for lock 0xe5129dc8848396c4 00000080:00010000:3.0:1787191336.119343:0:57816:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848396c4 from it ffffa3fb42103cb8 00010000:00010000:3.0:1787191336.119346:0:57816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0e00/0xe5129dc8848396c4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4602f78 expref: -99 pid: 57814 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191336.119352:0:57816:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0e00/0xe5129dc8848396c4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602f78 expref: -99 pid: 57814 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:3.0:1787191336.119373:0:57816:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xaf:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:3.0:1787191336.119380:0:57816:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xaf:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191336.119382:0:57816:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191336.119385:0:57816:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xaf:0x0] 00000008:00010000:3.0:1787191336.119397:0:57816:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191336.119399:0:57816:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667db0, osc lock ffff936b44f64d10, flags 0x400000400001002 00010000:00010000:3.0:1787191336.119409:0:57816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc8848396cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x190:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4602f7f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191336.119419:0:57816:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc8848396cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4602f7f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:3.0:1787191336.119428:0:57816:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191336.119430:0:57816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc8848396cb lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4602f7f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191336.119438:0:57816:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc8848396cb lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4602f7f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:3.0:1787191336.119447:0:57816:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191336.119452:0:57816:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xaf:0x0] updating i_size 5 i_blocks 0 00000020:00010000:3.0:1787191336.119456:0:57816:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c3a060 (ffff936b47a17ab8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191336.119459:0:57816:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c3a060 (ffff936b47a17ab8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191336.119462:0:57816:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667db0 (ffff936b43ab8cf8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191336.119465:0:57816:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c3a060 (ffff936b47a17ab8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191336.119468:0:57816:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667db0 (ffff936b47a17ab8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191336.119477:0:57816:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xaf:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191336.119495:0:57816:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191336.119502:0:57816:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191336.119509:0:57816:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191336.119517:0:57816:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191336.119524:0:57816:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191336.119528:0:57816:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191336.119530:0:57816:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191336.119534:0:57816:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42103c10 00010000:00010000:3.0:1787191336.119537:0:57816:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191336.119544:0:57816:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191336.119552:0:57816:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191336.119557:0:57816:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:3.0:1787191336.119560:0:57816:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191336.119567:0:57816:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:3.0:1787191336.119570:0:57816:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:3.0:1787191336.119576:0:57816:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:3.0:1787191336.119601:0:57816:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc8848396b6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xaf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4602f1d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787191336.119621:0:57816:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xaf:0x0]: losing layout lock 00010000:00010000:3.0:1787191336.119633:0:57816:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc8848396bd lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xaf:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4602f2b expref: -99 pid: 57814 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000002:00100000:3.0:1787191336.119678:0:57816:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a474000 x1874004626530560/t8589936507(8589936507) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191352 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191336.119689:0:57816:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191336.119695:0:57816:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1ea00 x1874004626533504/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191336.119722:0:57816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57816:1874004626533504:192.168.202.101@tcp:35:rm.0 00000100:00100000:3.0:1787191336.119825:0:57816:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c540 going to sleep for 11 seconds 00000100:00100000:2.0:1787191336.125766:0:57815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57815:1874004626533632:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191336.125797:0:57815:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc8848396e0 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602fb7 expref: -99 pid: 57815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.125862:0:57815:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc8848396e0 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602fb7 expref: -99 pid: 57815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.125870:0:57815:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc8848396e0 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602fb7 expref: -99 pid: 57815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.125882:0:57815:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc8848396e0 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602fb7 expref: -99 pid: 57815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.125893:0:57815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc8848396e0 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602fb7 expref: -99 pid: 57815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.125906:0:57815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc8848396e0 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602fb7 expref: -99 pid: 57815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.125918:0:57815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc8848396e0 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602fb7 expref: -99 pid: 57815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.125925:0:57815:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc8848396e0 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4602fb7 expref: -99 pid: 57815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191336.125936:0:57815:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b453ab800 x1874004626533632/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/976 e 0 to 0 dl 1787191352 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191336.125947:0:57815:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc8848396e0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602fb7 expref: -99 pid: 57815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191336.125959:0:57815:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc8848396e0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4602fb7 expref: -99 pid: 57815 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.125968:0:57815:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/175 (0 0) 00000080:00200000:2.0:1787191336.125974:0:57815:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1787191336.126033:0:57815:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xaf:0x0]: layout version change: 4294967294 -> 4 00000080:00010000:2.0:1787191336.126038:0:57815:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xaf:0x0](ffff936b4898d348) for lock 0xe5129dc8848396e0 00000080:00010000:2.0:1787191336.126044:0:57815:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xaf:0x0](ffff936b4898d348) 00000080:00010000:2.0:1787191336.126048:0:57815:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848396e0 from it ffffa3fb420fbcb8 00010000:00010000:2.0:1787191336.126051:0:57815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc8848396e0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4602fb7 expref: -99 pid: 57815 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.126060:0:57815:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc8848396e0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4602fb7 expref: -99 pid: 57815 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191336.126111:0:57815:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xaf:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:2.0:1787191336.126122:0:57815:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xaf:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191336.126126:0:57815:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191336.126129:0:57815:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xaf:0x0] 00000008:00010000:2.0:1787191336.126148:0:57815:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191336.126151:0:57815:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d11b0, osc lock ffff936b44e63300, flags 0x400000400001002 00010000:00010000:2.0:1787191336.126168:0:57815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc8848396cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x190:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4602f7f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191336.126182:0:57815:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc8848396cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4602f7f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:2.0:1787191336.126193:0:57815:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191336.126198:0:57815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc8848396cb lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4602f7f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191336.126207:0:57815:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc8848396cb lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4602f7f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000020:00200000:2.0:1787191336.126217:0:57815:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191336.126227:0:57815:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xaf:0x0] updating i_size 5 i_blocks 0 00000020:00010000:2.0:1787191336.126233:0:57815:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51656060 (ffff936b465cc3f8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191336.126236:0:57815:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51656060 (ffff936b465cc3f8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191336.126239:0:57815:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d11b0 (ffff936b47a17d88/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191336.126243:0:57815:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51656060 (ffff936b465cc3f8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191336.126245:0:57815:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d11b0 (ffff936b465cc3f8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191336.126256:0:57815:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xaf:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191336.126307:0:57815:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191336.126325:0:57815:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191336.126334:0:57815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.126344:0:57815:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.126351:0:57815:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191336.126356:0:57815:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191336.126359:0:57815:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191336.126363:0:57815:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb420fbbf8 00010000:00010000:2.0:1787191336.126366:0:57815:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.126373:0:57815:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.126382:0:57815:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.126389:0:57815:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191336.126406:0:57815:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:2.0:1787191336.127051:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191336.127229:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634844672 00000100:00100000:3.0:1787191336.127240:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634844672 00000100:00100000:3.0:1787191336.127298:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1195 00000100:00100000:3.0:1787191336.127309:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634844672:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191336.127323:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc8848396e0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xaf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4602fb7 expref: -99 pid: 57815 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.127452:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191336.127459:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634844672:12345-192.168.202.101@tcp:104: Request processed in 152us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191336.127466:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1195 00000080:00200000:2.0:1787191336.132699:0:57815:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b51c6a780, open_flags d902, mode 0 opened 0 00000080:00200000:2.0:1787191336.132707:0:57815:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:2.0:1787191336.132733:0:57815:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154403 00010000:00010000:2.0:1787191336.132799:0:57815:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc8848396e7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.132808:0:57815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc8848396e7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57815 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191336.132820:0:57815:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191336.132828:0:57815:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9500 x1874004626534272/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191336.132865:0:57815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc8848396e7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191336.132886:0:57815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57815:1874004626534272:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191336.133055:0:57815:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b523599c0 going to sleep for 11 seconds 00000080:00200000:3.0:1787191336.145616:0:57817:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191336.145634:0:57817:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191336.145895:0:57817:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191336.145911:0:57817:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191336.145919:0:57817:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191336.145925:0:57817:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191336.145929:0:57817:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191336.145934:0:57817:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb420e3b58 00010000:00010000:3.0:1787191336.145938:0:57817:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191336.145946:0:57817:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191336.145960:0:57817:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191336.145966:0:57817:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:3.0:1787191336.145972:0:57817:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191336.145983:0:57817:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:3.0:1787191336.145987:0:57817:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:3.0:1787191336.146000:0:57817:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1787191336.146045:0:57817:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc8848396ee lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.146053:0:57817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc8848396ee lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.146124:0:57817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc8848396ee lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191336.146149:0:57817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57817:1874004626534400:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191336.146421:0:57817:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c240 going to sleep for 11 seconds 00000080:00200000:2.0:1787191336.167774:0:57817:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=8 00000080:00200000:2.0:1787191336.167820:0:57817:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191336.167858:0:57817:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191336.167867:0:57817:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.167876:0:57817:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.167882:0:57817:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191336.167888:0:57817:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191336.167891:0:57817:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191336.167895:0:57817:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb420e3bf8 00010000:00010000:2.0:1787191336.167897:0:57817:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.167906:0:57817:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.167913:0:57817:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.167917:0:57817:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191336.167921:0:57817:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.167924:0:57817:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:2.0:1787191336.167926:0:57817:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:2.0:1787191336.167929:0:57817:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b51c6a900, open_flags a141, mode 81b6 opened 0 00000080:00200000:2.0:1787191336.167935:0:57817:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:2.0:1787191336.167948:0:57817:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xb0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:2.0:1787191336.167956:0:57817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc8848396fc lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4603020 expref: -99 pid: 57817 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191336.167992:0:57817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc8848396fc lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4603020 expref: -99 pid: 57817 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191336.167997:0:57817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191336.167999:0:57817:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc8848396fc lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4603020 expref: -99 pid: 57817 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191336.168021:0:57817:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483970a lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.168025:0:57817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483970a lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57817 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191336.168035:0:57817:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191336.168040:0:57817:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb100 x1874004626535168/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191336.168046:0:57817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483970a lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191336.168061:0:57817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57817:1874004626535168:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191336.168204:0:57817:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359600 going to sleep for 11 seconds 00000100:00100000:2.0:1787191336.179561:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191336.179935:0:40922:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787191336.179954:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634844800 00000100:00100000:2.0:1787191336.179966:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634844800 00000100:00100000:2.0:1787191336.180040:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1196 00000100:00100000:2.0:1787191336.180051:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b4121e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634844800:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191336.180082:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483970a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4603051 expref: -99 pid: 57817 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191336.180154:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191336.180161:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b4121e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634844800:12345-192.168.202.101@tcp:104: Request processed in 113us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191336.180169:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1196 00010000:00010000:2.0:1787191336.181488:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787191336.181498:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483970a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4603051 expref: -99 pid: 57817 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191336.181511:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd4600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191336.181517:0:40929:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483970a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4603051 expref: -99 pid: 57817 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191336.181526:0:40929:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483970a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4603051 expref: -99 pid: 57817 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191336.181534:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483970a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4603051 expref: -99 pid: 57817 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191336.181558:0:40929:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xb0:0x0]: losing layout lock 00010000:00010000:2.0:1787191336.181609:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483970a lrc: 2/0,0 mode: --/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4603051 expref: -99 pid: 57817 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191336.181616:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191336.181641:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483970a lrc: 1/0,0 mode: --/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4603051 expref: -99 pid: 57817 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191336.181649:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483970a lrc: 0/0,0 mode: --/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4603051 expref: -99 pid: 57817 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191336.181663:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191336.181665:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191336.181667:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191336.181684:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626535552:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191336.187774:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626535552:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00200000:3.0:1787191336.196680:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191336.196706:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191336.196719:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191336.196729:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191336.196734:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191336.196740:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191336.196742:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191336.196747:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:3.0:1787191336.196750:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191336.196755:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191336.196766:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191336.196771:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191336.196776:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191336.197361:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:3.0:1787191336.197368:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xb0:0x0](ffff936b5395ba88), inode mode 81a4 mask 42 00000080:00200008:3.0:1787191336.197373:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xb0:0x0](ffff936b5395ba88), flags 101101 00000002:00010000:3.0:1787191336.197386:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xb0:0x0]) in obj [0x200000405:0xb0:0x0], intent: open|creat flags 04240101102 00010000:00010000:3.0:1787191336.197444:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caec00/0xe5129dc884839718 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4603089 expref: -99 pid: 57819 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191336.197461:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xb0:0x0]: losing layout lock 00010000:00010000:3.0:1787191336.197500:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caec00/0xe5129dc884839718 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4603089 expref: -99 pid: 57819 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.197505:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191336.197508:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caec00/0xe5129dc884839718 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4603089 expref: -99 pid: 57819 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.197532:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483971f lrc: 3/0,1 mode: --/CW res: [0x200000405:0xb0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.197536:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483971f lrc: 3/0,1 mode: --/CW res: [0x200000405:0xb0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191336.197543:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191336.197549:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1d880 x1874004626536576/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191336.197555:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483971f lrc: 3/0,1 mode: --/CW res: [0x200000405:0xb0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191336.197571:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626536576:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191336.197798:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191336.202493:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191336.202604:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634845056 00000100:00100000:3.0:1787191336.202612:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634845056 00000100:00100000:3.0:1787191336.202668:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1197 00000100:00100000:3.0:1787191336.202679:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634845056:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191336.202693:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483971f lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xb0:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e460309e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.202743:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191336.202750:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634845056:12345-192.168.202.101@tcp:104: Request processed in 73us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191336.202757:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1197 00000100:00100000:2.0:1787191336.214638:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191336.214713:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634845184 00000100:00100000:3.0:1787191336.214720:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634845184 00000100:00100000:3.0:1787191336.214774:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1198 00000100:00100000:3.0:1787191336.214784:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634845184:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191336.214796:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc884839726 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e46030b3 expref: -99 pid: 57819 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.214866:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191336.214873:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634845184:12345-192.168.202.101@tcp:104: Request processed in 91us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191336.214880:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1198 00010000:00010000:3.0:1787191336.214901:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191336.214908:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc884839726 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e46030b3 expref: -99 pid: 57819 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.214916:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51fe0a00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191336.214921:0:57627:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc884839726 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x13/0x13 rrc: 4 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e46030b3 expref: -99 pid: 57819 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.214929:0:57627:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc884839726 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x13/0x13 rrc: 4 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e46030b3 expref: -99 pid: 57819 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.214937:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc884839726 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x13/0x13 rrc: 4 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x7130d520e46030b3 expref: -99 pid: 57819 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.214971:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc884839726 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x13/0x13 rrc: 4 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e46030b3 expref: -99 pid: 57819 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.214978:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191336.214991:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc884839726 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x13/0x13 rrc: 4 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e46030b3 expref: -99 pid: 57819 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.214998:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc884839726 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x13/0x13 rrc: 4 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e46030b3 expref: -99 pid: 57819 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.215010:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191336.215011:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191336.215013:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191336.215180:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626537600:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00200000:3.0:1787191336.219901:0:57819:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xb0:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1787191336.219912:0:57819:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c38de0 (ffff936b47a172d8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191336.219917:0:57819:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c38de0 (ffff936b47a172d8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191336.219922:0:57819:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7d330 (ffff936b465cc878/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191336.219927:0:57819:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c38de0 (ffff936b47a172d8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191336.219930:0:57819:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7d330 (ffff936b47a172d8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191336.219946:0:57819:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb0:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191336.220006:0:57819:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xb0:0x0](ffff936b5395ba88), flags 154000 00000002:00100000:3.0:1787191336.220094:0:57819:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a474380 x1874004626536320/t8589936518(8589936518) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191352 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191336.220113:0:57819:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:3.0:1787191336.220119:0:57819:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1c000 x1874004626537856/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191336.220147:0:57819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57819:1874004626537856:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191336.222971:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626537600:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191336.235139:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191336.235956:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634845824 00000100:00100000:3.0:1787191336.235966:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634845824 00000100:00100000:3.0:1787191336.236018:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1199 00000100:00100000:3.0:1787191336.236028:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:37089:x1874004634845824:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191336.236046:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc8848396cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x190:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000030000 nid: local remote: 0x7130d520e4602f7f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1787191336.236126:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191336.236133:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:37089:x1874004634845824:12345-192.168.202.101@tcp:104: Request processed in 107us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191336.236140:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1199 00000100:00100000:2.0:1787191336.236336:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191336.236686:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634846464 00000100:00100000:3.0:1787191336.236691:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634846464 00000100:00100000:3.0:1787191336.236717:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1200 00000100:00100000:3.0:1787191336.236725:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30353:x1874004634846464:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191336.236733:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc8848396d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4602fa9 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.236778:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191336.236784:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30353:x1874004634846464:12345-192.168.202.101@tcp:104: Request processed in 60us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191336.236792:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1200 00000100:00100000:3.0:1787191336.239742:0:57819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57819:1874004626538368:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191336.239753:0:57819:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf400/0xe5129dc884839749 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460311c expref: -99 pid: 57819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.239769:0:57819:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf400/0xe5129dc884839749 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460311c expref: -99 pid: 57819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.239777:0:57819:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf400/0xe5129dc884839749 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460311c expref: -99 pid: 57819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.239786:0:57819:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf400/0xe5129dc884839749 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460311c expref: -99 pid: 57819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.239795:0:57819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf400/0xe5129dc884839749 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460311c expref: -99 pid: 57819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.239803:0:57819:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf400/0xe5129dc884839749 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460311c expref: -99 pid: 57819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.239815:0:57819:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf400/0xe5129dc884839749 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460311c expref: -99 pid: 57819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.239822:0:57819:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf400/0xe5129dc884839749 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460311c expref: -99 pid: 57819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191336.239858:0:57819:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b6a474380 x1874004626538368/t8589936524(8589936524) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191352 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191336.239872:0:57819:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474380 x1874004626538368/t8589936524(8589936524) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191352 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191336.239882:0:57819:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf400/0xe5129dc884839749 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460311c expref: -99 pid: 57819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191336.239893:0:57819:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf400/0xe5129dc884839749 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460311c expref: -99 pid: 57819 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.239900:0:57819:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/176 (0 0) 00000080:00200000:3.0:1787191336.239904:0:57819:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191336.239938:0:57819:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xb0:0x0](ffff936b5395ba88): rc = 0 00000080:00010000:3.0:1787191336.239953:0:57819:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xb0:0x0](ffff936b5395ba88) for lock 0xe5129dc884839749 00000080:00010000:3.0:1787191336.239969:0:57819:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xb0:0x0](ffff936b5395ba88) 00000080:00200008:3.0:1787191336.239985:0:57819:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xb0:0x0](ffff936b5395ba88), flags 154400 00000002:00100000:3.0:1787191336.240012:0:57819:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474380 x1874004626538368/t8589936524(8589936524) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191352 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1787191336.240065:0:57819:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839749 from it ffff936b495dcc60 00010000:00010000:3.0:1787191336.240081:0:57819:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf400/0xe5129dc884839749 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460311c expref: -99 pid: 57819 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.240089:0:57819:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf400/0xe5129dc884839749 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460311c expref: -99 pid: 57819 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1787191336.240103:0:57819:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xb0:0x0](ffff936b5395ba88), inode mode 81a4 mask 44 00000080:00200000:3.0:1787191336.240161:0:57819:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xb0:0x0](ffff936b5395ba88), inode mode 81a4 mask 4 00000080:00200000:3.0:1787191336.240171:0:57819:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xb0:0x0](ffff936b5395ba88), xattr lov 00000080:00200008:3.0:1787191336.240766:0:57819:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xb0:0x0](ffff936b5395ba88), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191336.240775:0:57819:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xb0:0x0](ffff936b5395ba88),name=f70.sanity-flr 00000002:00010000:3.0:1787191336.240796:0:57819:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xb0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191336.240804:0:57819:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf400/0xe5129dc884839749 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460311c expref: -99 pid: 57819 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.240814:0:57819:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf400/0xe5129dc884839749 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460311c expref: -99 pid: 57819 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191336.240821:0:57819:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191336.240827:0:57819:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xb0:0x0](ffff936b5395ba88) 00000080:00010000:3.0:1787191336.240852:0:57819:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xb0:0x0](ffff936b5395ba88) for lock 0xe5129dc884839749 00000080:00010000:3.0:1787191336.240857:0:57819:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839749 from it ffffa3fb42113cd8 00010000:00010000:3.0:1787191336.240861:0:57819:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf400/0xe5129dc884839749 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460311c expref: -99 pid: 57819 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.240870:0:57819:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf400/0xe5129dc884839749 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460311c expref: -99 pid: 57819 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191336.240885:0:57819:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xb0:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00020000:00200000:3.0:1787191336.240891:0:57819:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xb0:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191336.240895:0:57819:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191336.240898:0:57819:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xb0:0x0] 00000008:00010000:3.0:1787191336.240906:0:57819:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191336.240908:0:57819:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667730, osc lock ffff936b44f64d10, flags 0x400000400001002 00010000:00010000:3.0:1787191336.240919:0:57819:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000cfb66679/0xe5129dc88483973b lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x195:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46030d6 expref: -99 pid: 57819 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.240937:0:57819:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000cfb66679/0xe5129dc88483973b lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x195:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46030d6 expref: -99 pid: 57819 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000008:00010000:3.0:1787191336.240950:0:57819:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000cfb66679/0xe5129dc88483973b lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x195:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46030d6 expref: -99 pid: 57819 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:3.0:1787191336.240960:0:57819:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191336.240964:0:57819:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000cfb66679/0xe5129dc88483973b lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x195:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46030d6 expref: -99 pid: 57819 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.240971:0:57819:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000cfb66679/0xe5129dc88483973b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x195:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46030d6 expref: -99 pid: 57819 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:3.0:1787191336.240980:0:57819:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191336.240989:0:57819:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xb0:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1787191336.240993:0:57819:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c38de0 (ffff936b47a172d8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191336.240996:0:57819:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c38de0 (ffff936b47a172d8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191336.240999:0:57819:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667730 (ffff936b465cc878/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191336.241002:0:57819:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c38de0 (ffff936b47a172d8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191336.241005:0:57819:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667730 (ffff936b47a172d8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191336.241014:0:57819:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb0:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191336.241039:0:57819:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xb0:0x0](ffff936b5395ba88), flags 154000 00000002:00100000:3.0:1787191336.241066:0:57819:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a474380 x1874004626538368/t8589936524(8589936524) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191352 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191336.241782:0:57819:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191336.241790:0:57819:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1c380 x1874004626539008/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191336.242770:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191336.242867:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634846592 00000100:00100000:3.0:1787191336.242878:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634846592 00000100:00100000:3.0:1787191336.242952:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1201 00000100:00100000:3.0:1787191336.242963:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:29543:x1874004634846592:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191336.242981:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000cfb66679/0xe5129dc88483973b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x195:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000010000 nid: local remote: 0x7130d520e46030d6 expref: -99 pid: 57819 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191336.243055:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191336.243061:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:29543:x1874004634846592:12345-192.168.202.101@tcp:104: Request processed in 101us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191336.243066:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1201 00000100:00100000:2.0:1787191336.248655:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191336.248753:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634846720 00000100:00100000:3.0:1787191336.248762:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634846720 00000100:00100000:3.0:1787191336.248960:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1202 00000100:00100000:3.0:1787191336.248972:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:37090:x1874004634846720:12345-192.168.202.101@tcp:105: 00010000:00010000:3.0:1787191336.248986:0:40922:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc884839750 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e460312a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.248999:0:40922:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc884839750 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e460312a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.249097:0:40922:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc884839750 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e460312a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.249109:0:40922:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc884839750 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080080020000 nid: local remote: 0x7130d520e460312a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.249118:0:40922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc884839750 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080080020000 nid: local remote: 0x7130d520e460312a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.249127:0:40922:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc884839750 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80080020000 nid: local remote: 0x7130d520e460312a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.249200:0:40922:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b51fe1e00) 00000100:00100000:3.0:1787191336.249253:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:37090:x1874004634846720:12345-192.168.202.101@tcp:105: Request processed in 283us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191336.249261:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1202 00000100:00100000:3.0:1787191336.254862:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626539392:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191336.254886:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b9bf1031/0xe5129dc884839757 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603131 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.254905:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b9bf1031/0xe5129dc884839757 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4603131 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.254920:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b9bf1031/0xe5129dc884839757 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4603131 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.254936:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b9bf1031/0xe5129dc884839757 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4603131 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191336.254949:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b9bf1031/0xe5129dc884839757 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4603131 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.254963:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b9bf1031/0xe5129dc884839757 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4603131 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.254971:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b9bf1031/0xe5129dc884839757 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4603131 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191336.255311:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626539648:192.168.202.101@tcp:10:bash.0 00000100:00100000:2.0:1787191336.255384:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787191336.255391:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626539520:192.168.202.101@tcp:10:bash.0 00000100:00100000:3.0:1787191336.259671:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626539520:192.168.202.101@tcp:10:bash.0 00000100:00100000:3.0:1787191336.259690:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626539648:192.168.202.101@tcp:10:bash.0 00000100:00100000:3.0:1787191336.265998:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626540160:192.168.202.101@tcp:35:bash.0 00000002:00100000:3.0:1787191336.266022:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1d880 x1874004626536576/t8589936519(8589936519) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191352 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787191336.270056:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191336.270156:0:51131:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787191336.270187:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634846848 00000100:00100000:3.0:1787191336.270196:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634846848 00000100:00100000:3.0:1787191336.270283:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1203 00000100:00100000:3.0:1787191336.270293:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b50880c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634846848:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191336.270311:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf400/0xe5129dc884839749 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e460311c expref: -99 pid: 57819 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191336.270386:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191336.270393:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b50880c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634846848:12345-192.168.202.101@tcp:104: Request processed in 102us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191336.270404:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1203 00010000:00010000:3.0:1787191336.271046:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191336.271053:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf400/0xe5129dc884839749 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e460311c expref: -99 pid: 57819 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191336.271121:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44caf400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191336.271127:0:57627:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf400/0xe5129dc884839749 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e460311c expref: -99 pid: 57819 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191336.271136:0:57627:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf400/0xe5129dc884839749 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e460311c expref: -99 pid: 57819 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191336.271145:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf400/0xe5129dc884839749 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e460311c expref: -99 pid: 57819 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191336.271261:0:57627:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483975e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xb0:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460313f expref: -99 pid: 57820 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191336.271275:0:57627:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf800/0xe5129dc884839742 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xb0:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46030e4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191336.271312:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf400/0xe5129dc884839749 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e460311c expref: -99 pid: 57819 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191336.271319:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787191336.271801:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626540544:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787191336.271944:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf400/0xe5129dc884839749 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e460311c expref: -99 pid: 57819 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191336.271958:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf400/0xe5129dc884839749 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e460311c expref: -99 pid: 57819 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191336.271973:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191336.271975:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191336.271977:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191336.275019:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626540544:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191336.279468:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191336.279503:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634846976 00000100:00100000:3.0:1787191336.279512:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634846976 00000100:00100000:3.0:1787191336.279582:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1204 00000100:00100000:3.0:1787191336.279595:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634846976:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191336.279615:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caee00/0xe5129dc884839765 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xb0:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e4603154 expref: -99 pid: 57820 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.279969:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191336.279977:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634846976:12345-192.168.202.101@tcp:104: Request processed in 385us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191336.279985:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1204 00000100:00100000:3.0:1787191336.285644:0:57821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57821:1874004626540672:192.168.202.101@tcp:101:rm.0 00010000:00010000:3.0:1787191336.285670:0:57821:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483976c lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603177 expref: -99 pid: 57821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.285692:0:57821:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483976c lrc: 4/1,0 mode: --/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603177 expref: -99 pid: 57821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.285701:0:57821:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483976c lrc: 4/1,0 mode: --/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603177 expref: -99 pid: 57821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.285714:0:57821:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483976c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603177 expref: -99 pid: 57821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.285727:0:57821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483976c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603177 expref: -99 pid: 57821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.285739:0:57821:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483976c lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603177 expref: -99 pid: 57821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.285747:0:57821:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483976c lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603177 expref: -99 pid: 57821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.285755:0:57821:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483976c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603177 expref: -99 pid: 57821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191336.285767:0:57821:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b6a476d80 x1874004626540672/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/976 e 0 to 0 dl 1787191352 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191336.285782:0:57821:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483976c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603177 expref: -99 pid: 57821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191336.285803:0:57821:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483976c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603177 expref: -99 pid: 57821 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.285823:0:57821:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/176 (0 0) 00000080:00200000:3.0:1787191336.285858:0:57821:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191336.285910:0:57821:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xb0:0x0](ffff936b5395ba88): rc = 0 00000080:00200000:3.0:1787191336.285928:0:57821:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xb0:0x0]: layout version change: 4 -> 4 00000080:00010000:3.0:1787191336.285936:0:57821:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xb0:0x0](ffff936b5395ba88) for lock 0xe5129dc88483976c 00000080:00010000:3.0:1787191336.285952:0:57821:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xb0:0x0](ffff936b5395ba88) 00000080:00010000:3.0:1787191336.285957:0:57821:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483976c from it ffffa3fb4211bb20 00010000:00010000:3.0:1787191336.286023:0:57821:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483976c lrc: 4/2,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4603177 expref: -99 pid: 57821 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.286033:0:57821:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483976c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4603177 expref: -99 pid: 57821 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000080:00200008:2.0:1787191336.286889:0:57821:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xb0:0x0](ffff936b5395ba88), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191336.286897:0:57821:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xb0:0x0](ffff936b5395ba88),name=f70.sanity-flr 00000002:00010000:2.0:1787191336.286916:0:57821:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xb0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191336.286923:0:57821:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483976c lrc: 3/2,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603177 expref: -99 pid: 57821 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.286931:0:57821:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483976c lrc: 3/2,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603177 expref: -99 pid: 57821 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000080:00200000:2.0:1787191336.286935:0:57821:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191336.286940:0:57821:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xb0:0x0](ffff936b5395ba88) 00000080:00010000:2.0:1787191336.286943:0:57821:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xb0:0x0](ffff936b5395ba88) for lock 0xe5129dc88483976c 00000080:00010000:2.0:1787191336.286946:0:57821:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483976c from it ffffa3fb4211bcb8 00010000:00010000:2.0:1787191336.286949:0:57821:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483976c lrc: 4/2,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4603177 expref: -99 pid: 57821 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.286954:0:57821:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483976c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4603177 expref: -99 pid: 57821 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000080:00200000:2.0:1787191336.286968:0:57821:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xb0:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:2.0:1787191336.286977:0:57821:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xb0:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191336.286979:0:57821:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191336.286981:0:57821:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xb0:0x0] 00000008:00010000:2.0:1787191336.286996:0:57821:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191336.286998:0:57821:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1db0, osc lock ffff936b44e63300, flags 0x400000400001002 00010000:00010000:2.0:1787191336.287011:0:57821:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc884839750 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x195:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460312a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191336.287019:0:57821:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc884839750 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460312a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:2.0:1787191336.287027:0:57821:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191336.287029:0:57821:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc884839750 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e460312a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191336.287034:0:57821:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc884839750 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460312a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000020:00200000:2.0:1787191336.287043:0:57821:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191336.287050:0:57821:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xb0:0x0] updating i_size 5 i_blocks 0 00000020:00010000:2.0:1787191336.287054:0:57821:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51656060 (ffff936b465cc3f8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191336.287056:0:57821:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51656060 (ffff936b465cc3f8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191336.287058:0:57821:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1db0 (ffff936b47a17d88/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191336.287061:0:57821:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51656060 (ffff936b465cc3f8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191336.287063:0:57821:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1db0 (ffff936b465cc3f8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191336.287082:0:57821:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb0:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191336.287130:0:57821:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191336.287139:0:57821:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191336.287147:0:57821:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.287265:0:57821:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.287275:0:57821:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191336.287279:0:57821:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191336.287283:0:57821:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191336.287287:0:57821:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4211bc10 00010000:00010000:2.0:1787191336.287291:0:57821:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.287298:0:57821:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.287307:0:57821:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.287313:0:57821:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191336.287318:0:57821:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.287324:0:57821:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:2.0:1787191336.287328:0:57821:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:2.0:1787191336.287332:0:57821:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:2.0:1787191336.287355:0:57821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483975e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xb0:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e460313f expref: -99 pid: 57820 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000002:00100000:2.0:1787191336.287796:0:57821:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a474380 x1874004626539904/t8589936526(8589936526) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191352 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191336.287809:0:57821:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191336.287814:0:57821:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9c00 x1874004626541184/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191336.287905:0:57821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57821:1874004626541184:192.168.202.101@tcp:35:rm.0 00000100:00100000:2.0:1787191336.288034:0:57821:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359000 going to sleep for 11 seconds 00010000:00010000:2.0:1787191336.289998:0:57820:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000080:00200000:2.0:1787191336.290019:0:57820:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xb0:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1787191336.290096:0:57820:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xb0:0x0]: layout version change: 4 -> 4 00000080:00010000:2.0:1787191336.290106:0:57820:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xb0:0x0](ffff936b5395ba88) for lock 0xe5129dc88483976c 00000080:00010000:2.0:1787191336.290113:0:57820:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xb0:0x0](ffff936b5395ba88) 00000080:00010000:2.0:1787191336.290117:0:57820:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483976c from it ffffa3fb420e3cd8 00010000:00010000:2.0:1787191336.290122:0:57820:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483976c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4603177 expref: -99 pid: 57821 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.290133:0:57820:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483976c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603177 expref: -99 pid: 57821 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191336.290184:0:57820:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xb0:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:2.0:1787191336.290195:0:57820:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xb0:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191336.290199:0:57820:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191336.290202:0:57820:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xb0:0x0] 00000008:00010000:2.0:1787191336.290221:0:57820:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191336.290224:0:57820:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1db0, osc lock ffff936b44e63300, flags 0x400000400001002 00010000:00010000:2.0:1787191336.290241:0:57820:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc884839750 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x195:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460312a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1787191336.290256:0:57820:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc884839750 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460312a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000020:00200000:2.0:1787191336.290268:0:57820:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191336.290272:0:57820:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc884839750 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e460312a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1787191336.290280:0:57820:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc884839750 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460312a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00000020:00200000:2.0:1787191336.290290:0:57820:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191336.290299:0:57820:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xb0:0x0] updating i_size 5 i_blocks 0 00000020:00010000:2.0:1787191336.290305:0:57820:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51656060 (ffff936b465cc3f8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191336.290308:0:57820:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51656060 (ffff936b465cc3f8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191336.290311:0:57820:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1db0 (ffff936b47a17d88/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191336.290314:0:57820:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51656060 (ffff936b465cc3f8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191336.290318:0:57820:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1db0 (ffff936b465cc3f8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191336.290327:0:57820:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb0:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200080:2.0:1787191336.290443:0:57820:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xb0:0x0](ffff936b5395ba88) cmd=c00c66f3 arg=d012e0 00000002:00010000:2.0:1787191336.290468:0:57820:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xb0:0x0]) in obj [0x200000405:0xb0:0x0], intent: open flags 05004040000002 00010000:00010000:2.0:1787191336.290514:0:57820:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483977a lrc: 3/1,0 mode: --/CR res: [0x200000405:0xb0:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x10000000000000 pid: 57820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.290526:0:57820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483977a lrc: 3/1,0 mode: --/CR res: [0x200000405:0xb0:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x0 pid: 57820 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191336.290537:0:57820:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:2.0:1787191336.290550:0:57820:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bbb80 x1874004626541440/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191336.290561:0:57820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483977a lrc: 3/1,0 mode: --/CR res: [0x200000405:0xb0:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x81000000000000 pid: 57820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191336.290586:0:57820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57820:1874004626541440:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191336.290790:0:57820:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359300 going to sleep for 11 seconds 00000100:00100000:2.0:1787191336.292683:0:57821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57821:1874004626541696:192.168.202.101@tcp:36:rm.0 00000100:00100000:2.0:1787191336.292764:0:57821:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787191336.295131:0:57820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57820:1874004626541440:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191336.295153:0:57820:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483977a lrc: 4/1,0 mode: --/CR res: [0x200000405:0xb0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4603193 expref: -99 pid: 57820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.295172:0:57820:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483977a lrc: 4/1,0 mode: --/PW res: [0x200000405:0xb0:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4603193 expref: -99 pid: 57820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.295185:0:57820:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483977a lrc: 4/1,0 mode: PW/PW res: [0x200000405:0xb0:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4603193 expref: -99 pid: 57820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.295197:0:57820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483977a lrc: 4/1,0 mode: PW/PW res: [0x200000405:0xb0:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4603193 expref: -99 pid: 57820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.295215:0:57820:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483977a lrc: 5/1,1 mode: PW/PW res: [0x200000405:0xb0:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4603193 expref: -99 pid: 57820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.295224:0:57820:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483977a lrc: 5/1,1 mode: PW/PW res: [0x200000405:0xb0:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4603193 expref: -99 pid: 57820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.295230:0:57820:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483977a lrc: 4/0,1 mode: PW/PW res: [0x200000405:0xb0:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4603193 expref: -99 pid: 57820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191336.295241:0:57820:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x600002b, status=0 req@ffff936b513bbb80 x1874004626541440/t8589936530(8589936530) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191352 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191336.295253:0:57820:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bbb80 x1874004626541440/t8589936530(8589936530) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191352 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191336.295267:0:57820:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483977a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xb0:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4603193 expref: -99 pid: 57820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.295277:0:57820:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 2 res 8589935621/176 (0 0) 00000080:00200000:2.0:1787191336.295283:0:57820:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xb0:0x0] suppgids 0 0: rc 0 00000002:00100000:2.0:1787191336.295304:0:57820:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bbb80 x1874004626541440/t8589936530(8589936530) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191352 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1787191336.295311:0:57820:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xb0:0x0](ffff936b5395ba88) for lock 0xe5129dc88483977a 00000080:00010000:2.0:1787191336.295317:0:57820:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483977a from it ffffa3fb420e3cc0 00010000:00010000:2.0:1787191336.295321:0:57820:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483977a lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xb0:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4603193 expref: -99 pid: 57820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.295333:0:57820:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483977a lrc: 2/0,0 mode: PW/PW res: [0x200000405:0xb0:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4603193 expref: -99 pid: 57820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00200000:2.0:1787191336.295398:0:57820:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xb0:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:2.0:1787191336.295410:0:57820:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xb0:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191336.295413:0:57820:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191336.295419:0:57820:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191336.295430:0:57820:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000100:00100000:2.0:1787191336.295493:0:2392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787191336.295510:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626541824:192.168.202.101@tcp:1:lfs.0 00000100:00100000:3.0:1787191336.296963:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191336.297141:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634847104 00000100:00100000:2.0:1787191336.297151:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634847104 00000100:00100000:2.0:1787191336.297258:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1205 00000100:00100000:2.0:1787191336.297269:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634847104:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191336.297286:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483976c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4603177 expref: -99 pid: 57821 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191336.297354:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191336.297361:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634847104:12345-192.168.202.101@tcp:104: Request processed in 95us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191336.297369:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1205 00000100:00100000:3.0:1787191336.298855:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191336.298888:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634847232 00000100:00100000:3.0:1787191336.298895:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634847232 00000100:00100000:3.0:1787191336.298932:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1206 00000100:00100000:3.0:1787191336.298941:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8720:x1874004634847232:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191336.298952:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc884839750 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420080020000 nid: local remote: 0x7130d520e460312a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00010000:00010000:3.0:1787191336.299013:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191336.299019:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8720:x1874004634847232:12345-192.168.202.101@tcp:104: Request processed in 80us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191336.299025:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1206 00000100:00100000:2.0:1787191336.304213:0:57821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57821:1874004626541696:192.168.202.101@tcp:36:rm.0 00000080:00200000:3.0:1787191336.306745:0:57627:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xb0:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1787191336.306797:0:57627:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb0:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1787191336.306918:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc884839750 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69480020020 nid: local remote: 0x7130d520e460312a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00010000:00010000:3.0:1787191336.306932:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191336.306958:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc884839750 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69480020020 nid: local remote: 0x7130d520e460312a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00010000:00010000:3.0:1787191336.306965:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc884839750 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69480020020 nid: local remote: 0x7130d520e460312a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00010000:00010000:3.0:1787191336.306986:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191336.306988:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191336.306990:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191336.306997:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787191336.307009:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626542208:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191336.308709:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626541824:192.168.202.101@tcp:1:lfs.0 00000100:00100000:3.0:1787191336.309012:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626542208:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00200000:2.0:1787191336.319004:0:57822:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191336.319024:0:57822:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191336.319039:0:57822:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.319053:0:57822:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.319062:0:57822:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191336.319079:0:57822:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191336.319083:0:57822:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191336.319090:0:57822:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb420b3b58 00010000:00010000:2.0:1787191336.319094:0:57822:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.319103:0:57822:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.319191:0:57822:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.319199:0:57822:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:2.0:1787191336.319205:0:57822:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.319217:0:57822:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:2.0:1787191336.319222:0:57822:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191336.319236:0:57822:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191336.319277:0:57822:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc88483978f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.319285:0:57822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc88483978f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.319294:0:57822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc88483978f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191336.319312:0:57822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57822:1874004626542848:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191336.319436:0:57822:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787191336.342347:0:57822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57822:1874004626543104:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191336.342375:0:57822:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483979d lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.342393:0:57822:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483979d lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.342400:0:57822:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483979d lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.342407:0:57822:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483979d lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.342422:0:57822:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483979d lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.342429:0:57822:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51fe1e00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191336.342435:0:57822:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483979d lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.342443:0:57822:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483979d lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.342449:0:57822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483979d lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.342457:0:57822:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191336.342465:0:57822:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483979d lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.342472:0:57822:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483979d lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191336.342509:0:57822:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b453aa300 x1874004626543104/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191352 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191336.342527:0:57822:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191336.342658:0:57822:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191336.342678:0:57822:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191336.342690:0:57822:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191336.342701:0:57822:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191336.342708:0:57822:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191336.342714:0:57822:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191336.342717:0:57822:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191336.342722:0:57822:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb420b3b58 00010000:00010000:3.0:1787191336.342726:0:57822:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191336.342734:0:57822:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191336.342750:0:57822:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191336.342759:0:57822:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:3.0:1787191336.342770:0:57822:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:3.0:1787191336.342776:0:57822:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:3.0:1787191336.342791:0:57822:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191336.342798:0:57822:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 64 lru_type: 1 00010000:00010000:3.0:1787191336.342806:0:57822:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 64 lru_type: 1 00000002:00010000:3.0:1787191336.342818:0:57822:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191336.342895:0:57822:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc8848397a4 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.342903:0:57822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc8848397a4 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.342917:0:57822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc8848397a4 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191336.342940:0:57822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57822:1874004626543232:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191336.343032:0:57822:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191336.347877:0:57822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57822:1874004626543232:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191336.347911:0:57822:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc8848397a4 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603211 expref: -99 pid: 57822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.347927:0:57822:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc8848397a4 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603211 expref: -99 pid: 57822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.347939:0:57822:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc8848397a4 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603211 expref: -99 pid: 57822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.347951:0:57822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc8848397a4 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603211 expref: -99 pid: 57822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.347964:0:57822:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc8848397a4 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603211 expref: -99 pid: 57822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.347973:0:57822:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc8848397a4 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603211 expref: -99 pid: 57822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.347981:0:57822:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc8848397a4 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603211 expref: -99 pid: 57822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191336.348001:0:57822:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b51d1c000 x1874004626543232/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191352 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191336.348017:0:57822:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc8848397a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603211 expref: -99 pid: 57822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.348030:0:57822:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:3.0:1787191336.348038:0:57822:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc8848397a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603211 expref: -99 pid: 57822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.348047:0:57822:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc8848397a4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603211 expref: -99 pid: 57822 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:3.0:1787191336.348088:0:57822:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191336.348100:0:57822:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 128 lru_type: 1 00010000:00010000:3.0:1787191336.348114:0:57822:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 128 lru_type: 1 00010000:00010000:3.0:1787191336.348122:0:57822:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 128 lru_type: 1 00010000:00010000:3.0:1787191336.348129:0:57822:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 129 lru_type: 1 00000080:00200000:3.0:1787191336.348142:0:57822:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1787191336.348165:0:57822:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:3.0:1787191336.348170:0:57822:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:3.0:1787191336.348178:0:57822:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb420b3cb8 00010000:00010000:3.0:1787191336.348182:0:57822:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 64 lru_type: 1 00010000:00010000:3.0:1787191336.348190:0:57822:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 65 lru_type: 1 00000002:00010000:3.0:1787191336.348208:0:57822:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191336.348214:0:57822:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc8848397a4 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603211 expref: -99 pid: 57822 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.348222:0:57822:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc8848397a4 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603211 expref: -99 pid: 57822 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.348230:0:57822:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc8848397a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603211 expref: -99 pid: 57822 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.348237:0:57822:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc8848397a4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603211 expref: -99 pid: 57822 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:3.0:1787191336.348246:0:57822:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191336.348251:0:57822:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 129 lru_type: 1 00010000:00010000:3.0:1787191336.348259:0:57822:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 129 lru_type: 1 00010000:00010000:3.0:1787191336.348272:0:57822:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 129 lru_type: 1 00010000:00010000:3.0:1787191336.348279:0:57822:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 130 lru_type: 1 00000080:00200008:3.0:1787191336.348930:0:57822:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:3.0:1787191336.348938:0:57822:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191336.348955:0:57822:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191336.348966:0:57822:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191336.348975:0:57822:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191336.348981:0:57822:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191336.348985:0:57822:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191336.348987:0:57822:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191336.348992:0:57822:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb420b3cb8 00010000:00010000:3.0:1787191336.348995:0:57822:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191336.349002:0:57822:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191336.349125:0:57822:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191336.349135:0:57822:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191336.349142:0:57822:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191336.349151:0:57822:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191336.349157:0:57822:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191336.349162:0:57822:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191336.349164:0:57822:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191336.349168:0:57822:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb420b3b58 00010000:00010000:3.0:1787191336.349171:0:57822:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191336.349179:0:57822:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191336.349188:0:57822:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191336.349194:0:57822:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:3.0:1787191336.349200:0:57822:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191336.349209:0:57822:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:3.0:1787191336.349213:0:57822:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:3.0:1787191336.349226:0:57822:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1787191336.349265:0:57822:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848397ab lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.349274:0:57822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848397ab lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.349284:0:57822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848397ab lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191336.349307:0:57822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57822:1874004626543360:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191336.349397:0:57822:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191336.361506:0:57822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57822:1874004626543360:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191336.361534:0:57822:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848397ab lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.361550:0:57822:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848397ab lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.361558:0:57822:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848397ab lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.361565:0:57822:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848397ab lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.361574:0:57822:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848397ab lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.361580:0:57822:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9a600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191336.361585:0:57822:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848397ab lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.361591:0:57822:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848397ab lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.361599:0:57822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848397ab lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.361606:0:57822:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191336.361613:0:57822:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848397ab lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.361619:0:57822:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc8848397ab lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191336.361637:0:57822:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b51d1c000 x1874004626543360/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191352 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191336.361717:0:57822:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1787191336.361755:0:57822:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc8848397a4 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603211 expref: -99 pid: 57822 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191336.361768:0:57822:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc8848397a4 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603211 expref: -99 pid: 57822 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:3.0:1787191336.361777:0:57822:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848397a4 from it ffffa3fb420b3930 00010000:00010000:3.0:1787191336.361780:0:57822:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc8848397a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603211 expref: -99 pid: 57822 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191336.361788:0:57822:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc8848397a4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603211 expref: -99 pid: 57822 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787191336.361985:0:57822:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191336.362004:0:57822:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191336.362014:0:57822:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191336.362023:0:57822:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191336.362035:0:57822:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191336.362040:0:57822:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191336.362044:0:57822:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191336.362048:0:57822:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb420b3bf8 00010000:00010000:3.0:1787191336.362051:0:57822:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191336.362058:0:57822:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191336.362067:0:57822:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191336.362086:0:57822:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191336.362091:0:57822:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191336.362098:0:57822:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:3.0:1787191336.362102:0:57822:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:3.0:1787191336.362108:0:57822:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b62914000, open_flags a141, mode 81b6 opened 0 00000080:00200000:3.0:1787191336.362119:0:57822:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:3.0:1787191336.362139:0:57822:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xb1:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:3.0:1787191336.362150:0:57822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc8848397a4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4603211 expref: -99 pid: 57822 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191336.362285:0:57822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc8848397a4 lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4603211 expref: -99 pid: 57822 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191336.362291:0:57822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191336.362294:0:57822:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc8848397a4 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4603211 expref: -99 pid: 57822 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191336.362324:0:57822:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc8848397b2 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.362331:0:57822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc8848397b2 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191336.362341:0:57822:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191336.362350:0:57822:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1c000 x1874004626543616/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191336.362360:0:57822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc8848397b2 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191336.362384:0:57822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57822:1874004626543616:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191336.362607:0:57822:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191336.372428:0:57822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57822:1874004626543616:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191336.372460:0:57822:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc8848397b2 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603242 expref: -99 pid: 57822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.372489:0:57822:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc8848397b2 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xb1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603242 expref: -99 pid: 57822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.372498:0:57822:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc8848397b2 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xb1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603242 expref: -99 pid: 57822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.372509:0:57822:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc8848397b2 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xb1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603242 expref: -99 pid: 57822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.372524:0:57822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc8848397b2 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xb1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603242 expref: -99 pid: 57822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.372538:0:57822:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc8848397b2 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xb1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603242 expref: -99 pid: 57822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.372547:0:57822:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc8848397b2 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xb1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603242 expref: -99 pid: 57822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.372555:0:57822:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc8848397b2 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xb1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603242 expref: -99 pid: 57822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191336.372567:0:57822:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b51d1c000 x1874004626543616/t8589936533(8589936533) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191352 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191336.372582:0:57822:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1c000 x1874004626543616/t8589936533(8589936533) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191352 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191336.372596:0:57822:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc8848397b2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xb1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603242 expref: -99 pid: 57822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.372607:0:57822:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/177 (0 0) 00000080:00200000:3.0:1787191336.372614:0:57822:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191336.372626:0:57822:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:3.0:1787191336.372668:0:57822:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xb1:0x0](ffff936b489aec08) 00000080:00200000:3.0:1787191336.372675:0:57822:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xb1:0x0], updating i_size 0 00000080:00200000:3.0:1787191336.372714:0:57822:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xb1:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:3.0:1787191336.372719:0:57822:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xb1:0x0](ffff936b489aec08) 00000080:00010000:3.0:1787191336.372723:0:57822:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xb1:0x0](ffff936b489aec08) for lock 0xe5129dc8848397b2 00000080:00010000:3.0:1787191336.372733:0:57822:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xb1:0x0](ffff936b489aec08) 00000080:00200008:3.0:1787191336.372747:0:57822:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xb1:0x0](ffff936b489aec08), flags 120501 00000002:00100000:3.0:1787191336.372768:0:57822:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1c000 x1874004626543616/t8589936533(8589936533) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191352 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1787191336.372800:0:57822:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848397b2 from it ffff936b46033ba0 00010000:00010000:3.0:1787191336.372804:0:57822:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc8848397b2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xb1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4603242 expref: -99 pid: 57822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.372813:0:57822:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc8848397b2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xb1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603242 expref: -99 pid: 57822 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191336.372868:0:57822:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xb1:0x0](ffff936b489aec08), inode mode 81a4 mask 40 00000080:00200000:3.0:1787191336.372925:0:57822:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xb1:0x0](ffff936b489aec08), inode mode 81a4 mask 2 00000080:00200000:3.0:1787191336.372935:0:57822:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xb1:0x0](ffff936b489aec08), xattr lov 00000002:00010000:3.0:1787191336.372952:0:57822:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xb1:0x0]) in obj [0x200000405:0xb1:0x0], intent: open flags 040000002 00010000:00010000:3.0:1787191336.372998:0:57822:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc8848397b9 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xb1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.373005:0:57822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc8848397b9 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xb1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191336.373015:0:57822:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191336.373020:0:57822:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1f100 x1874004626543872/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191336.373029:0:57822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc8848397b9 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xb1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191336.373048:0:57822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57822:1874004626543872:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191336.373491:0:57822:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1787191336.381267:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191336.381364:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634847872 00000100:00100000:3.0:1787191336.381375:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634847872 00000100:00100000:3.0:1787191336.381475:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1207 00000100:00100000:3.0:1787191336.381486:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634847872:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191336.381504:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc8848397b2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xb1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4603242 expref: -99 pid: 57822 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.381590:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191336.381598:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634847872:12345-192.168.202.101@tcp:104: Request processed in 114us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191336.381606:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1207 00000100:00100000:3.0:1787191336.408013:0:57822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57822:1874004626543872:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191336.408042:0:57822:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc8848397b9 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xb1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.408057:0:57822:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc8848397b9 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xb1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.408067:0:57822:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc8848397b9 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xb1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.408086:0:57822:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc8848397b9 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xb1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.408096:0:57822:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc8848397b9 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xb1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.408102:0:57822:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9b000 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191336.408108:0:57822:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc8848397b9 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xb1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.408115:0:57822:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc8848397b9 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xb1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.408123:0:57822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc8848397b9 lrc: 5/0,0 mode: --/CR res: [0x200000405:0xb1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.408131:0:57822:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191336.408138:0:57822:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc8848397b9 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xb1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.408146:0:57822:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc8848397b9 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xb1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57822 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191336.408170:0:57822:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b51d1f100 x1874004626543872/t8589936534(8589936534) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191352 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191336.408184:0:57822:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1f100 x1874004626543872/t8589936534(8589936534) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191352 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191336.408202:0:57822:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xb1:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1787191336.408250:0:57822:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xb1:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00000080:00200000:3.0:1787191336.408260:0:57822:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb1:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191336.408307:0:57822:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xb1:0x0], updating i_size 0 00000002:00100000:3.0:1787191336.408327:0:57822:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1f100 x1874004626543872/t8589936534(8589936534) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191352 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191336.408367:0:57822:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1f100 x1874004626543872/t8589936534(8589936534) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191352 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191336.408377:0:57822:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191336.408383:0:57822:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1c700 x1874004626544384/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191336.408404:0:57822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57822:1874004626544384:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191336.408574:0:57822:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191336.413576:0:57822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57822:1874004626544384:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191336.413618:0:57822:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1f100 x1874004626543872/t8589936534(8589936534) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191352 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:3.0:1787191336.413693:0:57822:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xb1:0x0](ffff936b489aec08), flags 100001 00000002:00100000:3.0:1787191336.413747:0:57822:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1c000 x1874004626543616/t8589936533(8589936533) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191352 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191336.413758:0:57822:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191336.413764:0:57822:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1ed80 x1874004626544640/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191336.413785:0:57822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ed80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57822:1874004626544640:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191336.413891:0:57822:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ce40 going to sleep for 11 seconds 00000020:00010000:2.0:1787191336.424021:0:57820:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b42ff64e8 (ffff936b465cc3f8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191336.424026:0:57820:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42ff64e8 (ffff936b465cc3f8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191336.424032:0:57820:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7dab0 (ffff936b47a17d88/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191336.424042:0:57820:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839796 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46031ee expref: -99 pid: 57820 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191336.424057:0:57820:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839796 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46031ee expref: -99 pid: 57820 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00010000:2.0:1787191336.424082:0:57820:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42ff64e8 (ffff936b465cc3f8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191336.424085:0:57820:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7dab0 (ffff936b465cc3f8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191336.424110:0:57820:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb0:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191336.424122:0:57820:0:(file.c:5244:ll_file_seek()) COMPLETED file f70.sanity-flr:[0x200000405:0xb0:0x0], offset: 0, type: SEEK_DATA, rc = 0 00000080:00200008:2.0:1787191336.424142:0:57820:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xb0:0x0], offset: 0, type: SEEK_HOLE 00000080:00200000:2.0:1787191336.424151:0:57820:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xb0:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:2.0:1787191336.424160:0:57820:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xb0:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191336.424163:0:57820:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191336.424176:0:57820:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191336.424185:0:57820:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191336.424201:0:57820:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xb0:0x0] updating i_size 5 i_blocks 8 00000080:00200000:2.0:1787191336.424207:0:57820:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb0:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191336.424212:0:57820:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000080:00200000:2.0:1787191336.424214:0:57820:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xb0:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191336.424219:0:57820:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191336.424223:0:57820:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191336.424225:0:57820:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:2.0:1787191336.424242:0:57820:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:2.0:1787191336.424245:0:57820:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1330, osc lock ffff936b44e63300, flags 0x0 00010000:00010000:2.0:1787191336.424262:0:57820:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839796 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x195:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46031ee expref: -99 pid: 57820 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191336.424275:0:57820:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839796 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46031ee expref: -99 pid: 57820 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191336.424285:0:57820:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839796 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46031ee expref: -99 pid: 57820 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191336.424293:0:57820:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839796 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46031ee expref: -99 pid: 57820 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191336.424300:0:57820:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839796 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46031ee expref: -99 pid: 57820 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191336.424309:0:57820:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xb0:0x0] updating i_size 5 i_blocks 8 00000100:00100000:2.0:1787191336.424355:0:2392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787191336.424370:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626544768:192.168.202.101@tcp:23:lfs.0 00000100:00100000:3.0:1787191336.434204:0:57822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ed80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57822:1874004626544640:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191336.434240:0:57822:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1c000 x1874004626543616/t8589936533(8589936533) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191352 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787191336.434654:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626544768:192.168.202.101@tcp:23:lfs.0 00000080:00200000:2.0:1787191336.435702:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191336.435719:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191336.435730:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.435743:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.435750:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191336.435756:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191336.435759:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191336.435765:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:2.0:1787191336.435768:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.435775:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.435784:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.435789:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191336.435794:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.435805:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:2.0:1787191336.435811:0:57570:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b484c4c00, open_flags 8241, mode 81b6 opened 0 00000080:00200000:2.0:1787191336.435820:0:57570:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:2.0:1787191336.435868:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xb2:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0101102 00010000:00010000:2.0:1787191336.435918:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc8848397c0 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.435930:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc8848397c0 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191336.435940:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191336.435951:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9f80 x1874004626545152/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191336.435962:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc8848397c0 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191336.435977:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626545152:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191336.436083:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787191336.453754:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626545920:192.168.202.101@tcp:101:bash.0 00010000:00010000:2.0:1787191336.453780:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc8848397d5 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xb1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46032b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.453795:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc8848397d5 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xb1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46032b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191336.453810:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b453a8700 x1874004626545920/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191352 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191336.453821:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc8848397d5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xb1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46032b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191336.453870:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc8848397d5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xb1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46032b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.453879:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/177 (0 0) 00000080:00200000:2.0:1787191336.453884:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xb1:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1787191336.453895:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xb1:0x0](ffff936b489aec08) for lock 0xe5129dc8848397d5 00000080:00010000:2.0:1787191336.453900:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848397d5 from it ffffa3fb41cab8c8 00010000:00010000:2.0:1787191336.453903:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc8848397d5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xb1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46032b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.453911:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc8848397d5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xb1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46032b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191336.453931:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc8848397d5 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xb1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46032b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191336.453940:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc8848397d5 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xb1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46032b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:2.0:1787191336.453948:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xb1:0x0](0000000089b06177) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc8848397d5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xb1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46032b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191336.454000:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xb1:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:2.0:1787191336.454004:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc8848397d5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xb1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46032b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191336.454009:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc8848397d5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xb1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46032b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:2.0:1787191336.454021:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xb1:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:2.0:1787191336.454026:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb1:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191336.454028:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xb1:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:2.0:1787191336.454033:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xb1:0x0](ffff936b489aec08) 00000002:00010000:2.0:1787191336.454038:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xb1:0x0]) in obj [0x200000405:0xb1:0x0], intent: layout flags 02 00010000:00010000:2.0:1787191336.454048:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc8848397d5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xb1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46032b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191336.454060:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xb1:0x0]: losing layout lock 00010000:00010000:2.0:1787191336.454095:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc8848397d5 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xb1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46032b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191336.454110:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191336.454113:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc8848397d5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xb1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46032b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191336.454145:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc8848397dc lrc: 3/0,1 mode: --/EX res: [0x200000405:0xb1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.454150:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc8848397dc lrc: 3/0,1 mode: --/EX res: [0x200000405:0xb1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191336.454157:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191336.454162:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513baa00 x1874004626546176/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191336.455239:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc8848397dc lrc: 3/0,1 mode: --/EX res: [0x200000405:0xb1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191336.455260:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626546176:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191336.456253:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191336.486959:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626547072:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191336.486976:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc8848397f1 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46032e3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.487331:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc8848397f1 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e46032e3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.487346:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc8848397f1 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e46032e3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.487360:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc8848397f1 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e46032e3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191336.487373:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc8848397f1 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e46032e3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.487383:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc8848397f1 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46032e3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.487390:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc8848397f1 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46032e3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.487451:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000920173e2/0xe5129dc8848397f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.487460:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000920173e2/0xe5129dc8848397f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.487469:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000920173e2/0xe5129dc8848397f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191336.487484:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626547456:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191336.487517:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191336.501318:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626547456:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191336.501347:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000920173e2/0xe5129dc8848397f8 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46032ea expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.501369:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000920173e2/0xe5129dc8848397f8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e46032ea expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.501383:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000920173e2/0xe5129dc8848397f8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e46032ea expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.501397:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000920173e2/0xe5129dc8848397f8 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e46032ea expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191336.501411:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000920173e2/0xe5129dc8848397f8 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e46032ea expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.501423:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000920173e2/0xe5129dc8848397f8 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46032ea expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.501431:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000920173e2/0xe5129dc8848397f8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46032ea expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191336.501795:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626547712:192.168.202.101@tcp:10:bash.0 00000100:00100000:3.0:1787191336.501949:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626547840:192.168.202.101@tcp:10:bash.0 00000100:00100000:3.0:1787191336.506022:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626547840:192.168.202.101@tcp:10:bash.0 00000100:00100000:2.0:1787191336.506385:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191336.506409:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634848512 00000100:00100000:2.0:1787191336.506415:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634848512 00000100:00100000:2.0:1787191336.506456:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1208 00000100:00100000:2.0:1787191336.506465:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6509:x1874004634848512:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191336.506484:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc884839781 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xb0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46031c4 expref: -99 pid: 57820 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191336.506549:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191336.506557:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6509:x1874004634848512:12345-192.168.202.101@tcp:104: Request processed in 92us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191336.506562:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626547712:192.168.202.101@tcp:10:bash.0 00000100:00100000:2.0:1787191336.506568:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1208 00000080:00200000:2.0:1787191336.535355:0:57824:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191336.535392:0:57824:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191336.535410:0:57824:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.535427:0:57824:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.535435:0:57824:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191336.535443:0:57824:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191336.535447:0:57824:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191336.540099:0:57824:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41f3bb58 00010000:00010000:2.0:1787191336.540114:0:57824:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.540129:0:57824:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.540162:0:57824:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.540185:0:57824:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191336.540195:0:57824:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.540220:0:57824:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:2.0:1787191336.540225:0:57824:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191336.540248:0:57824:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191336.540308:0:57824:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848397ff lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.540317:0:57824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848397ff lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.540327:0:57824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848397ff lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191336.540352:0:57824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57824:1874004626548608:192.168.202.101@tcp:101:rm.0 00000100:00100000:2.0:1787191336.540454:0:57824:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359300 going to sleep for 11 seconds 00000100:00100000:2.0:1787191336.547920:0:57820:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589936544 gen 1 00000100:00100000:2.0:1787191336.547934:0:57820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57820:1874004626548096:192.168.202.101@tcp:35:lfs.0 00000002:00100000:2.0:1787191336.547954:0:57820:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513bbb80 x1874004626541440/t8589936530(8589936530) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191352 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1787191336.547995:0:57820:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/176 (0 0) 00000080:00010000:2.0:1787191336.548004:0:57820:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xb0:0x0](ffff936b5395ba88) 00000002:00010000:2.0:1787191336.548012:0:57820:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xb0:0x0]) in obj [0x200000405:0xb0:0x0], intent: layout flags 0 00010000:00010000:2.0:1787191336.548042:0:57820:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884839806 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xb0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.548051:0:57820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884839806 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xb0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.548077:0:57820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884839806 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xb0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191336.548090:0:57820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57820:1874004626548992:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191336.548354:0:57820:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359000 going to sleep for 11 seconds 00000100:00100000:2.0:1787191336.558629:0:57820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57820:1874004626548992:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191336.558668:0:57820:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884839806 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xb0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460331b expref: -99 pid: 57820 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.558686:0:57820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884839806 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xb0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460331b expref: -99 pid: 57820 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191336.558701:0:57820:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b513bbb80 x1874004626548992/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191352 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191336.558713:0:57820:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884839806 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xb0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460331b expref: -99 pid: 57820 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191336.558726:0:57820:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884839806 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xb0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460331b expref: -99 pid: 57820 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.558737:0:57820:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/176 (0 0) 00000080:00200000:2.0:1787191336.558743:0:57820:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xb0:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1787191336.558759:0:57820:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xb0:0x0](ffff936b5395ba88) for lock 0xe5129dc884839806 00000080:00010000:2.0:1787191336.558767:0:57820:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839806 from it ffffa3fb420e3bc8 00010000:00010000:2.0:1787191336.558771:0:57820:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884839806 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xb0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460331b expref: -99 pid: 57820 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.558786:0:57820:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884839806 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xb0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460331b expref: -99 pid: 57820 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191336.558810:0:57820:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884839806 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xb0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460331b expref: -99 pid: 57820 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191336.558822:0:57820:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884839806 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xb0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460331b expref: -99 pid: 57820 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:2.0:1787191336.558830:0:57820:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xb0:0x0](00000000c6a8adc5) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884839806 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xb0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460331b expref: -99 pid: 57820 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191336.558918:0:57820:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884839806 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xb0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460331b expref: -99 pid: 57820 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191336.558926:0:57820:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884839806 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xb0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460331b expref: -99 pid: 57820 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191336.558943:0:57820:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xb0:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191336.558954:0:57820:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xb0:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191336.558958:0:57820:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191336.558966:0:57820:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191336.558977:0:57820:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191336.559012:0:57820:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb0:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:2.0:1787191336.559026:0:57820:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884839806 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xb0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460331b expref: -99 pid: 57820 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191336.559038:0:57820:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884839806 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xb0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460331b expref: -99 pid: 57820 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:2.0:1787191336.559046:0:57820:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xb0:0x0](00000000c6a8adc5) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884839806 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xb0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460331b expref: -99 pid: 57820 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191336.559109:0:57820:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xb0:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191336.559114:0:57820:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xb0:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191336.559117:0:57820:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191336.559119:0:57820:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191336.559123:0:57820:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191336.559129:0:57820:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb0:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:2.0:1787191336.559152:0:57820:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 5 blocks 8 [cma]time: 1787191336 1787191336 0 by oinfo size 5 blocks 8 [cma]time 1787191336 1787191336 1787191336 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839796 lrc: 1/0,0 mode: PR/PR res: [0x2c0000401:0x195:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46031ee expref: -99 pid: 57820 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00000008:00010000:2.0:1787191336.559186:0:57820:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 4096 blocks 8 [cma]time: 1787191336 1787191336 0 by oinfo size 5 blocks 8 [cma]time 1787191336 1787191336 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000cfb66679/0xe5129dc8848397e3 lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x193:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46032d5 expref: -99 pid: 57820 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000008:00010000:2.0:1787191336.559200:0:57820:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191336 1787191336 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc8848397ea lrc: 1/0,0 mode: PW/PW res: [0x2c0000401:0x196:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46032dc expref: -99 pid: 57820 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191336.559258:0:57820:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xb0:0x0]: layout version change: 4294967294 -> 6 00010000:00010000:2.0:1787191336.559263:0:57820:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884839806 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xb0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460331b expref: -99 pid: 57820 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191336.559277:0:57820:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4200/0xe5129dc884839806 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xb0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460331b expref: -99 pid: 57820 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200008:2.0:1787191336.559316:0:57820:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xb0:0x0](ffff936b5395ba88), flags 154002 00000002:00100000:2.0:1787191336.559362:0:57820:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a475500 x1874004626540416/t8589936528(8589936528) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191352 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191336.559375:0:57820:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191336.559380:0:57820:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bbb80 x1874004626549248/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191336.559406:0:57820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57820:1874004626549248:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191336.559507:0:57820:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359000 going to sleep for 11 seconds 00000100:00100000:2.0:1787191336.568042:0:57820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57820:1874004626549248:192.168.202.101@tcp:35:lfs.0 00000002:00100000:2.0:1787191336.568097:0:57820:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a475500 x1874004626540416/t8589936528(8589936528) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191352 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191336.568166:0:57820:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xb0:0x0] ignore/verify layout 1/0, layout version 3 restore needed 0 00020000:00200000:2.0:1787191336.568177:0:57820:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xb0:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191336.568180:0:57820:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191336.568186:0:57820:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191336.568196:0:57820:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191336.568216:0:57820:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb0:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191336.568223:0:57820:0:(llite_lib.c:2066:ll_clear_inode()) VFS Op:inode=[0x200000405:0xb0:0x0](ffff936b5395ba88) 00000080:00200000:2.0:1787191336.568343:0:57820:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191336.568361:0:57820:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191336.568375:0:57820:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.568391:0:57820:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.568399:0:57820:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191336.568405:0:57820:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191336.568408:0:57820:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191336.568415:0:57820:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb420e3bf8 00010000:00010000:2.0:1787191336.568419:0:57820:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.568428:0:57820:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.568443:0:57820:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.568449:0:57820:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191336.568455:0:57820:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.568467:0:57820:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b42a0e900, open_flags d900, mode 0 opened 0 00000080:00200000:2.0:1787191336.568473:0:57820:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:2.0:1787191336.568487:0:57820:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:2.0:1787191336.568545:0:57820:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483980d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.568554:0:57820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483980d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57820 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191336.568565:0:57820:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191336.568573:0:57820:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bbb80 x1874004626549504/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191336.568583:0:57820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483980d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191336.568603:0:57820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57820:1874004626549504:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191336.568790:0:57820:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359000 going to sleep for 11 seconds 00000100:00100000:3.0:1787191336.574751:0:57820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57820:1874004626549504:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191336.574776:0:57820:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483980d lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.574791:0:57820:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483980d lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.574798:0:57820:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483980d lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.574806:0:57820:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483980d lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.574815:0:57820:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483980d lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.574820:0:57820:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd4400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191336.574825:0:57820:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483980d lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.574850:0:57820:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483980d lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.574858:0:57820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483980d lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.574866:0:57820:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191336.574874:0:57820:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483980d lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.574886:0:57820:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483980d lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57820 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191336.574910:0:57820:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x7, status=0 req@ffff936b513bbb80 x1874004626549504/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/608 e 0 to 0 dl 1787191352 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191336.574925:0:57820:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191336.600774:0:57826:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191336.600789:0:57826:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191336.600798:0:57826:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.600808:0:57826:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.600815:0:57826:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191336.600820:0:57826:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191336.600823:0:57826:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191336.600827:0:57826:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb420b3bf8 00010000:00010000:2.0:1787191336.600855:0:57826:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.600863:0:57826:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.600873:0:57826:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.600878:0:57826:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191336.600882:0:57826:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.606104:0:57826:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:2.0:1787191336.606110:0:57826:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b51c6a180, open_flags d900, mode 0 opened 0 00000080:00200000:3.0:1787191336.606672:0:57826:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191336.606684:0:57826:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191336.606691:0:57826:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191336.606700:0:57826:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191336.606707:0:57826:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191336.606716:0:57826:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191336.606719:0:57826:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191336.606727:0:57826:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb420b3b58 00010000:00010000:3.0:1787191336.606729:0:57826:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191336.606736:0:57826:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191336.606745:0:57826:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191336.606748:0:57826:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191336.606751:0:57826:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191336.611976:0:57826:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=9 00000080:00200008:3.0:1787191336.611991:0:57826:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xb3:0x0](ffff936b5396e3c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191336.611998:0:57826:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xb3:0x0](ffff936b5396e3c8),name=f70.sanity-flr 00000002:00010000:3.0:1787191336.612015:0:57826:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xb3:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191336.612025:0:57826:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae000/0xe5129dc884839830 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46033bc expref: -99 pid: 57825 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.612036:0:57826:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae000/0xe5129dc884839830 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46033bc expref: -99 pid: 57825 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191336.612055:0:57826:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191336.612062:0:57826:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xb3:0x0](ffff936b5396e3c8) 00000080:00010000:3.0:1787191336.612078:0:57826:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xb3:0x0](ffff936b5396e3c8) for lock 0xe5129dc884839830 00000080:00010000:3.0:1787191336.612086:0:57826:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839830 from it ffffa3fb420b3cb8 00010000:00010000:3.0:1787191336.612092:0:57826:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae000/0xe5129dc884839830 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46033bc expref: -99 pid: 57825 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.612102:0:57826:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae000/0xe5129dc884839830 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46033bc expref: -99 pid: 57825 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000100:00100000:3.0:1787191336.619980:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191336.620116:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634849152 00000100:00100000:2.0:1787191336.620198:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634849152 00000100:00100000:2.0:1787191336.620261:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1209 00000100:00100000:2.0:1787191336.620271:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634849152:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191336.620290:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae000/0xe5129dc884839830 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46033bc expref: -99 pid: 57825 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191336.620373:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191336.620380:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634849152:12345-192.168.202.101@tcp:104: Request processed in 111us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191336.620387:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1209 00000080:00200000:3.0:1787191336.631781:0:57826:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191336.631798:0:57826:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191336.632425:0:57826:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191336.632452:0:57826:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191336.632470:0:57826:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191336.632477:0:57826:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191336.632482:0:57826:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191336.632490:0:57826:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb420b3bf8 00010000:00010000:3.0:1787191336.633460:0:57826:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191336.633475:0:57826:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191336.633991:0:57826:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191336.634004:0:57826:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191336.634012:0:57826:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191336.634033:0:57826:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b62915200, open_flags d902, mode 0 opened 0 00000080:00200000:3.0:1787191336.634039:0:57826:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:3.0:1787191336.634061:0:57826:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154403 00010000:00010000:3.0:1787191336.634127:0:57826:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483983e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.634136:0:57826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483983e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57826 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191336.634147:0:57826:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:3.0:1787191336.634170:0:57826:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1f800 x1874004626551424/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191336.634178:0:57826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483983e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191336.634199:0:57826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57826:1874004626551424:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191336.634380:0:57826:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191336.640730:0:57826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57826:1874004626551424:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191336.640758:0:57826:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483983e lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46033f4 expref: -99 pid: 57826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.640786:0:57826:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483983e lrc: 4/1,0 mode: --/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46033f4 expref: -99 pid: 57826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.640795:0:57826:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483983e lrc: 4/1,0 mode: --/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46033f4 expref: -99 pid: 57826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.640806:0:57826:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483983e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46033f4 expref: -99 pid: 57826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.641340:0:57826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483983e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46033f4 expref: -99 pid: 57826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.641358:0:57826:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483983e lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46033f4 expref: -99 pid: 57826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.641365:0:57826:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483983e lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46033f4 expref: -99 pid: 57826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.641372:0:57826:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483983e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46033f4 expref: -99 pid: 57826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191336.641389:0:57826:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b51d1f800 x1874004626551424/t8589936550(8589936550) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191352 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191336.641402:0:57826:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1f800 x1874004626551424/t8589936550(8589936550) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191352 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191336.641414:0:57826:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483983e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46033f4 expref: -99 pid: 57826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191336.641428:0:57826:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483983e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46033f4 expref: -99 pid: 57826 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.641438:0:57826:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/179 (0 0) 00000080:00200000:3.0:1787191336.641453:0:57826:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191336.641513:0:57826:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xb3:0x0](ffff936b5396e3c8): rc = 0 00000080:00200000:3.0:1787191336.641530:0:57826:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xb3:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:3.0:1787191336.641536:0:57826:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xb3:0x0](ffff936b5396e3c8) for lock 0xe5129dc88483983e 00000080:00010000:3.0:1787191336.641549:0:57826:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xb3:0x0](ffff936b5396e3c8) 00000080:00200008:3.0:1787191336.641564:0:57826:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xb3:0x0](ffff936b5396e3c8), flags 154402 00000002:00100000:3.0:1787191336.646186:0:57826:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1f800 x1874004626551424/t8589936550(8589936550) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191352 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1787191336.646249:0:57826:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483983e from it ffff936b46033900 00010000:00010000:3.0:1787191336.646259:0:57826:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483983e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46033f4 expref: -99 pid: 57826 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.646273:0:57826:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483983e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46033f4 expref: -99 pid: 57826 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191336.646303:0:57826:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xb3:0x0](ffff936b5396e3c8), inode mode 81a4 mask 46 00000080:00200000:3.0:1787191336.646410:0:57826:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xb3:0x0](ffff936b5396e3c8), inode mode 81a4 mask 4 00000080:00200000:3.0:1787191336.646418:0:57826:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xb3:0x0](ffff936b5396e3c8), xattr lov 00000080:00200008:3.0:1787191336.646453:0:57826:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xb3:0x0](ffff936b5396e3c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191336.646460:0:57826:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xb3:0x0](ffff936b5396e3c8),name=f70.sanity-flr 00000002:00010000:3.0:1787191336.646481:0:57826:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xb3:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191336.646494:0:57826:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483983e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46033f4 expref: -99 pid: 57826 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.646507:0:57826:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483983e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46033f4 expref: -99 pid: 57826 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191336.646514:0:57826:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191336.646522:0:57826:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xb3:0x0](ffff936b5396e3c8) 00000080:00010000:3.0:1787191336.646525:0:57826:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xb3:0x0](ffff936b5396e3c8) for lock 0xe5129dc88483983e 00000080:00010000:3.0:1787191336.646530:0:57826:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483983e from it ffffa3fb420b3cd8 00010000:00010000:3.0:1787191336.646533:0:57826:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483983e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46033f4 expref: -99 pid: 57826 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.646541:0:57826:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483983e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46033f4 expref: -99 pid: 57826 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191336.646561:0:57826:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xb3:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:3.0:1787191336.646571:0:57826:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xb3:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191336.646574:0:57826:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191336.646578:0:57826:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xb3:0x0] 00000008:00010000:3.0:1787191336.646597:0:57826:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191336.646602:0:57826:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b5235ce70, osc lock ffff936b44f64d10, flags 0x400000400001002 00000008:00010000:3.0:1787191336.646613:0:57826:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191336.646615:0:57826:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b5235ceb0, osc lock ffff936b44f64130, flags 0x400000400001002 00010000:00010000:3.0:1787191336.646663:0:57826:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000042bf27d3/0xe5129dc884839845 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.646674:0:57826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000042bf27d3/0xe5129dc884839845 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.646685:0:57826:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b51d1f480 x1874004626551552/t0(0) o101->lustre-OST0000-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191336.646757:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787191336.646778:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626551552:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191336.646936:0:57826:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000793f6478/0xe5129dc88483984c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.646945:0:57826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000793f6478/0xe5129dc88483984c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.646955:0:57826:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b51d1ea00 x1874004626551680/t0(0) o101->lustre-OST0001-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:3.0:1787191336.646975:0:57826:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 2 items remaining. 00000100:00100000:3.0:1787191336.646988:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626551680:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191336.652088:0:2391:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000793f6478/0xe5129dc88483984c lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.652123:0:2391:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000793f6478/0xe5129dc88483984c lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603409 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.652137:0:2391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000793f6478/0xe5129dc88483984c lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603409 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.652160:0:2391:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000793f6478/0xe5129dc88483984c lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603409 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191336.652176:0:2391:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000793f6478/0xe5129dc88483984c lrc: 5/2,0 mode: PR/PR res: [0x2c0000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4603409 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1787191336.652188:0:2391:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191336.652193:0:2391:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000793f6478/0xe5129dc88483984c lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4603409 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.652200:0:2391:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000793f6478/0xe5129dc88483984c lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4603409 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.652207:0:2391:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000793f6478/0xe5129dc88483984c lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4603409 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.652215:0:2391:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000793f6478/0xe5129dc88483984c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4603409 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1787191336.652240:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626551680:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191336.652259:0:2391:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000042bf27d3/0xe5129dc884839845 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.652269:0:2391:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000042bf27d3/0xe5129dc884839845 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603402 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.652277:0:2391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000042bf27d3/0xe5129dc884839845 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603402 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.652285:0:2391:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000042bf27d3/0xe5129dc884839845 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603402 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191336.652295:0:2391:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000042bf27d3/0xe5129dc884839845 lrc: 5/2,0 mode: PR/PR res: [0x280000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4603402 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1787191336.652304:0:2391:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1787191336.652311:0:2391:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000042bf27d3/0xe5129dc884839845 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4603402 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.652318:0:2391:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000042bf27d3/0xe5129dc884839845 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4603402 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.652330:0:2391:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000042bf27d3/0xe5129dc884839845 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4603402 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.652338:0:2391:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000042bf27d3/0xe5129dc884839845 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4603402 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1787191336.652348:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626551552:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191336.652407:0:57825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57825:1874004626551168:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191336.652438:0:57825:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a474e00 x1874004626550272/t8589936547(8589936547) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191352 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191336.653701:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191336.653728:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191336.653745:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.653760:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.653768:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191336.653775:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191336.653779:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191336.653785:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:2.0:1787191336.653789:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.653797:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.653827:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.653873:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191336.653879:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.653886:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:2.0:1787191336.653892:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xb3:0x0](ffff936b5396e3c8), inode mode 81a4 mask 42 00000080:00200008:2.0:1787191336.653900:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xb3:0x0](ffff936b5396e3c8), flags 101101 00000002:00010000:2.0:1787191336.653933:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xb3:0x0], intent: getxattr flags 0 00010000:00010000:2.0:1787191336.653979:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839853 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.653987:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839853 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.653997:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839853 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191336.654021:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626551808:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191336.654132:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359600 going to sleep for 11 seconds 00000080:00200000:2.0:1787191336.654176:0:57826:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xb3:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191336.654180:0:57826:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c38de0 (ffff936b47a172d8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191336.654183:0:57826:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c38de0 (ffff936b47a172d8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191336.654189:0:57826:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b5235ce70 (ffff936b465cc878/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191336.654193:0:57826:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b5235ceb0 (ffff936b47a17ab8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191336.654196:0:57826:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c38de0 (ffff936b47a172d8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191336.654198:0:57826:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b5235ce70 (ffff936b47a172d8/1) at cl_lock_fini():72 00000020:00010000:2.0:1787191336.654203:0:57826:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b5235ceb0 (ffff936b47a172d8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191336.654216:0:57826:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb3:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191336.655234:0:57826:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191336.655254:0:57826:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191336.655264:0:57826:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.655276:0:57826:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.655283:0:57826:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191336.655289:0:57826:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191336.655292:0:57826:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191336.655297:0:57826:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb420b3b58 00010000:00010000:2.0:1787191336.655301:0:57826:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.655308:0:57826:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.655320:0:57826:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.655326:0:57826:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191336.655331:0:57826:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.655334:0:57826:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=9 00000080:00200008:2.0:1787191336.655341:0:57826:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xb3:0x0](ffff936b5396e3c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191336.655345:0:57826:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xb3:0x0](ffff936b5396e3c8),name=f70.sanity-flr 00000002:00010000:2.0:1787191336.655357:0:57826:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xb3:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191336.655363:0:57826:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483983e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46033f4 expref: -99 pid: 57826 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191336.655375:0:57826:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483983e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46033f4 expref: -99 pid: 57826 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191336.655381:0:57826:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191336.655384:0:57826:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xb3:0x0](ffff936b5396e3c8) 00000080:00010000:2.0:1787191336.655387:0:57826:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xb3:0x0](ffff936b5396e3c8) for lock 0xe5129dc88483983e 00000080:00010000:2.0:1787191336.655390:0:57826:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483983e from it ffffa3fb420b3cb8 00010000:00010000:2.0:1787191336.655393:0:57826:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483983e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46033f4 expref: -99 pid: 57826 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191336.655400:0:57826:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483983e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46033f4 expref: -99 pid: 57826 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191336.655419:0:57826:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xb3:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00020000:00200000:2.0:1787191336.655430:0:57826:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xb3:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191336.655433:0:57826:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191336.655436:0:57826:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xb3:0x0] 00000008:00010000:2.0:1787191336.655456:0:57826:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191336.655460:0:57826:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b523599f0, osc lock ffff936b44e638f0, flags 0x400000400001002 00000008:00010000:2.0:1787191336.655465:0:57826:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191336.655467:0:57826:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b52359a30, osc lock ffff936b44e62980, flags 0x400000400001002 00010000:00010000:2.0:1787191336.655484:0:57826:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000042bf27d3/0xe5129dc884839845 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x197:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4603402 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191336.655496:0:57826:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000042bf27d3/0xe5129dc884839845 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4603402 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:2.0:1787191336.655513:0:57826:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191336.655517:0:57826:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000042bf27d3/0xe5129dc884839845 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4603402 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191336.655525:0:57826:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000042bf27d3/0xe5129dc884839845 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4603402 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191336.655542:0:57826:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000793f6478/0xe5129dc88483984c lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x19a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4603409 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191336.655550:0:57826:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000793f6478/0xe5129dc88483984c lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4603409 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:2.0:1787191336.655557:0:57826:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191336.655560:0:57826:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000793f6478/0xe5129dc88483984c lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4603409 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191336.655568:0:57826:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000793f6478/0xe5129dc88483984c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4603409 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:2.0:1787191336.655577:0:57826:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191336.655586:0:57826:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xb3:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191336.655590:0:57826:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c38de0 (ffff936b47a172d8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191336.655593:0:57826:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c38de0 (ffff936b47a172d8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191336.655596:0:57826:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b523599f0 (ffff936b47a17ab8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191336.655600:0:57826:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b52359a30 (ffff936b465cc878/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191336.655602:0:57826:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c38de0 (ffff936b47a172d8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191336.655604:0:57826:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b523599f0 (ffff936b47a172d8/1) at cl_lock_fini():72 00000020:00010000:2.0:1787191336.655608:0:57826:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b52359a30 (ffff936b47a172d8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191336.655617:0:57826:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb3:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191336.655638:0:57826:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xb3:0x0](ffff936b5396e3c8), flags 154002 00000080:00200000:2.0:1787191336.655676:0:57826:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191336.655684:0:57826:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191336.655690:0:57826:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.655699:0:57826:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.655705:0:57826:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191336.655709:0:57826:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191336.655712:0:57826:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191336.655716:0:57826:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb420b3bf8 00010000:00010000:2.0:1787191336.655719:0:57826:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.655726:0:57826:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.655734:0:57826:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.655737:0:57826:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191336.655741:0:57826:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.655744:0:57826:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:2.0:1787191336.655747:0:57826:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xb3:0x0](ffff936b5396e3c8), inode mode 81a4 mask 44 00000080:00200008:2.0:1787191336.655753:0:57826:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xb3:0x0](ffff936b5396e3c8), flags 154400 00000002:00010000:2.0:1787191336.655765:0:57826:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xb3:0x0]) in obj [0x200000405:0xb3:0x0], intent: open flags 0104240114401 00010000:00010000:2.0:1787191336.655803:0:57826:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483985a lrc: 3/1,0 mode: --/CR res: [0x200000405:0xb3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.655809:0:57826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483985a lrc: 3/1,0 mode: --/CR res: [0x200000405:0xb3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57826 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191336.655819:0:57826:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191336.655856:0:57826:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513baa00 x1874004626552064/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191336.655867:0:57826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483985a lrc: 3/1,0 mode: --/CR res: [0x200000405:0xb3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191336.655886:0:57826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57826:1874004626552064:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191336.656195:0:57826:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b523599c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191336.660189:0:57826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57826:1874004626552064:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191336.660215:0:57826:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483985a lrc: 4/1,0 mode: --/CR res: [0x200000405:0xb3:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603425 expref: -99 pid: 57826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.660232:0:57826:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483985a lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xb3:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603425 expref: -99 pid: 57826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.660244:0:57826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483985a lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xb3:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603425 expref: -99 pid: 57826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191336.660259:0:57826:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x200002b, status=0 req@ffff936b513baa00 x1874004626552064/t8589936552(8589936552) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191352 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191336.660273:0:57826:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513baa00 x1874004626552064/t8589936552(8589936552) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191352 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191336.660287:0:57826:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483985a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xb3:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603425 expref: -99 pid: 57826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191336.660301:0:57826:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483985a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xb3:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603425 expref: -99 pid: 57826 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.660312:0:57826:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/179 (0 0) 00000080:00200000:3.0:1787191336.660319:0:57826:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xb3:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1787191336.660376:0:57826:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xb3:0x0]: layout version change: 3 -> 3 00000080:00010000:3.0:1787191336.660380:0:57826:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xb3:0x0](ffff936b5396e3c8) for lock 0xe5129dc88483985a 00000080:00010000:3.0:1787191336.660386:0:57826:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483985a from it ffffa3fb420b3bf0 00010000:00010000:3.0:1787191336.660389:0:57826:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483985a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xb3:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4603425 expref: -99 pid: 57826 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.660397:0:57826:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483985a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xb3:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603425 expref: -99 pid: 57826 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000002:00100000:3.0:1787191336.660427:0:57826:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513baa00 x1874004626552064/t8589936552(8589936552) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191352 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191336.660545:0:57826:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xb3:0x0](ffff936b5396e3c8), inode mode 81a4 mask 4 00000080:00200000:3.0:1787191336.660552:0:57826:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xb3:0x0](ffff936b5396e3c8), xattr lov 00000080:00200008:3.0:1787191336.660570:0:57826:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xb3:0x0](ffff936b5396e3c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191336.660576:0:57826:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xb3:0x0](ffff936b5396e3c8),name=f70.sanity-flr 00000002:00010000:3.0:1787191336.660597:0:57826:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xb3:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191336.660606:0:57826:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483983e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46033f4 expref: -99 pid: 57826 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191336.660621:0:57826:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483983e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46033f4 expref: -99 pid: 57826 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787191336.660628:0:57826:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191336.660633:0:57826:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xb3:0x0](ffff936b5396e3c8) 00000080:00010000:3.0:1787191336.660636:0:57826:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xb3:0x0](ffff936b5396e3c8) for lock 0xe5129dc88483983e 00000080:00010000:3.0:1787191336.660640:0:57826:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483983e from it ffffa3fb420b3cd8 00010000:00010000:3.0:1787191336.660643:0:57826:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483983e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46033f4 expref: -99 pid: 57826 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191336.660651:0:57826:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483983e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46033f4 expref: -99 pid: 57826 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:3.0:1787191336.660668:0:57826:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xb3:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:3.0:1787191336.660679:0:57826:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xb3:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191336.660682:0:57826:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191336.660686:0:57826:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xb3:0x0] 00000008:00010000:3.0:1787191336.660706:0:57826:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191336.660709:0:57826:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b5235cc30, osc lock ffff936b44f64260, flags 0x400000400001002 00000008:00010000:3.0:1787191336.660715:0:57826:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191336.660717:0:57826:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b5235cc70, osc lock ffff936b44f658f0, flags 0x400000400001002 00010000:00010000:3.0:1787191336.660732:0:57826:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000042bf27d3/0xe5129dc884839845 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x197:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4603402 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191336.660743:0:57826:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000042bf27d3/0xe5129dc884839845 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4603402 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:3.0:1787191336.660761:0:57826:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191336.660764:0:57826:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000042bf27d3/0xe5129dc884839845 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4603402 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191336.660769:0:57826:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000042bf27d3/0xe5129dc884839845 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4603402 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191336.660781:0:57826:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000793f6478/0xe5129dc88483984c lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x19a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4603409 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191336.660786:0:57826:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000793f6478/0xe5129dc88483984c lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4603409 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:3.0:1787191336.660791:0:57826:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191336.660793:0:57826:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000793f6478/0xe5129dc88483984c lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4603409 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191336.660797:0:57826:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000793f6478/0xe5129dc88483984c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4603409 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:3.0:1787191336.660802:0:57826:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191336.660809:0:57826:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xb3:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1787191336.660812:0:57826:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b48035e10 (ffff936b43ab8cf8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191336.660813:0:57826:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b48035e10 (ffff936b43ab8cf8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191336.660815:0:57826:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b5235cc30 (ffff936b465cc368/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191336.660818:0:57826:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b5235cc70 (ffff936b465cc488/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191336.660820:0:57826:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b48035e10 (ffff936b43ab8cf8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191336.660821:0:57826:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b5235cc30 (ffff936b43ab8cf8/1) at cl_lock_fini():72 00000020:00010000:3.0:1787191336.660824:0:57826:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b5235cc70 (ffff936b43ab8cf8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191336.660864:0:57826:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb3:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191336.660886:0:57826:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xb3:0x0](ffff936b5396e3c8), flags 154000 00010000:00010000:3.0:1787191336.660895:0:57826:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483985a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xb3:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603425 expref: -99 pid: 57826 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191336.660930:0:57826:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191336.660936:0:57826:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191336.660941:0:57826:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191336.660946:0:57826:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191336.660950:0:57826:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191336.660952:0:57826:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191336.660954:0:57826:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191336.660957:0:57826:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb420b3bf8 00010000:00010000:3.0:1787191336.660958:0:57826:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191336.660963:0:57826:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191336.660969:0:57826:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191336.660973:0:57826:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191336.660976:0:57826:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191336.660978:0:57826:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:3.0:1787191336.660981:0:57826:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xb3:0x0](ffff936b5396e3c8), inode mode 81a4 mask 46 00000080:00200008:3.0:1787191336.660986:0:57826:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xb3:0x0](ffff936b5396e3c8), flags 154402 00000080:00200080:3.0:1787191336.661021:0:57826:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xb3:0x0](ffff936b5396e3c8) cmd=800466af arg=7ffcc7e23e2c 00000080:00200080:3.0:1787191336.661034:0:57826:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xb3:0x0](ffff936b5396e3c8) cmd=80086601 arg=7ffcc7e23dc8 00000100:00100000:3.0:1787191336.661081:0:57826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57826:1874004626552192:192.168.202.101@tcp:33:lfs.0 00000100:00100000:3.0:1787191336.661156:0:57826:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cc00 going to sleep for 11 seconds 00000080:00200000:2.0:1787191336.690549:0:57827:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191336.690594:0:57827:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191336.690611:0:57827:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.690627:0:57827:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.690635:0:57827:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191336.690741:0:57827:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191336.690746:0:57827:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191336.690754:0:57827:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb420e3bf8 00010000:00010000:2.0:1787191336.690758:0:57827:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.690768:0:57827:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.690783:0:57827:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.690791:0:57827:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191336.690796:0:57827:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.690808:0:57827:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b42f3a000, open_flags d900, mode 0 opened 0 00000080:00200000:2.0:1787191336.691138:0:57827:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:2.0:1787191336.691154:0:57827:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:2.0:1787191336.691212:0:57827:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839868 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.691221:0:57827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839868 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57827 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191336.691234:0:57827:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:2.0:1787191336.691247:0:57827:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8380 x1874004626553216/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191336.691257:0:57827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839868 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191336.691285:0:57827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57827:1874004626553216:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191336.691526:0:57827:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359540 going to sleep for 11 seconds 00000100:00100000:3.0:1787191336.704890:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191336.704932:0:40922:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787191336.704949:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634850816 00000100:00100000:3.0:1787191336.704958:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634850816 00000100:00100000:3.0:1787191336.706508:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1210 00000100:00100000:3.0:1787191336.706523:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b4121c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:37089:x1874004634850816:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191336.706544:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc8848397ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e46032dc expref: -99 pid: 57820 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.708234:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191336.708245:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b4121c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:37089:x1874004634850816:12345-192.168.202.101@tcp:104: Request processed in 1724us (3362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191336.708255:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1210 00000100:00100000:3.0:1787191336.708375:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191336.708419:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634850944 00000100:00100000:3.0:1787191336.708426:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634850944 00000100:00100000:3.0:1787191336.708457:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1211 00000100:00100000:3.0:1787191336.708465:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8420:x1874004634850944:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191336.708477:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000920173e2/0xe5129dc8848397f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e46032ea expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.708519:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787191336.708525:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8420:x1874004634850944:12345-192.168.202.101@tcp:104: Request processed in 60us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191336.708531:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1211 00000100:00100000:3.0:1787191336.708590:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191336.708605:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634851072 00000100:00100000:3.0:1787191336.708609:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634851072 00000100:00100000:3.0:1787191336.708629:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1212 00000100:00100000:3.0:1787191336.708635:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8720:x1874004634851072:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191336.708644:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc8848397f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x194:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e46032e3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191336.708671:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787191336.708676:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8720:x1874004634851072:12345-192.168.202.101@tcp:104: Request processed in 41us (86us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191336.708681:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1212 00000100:00100000:3.0:1787191336.708719:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191336.708733:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634851200 00000100:00100000:3.0:1787191336.708736:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634851200 00000100:00100000:3.0:1787191336.708754:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1213 00000100:00100000:3.0:1787191336.708760:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30511:x1874004634851200:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191336.708767:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b9bf1031/0xe5129dc884839757 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x192:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4603131 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.708795:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787191336.708800:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30511:x1874004634851200:12345-192.168.202.101@tcp:104: Request processed in 41us (82us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191336.708805:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1213 00000100:00100000:3.0:1787191336.708884:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191336.708899:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634851328 00000100:00100000:3.0:1787191336.708902:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634851328 00000100:00100000:3.0:1787191336.708919:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1214 00000100:00100000:3.0:1787191336.708924:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8422:x1874004634851328:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191336.708932:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839796 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x195:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e46031ee expref: -99 pid: 57820 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:3.0:1787191336.708954:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1787191336.708959:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8422:x1874004634851328:12345-192.168.202.101@tcp:104: Request processed in 35us (75us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191336.708964:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1214 00000100:00100000:3.0:1787191336.710439:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191336.710460:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634851456 00000100:00100000:3.0:1787191336.710465:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634851456 00000100:00100000:3.0:1787191336.710493:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1215 00000100:00100000:3.0:1787191336.710500:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30510:x1874004634851456:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191336.710510:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000cfb66679/0xe5129dc8848397e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x193:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e46032d5 expref: -99 pid: 57820 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.710549:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191336.710556:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30510:x1874004634851456:12345-192.168.202.101@tcp:104: Request processed in 56us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191336.710562:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1215 00000100:00100000:2.0:1787191336.731494:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191336.731582:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634851584 00000100:00100000:3.0:1787191336.731590:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634851584 00000100:00100000:3.0:1787191336.731644:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1216 00000100:00100000:3.0:1787191336.731655:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8720:x1874004634851584:12345-192.168.202.101@tcp:106: 00010000:00010000:3.0:1787191336.731669:0:40922:0:(ldlm_lockd.c:2541:ldlm_callback_handler()) ### glimpse ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483986f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x199:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46034b1 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.731683:0:40922:0:(ldlm_lockd.c:2123:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483986f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x199:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46034b1 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00010000:3.0:1787191336.731707:0:40922:0:(cl_object.c:322:cl_object_glimpse()) header@000000002edcf4f9[0x110, 1, [0x200000405:0xb3:0x0] hash] 00000020:00010000:3.0:1787191336.731710:0:40922:0:(cl_object.c:322:cl_object_glimpse()) size: 0 mtime: 1787191336 atime: 1787191336 ctime: 1787191336 blocks: 0 00000020:00010000:3.0:1787191336.731713:0:40922:0:(cl_object.c:322:cl_object_glimpse()) header@00000000a7ec9589[0x110, 2, [0x2c0000401:0x199:0x0] hash] 00000020:00010000:3.0:1787191336.731715:0:40922:0:(cl_object.c:322:cl_object_glimpse()) size: 0 mtime: 1787191336 atime: 1787191336 ctime: 1787191336 blocks: 0 00000100:00100000:3.0:1787191336.731763:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8720:x1874004634851584:12345-192.168.202.101@tcp:106: Request processed in 110us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191336.731771:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1216 00000080:00200000:2.0:1787191336.739457:0:57827:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xb3:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191336.739462:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c3abf0 (ffff936b47a171b8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191336.739465:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c3abf0 (ffff936b47a171b8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191336.739469:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b46b50930 (ffff936b47a17e18/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191336.739472:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c3abf0 (ffff936b47a171b8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191336.739474:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b46b50930 (ffff936b47a171b8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191336.739505:0:57827:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb3:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191336.739562:0:57827:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xb3:0x0](ffff936b5396e3c8), flags 154000 00000002:00100000:2.0:1787191336.739613:0:57827:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513b8380 x1874004626553216/t8589936557(8589936557) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191352 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191336.739622:0:57827:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191336.739627:0:57827:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9c00 x1874004626555008/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191336.739647:0:57827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57827:1874004626555008:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191336.739770:0:57827:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359780 going to sleep for 11 seconds 00000080:00200000:2.0:1787191336.751349:0:57828:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191336.751376:0:57828:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191336.751390:0:57828:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.751405:0:57828:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.751413:0:57828:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191336.751421:0:57828:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191336.751425:0:57828:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191336.751432:0:57828:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41f3bb58 00010000:00010000:2.0:1787191336.751437:0:57828:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.751445:0:57828:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.751460:0:57828:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.751467:0:57828:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191336.751472:0:57828:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.754155:0:57828:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=8 00000080:00200008:2.0:1787191336.754172:0:57828:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xb3:0x0](ffff936b5396e3c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191336.754179:0:57828:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xb3:0x0](ffff936b5396e3c8),name=f70.sanity-flr 00000002:00010000:2.0:1787191336.754200:0:57828:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xb3:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191336.754212:0:57828:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc884839876 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46034aa expref: -99 pid: 57827 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191336.754224:0:57828:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc884839876 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46034aa expref: -99 pid: 57827 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191336.754232:0:57828:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191336.754238:0:57828:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xb3:0x0](ffff936b5396e3c8) 00000080:00010000:2.0:1787191336.754240:0:57828:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xb3:0x0](ffff936b5396e3c8) for lock 0xe5129dc884839876 00000080:00010000:2.0:1787191336.754246:0:57828:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839876 from it ffffa3fb41f3bcb8 00010000:00010000:2.0:1787191336.754250:0:57828:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc884839876 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46034aa expref: -99 pid: 57827 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191336.754257:0:57828:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc884839876 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46034aa expref: -99 pid: 57827 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:2.0:1787191336.754287:0:57828:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xb3:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00020000:00200000:2.0:1787191336.754296:0:57828:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xb3:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191336.754300:0:57828:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191336.754303:0:57828:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xb3:0x0] 00000008:00010000:2.0:1787191336.754323:0:57828:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191336.754326:0:57828:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1530, osc lock ffff936b44e62980, flags 0x400000400001002 00010000:00010000:2.0:1787191336.754342:0:57828:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483986f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x199:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46034b1 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191336.754352:0:57828:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483986f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46034b1 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:2.0:1787191336.754362:0:57828:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191336.754365:0:57828:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483986f lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46034b1 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191336.754373:0:57828:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483986f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46034b1 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:2.0:1787191336.754382:0:57828:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191336.754390:0:57828:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xb3:0x0] updating i_size 5 i_blocks 0 00000020:00010000:2.0:1787191336.754467:0:57828:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c38de0 (ffff936b47a172d8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191336.754471:0:57828:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c38de0 (ffff936b47a172d8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191336.754474:0:57828:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1530 (ffff936b465cc878/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191336.754478:0:57828:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c38de0 (ffff936b47a172d8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191336.754480:0:57828:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1530 (ffff936b47a172d8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191336.754492:0:57828:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb3:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191336.754531:0:57828:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191336.754541:0:57828:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191336.754548:0:57828:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.754557:0:57828:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.754563:0:57828:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191336.754568:0:57828:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191336.754570:0:57828:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191336.754575:0:57828:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41f3bc10 00010000:00010000:2.0:1787191336.754577:0:57828:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.754584:0:57828:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.754592:0:57828:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.754597:0:57828:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191336.754601:0:57828:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.754607:0:57828:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:2.0:1787191336.754611:0:57828:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:2.0:1787191336.754616:0:57828:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:2.0:1787191336.754641:0:57828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839861 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xb3:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4603441 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191336.754672:0:57828:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xb3:0x0]: losing layout lock 00010000:00010000:2.0:1787191336.754685:0:57828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae000/0xe5129dc88483988b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e46034db expref: -99 pid: 57827 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000080:00200000:2.0:1787191336.754691:0:57828:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xb3:0x0]: losing layout lock 00010000:00010000:2.0:1787191336.754698:0:57828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc884839876 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46034aa expref: -99 pid: 57827 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:2.0:1787191336.754704:0:57828:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xb3:0x0]: losing layout lock 00010000:00010000:2.0:1787191336.754708:0:57828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839853 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4603417 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191336.754997:0:57828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839861 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xb3:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4603441 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191336.755008:0:57828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae000/0xe5129dc88483988b lrc: 2/0,0 mode: --/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46034db expref: -99 pid: 57827 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.755016:0:57828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc884839876 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46034aa expref: -99 pid: 57827 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191336.755023:0:57828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839853 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4603417 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191336.755030:0:57828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 4 locks packed 00010000:00010000:2.0:1787191336.755032:0:57828:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839861 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xb3:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4603441 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191336.755051:0:57828:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc884839876 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46034aa expref: -99 pid: 57827 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191336.755080:0:57828:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839853 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4603417 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:2.0:1787191336.755097:0:57828:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 36, max 7 00000100:00100000:2.0:1787191336.755108:0:57828:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9180 x1874004626555904/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 512/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787191336.755129:0:57828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57828:1874004626555904:192.168.202.101@tcp:36:rm.0 00000100:00100000:2.0:1787191336.755203:0:57828:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787191336.757370:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191336.757420:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191336.757744:0:51131:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787191336.757819:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634851712 00000100:00100000:2.0:1787191336.757823:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634851712 00000100:00100000:2.0:1787191336.757948:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1217 00000100:00100000:2.0:1787191336.757956:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b4121fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634851712:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191336.757961:0:51131:0:(ldlm_lockd.c:2455:ldlm_callback_handler()) callback on lock 0xe5129dc88483988b - lock disappeared 00010000:00010000:2.0:1787191336.757985:0:51131:0:(ldlm_lockd.c:2352:ldlm_callback_errmsg()) @@@ Operate with invalid parameter, NID=12345-192.168.202.101@tcp lock=0xe5129dc88483988b: rc = 0 req@ffff936b4121fc50 x1874004634851712/t0(0) o104->f10005b0-4ec5-4888-9c81-49c0b11e82c4@192.168.202.101@tcp:647/0 lens 328/224 e 0 to 0 dl 1787191347 ref 1 fl Interpret:/0/0 rc -22/-22 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787191336.757996:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b4121fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634851712:12345-192.168.202.101@tcp:104: Request processed in 42us (634us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787191336.758002:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1217 00000100:00100000:2.0:1787191336.787110:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191336.787308:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634851968 00000100:00100000:3.0:1787191336.787319:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634851968 00000100:00100000:3.0:1787191336.787376:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1218 00000100:00100000:3.0:1787191336.787384:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30511:x1874004634851968:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191336.787401:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483986f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420080000000 nid: local remote: 0x7130d520e46034b1 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1787191336.787491:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191336.787498:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30511:x1874004634851968:12345-192.168.202.101@tcp:104: Request processed in 114us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191336.787504:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1218 00000100:00100000:2.0:1787191336.816773:0:57829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57829:1874004626557440:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191336.816795:0:57829:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc8848398b5 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460356e expref: -99 pid: 57829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.816807:0:57829:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc8848398b5 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460356e expref: -99 pid: 57829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.816818:0:57829:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc8848398b5 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460356e expref: -99 pid: 57829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.816829:0:57829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc8848398b5 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460356e expref: -99 pid: 57829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.817339:0:57829:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc8848398b5 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460356e expref: -99 pid: 57829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.817348:0:57829:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc8848398b5 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460356e expref: -99 pid: 57829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.817355:0:57829:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc8848398b5 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460356e expref: -99 pid: 57829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191336.817366:0:57829:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b6a474380 x1874004626557440/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191352 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191336.817379:0:57829:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc8848398b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460356e expref: -99 pid: 57829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.817389:0:57829:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:2.0:1787191336.817397:0:57829:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc8848398b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460356e expref: -99 pid: 57829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.817406:0:57829:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc8848398b5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460356e expref: -99 pid: 57829 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:2.0:1787191336.817592:0:57829:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191336.817604:0:57829:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 132 lru_type: 1 00010000:00010000:2.0:1787191336.817684:0:57829:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 132 lru_type: 1 00010000:00010000:2.0:1787191336.817695:0:57829:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 132 lru_type: 1 00010000:00010000:2.0:1787191336.817702:0:57829:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 133 lru_type: 1 00000080:00200000:2.0:1787191336.817716:0:57829:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1787191336.817725:0:57829:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:2.0:1787191336.817729:0:57829:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:2.0:1787191336.817735:0:57829:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb42123cb8 00010000:00010000:2.0:1787191336.817739:0:57829:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 66 lru_type: 1 00010000:00010000:2.0:1787191336.817746:0:57829:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 67 lru_type: 1 00000002:00010000:2.0:1787191336.817761:0:57829:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191336.817768:0:57829:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc8848398b5 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460356e expref: -99 pid: 57829 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191336.817776:0:57829:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc8848398b5 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460356e expref: -99 pid: 57829 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191336.817784:0:57829:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc8848398b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460356e expref: -99 pid: 57829 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191336.817791:0:57829:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc8848398b5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460356e expref: -99 pid: 57829 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:2.0:1787191336.817799:0:57829:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191336.817804:0:57829:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 133 lru_type: 1 00010000:00010000:2.0:1787191336.817812:0:57829:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 133 lru_type: 1 00010000:00010000:2.0:1787191336.817820:0:57829:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 133 lru_type: 1 00010000:00010000:2.0:1787191336.817827:0:57829:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 134 lru_type: 1 00000080:00200008:2.0:1787191336.819664:0:57829:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:2.0:1787191336.819674:0:57829:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191336.819693:0:57829:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191336.819707:0:57829:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.819720:0:57829:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.819728:0:57829:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191336.819735:0:57829:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191336.819739:0:57829:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191336.819746:0:57829:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42123cb8 00010000:00010000:2.0:1787191336.819749:0:57829:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.819758:0:57829:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.820134:0:57829:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191336.820144:0:57829:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191336.820151:0:57829:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.820354:0:57829:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.820363:0:57829:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191336.820368:0:57829:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191336.820371:0:57829:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191336.820375:0:57829:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42123b58 00010000:00010000:2.0:1787191336.820378:0:57829:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.820385:0:57829:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.820396:0:57829:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.820402:0:57829:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191336.820407:0:57829:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.820418:0:57829:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:2.0:1787191336.820422:0:57829:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191336.820437:0:57829:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191336.820482:0:57829:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848398ca lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.820491:0:57829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848398ca lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.820500:0:57829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848398ca lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191336.820526:0:57829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57829:1874004626557824:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191336.820604:0:57829:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787191336.825212:0:57829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57829:1874004626557824:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191336.825235:0:57829:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848398ca lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.825248:0:57829:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848398ca lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.825260:0:57829:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848398ca lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.825267:0:57829:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848398ca lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.825275:0:57829:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848398ca lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.825282:0:57829:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd4a00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191336.825287:0:57829:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848398ca lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.825294:0:57829:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848398ca lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.825301:0:57829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848398ca lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.825308:0:57829:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191336.825315:0:57829:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848398ca lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.825322:0:57829:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848398ca lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57829 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191336.825340:0:57829:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513b8a80 x1874004626557824/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191352 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191336.825356:0:57829:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1787191336.825387:0:57829:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc8848398b5 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460356e expref: -99 pid: 57829 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191336.825400:0:57829:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc8848398b5 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460356e expref: -99 pid: 57829 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:2.0:1787191336.825410:0:57829:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848398b5 from it ffffa3fb42123930 00010000:00010000:2.0:1787191336.825414:0:57829:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc8848398b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460356e expref: -99 pid: 57829 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191336.825422:0:57829:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc8848398b5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460356e expref: -99 pid: 57829 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191336.825505:0:57829:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191336.825521:0:57829:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191336.825531:0:57829:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.825540:0:57829:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.825547:0:57829:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191336.825552:0:57829:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191336.825555:0:57829:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191336.825559:0:57829:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42123bf8 00010000:00010000:2.0:1787191336.825561:0:57829:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.825567:0:57829:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.825577:0:57829:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.825583:0:57829:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191336.825587:0:57829:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.825592:0:57829:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:2.0:1787191336.825594:0:57829:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:2.0:1787191336.825597:0:57829:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b42a0f500, open_flags a141, mode 81b6 opened 0 00000080:00200000:2.0:1787191336.825605:0:57829:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:2.0:1787191336.825631:0:57829:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xb4:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:2.0:1787191336.825642:0:57829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc8848398b5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e460356e expref: -99 pid: 57829 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191336.825698:0:57829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc8848398b5 lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e460356e expref: -99 pid: 57829 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191336.825705:0:57829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191336.825708:0:57829:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc8848398b5 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e460356e expref: -99 pid: 57829 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191336.825739:0:57829:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc8848398d8 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.825744:0:57829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc8848398d8 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57829 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191336.825753:0:57829:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191336.825757:0:57829:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8a80 x1874004626558208/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191336.825768:0:57829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc8848398d8 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191336.825783:0:57829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57829:1874004626558208:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191336.840319:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191336.840658:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634852608 00000100:00100000:2.0:1787191336.840670:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634852608 00000100:00100000:2.0:1787191336.840730:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1219 00000100:00100000:2.0:1787191336.840741:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634852608:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191336.840760:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc8848398d8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xb4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46035bb expref: -99 pid: 57829 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191336.840871:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191336.840879:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634852608:12345-192.168.202.101@tcp:104: Request processed in 140us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191336.840887:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1219 00000100:00100000:3.0:1787191336.846229:0:57829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57829:1874004626558464:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191336.846254:0:57829:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc8848398df lrc: 4/1,0 mode: --/CR res: [0x200000405:0xb4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.846270:0:57829:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc8848398df lrc: 4/1,0 mode: --/CR res: [0x200000405:0xb4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.846276:0:57829:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc8848398df lrc: 4/1,0 mode: --/CR res: [0x200000405:0xb4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.846283:0:57829:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc8848398df lrc: 3/0,0 mode: --/CR res: [0x200000405:0xb4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.846291:0:57829:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc8848398df lrc: 4/0,0 mode: --/CR res: [0x200000405:0xb4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.846296:0:57829:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44caea00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191336.846301:0:57829:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc8848398df lrc: 4/0,0 mode: --/CR res: [0x200000405:0xb4:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.846307:0:57829:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc8848398df lrc: 4/0,0 mode: --/CR res: [0x200000405:0xb4:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.846316:0:57829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc8848398df lrc: 5/0,0 mode: --/CR res: [0x200000405:0xb4:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.846322:0:57829:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191336.846328:0:57829:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc8848398df lrc: 3/0,0 mode: --/CR res: [0x200000405:0xb4:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.846333:0:57829:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc8848398df lrc: 0/0,0 mode: --/CR res: [0x200000405:0xb4:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57829 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191336.846356:0:57829:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b6a477b80 x1874004626558464/t8589936565(8589936565) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191352 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191336.846369:0:57829:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477b80 x1874004626558464/t8589936565(8589936565) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191352 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191336.846384:0:57829:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xb4:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1787191336.846446:0:57829:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xb4:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1787191336.846455:0:57829:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191336.846503:0:57829:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xb4:0x0], updating i_size 0 00000002:00100000:3.0:1787191336.846521:0:57829:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477b80 x1874004626558464/t8589936565(8589936565) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191352 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191336.846557:0:57829:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a477b80 x1874004626558464/t8589936565(8589936565) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191352 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191336.846565:0:57829:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191336.846570:0:57829:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1ed80 x1874004626558848/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191336.846589:0:57829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ed80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57829:1874004626558848:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191336.846667:0:57829:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cf00 going to sleep for 11 seconds 00000080:00200000:2.0:1787191336.860165:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191336.860197:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191336.860215:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.860231:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.860239:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191336.860246:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191336.860249:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191336.860257:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:2.0:1787191336.860262:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191336.860271:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191336.860287:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.860294:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191336.860300:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191336.860313:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:2.0:1787191336.860318:0:57570:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b42a0e480, open_flags 8241, mode 81b6 opened 0 00000080:00200000:2.0:1787191336.860329:0:57570:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:2.0:1787191336.860349:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xb5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0101102 00010000:00010000:2.0:1787191336.860408:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848398e6 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.860416:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848398e6 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191336.860427:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191336.860438:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb800 x1874004626559360/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191336.860448:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc8848398e6 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191336.860473:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626559360:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191336.860722:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359540 going to sleep for 11 seconds 00000080:00200080:3.0:1787191336.875346:0:57827:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xb3:0x0](ffff936b5396e3c8) cmd=400866b1 arg=1 00000080:00200008:3.0:1787191336.875368:0:57827:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xb3:0x0](ffff936b5396e3c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191336.875377:0:57827:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xb3:0x0](ffff936b5396e3c8),name=f70.sanity-flr 00000002:00010000:3.0:1787191336.875401:0:57827:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xb3:0x0]) in obj [0x200000405:0xb3:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191336.875419:0:57827:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc8848398c3 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603583 expref: -99 pid: 57827 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.875434:0:57827:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc8848398c3 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603583 expref: -99 pid: 57827 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191336.875442:0:57827:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xb3:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191336.875450:0:57827:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xb3:0x0](ffff936b5396e3c8) 00000080:00010000:3.0:1787191336.875454:0:57827:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xb3:0x0](ffff936b5396e3c8) for lock 0xe5129dc8848398c3 00000080:00010000:3.0:1787191336.875461:0:57827:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848398c3 from it ffffa3fb420e3cd8 00010000:00010000:3.0:1787191336.875465:0:57827:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc8848398c3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4603583 expref: -99 pid: 57827 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.875473:0:57827:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc8848398c3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603583 expref: -99 pid: 57827 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191336.875500:0:57827:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xb3:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00020000:00200000:3.0:1787191336.875513:0:57827:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xb3:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191336.875516:0:57827:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191336.875521:0:57827:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xb3:0x0] 00000008:00010000:3.0:1787191336.875542:0:57827:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191336.875545:0:57827:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b506678b0, osc lock ffff936b44f658f0, flags 0x400000400001002 00010000:00010000:3.0:1787191336.875562:0:57827:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000185c0a5e/0xe5129dc8848398d1 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x199:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460359f expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.875574:0:57827:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000185c0a5e/0xe5129dc8848398d1 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460359f expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:3.0:1787191336.875585:0:57827:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191336.875588:0:57827:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000185c0a5e/0xe5129dc8848398d1 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460359f expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191336.875595:0:57827:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000185c0a5e/0xe5129dc8848398d1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460359f expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:3.0:1787191336.875604:0:57827:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191336.875614:0:57827:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xb3:0x0] updating i_size 5 i_blocks 8 00000020:00010000:3.0:1787191336.875618:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b48035e10 (ffff936b43ab8cf8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191336.875621:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b48035e10 (ffff936b43ab8cf8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191336.875624:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b506678b0 (ffff936b465cc488/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191336.875628:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b48035e10 (ffff936b43ab8cf8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191336.875631:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b506678b0 (ffff936b43ab8cf8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191336.875644:0:57827:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb3:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191336.875660:0:57827:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xb3:0x0], offset: 0, type: SEEK_DATA 00000080:00200000:3.0:1787191336.875666:0:57827:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xb3:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:3.0:1787191336.875671:0:57827:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xb3:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191336.875674:0:57827:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191336.875678:0:57827:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191336.875682:0:57827:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1787191336.875698:0:57827:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xb3:0x0] updating i_size 5 i_blocks 8 00000080:00200000:3.0:1787191336.875706:0:57827:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb3:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191336.875712:0:57827:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000080:00200000:3.0:1787191336.875714:0:57827:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xb3:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:3.0:1787191336.875719:0:57827:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191336.875721:0:57827:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1787191336.875724:0:57827:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:3.0:1787191336.875731:0:57827:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:3.0:1787191336.875733:0:57827:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b506678b0, osc lock ffff936b44f658f0, flags 0x0 00010000:00010000:3.0:1787191336.875742:0:57827:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000185c0a5e/0xe5129dc8848398d1 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x199:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460359f expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191336.875750:0:57827:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000185c0a5e/0xe5129dc8848398d1 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460359f expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191336.875759:0:57827:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000185c0a5e/0xe5129dc8848398d1 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460359f expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191336.875766:0:57827:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000185c0a5e/0xe5129dc8848398d1 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460359f expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191336.875773:0:57827:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000185c0a5e/0xe5129dc8848398d1 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460359f expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191336.875783:0:57827:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xb3:0x0] updating i_size 5 i_blocks 8 00000100:00100000:3.0:1787191336.875884:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787191336.875904:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626559872:192.168.202.101@tcp:23:lfs.0 00000100:00100000:3.0:1787191336.882037:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626559872:192.168.202.101@tcp:23:lfs.0 00000020:00010000:3.0:1787191336.888630:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b45323f38 (ffff936b43ab8cf8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191336.888636:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b45323f38 (ffff936b43ab8cf8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191336.888641:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7d230 (ffff936b465cc488/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191336.888652:0:57827:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000185c0a5e/0xe5129dc8848398d1 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460359f expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191336.888669:0:57827:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000185c0a5e/0xe5129dc8848398d1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460359f expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00010000:3.0:1787191336.888687:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b45323f38 (ffff936b43ab8cf8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191336.888690:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7d230 (ffff936b43ab8cf8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191336.888707:0:57827:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb3:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191336.888718:0:57827:0:(file.c:5244:ll_file_seek()) COMPLETED file f70.sanity-flr:[0x200000405:0xb3:0x0], offset: 0, type: SEEK_HOLE, rc = 5 00000080:00200080:3.0:1787191336.888734:0:57827:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xb3:0x0](ffff936b5396e3c8) cmd=400866b1 arg=0 00000080:00200080:3.0:1787191336.888743:0:57827:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xb3:0x0](ffff936b5396e3c8) cmd=400866b1 arg=1 00000080:00200008:3.0:1787191336.888750:0:57827:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xb3:0x0](ffff936b5396e3c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191336.888756:0:57827:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xb3:0x0](ffff936b5396e3c8),name=f70.sanity-flr 00000002:00010000:3.0:1787191336.888776:0:57827:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xb3:0x0]) in obj [0x200000405:0xb3:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191336.888790:0:57827:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc8848398c3 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603583 expref: -99 pid: 57827 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191336.888803:0:57827:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc8848398c3 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603583 expref: -99 pid: 57827 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191336.889030:0:57827:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xb3:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191336.889038:0:57827:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xb3:0x0](ffff936b5396e3c8) 00000080:00010000:3.0:1787191336.889042:0:57827:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xb3:0x0](ffff936b5396e3c8) for lock 0xe5129dc8848398c3 00000080:00010000:3.0:1787191336.889049:0:57827:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848398c3 from it ffffa3fb420e3cd8 00010000:00010000:3.0:1787191336.889053:0:57827:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc8848398c3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4603583 expref: -99 pid: 57827 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191336.889291:0:57827:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc8848398c3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603583 expref: -99 pid: 57827 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787191336.889478:0:57827:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xb3:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:3.0:1787191336.889490:0:57827:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xb3:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191336.889493:0:57827:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191336.889497:0:57827:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xb3:0x0] 00000008:00010000:3.0:1787191336.889517:0:57827:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191336.889521:0:57827:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b506676b0, osc lock ffff936b44f64260, flags 0x400000400001002 00010000:00010000:3.0:1787191336.889536:0:57827:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000185c0a5e/0xe5129dc8848398d1 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x199:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460359f expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191336.889547:0:57827:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000185c0a5e/0xe5129dc8848398d1 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460359f expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:3.0:1787191336.889558:0:57827:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191336.889562:0:57827:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000185c0a5e/0xe5129dc8848398d1 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460359f expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191336.889571:0:57827:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000185c0a5e/0xe5129dc8848398d1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460359f expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000020:00200000:3.0:1787191336.889581:0:57827:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191336.889590:0:57827:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xb3:0x0] updating i_size 5 i_blocks 8 00000020:00010000:3.0:1787191336.889593:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b48035e10 (ffff936b43ab8cf8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191336.889597:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b48035e10 (ffff936b43ab8cf8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191336.889599:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b506676b0 (ffff936b465cc488/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191336.889602:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b48035e10 (ffff936b43ab8cf8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191336.889605:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b506676b0 (ffff936b43ab8cf8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191336.889613:0:57827:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb3:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191336.889641:0:57827:0:(file.c:2483:do_file_read_iter()) START file f70.sanity-flr:[0x200000405:0xb3:0x0], ppos: 0, count: 4096 00000080:00200000:3.0:1787191336.889650:0:57827:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: read ppos: 0, bytes: 4096 00000080:00200000:3.0:1787191336.889659:0:57827:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000020:00200000:3.0:1787191336.889665:0:57827:0:(cl_io.c:214:cl_io_rw_init()) header@000000002edcf4f9[0x110, 2, [0x200000405:0xb3:0x0] hash] 00000020:00200000:3.0:1787191336.889667:0:57827:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 4096) 2048 0 00000080:00200000:3.0:1787191336.889669:0:57827:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xb3:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00000080:00200000:3.0:1787191336.889679:0:57827:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1787191336.889686:0:57827:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:3.0:1787191336.889690:0:57827:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1787191336.889703:0:57827:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:3.0:1787191336.889711:0:57827:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:3.0:1787191336.889714:0:57827:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b506676b0, osc lock ffff936b44f64260, flags 0x40000 00000080:00200000:3.0:1787191336.889720:0:57827:0:(vvp_io.c:835:vvp_io_read_start()) f70.sanity-flr: read [0, 4096) 00000001:00010000:3.0:1787191336.889726:0:57827:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xb3:0x0] 00000008:00010000:3.0:1787191336.889733:0:57827:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191336.889734:0:57827:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b506678b0, osc lock ffff936b44f658f0, flags 0x400001002 00010000:00010000:3.0:1787191336.889743:0:57827:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000185c0a5e/0xe5129dc8848398d1 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x199:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460359f expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1787191336.889752:0:57827:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000185c0a5e/0xe5129dc8848398d1 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460359f expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000020:00200000:3.0:1787191336.889760:0:57827:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191336.889763:0:57827:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000185c0a5e/0xe5129dc8848398d1 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460359f expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1787191336.889777:0:57827:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000185c0a5e/0xe5129dc8848398d1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460359f expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00000020:00200000:3.0:1787191336.889786:0:57827:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191336.889791:0:57827:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xb3:0x0] updating i_size 5 i_blocks 8 00000020:00010000:3.0:1787191336.889793:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b48035e10 (ffff936b43ab8cf8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191336.889796:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b48035e10 (ffff936b43ab8cf8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191336.889799:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b506678b0 (ffff936b465cc488/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191336.889801:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b48035e10 (ffff936b43ab8cf8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191336.889804:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b506678b0 (ffff936b43ab8cf8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191336.889822:0:57827:0:(vvp_io.c:893:vvp_io_read_start()) count:4096 iocb pos:0 00000080:00200000:3.0:1787191336.889848:0:57827:0:(rw26.c:362:ll_direct_IO()) VFS Op:inode=[0x200000405:0xb3:0x0](ffff936b5396e3c8), size=4096 (max 536870912), offset=0=0x0, pages 1 (max 131072), lockless, parallel 00000020:00200000:3.0:1787191336.889898:0:57827:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:3.0:1787191336.889901:0:57827:0:(rw26.c:544:ll_direct_IO()) result 0 tot_bytes 5 count 5 file_offset 5 00000020:00010000:3.0:1787191336.889907:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b45323f38 (ffff936b43ab8cf8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191336.889909:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b45323f38 (ffff936b43ab8cf8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191336.889911:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b506676b0 (ffff936b465cc488/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191336.889914:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b45323f38 (ffff936b43ab8cf8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191336.889916:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b506676b0 (ffff936b43ab8cf8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191336.889921:0:57827:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000020:00200000:3.0:1787191336.889926:0:57827:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:3.0:1787191336.889945:0:27559:0:(osc_cache.c:2029:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff936b5124be40 00000008:00100000:3.0:1787191336.889990:0:27559:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff936b51d1c700 - object 0x2c0000401:409 offset 0<>5 00000100:00100000:2.0:1787191336.890111:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626560512:192.168.202.101@tcp:3:lfs.0 00000008:00010000:3.0:1787191336.893532:0:2391:0:(osc_cache.c:917:osc_extent_finish()) ### no dlm lock: extent: ffff936b5124be40 00000020:00200000:3.0:1787191336.893544:0:2391:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1787191336.893552:0:2391:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1787191336.893575:0:2391:0:(osc_cache.c:497:__osc_extent_remove()) ### no dlm lock: extent: ffff936b5124be40 00000100:00100000:3.0:1787191336.893599:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626560512:192.168.202.101@tcp:3:lfs.0 00000100:00100000:2.0:1787191336.904674:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191336.904745:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634853248 00000100:00100000:2.0:1787191336.904754:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634853248 00000100:00100000:2.0:1787191336.904797:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1220 00000100:00100000:2.0:1787191336.904806:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:25390:x1874004634853248:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191336.905076:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000042bf27d3/0xe5129dc884839845 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4603402 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191336.905116:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191336.905122:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:25390:x1874004634853248:12345-192.168.202.101@tcp:104: Request processed in 317us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191336.905129:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1220 00010000:00010000:2.0:1787191336.905313:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787191336.905320:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000042bf27d3/0xe5129dc884839845 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4603402 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191336.905329:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9a600 already unused, calling callback (ffffffffc1208790) 00010000:00010000:2.0:1787191336.905334:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000042bf27d3/0xe5129dc884839845 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4603402 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191336.905368:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000042bf27d3/0xe5129dc884839845 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4603402 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191336.905375:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191336.905391:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000042bf27d3/0xe5129dc884839845 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4603402 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191336.905405:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000042bf27d3/0xe5129dc884839845 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4603402 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191336.905424:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191336.905427:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191336.905428:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191336.905439:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626561408:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00200000:2.0:1787191336.911710:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xb4:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191336.911717:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b42ff64e8 (ffff936b465cc3f8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191336.911720:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42ff64e8 (ffff936b465cc3f8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191336.911725:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b628934b0 (ffff936b47a17008/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191336.911736:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000dc50e435/0xe5129dc884839909 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4603632 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.911750:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000dc50e435/0xe5129dc884839909 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4603632 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191336.911767:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b628934f0 (ffff936b47a17d88/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191336.911772:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc884839910 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460364e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191336.911779:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc884839910 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460364e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191336.911792:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42ff64e8 (ffff936b465cc3f8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191336.911794:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b628934b0 (ffff936b465cc3f8/1) at cl_lock_fini():72 00000020:00010000:2.0:1787191336.911799:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b628934f0 (ffff936b465cc3f8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191336.911899:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb4:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191336.911922:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xb4:0x0](ffff936b53969988) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191336.000000000, mtime 1787191336.000000000, ctime 1787191336.000000000, rc 0 00000080:00200008:2.0:1787191336.912272:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xb4:0x0], ppos: 0, count: 5 00000080:00200000:2.0:1787191336.912287:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191336.912293:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:2.0:1787191336.912298:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:2.0:1787191336.912302:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1787191336.912307:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@00000000d6254bde[0x110, 1, [0x200000405:0xb4:0x0] hash] 00000020:00200000:2.0:1787191336.912310:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:2.0:1787191336.912314:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xb4:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:2.0:1787191336.912327:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xb4:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:2.0:1787191336.912332:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xb4:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191336.912334:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1787191336.912338:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1787191336.912344:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:2.0:1787191336.912348:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1787191336.912364:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:2.0:1787191336.912378:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1787191336.912384:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1b30, osc lock ffff936b44e62980, flags 0x0 00010000:00010000:2.0:1787191336.912401:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000dc50e435/0xe5129dc884839909 lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x198:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4603632 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191336.912413:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000dc50e435/0xe5129dc884839909 lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4603632 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191336.912428:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000dc50e435/0xe5129dc884839909 lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4603632 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191336.912436:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000dc50e435/0xe5129dc884839909 lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4603632 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191336.912444:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000dc50e435/0xe5129dc884839909 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4603632 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191336.912454:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:2.0:1787191336.912463:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191336.912507:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:2.0:1787191336.912514:0:57570:0:(rw26.c:927:ll_write_end()) page@00000000fa770166[3 000000001ead4c4c 2 1 00000000a790cda1 0 0 0] 00000080:00200000:2.0:1787191336.912517:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @00000000b2b84e13 17ffffc0001001 3:0 ffff936b43a1e2a0 0 lru 00000080:00200000:2.0:1787191336.912523:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@0000000049655646 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000a2a44f55 00000000fca7e965 > 3< 0 0 > 4< 0 1 8 353435648 - | - - - - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1787191336.912525:0:57570:0:(rw26.c:927:ll_write_end()) end page@00000000fa770166 00000080:00200000:2.0:1787191336.912527:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:2.0:1787191336.912531:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:2.0:1787191336.912549:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 000000006982cee0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000dc50e435/0xe5129dc884839909 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4603632 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191336.912567:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b53969b38, count 1, dirtied 1 00000080:00200000:2.0:1787191336.912571:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:2.0:1787191336.912574:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:2.0:1787191336.912587:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b53cc5128 (ffff936b47a172d8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191336.912590:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b53cc5128 (ffff936b47a172d8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191336.912593:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1b30 (ffff936b465cc878/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191336.912598:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000dc50e435/0xe5129dc884839909 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4603632 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191336.912607:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000dc50e435/0xe5129dc884839909 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4603632 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:2.0:1787191336.912618:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b53cc5128 (ffff936b47a172d8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191336.912621:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1b30 (ffff936b47a172d8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191336.912628:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:2.0:1787191336.912633:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1787191336.912638:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb4:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191336.912641:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:2.0:1787191336.912646:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xb4:0x0] updating i_size 5 i_blocks 0 00000080:00200000:2.0:1787191336.912650:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:2.0:1787191336.912667:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xb4:0x0](ffff936b53969988), flags 100001 00000002:00100000:2.0:1787191336.912725:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513bb800 x1874004626559360/t8589936568(8589936568) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191352 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191336.912736:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191336.912741:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8a80 x1874004626561664/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191336.912761:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8a80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626561664:192.168.202.101@tcp:35:bash.0 00000100:00100000:3.0:1787191336.913418:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626561408:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191336.913726:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359600 going to sleep for 11 seconds 00000080:00200000:3.0:1787191336.920619:0:57827:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1787191336.920632:0:57827:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb3:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191336.920637:0:57827:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:3.0:1787191336.920647:0:57827:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xb3:0x0] updating i_size 5 i_blocks 8 00000020:00200000:3.0:1787191336.920650:0:57827:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191336.920659:0:57827:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200080:3.0:1787191336.920678:0:57827:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xb3:0x0](ffff936b5396e3c8) cmd=400866b1 arg=0 00000080:00200080:3.0:1787191336.920686:0:57827:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xb3:0x0](ffff936b5396e3c8) cmd=400866b1 arg=1 00000080:00200008:3.0:1787191336.920693:0:57827:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xb3:0x0](ffff936b5396e3c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191336.920700:0:57827:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xb3:0x0](ffff936b5396e3c8),name=f70.sanity-flr 00000002:00010000:3.0:1787191336.920722:0:57827:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xb3:0x0]) in obj [0x200000405:0xb3:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191336.920739:0:57827:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc8848398c3 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603583 expref: -99 pid: 57827 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191336.920752:0:57827:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc8848398c3 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603583 expref: -99 pid: 57827 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:3.0:1787191336.920761:0:57827:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xb3:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191336.920769:0:57827:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xb3:0x0](ffff936b5396e3c8) 00000080:00010000:3.0:1787191336.920773:0:57827:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xb3:0x0](ffff936b5396e3c8) for lock 0xe5129dc8848398c3 00000080:00010000:3.0:1787191336.920781:0:57827:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc8848398c3 from it ffffa3fb420e3cd8 00010000:00010000:3.0:1787191336.920785:0:57827:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc8848398c3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4603583 expref: -99 pid: 57827 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191336.920796:0:57827:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc8848398c3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xb3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603583 expref: -99 pid: 57827 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00000080:00200000:2.0:1787191336.920901:0:57827:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xb3:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:2.0:1787191336.920911:0:57827:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xb3:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191336.920915:0:57827:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191336.920919:0:57827:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xb3:0x0] 00000008:00010000:2.0:1787191336.920938:0:57827:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191336.920943:0:57827:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1b30, osc lock ffff936b44e62980, flags 0x400000400001002 00010000:00010000:2.0:1787191336.920961:0:57827:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000185c0a5e/0xe5129dc8848398d1 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x199:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460359f expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 0 00010000:00010000:2.0:1787191336.920973:0:57827:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000185c0a5e/0xe5129dc8848398d1 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460359f expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 0 00000020:00200000:2.0:1787191336.921056:0:57827:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191336.921060:0:57827:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000185c0a5e/0xe5129dc8848398d1 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460359f expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 0 00010000:00010000:2.0:1787191336.921079:0:57827:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000185c0a5e/0xe5129dc8848398d1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460359f expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00000020:00200000:2.0:1787191336.921089:0:57827:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191336.921095:0:57827:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xb3:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191336.921099:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c38de0 (ffff936b47a172d8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191336.921101:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c38de0 (ffff936b47a172d8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191336.921104:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1b30 (ffff936b465cc878/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191336.921108:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c38de0 (ffff936b47a172d8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191336.921111:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1b30 (ffff936b47a172d8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191336.921119:0:57827:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb3:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191336.921130:0:57827:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xb3:0x0], offset: 5, type: SEEK_DATA 00000080:00200000:2.0:1787191336.921135:0:57827:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xb3:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:2.0:1787191336.921139:0:57827:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xb3:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191336.921141:0:57827:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191336.921145:0:57827:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191336.921269:0:57827:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191336.921286:0:57827:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xb3:0x0] updating i_size 5 i_blocks 8 00000080:00200000:2.0:1787191336.921294:0:57827:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb3:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191336.921300:0:57827:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000080:00200000:2.0:1787191336.921302:0:57827:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xb3:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191336.921307:0:57827:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191336.921311:0:57827:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191336.921313:0:57827:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:2.0:1787191336.921321:0:57827:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:2.0:1787191336.921323:0:57827:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1b30, osc lock ffff936b44e62980, flags 0x0 00010000:00010000:2.0:1787191336.921333:0:57827:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000185c0a5e/0xe5129dc8848398d1 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x199:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460359f expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:2.0:1787191336.921343:0:57827:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000185c0a5e/0xe5129dc8848398d1 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460359f expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:2.0:1787191336.921353:0:57827:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000185c0a5e/0xe5129dc8848398d1 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460359f expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:2.0:1787191336.921363:0:57827:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000185c0a5e/0xe5129dc8848398d1 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460359f expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:2.0:1787191336.921370:0:57827:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000185c0a5e/0xe5129dc8848398d1 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460359f expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00000080:00200000:2.0:1787191336.921380:0:57827:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xb3:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191336.921385:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b53cc5128 (ffff936b47a172d8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191336.921387:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b53cc5128 (ffff936b47a172d8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191336.921389:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1b30 (ffff936b465cc878/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191336.921404:0:57827:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000185c0a5e/0xe5129dc8848398d1 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460359f expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:2.0:1787191336.921413:0:57827:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000185c0a5e/0xe5129dc8848398d1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460359f expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00000020:00010000:2.0:1787191336.921422:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b53cc5128 (ffff936b47a172d8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191336.921425:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1b30 (ffff936b47a172d8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191336.921433:0:57827:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb3:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191336.921439:0:57827:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xb3:0x0], offset: 0, type: (null) 00000080:00200000:2.0:1787191336.921444:0:57827:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xb3:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:2.0:1787191336.921449:0:57827:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xb3:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191336.921451:0:57827:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191336.921453:0:57827:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xb3:0x0] 00000008:00010000:2.0:1787191336.921460:0:57827:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191336.921462:0:57827:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1b30, osc lock ffff936b44e62980, flags 0x400000400001002 00010000:00010000:2.0:1787191336.921469:0:57827:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000185c0a5e/0xe5129dc8848398d1 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x199:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460359f expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00010000:00010000:2.0:1787191336.921478:0:57827:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000185c0a5e/0xe5129dc8848398d1 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460359f expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00000020:00200000:2.0:1787191336.921485:0:57827:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191336.921488:0:57827:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000185c0a5e/0xe5129dc8848398d1 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460359f expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00010000:00010000:2.0:1787191336.921494:0:57827:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000185c0a5e/0xe5129dc8848398d1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460359f expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00000020:00200000:2.0:1787191336.921503:0:57827:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191336.921507:0:57827:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xb3:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191336.921509:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c38de0 (ffff936b47a172d8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191336.921511:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c38de0 (ffff936b47a172d8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191336.921513:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1b30 (ffff936b465cc878/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191336.921516:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c38de0 (ffff936b47a172d8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191336.921518:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1b30 (ffff936b47a172d8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191336.921524:0:57827:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb3:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191336.921530:0:57827:0:(file.c:5244:ll_file_seek()) COMPLETED file f70.sanity-flr:[0x200000405:0xb3:0x0], offset: 0, type: (null), rc = 5 00000080:00200080:2.0:1787191336.921535:0:57827:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xb3:0x0](ffff936b5396e3c8) cmd=400866b1 arg=0 00000080:00200000:3.0:1787191336.958551:0:57831:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191336.958579:0:57831:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191336.958594:0:57831:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191336.958610:0:57831:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191336.958619:0:57831:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191336.958627:0:57831:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191336.958631:0:57831:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191336.958638:0:57831:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4212bb58 00010000:00010000:3.0:1787191336.958642:0:57831:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191336.958651:0:57831:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191336.958668:0:57831:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191336.958676:0:57831:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:3.0:1787191336.958682:0:57831:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191336.958692:0:57831:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:3.0:1787191336.958697:0:57831:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:3.0:1787191336.958711:0:57831:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1787191336.958766:0:57831:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483992c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.958780:0:57831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483992c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.958788:0:57831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483992c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191336.958807:0:57831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57831:1874004626562688:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191336.958911:0:57831:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c240 going to sleep for 11 seconds 00000100:00100000:2.0:1787191336.961117:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191336.961291:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634853376 00000100:00100000:3.0:1787191336.961301:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634853376 00000100:00100000:3.0:1787191336.961357:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1221 00000100:00100000:3.0:1787191336.961367:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:37089:x1874004634853376:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191336.961384:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000793f6478/0xe5129dc88483984c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4603409 expref: -99 pid: 57826 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191336.961460:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191336.961467:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:37089:x1874004634853376:12345-192.168.202.101@tcp:104: Request processed in 102us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191336.961474:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1221 00000100:00100000:2.0:1787191336.967896:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191336.967977:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634853504 00000100:00100000:3.0:1787191336.967985:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634853504 00000100:00100000:3.0:1787191336.968039:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1222 00000100:00100000:3.0:1787191336.968049:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:6490:x1874004634853504:12345-192.168.202.101@tcp:105: 00010000:00010000:3.0:1787191336.968287:0:40921:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b9bf1031/0xe5129dc884839925 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e460369b expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.968300:0:40921:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b9bf1031/0xe5129dc884839925 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e460369b expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.968309:0:40921:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b9bf1031/0xe5129dc884839925 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000020000 nid: local remote: 0x7130d520e460369b expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.968320:0:40921:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b9bf1031/0xe5129dc884839925 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10080000020000 nid: local remote: 0x7130d520e460369b expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.968328:0:40921:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b9bf1031/0xe5129dc884839925 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10080000020000 nid: local remote: 0x7130d520e460369b expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.968338:0:40921:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b9bf1031/0xe5129dc884839925 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x80000020000 nid: local remote: 0x7130d520e460369b expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191336.968542:0:40921:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b51fe0000) 00000100:00100000:3.0:1787191336.968606:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:6490:x1874004634853504:12345-192.168.202.101@tcp:105: Request processed in 559us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191336.968614:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1222 00000100:00100000:2.0:1787191336.990101:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191336.990327:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634853632 00000100:00100000:3.0:1787191336.990336:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634853632 00000100:00100000:3.0:1787191336.990391:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1223 00000100:00100000:3.0:1787191336.990408:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:15323:x1874004634853632:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191336.990427:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc8848398bc lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xb3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4603575 expref: -99 pid: 57827 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191336.990492:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191336.990499:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:15323:x1874004634853632:12345-192.168.202.101@tcp:104: Request processed in 93us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191336.990507:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1223 00000100:00100000:2.0:1787191337.008890:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191337.008924:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191337.009094:0:40921:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787191337.009115:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634854272 00000100:00100000:3.0:1787191337.009122:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634854272 00000100:00100000:3.0:1787191337.009181:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1224 00000100:00100000:3.0:1787191337.009191:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b50880c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8420:x1874004634854272:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191337.009210:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000dc50e435/0xe5129dc884839909 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4603632 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191337.009276:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191337.009283:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b50880c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8420:x1874004634854272:12345-192.168.202.101@tcp:104: Request processed in 94us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191337.009290:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1224 00010000:00010000:3.0:1787191337.009326:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191337.009332:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000dc50e435/0xe5129dc884839909 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4603632 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191337.009341:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b47a7ee00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191337.009348:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000dc50e435/0xe5129dc884839909 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4603632 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191337.009392:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000dc50e435/0xe5129dc884839909 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4603632 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191337.009399:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191337.009418:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000dc50e435/0xe5129dc884839909 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4603632 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191337.009425:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000dc50e435/0xe5129dc884839909 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x198:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4603632 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191337.009442:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191337.009444:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191337.009446:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191337.009460:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626564864:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787191337.010465:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191337.010471:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc884839910 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e460364e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191337.010478:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b47a7e600 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191337.010483:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc884839910 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e460364e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191337.010514:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc884839910 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e460364e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191337.010521:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191337.010545:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc884839910 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e460364e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191337.010553:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc884839910 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e460364e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:2.0:1787191337.010856:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626564992:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787191337.010989:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191337.010992:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191337.010993:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191337.021773:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191337.022008:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626564992:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191337.022213:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626564864:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191337.022241:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634855040 00000100:00100000:3.0:1787191337.022249:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634855040 00000100:00100000:3.0:1787191337.022297:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1225 00000100:00100000:3.0:1787191337.022306:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634855040:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191337.022325:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafc00/0xe5129dc884839948 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xb6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4603712 expref: -99 pid: 57831 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191337.022386:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191337.022405:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634855040:12345-192.168.202.101@tcp:104: Request processed in 87us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191337.022412:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1225 00000100:00100000:3.0:1787191337.029307:0:57831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57831:1874004626564736:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191337.029324:0:57831:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483994f lrc: 4/1,0 mode: --/CR res: [0x200000405:0xb6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.029336:0:57831:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483994f lrc: 4/1,0 mode: --/CR res: [0x200000405:0xb6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.029343:0:57831:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483994f lrc: 4/1,0 mode: --/CR res: [0x200000405:0xb6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.029349:0:57831:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483994f lrc: 3/0,0 mode: --/CR res: [0x200000405:0xb6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.029358:0:57831:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483994f lrc: 4/0,0 mode: --/CR res: [0x200000405:0xb6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.029363:0:57831:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51fe1200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191337.029368:0:57831:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483994f lrc: 4/0,0 mode: --/CR res: [0x200000405:0xb6:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.029374:0:57831:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483994f lrc: 4/0,0 mode: --/CR res: [0x200000405:0xb6:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.029380:0:57831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483994f lrc: 5/0,0 mode: --/CR res: [0x200000405:0xb6:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.029387:0:57831:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191337.029587:0:57831:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483994f lrc: 3/0,0 mode: --/CR res: [0x200000405:0xb6:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.029597:0:57831:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483994f lrc: 0/0,0 mode: --/CR res: [0x200000405:0xb6:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57831 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191337.029730:0:57831:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b453ab800 x1874004626564736/t8589936578(8589936578) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191353 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191337.029745:0:57831:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453ab800 x1874004626564736/t8589936578(8589936578) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191353 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191337.029762:0:57831:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xb6:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1787191337.029788:0:57831:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xb6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1787191337.029793:0:57831:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191337.029867:0:57831:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xb6:0x0], updating i_size 0 00000002:00100000:3.0:1787191337.029884:0:57831:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453ab800 x1874004626564736/t8589936578(8589936578) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191353 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191337.029974:0:57831:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453ab800 x1874004626564736/t8589936578(8589936578) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191353 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191337.029982:0:57831:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191337.029985:0:57831:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513baa00 x1874004626565504/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191337.030005:0:57831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57831:1874004626565504:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191337.030087:0:57831:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b523596c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191337.032054:0:57831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57831:1874004626565504:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191337.032099:0:57831:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453ab800 x1874004626564736/t8589936578(8589936578) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191353 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:3.0:1787191337.032142:0:57831:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xb6:0x0](ffff936b5395ba88), flags 100001 00000002:00100000:3.0:1787191337.032224:0:57831:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a475f80 x1874004626564352/t8589936576(8589936576) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191352 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191337.032231:0:57831:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:3.0:1787191337.032234:0:57831:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1f480 x1874004626566016/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191337.032245:0:57831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57831:1874004626566016:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191337.032271:0:57831:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c300 going to sleep for 11 seconds 00000100:00100000:3.0:1787191337.034374:0:57831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57831:1874004626566016:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191337.034525:0:57831:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a475f80 x1874004626564352/t8589936576(8589936576) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191352 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787191337.058167:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191337.058504:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634855168 00000100:00100000:2.0:1787191337.058512:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634855168 00000100:00100000:2.0:1787191337.058566:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1226 00000100:00100000:2.0:1787191337.058575:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634855168:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191337.058588:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc884839972 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xb6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46037ac expref: -99 pid: 57827 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191337.058671:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191337.058679:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634855168:12345-192.168.202.101@tcp:104: Request processed in 105us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191337.058686:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1226 00000080:00200000:2.0:1787191337.061426:0:57827:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xb6:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191337.061433:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51654de0 (ffff936b465ccea8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191337.061437:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51654de0 (ffff936b465ccea8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191337.061441:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62893c30 (ffff936b465ccb48/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191337.061446:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62893c70 (ffff936b465cca28/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191337.061448:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51654de0 (ffff936b465ccea8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191337.061451:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62893c30 (ffff936b465ccea8/1) at cl_lock_fini():72 00000020:00010000:2.0:1787191337.061455:0:57827:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62893c70 (ffff936b465ccea8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191337.061498:0:57827:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb6:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191337.061551:0:57827:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xb6:0x0](ffff936b5395ba88), flags 154000 00010000:00010000:2.0:1787191337.061576:0:57827:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc884839964 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xb6:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603789 expref: -99 pid: 57827 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:2.0:1787191337.061636:0:57827:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191337.061652:0:57827:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191337.061661:0:57827:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191337.061670:0:57827:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191337.061677:0:57827:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191337.061684:0:57827:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191337.061688:0:57827:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191337.061693:0:57827:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb420e3bf8 00010000:00010000:2.0:1787191337.061696:0:57827:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191337.061704:0:57827:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191337.061715:0:57827:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191337.061722:0:57827:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191337.061728:0:57827:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191337.061742:0:57827:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b42a0f200, open_flags d902, mode 0 opened 0 00000080:00200000:2.0:1787191337.061749:0:57827:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:2.0:1787191337.061766:0:57827:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154403 00010000:00010000:2.0:1787191337.061810:0:57827:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839987 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.061822:0:57827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839987 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57827 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191337.062258:0:57827:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:2.0:1787191337.062269:0:57827:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bbb80 x1874004626567680/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191337.062280:0:57827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839987 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191337.062302:0:57827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57827:1874004626567680:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191337.062811:0:57827:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787191337.079599:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191337.079856:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634855296 00000100:00100000:2.0:1787191337.079867:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634855296 00000100:00100000:2.0:1787191337.079917:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1227 00000100:00100000:2.0:1787191337.079926:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634855296:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191337.079944:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839987 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xb6:0x0].0x0 bits 0x19/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46037dd expref: -99 pid: 57827 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191337.080075:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191337.080082:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634855296:12345-192.168.202.101@tcp:104: Request processed in 158us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191337.080088:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1227 00000100:00100000:3.0:1787191337.098000:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191337.098095:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634856448 00000100:00100000:2.0:1787191337.098103:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634856448 00000100:00100000:2.0:1787191337.098162:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1228 00000100:00100000:2.0:1787191337.098169:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30511:x1874004634856448:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191337.098183:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000df9b55fb/0xe5129dc884839884 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x196:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e46034bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191337.098240:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191337.098246:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30511:x1874004634856448:12345-192.168.202.101@tcp:104: Request processed in 77us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191337.098253:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1228 00000100:00100000:2.0:1787191337.100224:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191337.100255:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191337.100276:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634856576 00000100:00100000:2.0:1787191337.100283:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634856576 00000100:00100000:2.0:1787191337.100313:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634856704 00000100:00100000:2.0:1787191337.100316:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634856704 00000100:00100000:2.0:1787191337.100331:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1229 00000100:00100000:2.0:1787191337.100339:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30353:x1874004634856576:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191337.100351:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000cfb66679/0xe5129dc88483991e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x197:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4603694 expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191337.100403:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191337.100410:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30353:x1874004634856576:12345-192.168.202.101@tcp:104: Request processed in 72us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191337.100417:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1229 00000100:00100000:2.0:1787191337.100434:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1230 00000100:00100000:2.0:1787191337.100441:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30510:x1874004634856704:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191337.100450:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b9bf1031/0xe5129dc884839925 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000030000 nid: local remote: 0x7130d520e460369b expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191337.100490:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787191337.100496:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30510:x1874004634856704:12345-192.168.202.101@tcp:104: Request processed in 56us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191337.100501:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1230 00000100:00100000:2.0:1787191337.100576:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626568576:192.168.202.101@tcp:101:bash.0 00010000:00010000:2.0:1787191337.100593:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483998e lrc: 4/0,1 mode: --/EX res: [0x200000405:0xb6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46037f2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.100602:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483998e lrc: 4/0,1 mode: --/CR res: [0x200000405:0xb6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46037f2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.100614:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483998e lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xb6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46037f2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.100624:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483998e lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xb6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46037f2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.100635:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483998e lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xb6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46037f2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.100655:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483998e lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xb6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46037f2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.100662:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483998e lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xb6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46037f2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191337.100678:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b6a476a00 x1874004626568576/t8589936589(8589936589) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191353 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191337.100696:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483998e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xb6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46037f2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191337.100706:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483998e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xb6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46037f2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.100715:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/182 (0 0) 00000080:00200000:2.0:1787191337.100722:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xb6:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1787191337.100736:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xb6:0x0](ffff936b5395ba88) for lock 0xe5129dc88483998e 00000080:00010000:2.0:1787191337.100743:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483998e from it ffffa3fb41cab930 00010000:00010000:2.0:1787191337.100747:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483998e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xb6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46037f2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.100755:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483998e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xb6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46037f2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191337.100772:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:2.0:1787191337.100779:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xb6:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:2.0:1787191337.100792:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483998e lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xb6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46037f2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191337.100802:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483998e lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xb6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46037f2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:2.0:1787191337.100815:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xb6:0x0](00000000c6a8adc5) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483998e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xb6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46037f2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191337.100880:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xb6:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:2.0:1787191337.100886:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483998e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xb6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46037f2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191337.100892:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483998e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xb6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46037f2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:2.0:1787191337.100907:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xb6:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:2.0:1787191337.100911:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xb6:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191337.100915:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191337.100923:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191337.100939:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191337.100943:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:2.0:1787191337.100958:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:2.0:1787191337.100962:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b52359330, osc lock ffff936b44e62980, flags 0x80000000 00000008:00010000:2.0:1787191337.100965:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:2.0:1787191337.100967:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b52359370, osc lock ffff936b44e638f0, flags 0x80000000 00010000:00010000:2.0:1787191337.101006:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848399a3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.101015:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848399a3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.101025:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848399a3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191337.101046:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626569344:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191337.101100:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359000 going to sleep for 11 seconds 00000100:00100000:2.0:1787191337.101161:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191337.101187:0:40922:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787191337.101196:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634856832 00000100:00100000:2.0:1787191337.101200:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634856832 00000100:00100000:2.0:1787191337.101221:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1231 00000100:00100000:2.0:1787191337.101228:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b4121c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8422:x1874004634856832:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191337.101236:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000185c0a5e/0xe5129dc8848398d1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x199:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e460359f expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:2.0:1787191337.101265:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787191337.101270:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b4121c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8422:x1874004634856832:12345-192.168.202.101@tcp:104: Request processed in 43us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191337.101276:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1231 00000100:00100000:2.0:1787191337.107767:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626569344:192.168.202.101@tcp:101:bash.0 00010000:00010000:2.0:1787191337.107794:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848399a3 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603846 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.107811:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848399a3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4603846 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.107823:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848399a3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4603846 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.107897:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848399a3 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4603846 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1787191337.107912:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848399a3 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4603846 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.107925:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848399a3 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4603846 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.107933:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848399a3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4603846 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.108007:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c283bfdf/0xe5129dc8848399b1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.108016:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c283bfdf/0xe5129dc8848399b1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.108027:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c283bfdf/0xe5129dc8848399b1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191337.108047:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626569984:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191337.108121:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359000 going to sleep for 11 seconds 00000100:00100000:3.0:1787191337.111110:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191337.111294:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634856960 00000100:00100000:2.0:1787191337.111304:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634856960 00000100:00100000:2.0:1787191337.111373:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1232 00000100:00100000:2.0:1787191337.111384:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:37089:x1874004634856960:12345-192.168.202.101@tcp:106: 00010000:00010000:2.0:1787191337.111400:0:40922:0:(ldlm_lockd.c:2541:ldlm_callback_handler()) ### glimpse ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848399a3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4603846 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.111414:0:40922:0:(ldlm_lockd.c:2123:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848399a3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4603846 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00010000:2.0:1787191337.111442:0:40922:0:(cl_object.c:322:cl_object_glimpse()) header@00000000537118e6[0x110, 1, [0x200000405:0xb6:0x0] hash] 00000020:00010000:2.0:1787191337.111445:0:40922:0:(cl_object.c:322:cl_object_glimpse()) size: 0 mtime: 1787191337 atime: 1787191336 ctime: 1787191337 blocks: 0 00000020:00010000:2.0:1787191337.111449:0:40922:0:(cl_object.c:322:cl_object_glimpse()) header@00000000d6254bde[0x110, 2, [0x2c0000401:0x19d:0x0] hash] 00000020:00010000:2.0:1787191337.111450:0:40922:0:(cl_object.c:322:cl_object_glimpse()) size: 0 mtime: 1787191337 atime: 1787191336 ctime: 1787191337 blocks: 0 00000100:00100000:2.0:1787191337.111509:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:37089:x1874004634856960:12345-192.168.202.101@tcp:106: Request processed in 126us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191337.111518:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1232 00000080:00200000:2.0:1787191337.118694:0:57832:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xb6:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191337.118701:0:57832:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b516579d0 (ffff936b465cc7e8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191337.118704:0:57832:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b516579d0 (ffff936b465cc7e8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191337.118709:0:57832:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b46b50130 (ffff936b465cc248/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191337.118713:0:57832:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b516579d0 (ffff936b465cc7e8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191337.118716:0:57832:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b46b50130 (ffff936b465cc7e8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191337.118728:0:57832:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb6:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191337.118792:0:57832:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xb6:0x0](ffff936b5395ba88), flags 154000 00000002:00100000:2.0:1787191337.118904:0:57832:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a476680 x1874004626568960/t8589936590(8589936590) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191353 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191337.118916:0:57832:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191337.118921:0:57832:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb480 x1874004626570496/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191337.118942:0:57832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57832:1874004626570496:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191337.119019:0:57832:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b523596c0 going to sleep for 11 seconds 00000080:00200000:2.0:1787191337.124928:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xb6:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191337.124938:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b42ff63f8 (ffff936b465cc908/0) at cl_lock_release():245 00000020:00010000:2.0:1787191337.124942:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42ff63f8 (ffff936b465cc908/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191337.124946:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b52359330 (ffff936b47a172d8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191337.124955:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848399a3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4603846 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.124968:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848399a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4603846 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191337.124982:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b52359370 (ffff936b465cc878/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191337.124985:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c283bfdf/0xe5129dc8848399b1 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4603854 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.124991:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c283bfdf/0xe5129dc8848399b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4603854 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191337.124995:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42ff63f8 (ffff936b465cc908/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191337.124997:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b52359330 (ffff936b465cc908/1) at cl_lock_fini():72 00000020:00010000:2.0:1787191337.125003:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b52359370 (ffff936b465cc908/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191337.125046:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb6:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191337.125071:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xb6:0x0](ffff936b5395ba88) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191337.000000000, mtime 1787191337.000000000, ctime 1787191337.000000000, rc 0 00000080:00200008:2.0:1787191337.125164:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xb6:0x0], ppos: 0, count: 5 00000080:00200000:2.0:1787191337.125177:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191337.125182:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:2.0:1787191337.125187:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:2.0:1787191337.125192:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1787191337.125197:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@00000000537118e6[0x110, 1, [0x200000405:0xb6:0x0] hash] 00000020:00200000:2.0:1787191337.125199:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:2.0:1787191337.125204:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xb6:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:2.0:1787191337.125216:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xb6:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:2.0:1787191337.125220:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xb6:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191337.125223:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1787191337.125227:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1787191337.125233:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:2.0:1787191337.125237:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1787191337.125252:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:2.0:1787191337.125268:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1787191337.125272:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d18b0, osc lock ffff936b44e638f0, flags 0x0 00010000:00010000:2.0:1787191337.125288:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848399a3 lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4603846 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191337.125301:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848399a3 lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4603846 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191337.125313:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848399a3 lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4603846 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191337.125322:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848399a3 lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4603846 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191337.125934:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848399a3 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4603846 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191337.125947:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:2.0:1787191337.125957:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191337.125995:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:2.0:1787191337.126000:0:57570:0:(rw26.c:927:ll_write_end()) page@00000000a33bb335[3 000000003ec08e8e 2 1 0000000053a99842 0 0 0] 00000080:00200000:2.0:1787191337.126003:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @000000007b066e91 17ffffc0001001 3:0 ffff936b43a1e9a0 0 lru 00000080:00200000:2.0:1787191337.126008:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@00000000aa395305 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000ef00a996 00000000a9621480 > 3< 0 0 > 4< 0 0 8 428093440 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1787191337.126009:0:57570:0:(rw26.c:927:ll_write_end()) end page@00000000a33bb335 00000080:00200000:2.0:1787191337.126010:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:2.0:1787191337.126014:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:2.0:1787191337.126027:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 00000000f287428f ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848399a3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4603846 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191337.126042:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b5395bc38, count 1, dirtied 1 00000080:00200000:2.0:1787191337.126045:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:2.0:1787191337.126047:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:2.0:1787191337.126060:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b42ff64e8 (ffff936b465cc7e8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191337.126074:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42ff64e8 (ffff936b465cc7e8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191337.126076:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d18b0 (ffff936b465cc248/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191337.126080:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848399a3 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4603846 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191337.126087:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848399a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4603846 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:2.0:1787191337.126099:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42ff64e8 (ffff936b465cc7e8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191337.126100:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d18b0 (ffff936b465cc7e8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191337.126106:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:2.0:1787191337.126109:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1787191337.126115:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb6:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191337.126117:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:2.0:1787191337.126122:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xb6:0x0] updating i_size 5 i_blocks 0 00000080:00200000:2.0:1787191337.126124:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:2.0:1787191337.126144:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xb6:0x0](ffff936b5395ba88), flags 100001 00000002:00100000:2.0:1787191337.126206:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a474700 x1874004626566272/t8589936582(8589936582) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191353 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191337.126218:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:2.0:1787191337.126224:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9f80 x1874004626570752/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191337.126245:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626570752:192.168.202.101@tcp:35:bash.0 00000100:00100000:2.0:1787191337.126314:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359300 going to sleep for 11 seconds 00000100:00100000:2.0:1787191337.128691:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626570752:192.168.202.101@tcp:35:bash.0 00000002:00100000:2.0:1787191337.128714:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a474700 x1874004626566272/t8589936582(8589936582) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191353 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1787191337.135098:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787191337.135106:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caee00/0xe5129dc8848399b8 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xb6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4603870 expref: -99 pid: 57832 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.135113:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44caee00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191337.135118:0:57627:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caee00/0xe5129dc8848399b8 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xb6:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4603870 expref: -99 pid: 57832 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.135125:0:57627:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caee00/0xe5129dc8848399b8 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xb6:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4603870 expref: -99 pid: 57832 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.135132:0:57627:0:(ldlm_request.c:1774:ldlm_cli_cancel()) ### lock is already being destroyed 00010000:00010000:2.0:1787191337.135135:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caee00/0xe5129dc8848399b8 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xb6:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4603870 expref: -99 pid: 57832 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.135141:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caee00/0xe5129dc8848399b8 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xb6:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4603870 expref: -99 pid: 57832 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.135869:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191337.135872:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191337.135874:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191337.137743:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191337.137788:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191337.137891:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634857088 00000100:00100000:2.0:1787191337.137900:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634857088 00000100:00100000:2.0:1787191337.137937:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634857216 00000100:00100000:2.0:1787191337.137940:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634857216 00000100:00100000:2.0:1787191337.137955:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1233 00000100:00100000:2.0:1787191337.137964:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+6:6505:x1874004634857088:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191337.137976:0:40921:0:(ldlm_lockd.c:2455:ldlm_callback_handler()) callback on lock 0xe5129dc8848399b8 - lock disappeared 00010000:00010000:2.0:1787191337.138030:0:40921:0:(ldlm_lockd.c:2352:ldlm_callback_errmsg()) @@@ Operate with invalid parameter, NID=12345-192.168.202.101@tcp lock=0xe5129dc8848399b8: rc = 0 req@ffff936b51d1c700 x1874004634857088/t0(0) o104->f10005b0-4ec5-4888-9c81-49c0b11e82c4@192.168.202.101@tcp:648/0 lens 328/224 e 0 to 0 dl 1787191348 ref 1 fl Interpret:/0/0 rc -22/-22 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787191337.138042:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+6:6505:x1874004634857088:12345-192.168.202.101@tcp:104: Request processed in 80us (309us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787191337.138050:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1233 00000100:00100000:2.0:1787191337.138078:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1234 00000100:00100000:2.0:1787191337.138084:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634857216:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191337.138091:0:40921:0:(ldlm_lockd.c:2455:ldlm_callback_handler()) callback on lock 0xe5129dc88483999c - lock disappeared 00010000:00010000:2.0:1787191337.138111:0:40921:0:(ldlm_lockd.c:2352:ldlm_callback_errmsg()) @@@ Operate with invalid parameter, NID=12345-192.168.202.101@tcp lock=0xe5129dc88483999c: rc = 0 req@ffff936b51d1ed80 x1874004634857216/t0(0) o104->f10005b0-4ec5-4888-9c81-49c0b11e82c4@192.168.202.101@tcp:648/0 lens 328/224 e 0 to 0 dl 1787191348 ref 1 fl Interpret:/0/0 rc -22/-22 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787191337.138121:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634857216:12345-192.168.202.101@tcp:104: Request processed in 38us (334us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787191337.138127:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1234 00000100:00100000:2.0:1787191337.152213:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191337.152303:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634857344 00000100:00100000:3.0:1787191337.152313:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634857344 00000100:00100000:3.0:1787191337.152369:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1235 00000100:00100000:3.0:1787191337.152380:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8419:x1874004634857344:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191337.152412:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848399a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420080000000 nid: local remote: 0x7130d520e4603846 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1787191337.152490:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191337.152498:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8419:x1874004634857344:12345-192.168.202.101@tcp:104: Request processed in 119us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191337.152505:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1235 00000080:00200000:2.0:1787191337.159092:0:40930:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xb6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1787191337.159140:0:40930:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:2.0:1787191337.159234:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848399a3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69480000020 nid: local remote: 0x7130d520e4603846 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1787191337.159242:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191337.159265:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848399a3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69480000020 nid: local remote: 0x7130d520e4603846 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1787191337.159274:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc8848399a3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69480000020 nid: local remote: 0x7130d520e4603846 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1787191337.159292:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191337.159294:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191337.159297:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191337.159303:0:2392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787191337.159316:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626572416:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191337.168986:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626572416:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191337.201536:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191337.201728:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634857984 00000100:00100000:3.0:1787191337.201739:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634857984 00000100:00100000:3.0:1787191337.201997:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1236 00000100:00100000:3.0:1787191337.202006:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634857984:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191337.202022:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc8848399f7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xb8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e460393b expref: -99 pid: 57834 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191337.202133:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191337.202140:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634857984:12345-192.168.202.101@tcp:104: Request processed in 135us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191337.202158:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1236 00000100:00100000:2.0:1787191337.212570:0:57834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57834:1874004626573952:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191337.212584:0:57834:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839a0c lrc: 4/1,0 mode: --/CR res: [0x200000405:0xb8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.212594:0:57834:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839a0c lrc: 4/1,0 mode: --/CR res: [0x200000405:0xb8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.212599:0:57834:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839a0c lrc: 4/1,0 mode: --/CR res: [0x200000405:0xb8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.212605:0:57834:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839a0c lrc: 3/0,0 mode: --/CR res: [0x200000405:0xb8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.212870:0:57834:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839a0c lrc: 4/0,0 mode: --/CR res: [0x200000405:0xb8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.212878:0:57834:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51fe0000 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191337.212957:0:57834:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839a0c lrc: 4/0,0 mode: --/CR res: [0x200000405:0xb8:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.212965:0:57834:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839a0c lrc: 4/0,0 mode: --/CR res: [0x200000405:0xb8:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.212973:0:57834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839a0c lrc: 5/0,0 mode: --/CR res: [0x200000405:0xb8:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.212982:0:57834:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191337.212989:0:57834:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839a0c lrc: 3/0,0 mode: --/CR res: [0x200000405:0xb8:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.213003:0:57834:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0000/0xe5129dc884839a0c lrc: 0/0,0 mode: --/CR res: [0x200000405:0xb8:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57834 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191337.213035:0:57834:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b453a9f80 x1874004626573952/t8589936598(8589936598) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191353 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191337.213049:0:57834:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9f80 x1874004626573952/t8589936598(8589936598) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191353 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191337.213076:0:57834:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xb8:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1787191337.213124:0:57834:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xb8:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1787191337.213131:0:57834:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb8:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191337.213177:0:57834:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xb8:0x0], updating i_size 0 00000002:00100000:2.0:1787191337.213196:0:57834:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9f80 x1874004626573952/t8589936598(8589936598) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191353 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191337.213238:0:57834:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a9f80 x1874004626573952/t8589936598(8589936598) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191353 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191337.213248:0:57834:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191337.213253:0:57834:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513ba680 x1874004626574336/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191337.213274:0:57834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57834:1874004626574336:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191337.213373:0:57834:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359300 going to sleep for 11 seconds 00000100:00100000:3.0:1787191337.239075:0:57834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57834:1874004626574592:192.168.202.101@tcp:35:lfs.0 00000080:00200000:2.0:1787191337.255075:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191337.255111:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191337.255132:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191337.255168:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191337.255177:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191337.255187:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191337.255191:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191337.255199:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:2.0:1787191337.255204:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191337.255213:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191337.255230:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191337.255238:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191337.255245:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191337.255261:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:2.0:1787191337.255267:0:57570:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b42a0f800, open_flags 8241, mode 81b6 opened 0 00000080:00200000:2.0:1787191337.255276:0:57570:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:2.0:1787191337.255302:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xb9:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0101102 00010000:00010000:2.0:1787191337.255363:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839a13 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.255372:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839a13 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191337.255385:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191337.255399:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb100 x1874004626574848/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191337.255409:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839a13 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191337.255432:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626574848:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191337.255594:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359600 going to sleep for 11 seconds 00000100:00100000:3.0:1787191337.260225:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626574848:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191337.260257:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839a13 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603988 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.260289:0:57570:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839a13 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xb8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603988 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.260297:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839a13 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xb8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603988 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.260309:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839a13 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xb8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603988 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.260319:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839a13 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xb8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603988 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.260332:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839a13 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xb8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603988 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.260340:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839a13 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xb8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603988 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.260348:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839a13 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xb8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603988 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191337.260358:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x2b, status=0 req@ffff936b513bb100 x1874004626574848/t8589936601(8589936601) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191353 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191337.260371:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bb100 x1874004626574848/t8589936601(8589936601) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191353 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191337.260385:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839a13 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xb8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603988 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191337.260399:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839a13 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xb8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603988 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.260408:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/184 (0 0) 00000080:00200000:3.0:1787191337.260414:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191337.260466:0:57570:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xb8:0x0](ffff936b53969988): rc = 0 00000080:00200000:3.0:1787191337.260482:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xb8:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:3.0:1787191337.260487:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xb8:0x0](ffff936b53969988) for lock 0xe5129dc884839a13 00000080:00010000:3.0:1787191337.260499:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xb8:0x0](ffff936b53969988) 00000080:00200008:3.0:1787191337.260515:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xb8:0x0](ffff936b53969988), flags 101101 00000002:00100000:3.0:1787191337.260537:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bb100 x1874004626574848/t8589936601(8589936601) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191353 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1787191337.260573:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839a13 from it ffff936b60dc4d20 00010000:00010000:3.0:1787191337.260578:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839a13 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xb8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4603988 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.260588:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839a13 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xb8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603988 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191337.260611:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xb8:0x0](ffff936b53969988), inode mode 81a4 mask 42 00000002:00010000:3.0:1787191337.260640:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xb8:0x0], intent: getxattr flags 0 00010000:00010000:3.0:1787191337.260680:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839a1a lrc: 3/1,0 mode: --/PR res: [0x200000405:0xb8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.260688:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839a1a lrc: 3/1,0 mode: --/PR res: [0x200000405:0xb8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.260701:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839a1a lrc: 3/1,0 mode: --/PR res: [0x200000405:0xb8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191337.260720:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626574976:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191337.260815:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787191337.276531:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626574976:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191337.276564:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839a1a lrc: 4/1,0 mode: --/PR res: [0x200000405:0xb8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460399d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.276581:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839a1a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xb8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460399d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.276593:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839a1a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xb8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460399d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191337.276609:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b51d1d880 x1874004626574976/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191353 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191337.276621:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839a1a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xb8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460399d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.276634:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/184 (0 0) 00000080:00200000:3.0:1787191337.276641:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xb8:0x0] suppgids 0 -1: rc 0 00000080:00010000:3.0:1787191337.276666:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xb8:0x0](ffff936b53969988) for lock 0xe5129dc884839a1a 00000080:00010000:3.0:1787191337.276675:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839a1a from it ffffa3fb41caba38 00010000:00010000:3.0:1787191337.276679:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839a1a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xb8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460399d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.276693:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839a1a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xb8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460399d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:3.0:1787191337.276735:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xb8:0x0](ffff936b53969988) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191337.000000000, mtime 1787191337.000000000, ctime 1787191337.000000000 00010000:00010000:3.0:1787191337.276770:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839a13 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xb8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4603988 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191337.276790:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xb8:0x0]: losing layout lock 00010000:00010000:3.0:1787191337.276974:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839a13 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xb8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4603988 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191337.276982:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191337.276985:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839a13 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xb8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4603988 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:3.0:1787191337.277005:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1787191337.277012:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1d880 x1874004626575232/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191337.277034:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626575232:192.168.202.101@tcp:36:bash.0 00000100:00100000:3.0:1787191337.277174:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787191337.282222:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626575232:192.168.202.101@tcp:36:bash.0 00000080:00200000:3.0:1787191337.282271:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:3.0:1787191337.282278:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xb8:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00010000:00010000:3.0:1787191337.282296:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/184 (0 0) 00000080:00010000:3.0:1787191337.282309:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xb8:0x0](ffff936b53969988) 00000002:00010000:3.0:1787191337.282319:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xb8:0x0]) in obj [0x200000405:0xb8:0x0], intent: layout flags 0 00010000:00010000:3.0:1787191337.282371:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884839a21 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xb8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.282381:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884839a21 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xb8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.282391:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884839a21 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xb8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191337.282410:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ce00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626575488:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191337.282490:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787191337.284735:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ce00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626575488:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191337.284760:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884839a21 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xb8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46039ab expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.284773:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884839a21 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xb8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46039ab expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191337.284787:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b51d1ce00 x1874004626575488/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191353 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191337.284797:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884839a21 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xb8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46039ab expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191337.284822:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884839a21 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xb8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46039ab expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.288190:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/184 (0 0) 00000080:00200000:3.0:1787191337.288198:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xb8:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1787191337.288220:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xb8:0x0](ffff936b53969988) for lock 0xe5129dc884839a21 00000080:00010000:3.0:1787191337.288228:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839a21 from it ffffa3fb41cab8c8 00010000:00010000:3.0:1787191337.288233:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884839a21 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xb8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46039ab expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.288245:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884839a21 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xb8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46039ab expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191337.288276:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884839a21 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xb8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46039ab expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191337.288287:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884839a21 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xb8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46039ab expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:3.0:1787191337.288295:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xb8:0x0](00000000d7469e7d) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884839a21 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xb8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46039ab expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191337.288346:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xb8:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:3.0:1787191337.288352:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884839a21 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xb8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46039ab expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191337.288360:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884839a21 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xb8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46039ab expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:3.0:1787191337.288375:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xb8:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:3.0:1787191337.288383:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb8:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191337.288387:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xb8:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:3.0:1787191337.288394:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xb8:0x0](ffff936b53969988) 00000002:00010000:3.0:1787191337.288403:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xb8:0x0]) in obj [0x200000405:0xb8:0x0], intent: layout flags 02 00010000:00010000:3.0:1787191337.288419:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884839a21 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xb8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46039ab expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191337.288432:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xb8:0x0]: losing layout lock 00010000:00010000:3.0:1787191337.288467:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884839a21 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xb8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46039ab expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191337.288473:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191337.288477:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884839a21 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xb8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46039ab expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191337.288501:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839a28 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xb8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.288508:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839a28 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xb8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191337.288519:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191337.288532:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1ce00 x1874004626575744/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191337.288542:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839a28 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xb8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191337.288563:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ce00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626575744:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191337.288709:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787191337.304415:0:57570:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589936604 gen 1 00000100:00100000:3.0:1787191337.304504:0:57570:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b513bb100 x1874004626574848/t8589936601(8589936601) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191353 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787191337.304523:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ce00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626575744:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191337.304547:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839a28 lrc: 4/0,1 mode: --/EX res: [0x200000405:0xb8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46039b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.304559:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839a28 lrc: 4/0,1 mode: --/CR res: [0x200000405:0xb8:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46039b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.304572:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839a28 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xb8:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46039b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.304585:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839a28 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xb8:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46039b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.304599:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839a28 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xb8:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46039b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.304609:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839a28 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xb8:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46039b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.304616:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839a28 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xb8:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46039b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191337.304626:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b51d1ce00 x1874004626575744/t8589936604(8589936604) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191353 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191337.304652:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839a28 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xb8:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46039b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191337.304663:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839a28 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xb8:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46039b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.304674:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/184 (0 0) 00000080:00200000:3.0:1787191337.304681:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xb8:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1787191337.304693:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xb8:0x0](ffff936b53969988) for lock 0xe5129dc884839a28 00000080:00010000:3.0:1787191337.304701:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839a28 from it ffffa3fb41cab930 00010000:00010000:3.0:1787191337.304705:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839a28 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xb8:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46039b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.304714:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839a28 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xb8:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46039b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191337.304734:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:3.0:1787191337.304743:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xb8:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:3.0:1787191337.304759:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839a28 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xb8:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46039b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191337.304771:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839a28 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xb8:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46039b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:3.0:1787191337.304780:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xb8:0x0](00000000d7469e7d) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839a28 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xb8:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46039b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191337.304874:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839a28 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xb8:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46039b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191337.304883:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839a28 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xb8:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46039b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191337.304898:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xb8:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1787191337.304909:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xb8:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191337.304912:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191337.304919:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191337.304930:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1787191337.304949:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb8:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:3.0:1787191337.304963:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839a28 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xb8:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46039b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191337.304973:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839a28 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xb8:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46039b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:3.0:1787191337.304981:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xb8:0x0](00000000d7469e7d) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839a28 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xb8:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46039b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191337.305000:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xb8:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1787191337.305004:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xb8:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191337.305007:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191337.305009:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191337.305013:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1787191337.305019:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb8:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191337.305109:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xb8:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:3.0:1787191337.305115:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839a28 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xb8:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46039b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191337.305123:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839a28 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xb8:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46039b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00020000:00200000:3.0:1787191337.305136:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xb8:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:3.0:1787191337.305140:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xb8:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191337.305142:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191337.305147:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191337.305159:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1787191337.305162:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:3.0:1787191337.305175:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:3.0:1787191337.305179:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b5235cdb0, osc lock ffff936b44f64260, flags 0x80000000 00000008:00010000:3.0:1787191337.305183:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:3.0:1787191337.305185:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b5235cdf0, osc lock ffff936b44f658f0, flags 0x80000000 00010000:00010000:3.0:1787191337.305230:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008763ad1f/0xe5129dc884839a2f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.305239:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008763ad1f/0xe5129dc884839a2f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19c:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.305250:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008763ad1f/0xe5129dc884839a2f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19c:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191337.305273:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ce00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626576128:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191337.305367:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c300 going to sleep for 11 seconds 00000100:00100000:3.0:1787191337.308639:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ce00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626576128:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191337.308664:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008763ad1f/0xe5129dc884839a2f lrc: 4/0,1 mode: --/PW res: [0x280000401:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46039c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.308684:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008763ad1f/0xe5129dc884839a2f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e46039c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.308696:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008763ad1f/0xe5129dc884839a2f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e46039c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.308711:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008763ad1f/0xe5129dc884839a2f lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e46039c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191337.308723:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008763ad1f/0xe5129dc884839a2f lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e46039c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.308736:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008763ad1f/0xe5129dc884839a2f lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46039c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.308743:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008763ad1f/0xe5129dc884839a2f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46039c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.308819:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000931bffc4/0xe5129dc884839a3d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.308829:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000931bffc4/0xe5129dc884839a3d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.308883:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000931bffc4/0xe5129dc884839a3d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191337.308903:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ce00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626576384:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191337.308965:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c300 going to sleep for 11 seconds 00000100:00100000:2.0:1787191337.316950:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191337.317146:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634858624 00000100:00100000:3.0:1787191337.317163:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634858624 00000100:00100000:3.0:1787191337.317214:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1237 00000100:00100000:3.0:1787191337.317223:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:25390:x1874004634858624:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191337.317239:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba1c2d9b/0xe5129dc884839979 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46037b3 expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191337.319317:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191337.319336:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:25390:x1874004634858624:12345-192.168.202.101@tcp:104: Request processed in 2107us (2389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191337.319354:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1237 00000080:00200000:2.0:1787191337.339392:0:57835:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191337.339421:0:57835:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191337.339436:0:57835:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191337.339449:0:57835:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191337.339456:0:57835:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191337.339476:0:57835:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191337.339480:0:57835:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191337.339486:0:57835:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41f3bb58 00010000:00010000:2.0:1787191337.339490:0:57835:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191337.339498:0:57835:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191337.339513:0:57835:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191337.339522:0:57835:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191337.339528:0:57835:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191337.339541:0:57835:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:2.0:1787191337.339546:0:57835:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191337.339559:0:57835:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191337.339599:0:57835:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839a52 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.339607:0:57835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839a52 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.339616:0:57835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839a52 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191337.339637:0:57835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57835:1874004626577792:192.168.202.101@tcp:101:rm.0 00000100:00100000:2.0:1787191337.339715:0:57835:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359540 going to sleep for 11 seconds 00000100:00100000:3.0:1787191337.339951:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191337.340041:0:51131:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787191337.340055:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634858752 00000100:00100000:2.0:1787191337.340071:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634858752 00000100:00100000:2.0:1787191337.340119:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1238 00000100:00100000:2.0:1787191337.340131:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b50880850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30511:x1874004634858752:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191337.340145:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bcda4bea/0xe5129dc884839980 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46037c1 expref: -99 pid: 57827 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191337.340203:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191337.340209:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b50880850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30511:x1874004634858752:12345-192.168.202.101@tcp:104: Request processed in 82us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191337.340216:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1238 00000100:00100000:2.0:1787191337.345143:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191337.345734:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634858880 00000100:00100000:3.0:1787191337.345744:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634858880 00000100:00100000:3.0:1787191337.345787:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1239 00000100:00100000:3.0:1787191337.345794:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:6490:x1874004634858880:12345-192.168.202.101@tcp:105: 00010000:00010000:3.0:1787191337.345807:0:40922:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc884839a4b lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e46039f8 expref: -99 pid: 57832 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.345819:0:40922:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc884839a4b lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e46039f8 expref: -99 pid: 57832 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.345869:0:40922:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc884839a4b lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000020000 nid: local remote: 0x7130d520e46039f8 expref: -99 pid: 57832 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.345880:0:40922:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc884839a4b lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10080000020000 nid: local remote: 0x7130d520e46039f8 expref: -99 pid: 57832 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.345887:0:40922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc884839a4b lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10080000020000 nid: local remote: 0x7130d520e46039f8 expref: -99 pid: 57832 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.345894:0:40922:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc884839a4b lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x80000020000 nid: local remote: 0x7130d520e46039f8 expref: -99 pid: 57832 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.345912:0:40922:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b51fe0a00) 00000100:00100000:3.0:1787191337.345957:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:6490:x1874004634858880:12345-192.168.202.101@tcp:105: Request processed in 164us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191337.345961:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1239 00000080:00200000:2.0:1787191337.351050:0:57832:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xb6:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191337.351056:0:57832:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b497c9a88 (ffff936b465ccea8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191337.351059:0:57832:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b497c9a88 (ffff936b465ccea8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191337.351073:0:57832:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62893c30 (ffff936b465cca28/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191337.351084:0:57832:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc884839a44 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46039f1 expref: -99 pid: 57832 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.351102:0:57832:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc884839a44 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46039f1 expref: -99 pid: 57832 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191337.351118:0:57832:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62893c70 (ffff936b43ab8cf8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191337.351124:0:57832:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc884839a4b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e46039f8 expref: -99 pid: 57832 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.351132:0:57832:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc884839a4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e46039f8 expref: -99 pid: 57832 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191337.351141:0:57832:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b497c9a88 (ffff936b465ccea8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191337.351145:0:57832:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62893c30 (ffff936b465ccea8/1) at cl_lock_fini():72 00000020:00010000:2.0:1787191337.351149:0:57832:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62893c70 (ffff936b465ccea8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191337.351210:0:57832:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb6:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191337.351231:0:57832:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xb6:0x0](ffff936b5395ba88) current size 5, valid attrs 10002168, mode 0, uid -1322410190, gid -1, new size 5, atime 1787191337.000000000, mtime 1787191337.000000000, ctime 1787191337.000000000, rc 0 00000080:00200080:2.0:1787191337.351252:0:57832:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xb6:0x0](ffff936b5395ba88) cmd=400866b1 arg=0 00000080:00200008:2.0:1787191337.351279:0:57832:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xb6:0x0](ffff936b5395ba88) current size 5, valid attrs 101f0, mode a3fb, uid 1628899008, gid -27797, new size 18446624687905946248, atime 1787191336.000000000, mtime 1787191337.000000000, ctime 1787191337.000000000 00000020:00100000:2.0:1787191337.351330:0:57832:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 36, max 7 00000100:00100000:2.0:1787191337.351346:0:57832:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513baa00 x1874004626578688/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787191337.351363:0:57832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57832:1874004626578688:192.168.202.101@tcp:36:lfs.0 00000100:00100000:2.0:1787191337.351472:0:57832:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359540 going to sleep for 11 seconds 00000100:00100000:3.0:1787191337.354359:0:57832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57832:1874004626578688:192.168.202.101@tcp:36:lfs.0 00000080:00200000:3.0:1787191337.354415:0:57832:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xb6:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:3.0:1787191337.354429:0:57832:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xb6:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191337.354433:0:57832:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191337.354442:0:57832:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191337.354456:0:57832:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1787191337.354459:0:57832:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:3.0:1787191337.354473:0:57832:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:3.0:1787191337.354479:0:57832:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b506679b0, osc lock ffff936b44f64130, flags 0x0 00010000:00010000:3.0:1787191337.354495:0:57832:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b52373000 type 11 mode 2 res 11811161089/413 (0 1048575) 00010000:00010000:3.0:1787191337.354538:0:57832:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc884839a59 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57832 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.354551:0:57832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc884839a59 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57832 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.354560:0:57832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc884839a59 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57832 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191337.354575:0:57832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57832:1874004626578816:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191337.354635:0:57832:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1787191337.356232:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191337.356295:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634859008 00000100:00100000:3.0:1787191337.356302:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634859008 00000100:00100000:3.0:1787191337.356436:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1240 00000100:00100000:3.0:1787191337.356448:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30353:x1874004634859008:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191337.356463:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc884839a05 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x19d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000000000 nid: local remote: 0x7130d520e4603965 expref: -99 pid: 57832 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:3.0:1787191337.356522:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191337.356528:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30353:x1874004634859008:12345-192.168.202.101@tcp:104: Request processed in 84us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191337.356535:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1240 00000100:00100000:3.0:1787191337.360073:0:57832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57832:1874004626578816:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191337.360108:0:57832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc884839a59 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000020000 nid: local remote: 0x7130d520e4603a3e expref: -99 pid: 57832 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.360129:0:57832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc884839a59 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e4603a3e expref: -99 pid: 57832 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.360138:0:57832:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc884839a59 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e4603a3e expref: -99 pid: 57832 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191337.362964:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191337.363026:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634859136 00000100:00100000:3.0:1787191337.363036:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634859136 00000100:00100000:3.0:1787191337.363096:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1241 00000100:00100000:3.0:1787191337.363106:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30131:x1874004634859136:12345-192.168.202.101@tcp:105: 00010000:00010000:3.0:1787191337.363120:0:40921:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc884839a59 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e4603a3e expref: -99 pid: 57832 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.363134:0:40921:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc884839a59 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e4603a3e expref: -99 pid: 57832 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.363144:0:40921:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc884839a59 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000020000 nid: local remote: 0x7130d520e4603a3e expref: -99 pid: 57832 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.363167:0:40921:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc884839a59 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080000020000 nid: local remote: 0x7130d520e4603a3e expref: -99 pid: 57832 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.363177:0:40921:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc884839a59 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080000020000 nid: local remote: 0x7130d520e4603a3e expref: -99 pid: 57832 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.363192:0:40921:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc884839a59 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000020000 nid: local remote: 0x7130d520e4603a3e expref: -99 pid: 57832 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.363263:0:40921:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b44e9b600) 00000100:00100000:3.0:1787191337.363320:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30131:x1874004634859136:12345-192.168.202.101@tcp:105: Request processed in 215us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191337.363328:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1241 00000020:00010000:3.0:1787191337.372008:0:57832:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b50421b78 (ffff936b43ab8128/0) at cl_lock_release():245 00000020:00010000:3.0:1787191337.372013:0:57832:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50421b78 (ffff936b43ab8128/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191337.372018:0:57832:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b506679b0 (ffff936b465cc758/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191337.372029:0:57832:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc884839a59 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4603a3e expref: -99 pid: 57832 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.372043:0:57832:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc884839a59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4603a3e expref: -99 pid: 57832 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1787191337.372058:0:57832:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50421b78 (ffff936b43ab8128/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191337.372073:0:57832:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b506679b0 (ffff936b43ab8128/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191337.372090:0:57832:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb6:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191337.372104:0:57832:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xb6:0x0](ffff936b5395ba88) current size 5, valid attrs 100101f0, mode a3fb, uid 1628899008, gid -27797, new size 18446624687905946248, atime 1787191336.000000000, mtime 1787191337.000000000, ctime 1787191337.000000000, rc 0 00000080:00200080:3.0:1787191337.372127:0:57832:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xb6:0x0](ffff936b5395ba88) cmd=c00c66f3 arg=12612e0 00010000:00010000:3.0:1787191337.372183:0:57832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafc00/0xe5129dc8848399cd lrc: 2/0,0 mode: PW/PW res: [0x200000405:0xb6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81008000000000 nid: local remote: 0x7130d520e46038b6 expref: -99 pid: 57832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.372206:0:57832:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafc00/0xe5129dc8848399cd lrc: 0/0,0 mode: --/PW res: [0x200000405:0xb6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x85809400000000 nid: local remote: 0x7130d520e46038b6 expref: -99 pid: 57832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191337.372224:0:57832:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a476a00 x1874004626571904/t8589936595(8589936595) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191353 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191337.372236:0:57832:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191337.372241:0:57832:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1c380 x1874004626579456/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191337.372262:0:57832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57832:1874004626579456:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191337.372388:0:57832:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191337.375997:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191337.376025:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634859264 00000100:00100000:3.0:1787191337.377157:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634859264 00000100:00100000:3.0:1787191337.377213:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1242 00000100:00100000:3.0:1787191337.377223:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6508:x1874004634859264:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191337.377237:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc8848399f0 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xb6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e460391f expref: -99 pid: 57832 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191337.377292:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191337.377296:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6508:x1874004634859264:12345-192.168.202.101@tcp:104: Request processed in 77us (1302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191337.377301:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1242 00000100:00100000:3.0:1787191337.388904:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191337.388977:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634859904 00000100:00100000:2.0:1787191337.388987:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634859904 00000100:00100000:2.0:1787191337.389048:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1243 00000100:00100000:2.0:1787191337.389072:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8420:x1874004634859904:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191337.389091:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008763ad1f/0xe5129dc884839a2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e46039c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191337.389172:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191337.389179:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8420:x1874004634859904:12345-192.168.202.101@tcp:104: Request processed in 123us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191337.389186:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1243 00000100:00100000:2.0:1787191337.389319:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191337.389344:0:40921:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787191337.389352:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634860544 00000100:00100000:2.0:1787191337.389356:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634860544 00000100:00100000:2.0:1787191337.389377:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1244 00000100:00100000:2.0:1787191337.389383:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b50883050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:29543:x1874004634860544:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191337.389391:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000931bffc4/0xe5129dc884839a3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e46039dc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191337.389439:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191337.389446:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b50883050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:29543:x1874004634860544:12345-192.168.202.101@tcp:104: Request processed in 63us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191337.389452:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1244 00000100:00100000:3.0:1787191337.421801:0:57832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57832:1874004626580864:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191337.421855:0:57832:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a476680 x1874004626571136/t8589936593(8589936593) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191353 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191337.421908:0:57832:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xb6:0x0] ignore/verify layout 1/0, layout version 5 restore needed 0 00020000:00200000:3.0:1787191337.421917:0:57832:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xb6:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191337.421919:0:57832:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191337.421925:0:57832:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:3.0:1787191337.421954:0:57832:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xb6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191337.421959:0:57832:0:(llite_lib.c:2066:ll_clear_inode()) VFS Op:inode=[0x200000405:0xb6:0x0](ffff936b5395ba88) 00000080:00200000:3.0:1787191337.422056:0:57832:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191337.422084:0:57832:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191337.422098:0:57832:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191337.422111:0:57832:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191337.422119:0:57832:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191337.422125:0:57832:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191337.422129:0:57832:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191337.422137:0:57832:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42133bf8 00010000:00010000:3.0:1787191337.422141:0:57832:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191337.422149:0:57832:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191337.422164:0:57832:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191337.422170:0:57832:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191337.422176:0:57832:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191337.422180:0:57832:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:3.0:1787191337.422184:0:57832:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xba:0x0](ffff936b53969988), inode mode 81a4 mask 44 00000080:00200008:3.0:1787191337.422191:0:57832:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xba:0x0](ffff936b53969988), flags 154400 00000002:00010000:3.0:1787191337.422206:0:57832:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xba:0x0]) in obj [0x200000405:0xba:0x0], intent: open flags 0100240114401 00010000:00010000:3.0:1787191337.422250:0:57832:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884839a91 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xba:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.422258:0:57832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884839a91 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xba:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57832 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191337.422268:0:57832:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:3.0:1787191337.422274:0:57832:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1c380 x1874004626581376/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191337.422283:0:57832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884839a91 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xba:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191337.422299:0:57832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57832:1874004626581376:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191337.422467:0:57832:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787191337.427771:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626581632:192.168.202.101@tcp:400:kworker.0 00000100:00100000:3.0:1787191337.427882:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787191337.427890:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:95df428c-87a4-4fae-83fd-e31aed0d69bf:2391:1874004626581504:192.168.202.101@tcp:400:kworker.0 00000100:00100000:3.0:1787191337.428330:0:57832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57832:1874004626581376:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191337.428561:0:57832:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884839a91 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xba:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603aed expref: -99 pid: 57832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.428579:0:57832:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884839a91 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603aed expref: -99 pid: 57832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.428602:0:57832:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884839a91 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603aed expref: -99 pid: 57832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.428615:0:57832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884839a91 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603aed expref: -99 pid: 57832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.428644:0:57832:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884839a91 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603aed expref: -99 pid: 57832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.428653:0:57832:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884839a91 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603aed expref: -99 pid: 57832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.428660:0:57832:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884839a91 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603aed expref: -99 pid: 57832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191337.428672:0:57832:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b51d1c380 x1874004626581376/t8589936612(8589936612) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191353 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191337.428685:0:57832:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1c380 x1874004626581376/t8589936612(8589936612) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191353 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191337.428697:0:57832:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884839a91 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603aed expref: -99 pid: 57832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.428710:0:57832:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc884839a83 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603ad1 expref: -99 pid: 57836 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191337.428721:0:57832:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc884839a83 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603ad1 expref: -99 pid: 57836 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191337.428729:0:57832:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884839a91 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603aed expref: -99 pid: 57832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.428736:0:57832:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884839a91 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x7130d520e4603aed expref: -99 pid: 57832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.428743:0:57832:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884839a91 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x7130d520e4603aed expref: -99 pid: 57832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.428760:0:57832:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000080:00200000:3.0:1787191337.428766:0:57832:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xba:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1787191337.428783:0:57832:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xba:0x0], updating i_size 0 00010000:00010000:2.0:1787191337.428809:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000080:00200000:3.0:1787191337.428811:0:57832:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xba:0x0]: layout version change: 4294967295 -> 4294967295 00010000:00010000:2.0:1787191337.428817:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884839a91 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x7130d520e4603aed expref: -99 pid: 57832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00010000:3.0:1787191337.428818:0:57832:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xba:0x0](ffff936b53969988) for lock 0xe5129dc884839a83 00000080:00010000:3.0:1787191337.428824:0:57832:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839a83 from it ffffa3fb42133bf0 00010000:00010000:2.0:1787191337.428825:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9ae00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191337.428827:0:57832:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc884839a83 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4603ad1 expref: -99 pid: 57836 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191337.428853:0:57832:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc884839a83 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603ad1 expref: -99 pid: 57836 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191337.428854:0:40930:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884839a91 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x7130d520e4603aed expref: -99 pid: 57832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.428864:0:40930:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884839a91 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x7130d520e4603aed expref: -99 pid: 57832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.428871:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884839a91 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4603aed expref: -99 pid: 57832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191337.428883:0:57832:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1c380 x1874004626581376/t8589936612(8589936612) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191353 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1787191337.428887:0:40930:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc884839a83 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603ad1 expref: -99 pid: 57836 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191337.428915:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884839a91 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4603aed expref: -99 pid: 57832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.428921:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191337.428936:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884839a91 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4603aed expref: -99 pid: 57832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.428942:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884839a91 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4603aed expref: -99 pid: 57832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.428959:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191337.428961:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191337.428962:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191337.428972:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787191337.428984:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626581760:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00200000:3.0:1787191337.428994:0:57832:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xba:0x0](ffff936b53969988), inode mode 81a4 mask 4 00000080:00200000:3.0:1787191337.429001:0:57832:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xba:0x0](ffff936b53969988), xattr lov 00000080:00200008:3.0:1787191337.429035:0:57832:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xba:0x0](ffff936b53969988), flags 154000 00000002:00100000:3.0:1787191337.429081:0:57832:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1c380 x1874004626581376/t8589936612(8589936612) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191353 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191337.429091:0:57832:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:3.0:1787191337.429096:0:57832:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1d880 x1874004626582016/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191337.429117:0:57832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57832:1874004626582016:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191337.429156:0:57832:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787191337.431754:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:95df428c-87a4-4fae-83fd-e31aed0d69bf:2391:1874004626581504:192.168.202.101@tcp:400:kworker.0 00000100:00100000:3.0:1787191337.439366:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626581760:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191337.439389:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626581632:192.168.202.101@tcp:400:kworker.0 00000100:00100000:3.0:1787191337.442799:0:57832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57832:1874004626582016:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191337.444125:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191337.444241:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634860672 00000100:00100000:2.0:1787191337.444253:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634860672 00000100:00100000:2.0:1787191337.444316:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1245 00000100:00100000:2.0:1787191337.444327:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634860672:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191337.444345:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc884839a83 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4603ad1 expref: -99 pid: 57836 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191337.444554:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191337.444561:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634860672:12345-192.168.202.101@tcp:104: Request processed in 236us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191337.444570:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1245 00010000:00010000:3.0:1787191337.497860:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191337.497868:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc884839aad lrc: 1/0,0 mode: --/CR res: [0x200000405:0xba:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4603b5d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.497877:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cae200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191337.497882:0:57627:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc884839aad lrc: 1/0,0 mode: --/CR res: [0x200000405:0xba:0x0].0x0 bits 0x8/0x8 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4603b5d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.497890:0:57627:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc884839aad lrc: 1/0,0 mode: --/CR res: [0x200000405:0xba:0x0].0x0 bits 0x8/0x8 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4603b5d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.497899:0:57627:0:(ldlm_request.c:1774:ldlm_cli_cancel()) ### lock is already being destroyed 00010000:00010000:3.0:1787191337.497901:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc884839aad lrc: 1/0,0 mode: --/CR res: [0x200000405:0xba:0x0].0x0 bits 0x8/0x8 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4603b5d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.497907:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc884839aad lrc: 0/0,0 mode: --/CR res: [0x200000405:0xba:0x0].0x0 bits 0x8/0x8 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4603b5d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.497919:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191337.497921:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191337.497922:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191337.503119:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191337.503252:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634860800 00000100:00100000:3.0:1787191337.503258:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634860800 00000100:00100000:3.0:1787191337.503313:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1246 00000100:00100000:3.0:1787191337.503322:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634860800:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191337.503334:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc884839ab4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4603b6b expref: -99 pid: 57837 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191337.503400:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191337.503407:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634860800:12345-192.168.202.101@tcp:104: Request processed in 87us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191337.503415:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1246 00010000:00010000:3.0:1787191337.503436:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191337.503442:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc884839ab4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4603b6b expref: -99 pid: 57837 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191337.503451:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b6a608200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191337.503456:0:43384:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc884839ab4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4603b6b expref: -99 pid: 57837 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191337.503465:0:43384:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc884839ab4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4603b6b expref: -99 pid: 57837 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191337.503473:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc884839ab4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4603b6b expref: -99 pid: 57837 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191337.503727:0:43384:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xba:0x0]: losing layout lock 00010000:00010000:3.0:1787191337.503766:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc884839ab4 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4603b6b expref: -99 pid: 57837 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191337.503773:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191337.503801:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc884839ab4 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4603b6b expref: -99 pid: 57837 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191337.503818:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc884839ab4 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4603b6b expref: -99 pid: 57837 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191337.503861:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191337.503863:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191337.503865:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191337.503872:0:2392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787191337.503884:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626584320:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191337.512055:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626584320:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191337.519395:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191337.519435:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191337.519454:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191337.519482:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634861952 00000100:00100000:2.0:1787191337.519501:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634861952 00000100:00100000:2.0:1787191337.519542:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634862080 00000100:00100000:2.0:1787191337.519545:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634862080 00000100:00100000:2.0:1787191337.519555:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634862208 00000100:00100000:2.0:1787191337.519558:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634862208 00000100:00100000:2.0:1787191337.519571:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1247 00000100:00100000:2.0:1787191337.519579:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+5:30511:x1874004634861952:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191337.519598:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc884839a59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000030000 nid: local remote: 0x7130d520e4603a3e expref: -99 pid: 57832 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191337.519680:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191337.519687:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+5:30511:x1874004634861952:12345-192.168.202.101@tcp:104: Request processed in 109us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191337.519695:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1247 00000100:00100000:2.0:1787191337.519716:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1248 00000100:00100000:2.0:1787191337.519723:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30353:x1874004634862080:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191337.519731:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc884839a4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000030000 nid: local remote: 0x7130d520e46039f8 expref: -99 pid: 57832 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191337.519771:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787191337.519776:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30353:x1874004634862080:12345-192.168.202.101@tcp:104: Request processed in 55us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191337.519784:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1248 00000100:00100000:2.0:1787191337.519795:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1249 00000100:00100000:2.0:1787191337.519814:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8420:x1874004634862208:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191337.519822:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc884839a44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e46039f1 expref: -99 pid: 57832 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191337.519870:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787191337.519875:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8420:x1874004634862208:12345-192.168.202.101@tcp:104: Request processed in 75us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191337.519881:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1249 00000100:00100000:2.0:1787191337.519909:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191337.519925:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634862336 00000100:00100000:2.0:1787191337.519928:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634862336 00000100:00100000:2.0:1787191337.519943:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1250 00000100:00100000:2.0:1787191337.519948:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:29543:x1874004634862336:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191337.519956:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c283bfdf/0xe5129dc8848399b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4603854 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191337.519979:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787191337.519984:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:29543:x1874004634862336:12345-192.168.202.101@tcp:104: Request processed in 36us (74us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191337.519990:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1250 00000100:00100000:2.0:1787191337.520052:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191337.520088:0:40921:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787191337.520098:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634862464 00000100:00100000:2.0:1787191337.520101:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634862464 00000100:00100000:2.0:1787191337.520116:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1251 00000100:00100000:2.0:1787191337.520122:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b50880850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634862464:12345-192.168.202.101@tcp:105: 00010000:00010000:2.0:1787191337.520130:0:40921:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839ac9 lrc: 5/1,0 mode: --/CR res: [0x200000405:0xba:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603b87 expref: -99 pid: 57837 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.520138:0:40921:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839ac9 lrc: 5/1,0 mode: --/CR res: [0x200000405:0xba:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603b87 expref: -99 pid: 57837 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.520159:0:40921:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839ac9 lrc: 5/1,0 mode: --/CR res: [0x200000405:0xba:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603b87 expref: -99 pid: 57837 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.520169:0:40921:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839ac9 lrc: 5/1,0 mode: CR/CR res: [0x200000405:0xba:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10080000000000 nid: local remote: 0x7130d520e4603b87 expref: -99 pid: 57837 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.520178:0:40921:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839ac9 lrc: 6/1,0 mode: CR/CR res: [0x200000405:0xba:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10080000000000 nid: local remote: 0x7130d520e4603b87 expref: -99 pid: 57837 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.520187:0:40921:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839ac9 lrc: 6/1,0 mode: CR/CR res: [0x200000405:0xba:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x80000000000 nid: local remote: 0x7130d520e4603b87 expref: -99 pid: 57837 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.520202:0:40921:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b587bd400) 00000100:00100000:2.0:1787191337.520221:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b50880850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634862464:12345-192.168.202.101@tcp:105: Request processed in 99us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191337.520227:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1251 00010000:00010000:3.0:1787191337.520864:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191337.520874:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191337.535581:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191337.537625:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634862592 00000100:00100000:3.0:1787191337.537651:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634862592 00000100:00100000:3.0:1787191337.537725:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1252 00000100:00100000:3.0:1787191337.537735:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8422:x1874004634862592:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191337.537754:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003b2ea1d7/0xe5129dc884839ac2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000010000 nid: local remote: 0x7130d520e4603b80 expref: -99 pid: 57837 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191337.538753:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191337.538762:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8422:x1874004634862592:12345-192.168.202.101@tcp:104: Request processed in 1028us (3185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191337.538768:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1252 00000100:00100000:2.0:1787191337.539494:0:57837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57837:1874004626585728:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191337.539519:0:57837:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839ad7 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603bc6 expref: -99 pid: 57837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.539541:0:57837:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839ad7 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603bc6 expref: -99 pid: 57837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.539550:0:57837:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839ad7 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603bc6 expref: -99 pid: 57837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.539562:0:57837:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839ad7 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603bc6 expref: -99 pid: 57837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.539573:0:57837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839ad7 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603bc6 expref: -99 pid: 57837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.539586:0:57837:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839ad7 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603bc6 expref: -99 pid: 57837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.539595:0:57837:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839ad7 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603bc6 expref: -99 pid: 57837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.539602:0:57837:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839ad7 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603bc6 expref: -99 pid: 57837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191337.539613:0:57837:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b453a8380 x1874004626585728/t8589936623(8589936623) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191353 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191337.539627:0:57837:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8380 x1874004626585728/t8589936623(8589936623) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191353 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191337.539649:0:57837:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603bc6 expref: -99 pid: 57837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191337.539663:0:57837:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603bc6 expref: -99 pid: 57837 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.539673:0:57837:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/186 (0 0) 00000080:00200000:2.0:1787191337.539679:0:57837:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191337.539733:0:57837:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xba:0x0](ffff936b53969988): rc = 0 00000080:00200000:2.0:1787191337.539749:0:57837:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xba:0x0]: layout version change: 4 -> 4 00000080:00010000:2.0:1787191337.539755:0:57837:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xba:0x0](ffff936b53969988) for lock 0xe5129dc884839ad7 00000080:00010000:2.0:1787191337.539770:0:57837:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xba:0x0](ffff936b53969988) 00000080:00200008:2.0:1787191337.539785:0:57837:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xba:0x0](ffff936b53969988), flags 154400 00000002:00100000:2.0:1787191337.539822:0:57837:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8380 x1874004626585728/t8589936623(8589936623) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191353 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1787191337.539908:0:57837:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839ad7 from it ffff936b5339f480 00010000:00010000:2.0:1787191337.539913:0:57837:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4603bc6 expref: -99 pid: 57837 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.539923:0:57837:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839ad7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603bc6 expref: -99 pid: 57837 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191337.539946:0:57837:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xba:0x0](ffff936b53969988), inode mode 81a4 mask 44 00000080:00200000:2.0:1787191337.540012:0:57837:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xba:0x0](ffff936b53969988), inode mode 81a4 mask 4 00000080:00200000:2.0:1787191337.540020:0:57837:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xba:0x0](ffff936b53969988), xattr lov 00000080:00200008:2.0:1787191337.540043:0:57837:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xba:0x0](ffff936b53969988), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191337.540050:0:57837:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xba:0x0](ffff936b53969988),name=f70.sanity-flr 00000002:00010000:2.0:1787191337.540081:0:57837:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xba:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191337.540091:0:57837:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839ad7 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603bc6 expref: -99 pid: 57837 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191337.540102:0:57837:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839ad7 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603bc6 expref: -99 pid: 57837 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191337.540109:0:57837:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191337.540114:0:57837:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xba:0x0](ffff936b53969988) 00000080:00010000:2.0:1787191337.540118:0:57837:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xba:0x0](ffff936b53969988) for lock 0xe5129dc884839ad7 00000080:00010000:2.0:1787191337.540123:0:57837:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839ad7 from it ffffa3fb4214bcd8 00010000:00010000:2.0:1787191337.540126:0:57837:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4603bc6 expref: -99 pid: 57837 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191337.540133:0:57837:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839ad7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xba:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603bc6 expref: -99 pid: 57837 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191337.540432:0:57837:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xba:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:2.0:1787191337.540444:0:57837:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xba:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191337.540447:0:57837:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191337.540451:0:57837:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xba:0x0] 00000008:00010000:2.0:1787191337.540470:0:57837:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191337.540474:0:57837:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1430, osc lock ffff936b44e638f0, flags 0x400000400001002 00010000:00010000:2.0:1787191337.540532:0:57837:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003b2ea1d7/0xe5129dc884839ac2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000010000 nid: local remote: 0x7130d520e4603b80 expref: -99 pid: 57837 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191337.540544:0:57837:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003b2ea1d7/0xe5129dc884839ac2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x1a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000010000 nid: local remote: 0x7130d520e4603b80 expref: -99 pid: 57837 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:2.0:1787191337.540555:0:57837:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191337.540559:0:57837:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003b2ea1d7/0xe5129dc884839ac2 lrc: 6/1,0 mode: PR/PR res: [0x2c0000401:0x1a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810420000010000 nid: local remote: 0x7130d520e4603b80 expref: -99 pid: 57837 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191337.540566:0:57837:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003b2ea1d7/0xe5129dc884839ac2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x1a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810420000010000 nid: local remote: 0x7130d520e4603b80 expref: -99 pid: 57837 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:2.0:1787191337.540571:0:57837:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191337.540580:0:57837:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xba:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191337.540584:0:57837:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b516579d0 (ffff936b465cc7e8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191337.540587:0:57837:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b516579d0 (ffff936b465cc7e8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191337.540589:0:57837:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1430 (ffff936b465cc248/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191337.540593:0:57837:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b516579d0 (ffff936b465cc7e8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191337.540595:0:57837:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1430 (ffff936b465cc7e8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191337.540605:0:57837:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xba:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191337.540687:0:57837:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xba:0x0](ffff936b53969988), flags 154000 00000002:00100000:2.0:1787191337.540734:0:57837:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a8380 x1874004626585728/t8589936623(8589936623) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191353 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191337.540745:0:57837:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191337.540750:0:57837:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8380 x1874004626585984/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191337.540772:0:57837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57837:1874004626585984:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191337.542973:0:57837:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787191337.546400:0:57837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57837:1874004626585984:192.168.202.101@tcp:35:lfs.0 00000002:00100000:2.0:1787191337.546446:0:57837:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a8380 x1874004626585728/t8589936623(8589936623) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191353 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191337.546575:0:57837:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191337.546594:0:57837:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191337.546609:0:57837:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191337.546632:0:57837:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191337.546641:0:57837:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191337.546647:0:57837:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191337.546650:0:57837:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191337.546656:0:57837:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4214bbf8 00010000:00010000:2.0:1787191337.546660:0:57837:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191337.546667:0:57837:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191337.546681:0:57837:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191337.546687:0:57837:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191337.546692:0:57837:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191337.546696:0:57837:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:2.0:1787191337.546700:0:57837:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xba:0x0](ffff936b53969988), inode mode 81a4 mask 46 00000080:00200008:2.0:1787191337.546707:0:57837:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xba:0x0](ffff936b53969988), flags 154402 00000080:00200080:2.0:1787191337.546767:0:57837:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xba:0x0](ffff936b53969988) cmd=800466af arg=7fff45d2aa6c 00000100:00100000:3.0:1787191337.547161:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191337.547192:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634862720 00000100:00100000:3.0:1787191337.547199:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634862720 00000100:00100000:3.0:1787191337.547247:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1253 00000100:00100000:3.0:1787191337.547256:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:6489:x1874004634862720:12345-192.168.202.101@tcp:105: 00010000:00010000:3.0:1787191337.547269:0:51131:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839ad0 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4603baa expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.547285:0:51131:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839ad0 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4603baa expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.547294:0:51131:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839ad0 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e4603baa expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.547304:0:51131:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839ad0 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080080020000 nid: local remote: 0x7130d520e4603baa expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.547319:0:51131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839ad0 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080080020000 nid: local remote: 0x7130d520e4603baa expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.547331:0:51131:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839ad0 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80080020000 nid: local remote: 0x7130d520e4603baa expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200080:2.0:1787191337.547339:0:57837:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xba:0x0](ffff936b53969988) cmd=80086601 arg=7fff45d2aa08 00010000:00010000:3.0:1787191337.547357:0:51131:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b44cae400) 00000100:00100000:2.0:1787191337.547375:0:57837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57837:1874004626586240:192.168.202.101@tcp:33:lfs.0 00000100:00100000:3.0:1787191337.547686:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:6489:x1874004634862720:12345-192.168.202.101@tcp:105: Request processed in 430us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191337.547694:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1253 00000100:00100000:2.0:1787191337.547949:0:57837:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787191337.552098:0:57837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57837:1874004626586240:192.168.202.101@tcp:33:lfs.0 00000080:00200080:3.0:1787191337.552143:0:57837:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xba:0x0](ffff936b53969988) cmd=c00c66f3 arg=7fff45d2a9f4 00000080:00200008:3.0:1787191337.552276:0:57837:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xba:0x0](ffff936b53969988), flags 154002 00000080:00200000:2.0:1787191337.560090:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xba:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191337.560099:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b497c9d58 (ffff936b465cc5a8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191337.560103:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b497c9d58 (ffff936b465cc5a8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191337.560108:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99870 (ffff936b465ccab8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191337.560118:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839ad0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4603baa expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.560133:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839ad0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4603baa expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191337.560214:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f998b0 (ffff936b465cc098/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191337.560220:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc884839ade lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4603bd4 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.560229:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc884839ade lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4603bd4 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191337.560240:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b497c9d58 (ffff936b465cc5a8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191337.560243:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99870 (ffff936b465cc5a8/1) at cl_lock_fini():72 00000020:00010000:2.0:1787191337.560247:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f998b0 (ffff936b465cc5a8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191337.560295:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xba:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191337.560316:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xba:0x0](ffff936b53969988) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191337.000000000, mtime 1787191337.000000000, ctime 1787191337.000000000, rc 0 00000080:00200008:2.0:1787191337.560385:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xba:0x0], ppos: 0, count: 5 00000080:00200000:2.0:1787191337.560396:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191337.560400:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:2.0:1787191337.560404:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:2.0:1787191337.560408:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1787191337.560414:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@00000000e826995f[0x110, 1, [0x200000405:0xba:0x0] hash] 00000020:00200000:2.0:1787191337.560416:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:2.0:1787191337.560420:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xba:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:2.0:1787191337.560432:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xba:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:2.0:1787191337.560437:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xba:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191337.560440:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1787191337.560444:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1787191337.560450:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:2.0:1787191337.560454:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1787191337.560469:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:2.0:1787191337.560481:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1787191337.560486:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1430, osc lock ffff936b44e638f0, flags 0x0 00010000:00010000:2.0:1787191337.560503:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839ad0 lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x1a1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4603baa expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191337.560516:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839ad0 lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4603baa expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191337.560529:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839ad0 lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4603baa expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191337.560537:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839ad0 lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4603baa expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191337.560544:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839ad0 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4603baa expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191337.560555:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:2.0:1787191337.560564:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191337.560598:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:2.0:1787191337.560606:0:57570:0:(rw26.c:927:ll_write_end()) page@00000000a33bb335[3 00000000c8385708 2 1 0000000053a99842 0 0 0] 00000080:00200000:2.0:1787191337.560610:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @00000000db91f1e8 17ffffc0001001 3:0 ffff936b43a1e9a0 0 lru 00000080:00200000:2.0:1787191337.560616:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@00000000aa395305 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000ef00a996 000000006a0566da > 3< 0 0 > 4< 0 0 8 436502528 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1787191337.560618:0:57570:0:(rw26.c:927:ll_write_end()) end page@00000000a33bb335 00000080:00200000:2.0:1787191337.560620:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:2.0:1787191337.560624:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:2.0:1787191337.560654:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 00000000f287428f ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839ad0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4603baa expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191337.560678:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b53969b38, count 1, dirtied 1 00000080:00200000:2.0:1787191337.560683:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:2.0:1787191337.560685:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:2.0:1787191337.560698:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b42ff64e8 (ffff936b465cc7e8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191337.560701:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42ff64e8 (ffff936b465cc7e8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191337.560703:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1430 (ffff936b465cc248/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191337.560707:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839ad0 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4603baa expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191337.560716:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839ad0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4603baa expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:2.0:1787191337.560725:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42ff64e8 (ffff936b465cc7e8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191337.560727:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1430 (ffff936b465cc7e8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191337.560734:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:2.0:1787191337.560737:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1787191337.560743:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xba:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191337.560746:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:2.0:1787191337.560751:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xba:0x0] updating i_size 5 i_blocks 0 00000080:00200000:2.0:1787191337.560755:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:2.0:1787191337.560771:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xba:0x0](ffff936b53969988), flags 100001 00000002:00100000:2.0:1787191337.561008:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453ab800 x1874004626582912/t8589936617(8589936617) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191353 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191337.561020:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191337.561026:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8a80 x1874004626586880/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191337.561053:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8a80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626586880:192.168.202.101@tcp:35:bash.0 00000100:00100000:2.0:1787191337.561250:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787191337.576089:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191337.576200:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634862848 00000100:00100000:2.0:1787191337.576210:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634862848 00000100:00100000:2.0:1787191337.576258:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1254 00000100:00100000:2.0:1787191337.576267:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634862848:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191337.576284:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839ae5 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xba:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e4603be2 expref: -99 pid: 57838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.576361:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191337.576368:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634862848:12345-192.168.202.101@tcp:104: Request processed in 102us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191337.576376:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1254 00010000:00010000:3.0:1787191337.579236:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191337.579243:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839ae5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xba:0x0].0x0 bits 0xd/0x3 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4603be2 expref: -99 pid: 57838 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.579252:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cae800 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191337.579257:0:43384:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839ae5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xba:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4603be2 expref: -99 pid: 57838 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.579264:0:43384:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839ae5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xba:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4603be2 expref: -99 pid: 57838 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.579275:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839ae5 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xba:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4603be2 expref: -99 pid: 57838 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1787191337.579290:0:43384:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xba:0x0]: losing layout lock 00010000:00010000:3.0:1787191337.579332:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839ae5 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xba:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4603be2 expref: -99 pid: 57838 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.579338:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787191337.579401:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626587520:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787191337.579503:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839ae5 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xba:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4603be2 expref: -99 pid: 57838 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.579512:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839ae5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xba:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4603be2 expref: -99 pid: 57838 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.579530:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191337.579532:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191337.579534:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191337.582931:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626587520:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191337.638566:0:57841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57841:1874004626588672:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191337.638587:0:57841:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839b0f lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.638599:0:57841:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839b0f lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.638605:0:57841:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839b0f lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.638616:0:57841:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839b0f lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.638625:0:57841:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839b0f lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.638631:0:57841:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cae800 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191337.638636:0:57841:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839b0f lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.638643:0:57841:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839b0f lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.638650:0:57841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839b0f lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.638657:0:57841:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191337.638664:0:57841:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839b0f lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.638671:0:57841:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839b0f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57841 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191337.638689:0:57841:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x7, status=0 req@ffff936b6a474380 x1874004626588672/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/608 e 0 to 0 dl 1787191353 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191337.638704:0:57841:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1787191337.638727:0:57841:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839b08 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603c60 expref: -99 pid: 57840 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191337.638739:0:57841:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839b08 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603c60 expref: -99 pid: 57840 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:3.0:1787191337.638746:0:57841:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839b08 from it ffffa3fb4215b9a0 00010000:00010000:3.0:1787191337.638750:0:57841:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839b08 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603c60 expref: -99 pid: 57840 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191337.638758:0:57841:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839b08 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603c60 expref: -99 pid: 57840 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787191337.639008:0:57841:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191337.639024:0:57841:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191337.639031:0:57841:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191337.639039:0:57841:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191337.639045:0:57841:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191337.639049:0:57841:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191337.639052:0:57841:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191337.639070:0:57841:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4215bb58 00010000:00010000:3.0:1787191337.639074:0:57841:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191337.639082:0:57841:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191337.639091:0:57841:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191337.639098:0:57841:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191337.639103:0:57841:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191337.639106:0:57841:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=9 00000100:00100000:3.0:1787191337.651913:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191337.651953:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634862976 00000100:00100000:3.0:1787191337.651963:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634862976 00000100:00100000:3.0:1787191337.652019:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1255 00000100:00100000:3.0:1787191337.652030:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634862976:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191337.652048:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839b16 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4603c91 expref: -99 pid: 57840 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191337.652135:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191337.652141:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634862976:12345-192.168.202.101@tcp:104: Request processed in 115us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191337.652155:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1255 00000080:00200000:2.0:1787191337.666492:0:57842:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191337.666530:0:57842:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191337.666547:0:57842:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191337.666563:0:57842:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191337.666570:0:57842:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191337.666578:0:57842:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191337.666582:0:57842:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191337.666589:0:57842:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42163bf8 00010000:00010000:2.0:1787191337.666593:0:57842:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191337.666603:0:57842:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191337.666617:0:57842:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191337.666624:0:57842:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191337.666630:0:57842:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191337.666641:0:57842:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b5871e180, open_flags d900, mode 0 opened 0 00000080:00200000:2.0:1787191337.666647:0:57842:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:2.0:1787191337.666661:0:57842:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:2.0:1787191337.666714:0:57842:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839b24 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.666722:0:57842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839b24 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57842 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191337.666736:0:57842:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:2.0:1787191337.666748:0:57842:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb800 x1874004626589568/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191337.666758:0:57842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839b24 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191337.666781:0:57842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57842:1874004626589568:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191337.667608:0:57842:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b523596c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191337.674671:0:57842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57842:1874004626589568:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191337.674702:0:57842:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839b24 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603cc9 expref: -99 pid: 57842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.674725:0:57842:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839b24 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603cc9 expref: -99 pid: 57842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.674733:0:57842:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839b24 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603cc9 expref: -99 pid: 57842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.674743:0:57842:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839b24 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603cc9 expref: -99 pid: 57842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.674754:0:57842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839b24 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603cc9 expref: -99 pid: 57842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.674767:0:57842:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839b24 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603cc9 expref: -99 pid: 57842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.674774:0:57842:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839b24 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603cc9 expref: -99 pid: 57842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.674781:0:57842:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839b24 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603cc9 expref: -99 pid: 57842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191337.674794:0:57842:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b513bb800 x1874004626589568/t8589936631(8589936631) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191353 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191337.674807:0:57842:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bb800 x1874004626589568/t8589936631(8589936631) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191353 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191337.674820:0:57842:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839b24 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603cc9 expref: -99 pid: 57842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191337.674854:0:57842:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839b24 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603cc9 expref: -99 pid: 57842 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.674864:0:57842:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/188 (0 0) 00000080:00200000:2.0:1787191337.674869:0:57842:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191337.674917:0:57842:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xbc:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1787191337.674926:0:57842:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xbc:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191337.674972:0:57842:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xbc:0x0](ffff936b53969988): rc = 0 00000080:00200000:2.0:1787191337.674993:0:57842:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xbc:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:2.0:1787191337.674999:0:57842:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xbc:0x0](ffff936b53969988) for lock 0xe5129dc884839b24 00000080:00010000:2.0:1787191337.675012:0:57842:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xbc:0x0](ffff936b53969988) 00000080:00200008:2.0:1787191337.675028:0:57842:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xbc:0x0](ffff936b53969988), flags 154400 00000002:00100000:2.0:1787191337.675050:0:57842:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bb800 x1874004626589568/t8589936631(8589936631) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191353 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1787191337.675114:0:57842:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839b24 from it ffff936b60dc4d80 00010000:00010000:2.0:1787191337.675119:0:57842:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839b24 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4603cc9 expref: -99 pid: 57842 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.675128:0:57842:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839b24 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603cc9 expref: -99 pid: 57842 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191337.675152:0:57842:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xbc:0x0](ffff936b53969988), inode mode 81a4 mask 44 00000080:00200000:2.0:1787191337.675251:0:57842:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xbc:0x0](ffff936b53969988), inode mode 81a4 mask 4 00000080:00200000:2.0:1787191337.675258:0:57842:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xbc:0x0](ffff936b53969988), xattr lov 00000080:00200008:2.0:1787191337.675284:0:57842:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xbc:0x0](ffff936b53969988), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191337.675290:0:57842:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xbc:0x0](ffff936b53969988),name=f70.sanity-flr 00000002:00010000:2.0:1787191337.675308:0:57842:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xbc:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191337.675316:0:57842:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839b24 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603cc9 expref: -99 pid: 57842 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191337.675328:0:57842:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839b24 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603cc9 expref: -99 pid: 57842 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191337.675336:0:57842:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191337.675342:0:57842:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xbc:0x0](ffff936b53969988) 00000080:00010000:2.0:1787191337.675345:0:57842:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xbc:0x0](ffff936b53969988) for lock 0xe5129dc884839b24 00000080:00010000:2.0:1787191337.675349:0:57842:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839b24 from it ffffa3fb42163cd8 00010000:00010000:2.0:1787191337.675352:0:57842:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839b24 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4603cc9 expref: -99 pid: 57842 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191337.675359:0:57842:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839b24 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603cc9 expref: -99 pid: 57842 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191337.675376:0:57842:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xbc:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:2.0:1787191337.675385:0:57842:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xbc:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191337.675388:0:57842:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191337.675391:0:57842:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xbc:0x0] 00000008:00010000:2.0:1787191337.675406:0:57842:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191337.675410:0:57842:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d10b0, osc lock ffff936b44e638f0, flags 0x400000400001002 00010000:00010000:2.0:1787191337.675456:0:57842:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc884839b2b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57842 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.675470:0:57842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc884839b2b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57842 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.675480:0:57842:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b513b8e00 x1874004626589696/t0(0) o101->lustre-OST0000-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:2.0:1787191337.675518:0:57842:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:2.0:1787191337.675538:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626589696:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191337.692988:0:2391:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc884839b2b lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57842 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.693012:0:2391:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc884839b2b lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603cd7 expref: -99 pid: 57842 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.693029:0:2391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc884839b2b lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603cd7 expref: -99 pid: 57842 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.693045:0:2391:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc884839b2b lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603cd7 expref: -99 pid: 57842 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1787191337.693073:0:2391:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc884839b2b lrc: 5/2,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4603cd7 expref: -99 pid: 57842 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:2.0:1787191337.693086:0:2391:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:2.0:1787191337.693105:0:2391:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc884839b2b lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4603cd7 expref: -99 pid: 57842 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.693114:0:2391:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc884839b2b lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4603cd7 expref: -99 pid: 57842 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.693121:0:2391:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc884839b2b lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4603cd7 expref: -99 pid: 57842 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.693130:0:2391:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc884839b2b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4603cd7 expref: -99 pid: 57842 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:2.0:1787191337.693148:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626589696:192.168.202.101@tcp:101:lfs.0 00000080:00200000:3.0:1787191337.693556:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191337.693573:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191337.693596:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191337.693609:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191337.693617:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191337.693625:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191337.693628:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191337.693635:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:3.0:1787191337.693639:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191337.693652:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191337.693663:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191337.693670:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191337.693677:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191337.693684:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:3.0:1787191337.693691:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xbc:0x0](ffff936b53969988), inode mode 81a4 mask 42 00000080:00200008:3.0:1787191337.693699:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xbc:0x0](ffff936b53969988), flags 101101 00000002:00010000:3.0:1787191337.693714:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xbc:0x0]) in obj [0x200000405:0xbc:0x0], intent: open|creat flags 04240101102 00010000:00010000:3.0:1787191337.693726:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839b24 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4603cc9 expref: -99 pid: 57842 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191337.693744:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xbc:0x0]: losing layout lock 00010000:00010000:3.0:1787191337.693775:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839b24 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4603cc9 expref: -99 pid: 57842 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191337.693861:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191337.693865:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc884839b24 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4603cc9 expref: -99 pid: 57842 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191337.693899:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839b32 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xbc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.693907:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839b32 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xbc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191337.693924:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:3.0:1787191337.693933:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1c700 x1874004626590720/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191337.693942:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839b32 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xbc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.729828:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787191337.729896:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839b47 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4603d24 expref: -99 pid: 57842 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.729909:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b587bcc00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191337.729913:0:40929:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839b47 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4603d24 expref: -99 pid: 57842 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.729921:0:40929:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839b47 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4603d24 expref: -99 pid: 57842 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.729930:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839b47 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4603d24 expref: -99 pid: 57842 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000080:00200000:2.0:1787191337.729951:0:40929:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xbc:0x0]: losing layout lock 00010000:00010000:2.0:1787191337.729996:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839b47 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4603d24 expref: -99 pid: 57842 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.730004:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787191337.730079:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626592000:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787191337.730183:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839b47 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4603d24 expref: -99 pid: 57842 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.730193:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839b47 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4603d24 expref: -99 pid: 57842 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.730209:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191337.730211:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191337.730213:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191337.740121:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626592000:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191337.752740:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191337.752773:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634864128 00000100:00100000:3.0:1787191337.752782:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634864128 00000100:00100000:3.0:1787191337.752866:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1256 00000100:00100000:3.0:1787191337.752877:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30353:x1874004634864128:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191337.752896:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc884839ade lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4603bd4 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191337.752955:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191337.752962:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30353:x1874004634864128:12345-192.168.202.101@tcp:104: Request processed in 87us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191337.752968:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1256 00000100:00100000:3.0:1787191337.753049:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191337.753076:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634864256 00000100:00100000:3.0:1787191337.753080:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634864256 00000100:00100000:3.0:1787191337.753101:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1257 00000100:00100000:3.0:1787191337.753108:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8420:x1874004634864256:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191337.753117:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839ad0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080030000 nid: local remote: 0x7130d520e4603baa expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191337.753159:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787191337.753165:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8420:x1874004634864256:12345-192.168.202.101@tcp:104: Request processed in 58us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191337.753172:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1257 00010000:00010000:3.0:1787191337.753188:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787191337.753194:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc884839ade lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4603bd4 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191337.753203:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cae600 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191337.753209:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc884839ade lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4603bd4 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191337.753249:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc884839ade lrc: 2/0,0 mode: --/PW res: [0x280000401:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4603bd4 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191337.753256:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191337.753277:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc884839ade lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4603bd4 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191337.753284:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc884839ade lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4603bd4 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191337.753304:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191337.753307:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839ad0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080030000 nid: local remote: 0x7130d520e4603baa expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191337.753318:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cae400 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191337.753321:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839ad0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428480030000 nid: local remote: 0x7130d520e4603baa expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191337.753341:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839ad0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480030020 nid: local remote: 0x7130d520e4603baa expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191337.753347:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191337.753354:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839ad0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480030020 nid: local remote: 0x7130d520e4603baa expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191337.753361:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839ad0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480030020 nid: local remote: 0x7130d520e4603baa expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191337.753374:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191337.753376:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191337.753377:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191337.753391:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626592256:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191337.753429:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787191337.753433:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626592384:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191337.758107:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191337.758211:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626592256:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191337.758268:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626592384:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191337.758381:0:40922:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787191337.758399:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634864384 00000100:00100000:2.0:1787191337.758405:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634864384 00000100:00100000:2.0:1787191337.758454:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1258 00000100:00100000:2.0:1787191337.758463:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b50881850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8422:x1874004634864384:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191337.758480:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc884839b2b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000010000 nid: local remote: 0x7130d520e4603cd7 expref: -99 pid: 57842 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191337.758557:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191337.758564:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b50881850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8422:x1874004634864384:12345-192.168.202.101@tcp:104: Request processed in 102us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191337.758571:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1258 00000100:00100000:2.0:1787191337.761123:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191337.761201:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634864512 00000100:00100000:3.0:1787191337.761209:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634864512 00000100:00100000:3.0:1787191337.761265:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1259 00000100:00100000:3.0:1787191337.761274:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:6489:x1874004634864512:12345-192.168.202.101@tcp:105: 00010000:00010000:3.0:1787191337.761288:0:51131:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000be535028/0xe5129dc884839b5c lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603d6a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.761303:0:51131:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000be535028/0xe5129dc884839b5c lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603d6a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.761312:0:51131:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000be535028/0xe5129dc884839b5c lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603d6a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.761324:0:51131:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000be535028/0xe5129dc884839b5c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080000000000 nid: local remote: 0x7130d520e4603d6a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.761334:0:51131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000be535028/0xe5129dc884839b5c lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080000000000 nid: local remote: 0x7130d520e4603d6a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.761344:0:51131:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000be535028/0xe5129dc884839b5c lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000000000 nid: local remote: 0x7130d520e4603d6a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.761361:0:51131:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b587bcc00) 00000100:00100000:3.0:1787191337.761412:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:6489:x1874004634864512:12345-192.168.202.101@tcp:105: Request processed in 138us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191337.761419:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1259 00000080:00200000:2.0:1787191337.792807:0:57843:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191337.792862:0:57843:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191337.792882:0:57843:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191337.792899:0:57843:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191337.792906:0:57843:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191337.792916:0:57843:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191337.792921:0:57843:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191337.792929:0:57843:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42173bf8 00010000:00010000:2.0:1787191337.792933:0:57843:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191337.792942:0:57843:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191337.792959:0:57843:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191337.792967:0:57843:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191337.792973:0:57843:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191337.792977:0:57843:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:2.0:1787191337.792980:0:57843:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xbc:0x0](ffff936b53969988), inode mode 81a4 mask 44 00000080:00200008:2.0:1787191337.792986:0:57843:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xbc:0x0](ffff936b53969988), flags 154400 00000002:00010000:2.0:1787191337.793001:0:57843:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xbc:0x0]) in obj [0x200000405:0xbc:0x0], intent: open flags 0104240114401 00010000:00010000:2.0:1787191337.793050:0:57843:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839b71 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xbc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x10000000000000 pid: 57843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.795257:0:57843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839b71 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xbc:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x0 pid: 57843 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191337.795275:0:57843:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191337.795287:0:57843:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9500 x1874004626594048/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191337.795298:0:57843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839b71 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xbc:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x0 pid: 57843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191337.795322:0:57843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57843:1874004626594048:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191337.796028:0:57843:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359600 going to sleep for 11 seconds 00000100:00100000:2.0:1787191337.798813:0:57843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57843:1874004626594048:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191337.798984:0:57843:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839b71 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xbc:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603da2 expref: -99 pid: 57843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.799577:0:57843:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839b71 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xbc:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603da2 expref: -99 pid: 57843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.799593:0:57843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839b71 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xbc:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603da2 expref: -99 pid: 57843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191337.799612:0:57843:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x200002b, status=0 req@ffff936b513b9500 x1874004626594048/t8589936643(8589936643) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191353 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191337.799626:0:57843:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9500 x1874004626594048/t8589936643(8589936643) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191353 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191337.799639:0:57843:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839b71 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xbc:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603da2 expref: -99 pid: 57843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191337.799653:0:57843:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839b71 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xbc:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603da2 expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.799669:0:57843:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/188 (0 0) 00000080:00200000:2.0:1787191337.799674:0:57843:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xbc:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1787191337.799735:0:57843:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xbc:0x0]: layout version change: 4 -> 4 00000080:00010000:2.0:1787191337.799741:0:57843:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xbc:0x0](ffff936b53969988) for lock 0xe5129dc884839b71 00000080:00010000:2.0:1787191337.799747:0:57843:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839b71 from it ffffa3fb42173bf0 00010000:00010000:2.0:1787191337.799751:0:57843:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839b71 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xbc:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4603da2 expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.799761:0:57843:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839b71 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xbc:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603da2 expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000002:00100000:2.0:1787191337.799791:0:57843:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9500 x1874004626594048/t8589936643(8589936643) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191353 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191337.799955:0:57843:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xbc:0x0](ffff936b53969988), inode mode 81a4 mask 4 00000080:00200000:2.0:1787191337.799964:0:57843:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xbc:0x0](ffff936b53969988), xattr lov 00000080:00200008:2.0:1787191337.799992:0:57843:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xbc:0x0](ffff936b53969988), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191337.800011:0:57843:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xbc:0x0](ffff936b53969988),name=f70.sanity-flr 00000002:00010000:2.0:1787191337.800030:0:57843:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xbc:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191337.800039:0:57843:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839b55 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603d47 expref: -99 pid: 57842 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191337.800050:0:57843:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839b55 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603d47 expref: -99 pid: 57842 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191337.800067:0:57843:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191337.800073:0:57843:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xbc:0x0](ffff936b53969988) 00000080:00010000:2.0:1787191337.800077:0:57843:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xbc:0x0](ffff936b53969988) for lock 0xe5129dc884839b55 00000080:00010000:2.0:1787191337.800091:0:57843:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839b55 from it ffffa3fb42173cd8 00010000:00010000:2.0:1787191337.800095:0:57843:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839b55 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603d47 expref: -99 pid: 57842 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191337.800102:0:57843:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839b55 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603d47 expref: -99 pid: 57842 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191337.800121:0:57843:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xbc:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:2.0:1787191337.800131:0:57843:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xbc:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191337.800134:0:57843:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191337.800138:0:57843:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xbc:0x0] 00000008:00010000:2.0:1787191337.801757:0:57843:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191337.801763:0:57843:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d15b0, osc lock ffff936b44e62980, flags 0x400000400001002 00010000:00010000:2.0:1787191337.801788:0:57843:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000be535028/0xe5129dc884839b5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4603d6a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191337.801804:0:57843:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000be535028/0xe5129dc884839b5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4603d6a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:2.0:1787191337.801818:0:57843:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191337.801823:0:57843:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000be535028/0xe5129dc884839b5c lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4603d6a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191337.801847:0:57843:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000be535028/0xe5129dc884839b5c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4603d6a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:2.0:1787191337.801862:0:57843:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191337.801875:0:57843:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xbc:0x0] updating i_size 5 i_blocks 0 00000020:00010000:2.0:1787191337.801882:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c3a060 (ffff936b47a17ab8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191337.801886:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c3a060 (ffff936b47a17ab8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191337.801888:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d15b0 (ffff936b465ccf38/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191337.801892:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c3a060 (ffff936b47a17ab8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191337.801895:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d15b0 (ffff936b47a17ab8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191337.801909:0:57843:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xbc:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191337.801960:0:57843:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xbc:0x0](ffff936b53969988), flags 154000 00010000:00010000:2.0:1787191337.801978:0:57843:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839b71 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xbc:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603da2 expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191337.802382:0:57843:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191337.802461:0:57843:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191337.802471:0:57843:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191337.802481:0:57843:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191337.802489:0:57843:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191337.802554:0:57843:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191337.802559:0:57843:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191337.802564:0:57843:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42173b58 00010000:00010000:2.0:1787191337.802569:0:57843:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191337.802577:0:57843:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191337.802593:0:57843:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191337.802600:0:57843:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191337.802606:0:57843:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191337.802610:0:57843:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=9 00000080:00200008:2.0:1787191337.802617:0:57843:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xbc:0x0](ffff936b53969988), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191337.802622:0:57843:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xbc:0x0](ffff936b53969988),name=f70.sanity-flr 00000002:00010000:2.0:1787191337.802633:0:57843:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xbc:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191337.802641:0:57843:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839b55 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603d47 expref: -99 pid: 57842 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191337.802649:0:57843:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839b55 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603d47 expref: -99 pid: 57842 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191337.802656:0:57843:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191337.802660:0:57843:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xbc:0x0](ffff936b53969988) 00000080:00010000:2.0:1787191337.802663:0:57843:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xbc:0x0](ffff936b53969988) for lock 0xe5129dc884839b55 00000080:00010000:2.0:1787191337.802667:0:57843:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839b55 from it ffffa3fb42173cb8 00010000:00010000:2.0:1787191337.802670:0:57843:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839b55 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603d47 expref: -99 pid: 57842 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191337.802679:0:57843:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839b55 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603d47 expref: -99 pid: 57842 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191337.802695:0:57843:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xbc:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:2.0:1787191337.802705:0:57843:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xbc:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191337.802709:0:57843:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191337.802713:0:57843:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xbc:0x0] 00000008:00010000:2.0:1787191337.802726:0:57843:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191337.802728:0:57843:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d15b0, osc lock ffff936b44e62980, flags 0x400000400001002 00010000:00010000:2.0:1787191337.802740:0:57843:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000be535028/0xe5129dc884839b5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4603d6a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191337.802749:0:57843:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000be535028/0xe5129dc884839b5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4603d6a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:2.0:1787191337.802759:0:57843:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191337.802763:0:57843:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000be535028/0xe5129dc884839b5c lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4603d6a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191337.802771:0:57843:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000be535028/0xe5129dc884839b5c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4603d6a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:2.0:1787191337.802779:0:57843:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191337.802784:0:57843:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xbc:0x0] updating i_size 5 i_blocks 0 00000020:00010000:2.0:1787191337.802789:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c3a060 (ffff936b47a17ab8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191337.802791:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c3a060 (ffff936b47a17ab8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191337.802794:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d15b0 (ffff936b465ccf38/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191337.802797:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c3a060 (ffff936b47a17ab8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191337.802799:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d15b0 (ffff936b47a17ab8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191337.802808:0:57843:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xbc:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191337.802858:0:57843:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191337.802866:0:57843:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191337.802872:0:57843:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191337.802884:0:57843:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191337.802890:0:57843:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191337.802895:0:57843:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191337.802897:0:57843:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191337.802901:0:57843:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42173bf8 00010000:00010000:2.0:1787191337.802904:0:57843:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191337.802912:0:57843:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191337.802920:0:57843:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191337.802923:0:57843:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191337.802927:0:57843:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191337.802930:0:57843:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:2.0:1787191337.802934:0:57843:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xbc:0x0](ffff936b53969988), inode mode 81a4 mask 46 00000080:00200008:2.0:1787191337.802940:0:57843:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xbc:0x0](ffff936b53969988), flags 154402 00000002:00010000:2.0:1787191337.802952:0:57843:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xbc:0x0]) in obj [0x200000405:0xbc:0x0], intent: open flags 0104240114403 00010000:00010000:2.0:1787191337.803065:0:57843:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839b78 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xbc:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x10000000000000 pid: 57843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.803074:0:57843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839b78 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xbc:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x0 pid: 57843 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191337.803086:0:57843:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191337.803098:0:57843:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8e00 x1874004626594560/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191337.803107:0:57843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839b78 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xbc:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x0 pid: 57843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191337.803127:0:57843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57843:1874004626594560:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191337.803595:0:57843:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359600 going to sleep for 11 seconds 00000100:00100000:3.0:1787191337.808646:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191337.808703:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191337.808733:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634864640 00000100:00100000:3.0:1787191337.808743:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634864640 00000100:00100000:2.0:1787191337.808767:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634864768 00000100:00100000:2.0:1787191337.808773:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634864768 00000100:00100000:2.0:1787191337.808823:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1260 00000100:00100000:2.0:1787191337.809269:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+6:6506:x1874004634864768:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191337.809289:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839b55 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e4603d47 expref: -99 pid: 57842 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191337.809612:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191337.809620:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+6:6506:x1874004634864768:12345-192.168.202.101@tcp:104: Request processed in 788us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191337.809628:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1260 00000100:00100000:2.0:1787191337.809652:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1261 00000100:00100000:2.0:1787191337.809659:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634864640:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191337.809667:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839b63 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4603d86 expref: -99 pid: 57842 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191337.809698:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787191337.809706:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634864640:12345-192.168.202.101@tcp:104: Request processed in 48us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191337.809713:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1261 00010000:00010000:3.0:1787191337.810983:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191337.830247:0:57844:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b5058ca80 x1874004626596096/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 512/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787191337.830267:0:57844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b5058ca80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57844:1874004626596096:192.168.202.101@tcp:36:rm.0 00000100:00100000:1.0:1787191337.830295:0:57844:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628939c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191337.833595:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191337.833679:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191337.833996:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634864896 00000100:00100000:3.0:1787191337.834007:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634864896 00000100:00100000:3.0:1787191337.834069:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634865024 00000100:00100000:3.0:1787191337.834079:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634865024 00000100:00100000:3.0:1787191337.834100:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1262 00000100:00100000:3.0:1787191337.834115:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:37089:x1874004634864896:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191337.834135:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000be535028/0xe5129dc884839b5c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000020000 nid: local remote: 0x7130d520e4603d6a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 1 00010000:00010000:3.0:1787191337.834252:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191337.834259:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:37089:x1874004634864896:12345-192.168.202.101@tcp:104: Request processed in 150us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191337.834266:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1262 00000100:00100000:3.0:1787191337.834283:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1263 00000100:00100000:3.0:1787191337.834290:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634865024:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191337.834299:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839b86 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4603de8 expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000100:00100000:1.0:1787191337.834746:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626596224:192.168.202.101@tcp:4:bash.0 00010000:00010000:3.0:1787191337.834971:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191337.834979:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634865024:12345-192.168.202.101@tcp:104: Request processed in 689us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191337.834986:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1263 00010000:00010000:2.0:1787191337.835195:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787191337.835202:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839b86 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4603de8 expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191337.835211:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44caea00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191337.835217:0:40929:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839b86 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4603de8 expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191337.835225:0:40929:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839b86 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4603de8 expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191337.835233:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839b86 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4603de8 expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:2.0:1787191337.835252:0:40929:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xbc:0x0]: losing layout lock 00010000:00010000:2.0:1787191337.835292:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839b86 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4603de8 expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191337.835299:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191337.835318:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839b86 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4603de8 expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191337.835326:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839b86 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4603de8 expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191337.835339:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191337.835411:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191337.835414:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191337.835427:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626596352:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191337.838001:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626596352:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00200000:2.0:1787191337.840320:0:40930:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xbc:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00000080:00200000:2.0:1787191337.840394:0:40930:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xbc:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:2.0:1787191337.840448:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000be535028/0xe5129dc884839b5c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400020020 nid: local remote: 0x7130d520e4603d6a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 1 00010000:00010000:2.0:1787191337.840456:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191337.840478:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000be535028/0xe5129dc884839b5c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400020020 nid: local remote: 0x7130d520e4603d6a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 1 00010000:00010000:2.0:1787191337.840487:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000be535028/0xe5129dc884839b5c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400020020 nid: local remote: 0x7130d520e4603d6a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 1 00010000:00010000:2.0:1787191337.840508:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191337.840524:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191337.840526:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191337.840541:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626596480:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191337.841278:0:57844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b5058ca80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57844:1874004626596096:192.168.202.101@tcp:36:rm.0 00000100:00100000:2.0:1787191337.844108:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626596480:192.168.202.101@tcp:103:ldlm_bl.0 00000020:00100000:2.0:1787191337.848726:0:57843:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1787191337.848737:0:57843:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9f80 x1874004626596736/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 472/440 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787191337.848758:0:57843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57843:1874004626596736:192.168.202.101@tcp:36:lfs.0 00000100:00100000:2.0:1787191337.850454:0:57843:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359e40 going to sleep for 11 seconds 00000080:00200000:1.0:1787191337.850681:0:57845:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191337.850704:0:57845:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191337.850719:0:57845:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191337.850734:0:57845:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191337.850741:0:57845:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191337.850749:0:57845:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191337.850752:0:57845:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191337.850759:0:57845:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4217bb58 00010000:00010000:1.0:1787191337.850763:0:57845:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191337.850771:0:57845:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191337.850785:0:57845:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191337.850791:0:57845:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:1.0:1787191337.850797:0:57845:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191337.850808:0:57845:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:1.0:1787191337.850812:0:57845:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191337.850822:0:57845:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191337.850941:0:57845:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839b94 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.850949:0:57845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839b94 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.850959:0:57845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839b94 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191337.850978:0:57845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b5058f480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57845:1874004626596864:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191337.851029:0:57845:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628939c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191337.854650:0:57845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b5058f480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57845:1874004626596864:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191337.854671:0:57845:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839b94 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.854684:0:57845:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839b94 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.854691:0:57845:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839b94 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.854698:0:57845:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839b94 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.854707:0:57845:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839b94 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.854718:0:57845:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b587bd600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191337.854723:0:57845:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839b94 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.854729:0:57845:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839b94 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.854736:0:57845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839b94 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.854742:0:57845:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191337.854749:0:57845:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839b94 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.854755:0:57845:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839b94 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191337.854776:0:57845:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b5058f480 x1874004626596864/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191353 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191337.854791:0:57845:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191337.854896:0:57845:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191337.854910:0:57845:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191337.854920:0:57845:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191337.854931:0:57845:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191337.854938:0:57845:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191337.854943:0:57845:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191337.854947:0:57845:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191337.854952:0:57845:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4217bbe8 00010000:00010000:1.0:1787191337.854955:0:57845:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191337.854963:0:57845:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191337.854976:0:57845:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191337.854982:0:57845:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000080:00200000:1.0:1787191337.854987:0:57845:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191337.854998:0:57845:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:1.0:1787191337.855002:0:57845:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191337.855012:0:57845:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191337.855049:0:57845:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839b9b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.855065:0:57845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839b9b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.855086:0:57845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839b9b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191337.855105:0:57845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b5058f480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57845:1874004626596992:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191337.855174:0:57845:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628939c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191337.862579:0:57845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b5058f480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57845:1874004626596992:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191337.862591:0:57845:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839b9b lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.862601:0:57845:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839b9b lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.862608:0:57845:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839b9b lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.862616:0:57845:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839b9b lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.862623:0:57845:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839b9b lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.862629:0:57845:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b587bd000 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191337.862634:0:57845:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839b9b lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.862641:0:57845:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839b9b lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.862648:0:57845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839b9b lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.862656:0:57845:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191337.862662:0:57845:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839b9b lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.862669:0:57845:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839b9b lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191337.862688:0:57845:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b5058f480 x1874004626596992/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191353 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191337.862706:0:57845:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191337.862787:0:57845:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191337.862982:0:57845:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191337.862994:0:57845:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191337.863006:0:57845:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191337.863012:0:57845:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191337.863018:0:57845:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191337.863021:0:57845:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191337.863026:0:57845:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4217bb58 00010000:00010000:1.0:1787191337.863030:0:57845:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191337.863037:0:57845:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191337.863048:0:57845:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191337.863066:0:57845:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:1.0:1787191337.863076:0:57845:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:1.0:1787191337.863081:0:57845:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:1.0:1787191337.863093:0:57845:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191337.863100:0:57845:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 71 lru_type: 1 00010000:00010000:1.0:1787191337.863113:0:57845:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 71 lru_type: 1 00000002:00010000:1.0:1787191337.863122:0:57845:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191337.863151:0:57845:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839ba9 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.863158:0:57845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839ba9 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.863165:0:57845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839ba9 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191337.863181:0:57845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b5058f480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57845:1874004626597248:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191337.863225:0:57845:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628939c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191337.867545:0:57845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b5058f480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57845:1874004626597248:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191337.867562:0:57845:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839ba9 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603e5f expref: -99 pid: 57845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.867573:0:57845:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839ba9 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603e5f expref: -99 pid: 57845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.867584:0:57845:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839ba9 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603e5f expref: -99 pid: 57845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.867595:0:57845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839ba9 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603e5f expref: -99 pid: 57845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.867611:0:57845:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839ba9 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603e5f expref: -99 pid: 57845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.867619:0:57845:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839ba9 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603e5f expref: -99 pid: 57845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.867625:0:57845:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839ba9 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603e5f expref: -99 pid: 57845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191337.867633:0:57845:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b5058f480 x1874004626597248/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191353 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191337.867643:0:57845:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603e5f expref: -99 pid: 57845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.867649:0:57845:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:1.0:1787191337.867654:0:57845:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603e5f expref: -99 pid: 57845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.867659:0:57845:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839ba9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603e5f expref: -99 pid: 57845 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:1.0:1787191337.867681:0:57845:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191337.867688:0:57845:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 142 lru_type: 1 00010000:00010000:1.0:1787191337.867695:0:57845:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 142 lru_type: 1 00010000:00010000:1.0:1787191337.867700:0:57845:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 142 lru_type: 1 00010000:00010000:1.0:1787191337.867704:0:57845:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 143 lru_type: 1 00000080:00200000:1.0:1787191337.867712:0:57845:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191337.867718:0:57845:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:1.0:1787191337.867720:0:57845:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:1.0:1787191337.867724:0:57845:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb4217bcb8 00010000:00010000:1.0:1787191337.867726:0:57845:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 71 lru_type: 1 00010000:00010000:1.0:1787191337.867730:0:57845:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 72 lru_type: 1 00000002:00010000:1.0:1787191337.867740:0:57845:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191337.867743:0:57845:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839ba9 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603e5f expref: -99 pid: 57845 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191337.867748:0:57845:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839ba9 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603e5f expref: -99 pid: 57845 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191337.867752:0:57845:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603e5f expref: -99 pid: 57845 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191337.867756:0:57845:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839ba9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603e5f expref: -99 pid: 57845 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:1.0:1787191337.867761:0:57845:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191337.867763:0:57845:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 143 lru_type: 1 00010000:00010000:1.0:1787191337.867769:0:57845:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 143 lru_type: 1 00010000:00010000:1.0:1787191337.867775:0:57845:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 143 lru_type: 1 00010000:00010000:1.0:1787191337.867782:0:57845:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 144 lru_type: 1 00000080:00200008:1.0:1787191337.868349:0:57845:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:1.0:1787191337.868354:0:57845:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191337.868365:0:57845:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191337.868371:0:57845:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191337.868378:0:57845:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191337.868382:0:57845:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191337.868386:0:57845:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191337.868387:0:57845:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191337.868391:0:57845:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4217bcb8 00010000:00010000:1.0:1787191337.868393:0:57845:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191337.868398:0:57845:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191337.868482:0:57845:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191337.868488:0:57845:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191337.868492:0:57845:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191337.868498:0:57845:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191337.868502:0:57845:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191337.868504:0:57845:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191337.868506:0:57845:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191337.868509:0:57845:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4217bb58 00010000:00010000:1.0:1787191337.868510:0:57845:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191337.868515:0:57845:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191337.868520:0:57845:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191337.868524:0:57845:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:1.0:1787191337.868527:0:57845:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191337.868533:0:57845:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:1.0:1787191337.868536:0:57845:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191337.868545:0:57845:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191337.868575:0:57845:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839bb7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.868582:0:57845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839bb7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.868592:0:57845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839bb7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191337.868610:0:57845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b5058f480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57845:1874004626597504:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191337.868641:0:57845:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628939c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191337.873179:0:57845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b5058f480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57845:1874004626597504:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191337.873200:0:57845:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839bb7 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.873214:0:57845:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839bb7 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.873220:0:57845:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839bb7 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.873225:0:57845:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839bb7 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.873231:0:57845:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839bb7 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.873235:0:57845:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b587bd600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191337.873238:0:57845:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839bb7 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.873243:0:57845:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839bb7 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.873248:0:57845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839bb7 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.873252:0:57845:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191337.873256:0:57845:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839bb7 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.873260:0:57845:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839bb7 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191337.873273:0:57845:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b5058f480 x1874004626597504/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191353 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191337.873284:0:57845:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1787191337.873316:0:57845:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839ba9 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603e5f expref: -99 pid: 57845 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191337.873327:0:57845:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839ba9 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603e5f expref: -99 pid: 57845 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:1.0:1787191337.873333:0:57845:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839ba9 from it ffffa3fb4217b930 00010000:00010000:1.0:1787191337.873335:0:57845:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603e5f expref: -99 pid: 57845 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191337.873340:0:57845:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839ba9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603e5f expref: -99 pid: 57845 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191337.873407:0:57845:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191337.873417:0:57845:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191337.873423:0:57845:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191337.873429:0:57845:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191337.873432:0:57845:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191337.873435:0:57845:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191337.873437:0:57845:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191337.873440:0:57845:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4217bbf8 00010000:00010000:1.0:1787191337.873442:0:57845:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191337.873446:0:57845:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191337.873451:0:57845:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191337.873456:0:57845:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191337.873460:0:57845:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191337.873463:0:57845:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:1.0:1787191337.873466:0:57845:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:1.0:1787191337.873469:0:57845:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b484de600, open_flags a141, mode 81b6 opened 0 00000080:00200000:1.0:1787191337.873476:0:57845:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:1.0:1787191337.873491:0:57845:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xbd:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:1.0:1787191337.873500:0:57845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839ba9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4603e5f expref: -99 pid: 57845 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191337.873536:0:57845:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839ba9 lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4603e5f expref: -99 pid: 57845 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191337.873540:0:57845:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191337.873542:0:57845:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839ba9 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4603e5f expref: -99 pid: 57845 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191337.873565:0:57845:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839bbe lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.873571:0:57845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839bbe lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191337.873581:0:57845:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191337.873588:0:57845:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b5058f480 x1874004626597760/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191337.873596:0:57845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839bbe lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191337.873615:0:57845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b5058f480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57845:1874004626597760:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191337.876229:0:57845:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628939c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191337.877442:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626597888:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191337.882595:0:57845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b5058f480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57845:1874004626597760:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191337.882622:0:57845:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839bbe lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603e9e expref: -99 pid: 57845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.882652:0:57845:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839bbe lrc: 4/0,1 mode: --/PR res: [0x200000405:0xbd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603e9e expref: -99 pid: 57845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.882661:0:57845:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839bbe lrc: 4/0,1 mode: --/PR res: [0x200000405:0xbd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603e9e expref: -99 pid: 57845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.882672:0:57845:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839bbe lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xbd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603e9e expref: -99 pid: 57845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.882683:0:57845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839bbe lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xbd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603e9e expref: -99 pid: 57845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.882696:0:57845:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839bbe lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xbd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603e9e expref: -99 pid: 57845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.882704:0:57845:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839bbe lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xbd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603e9e expref: -99 pid: 57845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.882712:0:57845:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839bbe lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xbd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603e9e expref: -99 pid: 57845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191337.882724:0:57845:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b5058f480 x1874004626597760/t8589936650(8589936650) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191353 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191337.882742:0:57845:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b5058f480 x1874004626597760/t8589936650(8589936650) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191353 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191337.882754:0:57845:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839bbe lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xbd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603e9e expref: -99 pid: 57845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.882763:0:57845:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/189 (0 0) 00000080:00200000:3.0:1787191337.882769:0:57845:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191337.882781:0:57845:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:3.0:1787191337.882810:0:57845:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xbd:0x0](ffff936b489a9988) 00000080:00200000:3.0:1787191337.882817:0:57845:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xbd:0x0], updating i_size 0 00000080:00200000:3.0:1787191337.882893:0:57845:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xbd:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:3.0:1787191337.882901:0:57845:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xbd:0x0](ffff936b489a9988) 00000080:00010000:3.0:1787191337.882905:0:57845:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xbd:0x0](ffff936b489a9988) for lock 0xe5129dc884839bbe 00000080:00010000:3.0:1787191337.882916:0:57845:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xbd:0x0](ffff936b489a9988) 00000080:00200008:3.0:1787191337.882930:0:57845:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xbd:0x0](ffff936b489a9988), flags 120501 00000002:00100000:2.0:1787191337.883139:0:57845:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b5058f480 x1874004626597760/t8589936650(8589936650) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191353 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1787191337.883189:0:57845:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839bbe from it ffff936b5339fa80 00010000:00010000:2.0:1787191337.883194:0:57845:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839bbe lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xbd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4603e9e expref: -99 pid: 57845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.883203:0:57845:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839bbe lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603e9e expref: -99 pid: 57845 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191337.883226:0:57845:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xbd:0x0](ffff936b489a9988), inode mode 81a4 mask 40 00000080:00200000:2.0:1787191337.883282:0:57845:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xbd:0x0](ffff936b489a9988), inode mode 81a4 mask 2 00000080:00200000:2.0:1787191337.883292:0:57845:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xbd:0x0](ffff936b489a9988), xattr lov 00000002:00010000:2.0:1787191337.883309:0:57845:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xbd:0x0]) in obj [0x200000405:0xbd:0x0], intent: open flags 040000002 00010000:00010000:2.0:1787191337.883357:0:57845:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839bcc lrc: 3/1,0 mode: --/CR res: [0x200000405:0xbd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.883364:0:57845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839bcc lrc: 3/1,0 mode: --/CR res: [0x200000405:0xbd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191337.883373:0:57845:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191337.883380:0:57845:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513baa00 x1874004626598144/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191337.883388:0:57845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839bcc lrc: 3/1,0 mode: --/CR res: [0x200000405:0xbd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191337.883408:0:57845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57845:1874004626598144:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191337.883558:0:57845:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359780 going to sleep for 11 seconds 00010000:00010000:1.0:1787191337.884122:0:2390:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.884140:0:2390:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.884154:0:2390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.884225:0:2390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191337.884239:0:2390:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 5, setting rss=5; kms=5, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 5/2,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1787191337.884250:0:2390:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1787191337.884268:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.884276:0:2390:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.884283:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.884291:0:2390:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1787191337.884303:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626597888:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191337.889242:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191337.889328:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634865664 00000100:00100000:3.0:1787191337.889339:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634865664 00000100:00100000:3.0:1787191337.889399:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1264 00000100:00100000:3.0:1787191337.889408:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634865664:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191337.889426:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839bbe lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4603e9e expref: -99 pid: 57845 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191337.889494:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191337.889499:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634865664:12345-192.168.202.101@tcp:104: Request processed in 94us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191337.889503:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1264 00010000:00010000:1.0:1787191337.889608:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191337.889616:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839bbe lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4603e9e expref: -99 pid: 57845 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191337.889626:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b587bce00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191337.889632:0:43384:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839bbe lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbd:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4603e9e expref: -99 pid: 57845 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191337.889641:0:43384:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839bbe lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbd:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4603e9e expref: -99 pid: 57845 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191337.889650:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839bbe lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xbd:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4603e9e expref: -99 pid: 57845 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191337.889677:0:43384:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xbd:0x0]: losing layout lock 00010000:00010000:1.0:1787191337.889725:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839bbe lrc: 2/0,0 mode: --/PR res: [0x200000405:0xbd:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4603e9e expref: -99 pid: 57845 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191337.889733:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191337.889757:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839bbe lrc: 1/0,0 mode: --/PR res: [0x200000405:0xbd:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4603e9e expref: -99 pid: 57845 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191337.889764:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839bbe lrc: 0/0,0 mode: --/PR res: [0x200000405:0xbd:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4603e9e expref: -99 pid: 57845 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191337.889782:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191337.889784:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191337.889786:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191337.889803:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b5058c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626598272:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191337.892569:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b5058c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626598272:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191337.893523:0:57845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57845:1874004626598144:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191337.893544:0:57845:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839bcc lrc: 4/1,0 mode: --/CR res: [0x200000405:0xbd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.893626:0:57845:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839bcc lrc: 4/1,0 mode: --/CR res: [0x200000405:0xbd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.893634:0:57845:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839bcc lrc: 4/1,0 mode: --/CR res: [0x200000405:0xbd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.893641:0:57845:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839bcc lrc: 3/0,0 mode: --/CR res: [0x200000405:0xbd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.893649:0:57845:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839bcc lrc: 4/0,0 mode: --/CR res: [0x200000405:0xbd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.893655:0:57845:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd4600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191337.893659:0:57845:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839bcc lrc: 4/0,0 mode: --/CR res: [0x200000405:0xbd:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.893665:0:57845:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839bcc lrc: 4/0,0 mode: --/CR res: [0x200000405:0xbd:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.893672:0:57845:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839bcc lrc: 5/0,0 mode: --/CR res: [0x200000405:0xbd:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.893679:0:57845:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191337.893685:0:57845:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839bcc lrc: 3/0,0 mode: --/CR res: [0x200000405:0xbd:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191337.893691:0:57845:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839bcc lrc: 0/0,0 mode: --/CR res: [0x200000405:0xbd:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57845 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191337.893719:0:57845:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b513baa00 x1874004626598144/t8589936651(8589936651) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191353 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191337.893732:0:57845:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513baa00 x1874004626598144/t8589936651(8589936651) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191353 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191337.893747:0:57845:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xbd:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787191337.893796:0:57845:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xbd:0x0] ignore/verify layout 1/0, layout version 5 restore needed 0 00000080:00200000:1.0:1787191337.893804:0:57845:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xbd:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191337.893878:0:57845:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xbd:0x0], updating i_size 0 00000002:00100000:1.0:1787191337.893898:0:57845:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513baa00 x1874004626598144/t8589936651(8589936651) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191353 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191337.893935:0:57845:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513baa00 x1874004626598144/t8589936651(8589936651) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191353 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191337.893944:0:57845:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191337.893949:0:57845:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b5058c000 x1874004626598528/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191337.894105:0:57845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b5058c000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57845:1874004626598528:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191337.894306:0:57845:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893180 going to sleep for 11 seconds 00000100:00100000:1.0:1787191337.899192:0:57845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b5058c000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57845:1874004626598528:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191337.899234:0:57845:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513baa00 x1874004626598144/t8589936651(8589936651) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191353 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1787191337.899295:0:57845:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xbd:0x0](ffff936b489a9988), flags 100001 00000002:00100000:1.0:1787191337.899351:0:57845:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b5058f480 x1874004626597760/t8589936650(8589936650) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191353 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191337.899363:0:57845:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191337.899368:0:57845:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b5058ea00 x1874004626598784/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191337.899391:0:57845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b5058ea00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57845:1874004626598784:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191337.899472:0:57845:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893180 going to sleep for 11 seconds 00000100:00100000:1.0:1787191337.903322:0:57845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b5058ea00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57845:1874004626598784:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191337.903372:0:57845:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b5058f480 x1874004626597760/t8589936650(8589936650) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191353 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191337.905418:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191337.905450:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191337.905468:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191337.905483:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191337.905491:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191337.905498:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191337.905502:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191337.905509:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:2.0:1787191337.905513:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191337.905521:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191337.905537:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191337.905544:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191337.905550:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191337.905707:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:2.0:1787191337.905714:0:57570:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b513cfc80, open_flags 8241, mode 81b6 opened 0 00000080:00200000:2.0:1787191337.905723:0:57570:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:2.0:1787191337.905743:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xbe:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0101102 00010000:00010000:2.0:1787191337.905801:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc884839bd3 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.905810:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc884839bd3 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191337.905822:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191337.905921:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb100 x1874004626599040/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191337.905931:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc884839bd3 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191337.906224:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626599040:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191337.906361:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359780 going to sleep for 11 seconds 00000100:00100000:3.0:1787191337.912539:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626599040:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191337.912569:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc884839bd3 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603edd expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.912599:0:57570:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc884839bd3 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xbd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603edd expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.912608:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc884839bd3 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xbd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603edd expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.912685:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc884839bd3 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xbd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603edd expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.912697:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc884839bd3 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xbd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603edd expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.912712:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc884839bd3 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xbd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603edd expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.912720:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc884839bd3 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xbd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603edd expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.912727:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc884839bd3 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xbd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603edd expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191337.912739:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x2b, status=0 req@ffff936b513bb100 x1874004626599040/t8589936654(8589936654) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191353 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191337.912754:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bb100 x1874004626599040/t8589936654(8589936654) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191353 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191337.912768:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc884839bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xbd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603edd expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191337.912782:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc884839bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xbd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603edd expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.912792:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/189 (0 0) 00000080:00200000:3.0:1787191337.913042:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191337.913104:0:57570:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xbd:0x0](ffff936b489a9988): rc = 0 00000080:00200000:3.0:1787191337.913121:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xbd:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:3.0:1787191337.913128:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xbd:0x0](ffff936b489a9988) for lock 0xe5129dc884839bd3 00000080:00010000:3.0:1787191337.913202:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xbd:0x0](ffff936b489a9988) 00000080:00200008:3.0:1787191337.913218:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xbd:0x0](ffff936b489a9988), flags 101101 00000002:00100000:3.0:1787191337.913245:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bb100 x1874004626599040/t8589936654(8589936654) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191353 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1787191337.913278:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839bd3 from it ffff936b60dc4d80 00010000:00010000:3.0:1787191337.913283:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc884839bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xbd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4603edd expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.913292:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc884839bd3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603edd expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191337.913314:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xbd:0x0](ffff936b489a9988), inode mode 81a4 mask 42 00000002:00010000:3.0:1787191337.913342:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xbd:0x0], intent: getxattr flags 0 00010000:00010000:3.0:1787191337.913388:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839bda lrc: 3/1,0 mode: --/PR res: [0x200000405:0xbd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.913400:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839bda lrc: 3/1,0 mode: --/PR res: [0x200000405:0xbd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.913410:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839bda lrc: 3/1,0 mode: --/PR res: [0x200000405:0xbd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191337.913431:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626599168:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191337.913619:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787191337.916586:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626599168:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191337.916626:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839bda lrc: 4/1,0 mode: --/PR res: [0x200000405:0xbd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603ef2 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.916644:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839bda lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xbd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603ef2 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.916657:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839bda lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xbd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603ef2 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191337.916671:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b51d1f480 x1874004626599168/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191353 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191337.916682:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839bda lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xbd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603ef2 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.916693:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/189 (0 0) 00000080:00200000:3.0:1787191337.916699:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xbd:0x0] suppgids 0 -1: rc 0 00000080:00010000:3.0:1787191337.916725:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xbd:0x0](ffff936b489a9988) for lock 0xe5129dc884839bda 00000080:00010000:3.0:1787191337.916734:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839bda from it ffffa3fb41caba38 00010000:00010000:3.0:1787191337.916738:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839bda lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xbd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603ef2 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.916748:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839bda lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603ef2 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:3.0:1787191337.916787:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xbd:0x0](ffff936b489a9988) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191337.000000000, mtime 1787191337.000000000, ctime 1787191337.000000000 00010000:00010000:3.0:1787191337.916877:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc884839bd3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4603edd expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191337.916898:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xbd:0x0]: losing layout lock 00010000:00010000:3.0:1787191337.916949:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc884839bd3 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xbd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4603edd expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191337.916962:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191337.916967:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc884839bd3 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xbd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4603edd expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:3.0:1787191337.916987:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1787191337.916995:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1f480 x1874004626599424/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191337.917016:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626599424:192.168.202.101@tcp:36:bash.0 00000100:00100000:3.0:1787191337.917092:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787191337.921368:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626599424:192.168.202.101@tcp:36:bash.0 00000080:00200000:3.0:1787191337.921416:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:3.0:1787191337.921422:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xbd:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00010000:00010000:3.0:1787191337.921439:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/189 (0 0) 00000080:00010000:3.0:1787191337.921447:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xbd:0x0](ffff936b489a9988) 00000002:00010000:3.0:1787191337.921454:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xbd:0x0]) in obj [0x200000405:0xbd:0x0], intent: layout flags 0 00010000:00010000:3.0:1787191337.921496:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884839be1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xbd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.921502:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884839be1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xbd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.921510:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884839be1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xbd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191337.921524:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626599552:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191337.921586:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787191337.924495:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626599552:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191337.924523:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884839be1 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xbd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603f00 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.924535:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884839be1 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xbd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603f00 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191337.924546:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b51d1c700 x1874004626599552/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191353 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191337.924553:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884839be1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xbd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603f00 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191337.924562:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884839be1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xbd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603f00 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.924572:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/189 (0 0) 00000080:00200000:3.0:1787191337.924577:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xbd:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1787191337.924590:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xbd:0x0](ffff936b489a9988) for lock 0xe5129dc884839be1 00000080:00010000:3.0:1787191337.924596:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839be1 from it ffffa3fb41cab8c8 00010000:00010000:3.0:1787191337.924599:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884839be1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xbd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603f00 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.924606:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884839be1 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xbd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603f00 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191337.924639:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884839be1 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xbd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603f00 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191337.924649:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884839be1 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xbd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603f00 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:3.0:1787191337.924657:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xbd:0x0](00000000fb2aac00) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884839be1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xbd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603f00 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191337.924696:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xbd:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:3.0:1787191337.924700:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884839be1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xbd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4603f00 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191337.924705:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884839be1 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xbd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603f00 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:3.0:1787191337.924717:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xbd:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:3.0:1787191337.924723:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xbd:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191337.924726:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xbd:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:3.0:1787191337.924732:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xbd:0x0](ffff936b489a9988) 00000002:00010000:3.0:1787191337.924738:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xbd:0x0]) in obj [0x200000405:0xbd:0x0], intent: layout flags 02 00010000:00010000:3.0:1787191337.924750:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884839be1 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xbd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4603f00 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191337.924760:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xbd:0x0]: losing layout lock 00010000:00010000:3.0:1787191337.924783:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884839be1 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xbd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4603f00 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191337.924788:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191337.924790:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884839be1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xbd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4603f00 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191337.925228:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839be8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xbd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.925234:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839be8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xbd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191337.925242:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191337.925247:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1c700 x1874004626599808/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191337.925253:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839be8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xbd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191337.925270:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626599808:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191337.925378:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787191337.940034:0:57570:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589936657 gen 1 00000100:00100000:3.0:1787191337.940135:0:57570:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b513bb100 x1874004626599040/t8589936654(8589936654) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191353 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787191337.940417:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626599808:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191337.940440:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839be8 lrc: 4/0,1 mode: --/EX res: [0x200000405:0xbd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603f0e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.940454:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839be8 lrc: 4/0,1 mode: --/CR res: [0x200000405:0xbd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603f0e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.940466:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839be8 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xbd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603f0e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.940478:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839be8 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xbd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603f0e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.940562:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839be8 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xbd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603f0e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.940572:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839be8 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xbd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603f0e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.940579:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839be8 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xbd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603f0e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191337.940590:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b51d1c700 x1874004626599808/t8589936657(8589936657) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191353 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191337.940616:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839be8 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xbd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603f0e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191337.940627:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839be8 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xbd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603f0e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.940637:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/189 (0 0) 00000080:00200000:3.0:1787191337.940643:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xbd:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1787191337.940654:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xbd:0x0](ffff936b489a9988) for lock 0xe5129dc884839be8 00000080:00010000:3.0:1787191337.940662:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839be8 from it ffffa3fb41cab930 00010000:00010000:3.0:1787191337.940666:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839be8 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xbd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603f0e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.940676:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839be8 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xbd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603f0e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191337.940694:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:3.0:1787191337.940702:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xbd:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:3.0:1787191337.940718:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839be8 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xbd:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603f0e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191337.940729:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839be8 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xbd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603f0e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:3.0:1787191337.940738:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xbd:0x0](00000000fb2aac00) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839be8 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xbd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603f0e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191337.940786:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839be8 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xbd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603f0e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191337.940794:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839be8 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xbd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603f0e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191337.940808:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xbd:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00020000:00200000:3.0:1787191337.940818:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xbd:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191337.940821:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191337.940826:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:3.0:1787191337.941671:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xbd:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:3.0:1787191337.941695:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839be8 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xbd:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603f0e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191337.941708:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839be8 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xbd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603f0e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:3.0:1787191337.941716:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xbd:0x0](00000000fb2aac00) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839be8 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xbd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603f0e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191337.941743:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xbd:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1787191337.941750:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xbd:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191337.941754:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191337.941757:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:3.0:1787191337.941772:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xbd:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191337.942696:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xbd:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:3.0:1787191337.942708:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839be8 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xbd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4603f0e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191337.942720:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839be8 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xbd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603f0e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00020000:00200000:3.0:1787191337.942740:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xbd:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:3.0:1787191337.942744:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xbd:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191337.942747:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191337.942755:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191337.942769:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1787191337.942772:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:3.0:1787191337.942784:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:3.0:1787191337.942789:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b5235c1b0, osc lock ffff936b44f64130, flags 0x80000000 00000008:00010000:3.0:1787191337.942793:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:3.0:1787191337.942794:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b5235c1f0, osc lock ffff936b44f64d10, flags 0x80000000 00010000:00010000:3.0:1787191337.942875:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000729b914c/0xe5129dc884839bef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.942885:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000729b914c/0xe5129dc884839bef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.942896:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000729b914c/0xe5129dc884839bef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191337.943104:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626599936:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191337.943205:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ce40 going to sleep for 11 seconds 00000080:00200080:1.0:1787191337.943487:0:57843:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xbc:0x0](ffff936b53969988) cmd=400866b1 arg=1 00000080:00200008:1.0:1787191337.943500:0:57843:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xbc:0x0](ffff936b53969988), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191337.943507:0:57843:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xbc:0x0](ffff936b53969988),name=f70.sanity-flr 00000002:00010000:1.0:1787191337.943527:0:57843:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xbc:0x0]) in obj [0x200000405:0xbc:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191337.943539:0:57843:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc884839bb0 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603e6d expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191337.943553:0:57843:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc884839bb0 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603e6d expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191337.943561:0:57843:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xbc:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191337.943571:0:57843:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xbc:0x0](ffff936b53969988) 00000080:00010000:1.0:1787191337.943575:0:57843:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xbc:0x0](ffff936b53969988) for lock 0xe5129dc884839bb0 00000080:00010000:1.0:1787191337.943580:0:57843:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839bb0 from it ffffa3fb42173cd8 00010000:00010000:1.0:1787191337.943583:0:57843:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc884839bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4603e6d expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191337.943598:0:57843:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc884839bb0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603e6d expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191337.943619:0:57843:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xbc:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:1.0:1787191337.943628:0:57843:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xbc:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191337.943631:0:57843:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191337.943634:0:57843:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xbc:0x0] 00000008:00010000:1.0:1787191337.943647:0:57843:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191337.943650:0:57843:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b47d7dab0, osc lock ffff936b46837690, flags 0x400000400001002 00010000:00010000:1.0:1787191337.943663:0:57843:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191337.943674:0:57843:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1787191337.943686:0:57843:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191337.943690:0:57843:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191337.943698:0:57843:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1787191337.943709:0:57843:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191337.943718:0:57843:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xbc:0x0] updating i_size 5 i_blocks 8 00000020:00010000:1.0:1787191337.943722:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b516579d0 (ffff936b465cc7e8/0) at cl_lock_release():245 00000020:00010000:1.0:1787191337.943725:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b516579d0 (ffff936b465cc7e8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191337.943728:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7dab0 (ffff936b465cc368/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191337.943732:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b516579d0 (ffff936b465cc7e8/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191337.943735:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7dab0 (ffff936b465cc7e8/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191337.943746:0:57843:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xbc:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1787191337.943761:0:57843:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xbc:0x0], offset: 0, type: SEEK_DATA 00000080:00200000:1.0:1787191337.954117:0:57843:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xbc:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00000100:00100000:1.0:1787191337.954502:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626600064:192.168.202.101@tcp:23:lfs.0 00000100:00100000:3.0:1787191337.956716:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626599936:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191337.956742:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000729b914c/0xe5129dc884839bef lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603f15 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.956762:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000729b914c/0xe5129dc884839bef lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4603f15 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.956789:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000729b914c/0xe5129dc884839bef lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4603f15 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.956803:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000729b914c/0xe5129dc884839bef lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4603f15 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191337.956813:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000729b914c/0xe5129dc884839bef lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4603f15 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.956824:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000729b914c/0xe5129dc884839bef lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4603f15 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.956869:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000729b914c/0xe5129dc884839bef lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4603f15 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.956931:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc884839bf6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.956941:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc884839bf6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.956962:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc884839bf6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191337.956984:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626600192:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191337.957038:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ce40 going to sleep for 11 seconds 00000020:00010000:2.0:1787191337.957227:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b42ff64e8 (ffff936b465cc7e8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191337.957243:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42ff64e8 (ffff936b465cc7e8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191337.957247:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b46b504b0 (ffff936b47a17ea8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191337.957254:0:57843:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191337.957264:0:57843:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00010000:2.0:1787191337.957276:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42ff64e8 (ffff936b465cc7e8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191337.957279:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b46b504b0 (ffff936b465cc7e8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191337.957316:0:57843:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xbc:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191337.957338:0:57843:0:(file.c:5244:ll_file_seek()) COMPLETED file f70.sanity-flr:[0x200000405:0xbc:0x0], offset: 0, type: SEEK_DATA, rc = 0 00000080:00200008:2.0:1787191337.957350:0:57843:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xbc:0x0], offset: 0, type: SEEK_HOLE 00000080:00200000:2.0:1787191337.957357:0:57843:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xbc:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191337.957366:0:57843:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xbc:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191337.957369:0:57843:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191337.957374:0:57843:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191337.957382:0:57843:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191337.957397:0:57843:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xbc:0x0] updating i_size 5 i_blocks 8 00000080:00200000:2.0:1787191337.957402:0:57843:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xbc:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191337.957407:0:57843:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000080:00200000:2.0:1787191337.957410:0:57843:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xbc:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191337.957414:0:57843:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191337.957418:0:57843:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191337.957420:0:57843:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:2.0:1787191337.957431:0:57843:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:2.0:1787191337.957435:0:57843:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1f30, osc lock ffff936b44e62980, flags 0x0 00010000:00010000:2.0:1787191337.957447:0:57843:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191337.957458:0:57843:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191337.957468:0:57843:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191337.957476:0:57843:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191337.957482:0:57843:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191337.957491:0:57843:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xbc:0x0] updating i_size 5 i_blocks 8 00000100:00100000:2.0:1787191337.957531:0:2392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787191337.957542:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626600320:192.168.202.101@tcp:23:lfs.0 00000100:00100000:2.0:1787191337.963367:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626600320:192.168.202.101@tcp:23:lfs.0 00000100:00100000:3.0:1787191337.965278:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626600192:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191337.965297:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc884839bf6 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603f1c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.965314:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc884839bf6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4603f1c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.965327:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc884839bf6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4603f1c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.965339:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc884839bf6 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4603f1c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191337.965350:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc884839bf6 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4603f1c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.965361:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc884839bf6 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4603f1c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191337.965368:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc884839bf6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4603f1c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191337.965455:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787191337.965467:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626600576:192.168.202.101@tcp:10:bash.0 00000100:00100000:3.0:1787191337.965535:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626600704:192.168.202.101@tcp:10:bash.0 00000080:00200000:2.0:1787191337.976684:0:57843:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1787191337.976698:0:57843:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xbc:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191337.976702:0:57843:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 1 io complete with rc: 0, result: 5, restart: 0 00000020:00200000:2.0:1787191337.976705:0:57843:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191337.976713:0:57843:0:(file.c:2324:ll_file_io_generic()) iot: 1, result: 5 00000080:00200080:2.0:1787191337.976731:0:57843:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xbc:0x0](ffff936b53969988) cmd=400866b1 arg=0 00000080:00200080:2.0:1787191337.976742:0:57843:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xbc:0x0](ffff936b53969988) cmd=400866b1 arg=2 00000080:00200008:2.0:1787191337.976748:0:57843:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xbc:0x0](ffff936b53969988), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191337.976756:0:57843:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xbc:0x0](ffff936b53969988),name=f70.sanity-flr 00000002:00010000:2.0:1787191337.976776:0:57843:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xbc:0x0]) in obj [0x200000405:0xbc:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191337.976792:0:57843:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc884839bb0 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603e6d expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191337.976807:0:57843:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc884839bb0 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603e6d expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191337.976815:0:57843:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xbc:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191337.976823:0:57843:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xbc:0x0](ffff936b53969988) 00000080:00010000:2.0:1787191337.976826:0:57843:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xbc:0x0](ffff936b53969988) for lock 0xe5129dc884839bb0 00000080:00010000:2.0:1787191337.977158:0:57843:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839bb0 from it ffffa3fb42173cd8 00010000:00010000:2.0:1787191337.977164:0:57843:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc884839bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4603e6d expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191337.977174:0:57843:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc884839bb0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603e6d expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:2.0:1787191337.977204:0:57843:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xbc:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:2.0:1787191337.977214:0:57843:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xbc:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191337.977218:0:57843:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191337.977221:0:57843:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xbc:0x0] 00000008:00010000:2.0:1787191337.977240:0:57843:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191337.977243:0:57843:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1d30, osc lock ffff936b44e62130, flags 0x400000400001002 00010000:00010000:2.0:1787191337.977259:0:57843:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00010000:00010000:2.0:1787191337.977272:0:57843:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00000020:00200000:2.0:1787191337.977282:0:57843:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191337.977285:0:57843:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00010000:00010000:2.0:1787191337.977293:0:57843:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 1 00000020:00200000:2.0:1787191337.977302:0:57843:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191337.977311:0:57843:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xbc:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191337.977315:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c38000 (ffff936b47a17998/0) at cl_lock_release():245 00000020:00010000:2.0:1787191337.977318:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c38000 (ffff936b47a17998/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191337.977321:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1d30 (ffff936b47a17a28/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191337.977325:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c38000 (ffff936b47a17998/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191337.977327:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1d30 (ffff936b47a17998/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191337.977336:0:57843:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xbc:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191337.977358:0:57843:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xbc:0x0], ppos: 0, count: 4096 00000080:00200000:2.0:1787191337.977364:0:57843:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 4096 00000080:00200000:2.0:1787191337.977372:0:57843:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 2 00000020:00200000:2.0:1787191337.977378:0:57843:0:(cl_io.c:214:cl_io_rw_init()) header@00000000e826995f[0x110, 2, [0x200000405:0xbc:0x0] hash] 00000020:00200000:2.0:1787191337.977380:0:57843:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 4096) 2048 0 00000080:00200000:2.0:1787191337.977383:0:57843:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xbc:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00000080:00200000:2.0:1787191337.977392:0:57843:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1787191337.977399:0:57843:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:2.0:1787191337.977403:0:57843:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x11 00000080:00200000:2.0:1787191337.977416:0:57843:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:2.0:1787191337.977424:0:57843:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:2.0:1787191337.977427:0:57843:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1d30, osc lock ffff936b44e62130, flags 0x40000 00000080:00200000:2.0:1787191337.977434:0:57843:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 4096) append 0 append lockpos 0 00000002:00010000:2.0:1787191337.977457:0:57843:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xbc:0x0], intent: getxattr flags 0 00010000:00010000:2.0:1787191337.977493:0:57843:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839bfd lrc: 3/1,0 mode: --/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.977502:0:57843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839bfd lrc: 3/1,0 mode: --/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.977512:0:57843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839bfd lrc: 3/1,0 mode: --/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191337.977530:0:57843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57843:1874004626600832:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191337.977605:0:57843:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191337.979465:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626600576:192.168.202.101@tcp:10:bash.0 00000100:00100000:3.0:1787191337.979506:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626600704:192.168.202.101@tcp:10:bash.0 00000100:00100000:2.0:1787191337.980628:0:57843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57843:1874004626600832:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191337.980647:0:57843:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839bfd lrc: 4/1,0 mode: --/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603f31 expref: -99 pid: 57843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.980662:0:57843:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839bfd lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603f31 expref: -99 pid: 57843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.980674:0:57843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839bfd lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603f31 expref: -99 pid: 57843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191337.980688:0:57843:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b513ba680 x1874004626600832/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1408 e 0 to 0 dl 1787191353 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191337.980700:0:57843:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839bfd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603f31 expref: -99 pid: 57843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.980711:0:57843:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/188 (0 0) 00000080:00200000:2.0:1787191337.980717:0:57843:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xbc:0x0] suppgids 0 -1: rc 0 00000080:00010000:2.0:1787191337.980734:0:57843:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xbc:0x0](ffff936b53969988) for lock 0xe5129dc884839bfd 00000080:00010000:2.0:1787191337.980741:0:57843:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839bfd from it ffffa3fb421738e8 00010000:00010000:2.0:1787191337.980743:0:57843:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839bfd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603f31 expref: -99 pid: 57843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191337.980749:0:57843:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5800/0xe5129dc884839bfd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603f31 expref: -99 pid: 57843 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191337.980775:0:57843:0:(rw26.c:362:ll_direct_IO()) VFS Op:inode=[0x200000405:0xbc:0x0](ffff936b53969988), size=4096 (max 536870912), offset=0=0x0, pages 1 (max 131072), lockless, parallel 00000020:00200000:2.0:1787191337.980828:0:57843:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1787191337.980979:0:57843:0:(rw26.c:544:ll_direct_IO()) result 0 tot_bytes 4096 count 4096 file_offset 4096 00000080:00200000:2.0:1787191337.980991:0:57843:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xbc:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191337.980994:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b53cc5b78 (ffff936b47a17998/0) at cl_lock_release():245 00000020:00010000:2.0:1787191337.980996:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b53cc5b78 (ffff936b47a17998/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191337.980998:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1d30 (ffff936b47a17a28/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191337.981001:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b53cc5b78 (ffff936b47a17998/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191337.981003:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1d30 (ffff936b47a17998/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191337.981008:0:57843:0:(vvp_io.c:533:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:2.0:1787191337.981013:0:57843:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1787191337.981028:0:25580:0:(osc_cache.c:2029:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff936b466993c0 00000008:00100000:2.0:1787191337.981117:0:25580:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff936b513ba680 - object 0x2c0000401:420 offset 0<>4096 00000100:00100000:3.0:1787191337.981239:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626600960:192.168.202.101@tcp:4:lfs.0 00000100:00100000:3.0:1787191337.989641:0:2392:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-ffff936b581fb000: committing for last_committed 17179870272 gen 1 00000008:00010000:3.0:1787191337.989760:0:2392:0:(osc_cache.c:917:osc_extent_finish()) ### no dlm lock: extent: ffff936b466993c0 00000020:00200000:3.0:1787191337.989769:0:2392:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1787191337.989778:0:2392:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1787191337.989794:0:2392:0:(osc_cache.c:497:__osc_extent_remove()) ### no dlm lock: extent: ffff936b466993c0 00000100:00100000:3.0:1787191337.989816:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626600960:192.168.202.101@tcp:4:lfs.0 00000080:00200000:2.0:1787191337.992359:0:57843:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1787191337.992381:0:57843:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xbc:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191337.992387:0:57843:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:2.0:1787191337.992398:0:57843:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xbc:0x0] updating i_size 5 i_blocks 8 00000020:00200000:2.0:1787191337.992402:0:57843:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191337.992415:0:57843:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200080:2.0:1787191337.992434:0:57843:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xbc:0x0](ffff936b53969988) cmd=400866b1 arg=0 00000080:00200080:2.0:1787191337.992442:0:57843:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xbc:0x0](ffff936b53969988) cmd=400866b1 arg=1 00000080:00200008:2.0:1787191337.992448:0:57843:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xbc:0x0](ffff936b53969988), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191337.992456:0:57843:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xbc:0x0](ffff936b53969988),name=f70.sanity-flr 00000002:00010000:2.0:1787191337.992481:0:57843:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xbc:0x0]) in obj [0x200000405:0xbc:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191337.992516:0:57843:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc884839bb0 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603e6d expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191337.992535:0:57843:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc884839bb0 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603e6d expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:2.0:1787191337.992543:0:57843:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xbc:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191337.992553:0:57843:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xbc:0x0](ffff936b53969988) 00000080:00010000:2.0:1787191337.992556:0:57843:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xbc:0x0](ffff936b53969988) for lock 0xe5129dc884839bb0 00000080:00010000:2.0:1787191337.992564:0:57843:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839bb0 from it ffffa3fb42173cd8 00010000:00010000:2.0:1787191337.992568:0:57843:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc884839bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4603e6d expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191337.992583:0:57843:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc884839bb0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603e6d expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00000080:00200000:2.0:1787191337.992607:0:57843:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xbc:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:2.0:1787191337.992617:0:57843:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xbc:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191337.992621:0:57843:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191337.992624:0:57843:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xbc:0x0] 00000008:00010000:2.0:1787191337.992647:0:57843:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191337.992651:0:57843:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1d30, osc lock ffff936b44e62130, flags 0x400000400001002 00010000:00010000:2.0:1787191337.992668:0:57843:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 1 00010000:00010000:2.0:1787191337.992680:0:57843:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 1 00000020:00200000:2.0:1787191337.992691:0:57843:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191337.992694:0:57843:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 1 00010000:00010000:2.0:1787191337.992701:0:57843:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00000020:00200000:2.0:1787191337.992711:0:57843:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191337.992716:0:57843:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xbc:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191337.992720:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c38000 (ffff936b47a17998/0) at cl_lock_release():245 00000020:00010000:2.0:1787191337.992723:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c38000 (ffff936b47a17998/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191337.992727:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1d30 (ffff936b47a17a28/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191337.992730:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c38000 (ffff936b47a17998/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191337.992733:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1d30 (ffff936b47a17998/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191337.992742:0:57843:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xbc:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191337.992752:0:57843:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xbc:0x0], offset: 5, type: SEEK_DATA 00000080:00200000:2.0:1787191337.992757:0:57843:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xbc:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:2.0:1787191337.992761:0:57843:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xbc:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191337.992764:0:57843:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191337.992768:0:57843:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191337.992773:0:57843:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191337.992786:0:57843:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xbc:0x0] updating i_size 5 i_blocks 8 00000080:00200000:2.0:1787191337.992794:0:57843:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xbc:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191337.992799:0:57843:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000080:00200000:2.0:1787191337.992801:0:57843:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xbc:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191337.992806:0:57843:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191337.992809:0:57843:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191337.992811:0:57843:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:2.0:1787191337.992817:0:57843:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:2.0:1787191337.992819:0:57843:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1d30, osc lock ffff936b44e62130, flags 0x0 00010000:00010000:2.0:1787191337.992827:0:57843:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:2.0:1787191337.993096:0:57843:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:2.0:1787191337.993107:0:57843:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:2.0:1787191337.993115:0:57843:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:2.0:1787191337.993123:0:57843:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00000080:00200000:2.0:1787191337.993135:0:57843:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xbc:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191337.993139:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b53cc5b78 (ffff936b47a17998/0) at cl_lock_release():245 00000020:00010000:2.0:1787191337.993142:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b53cc5b78 (ffff936b47a17998/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191337.993145:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1d30 (ffff936b47a17a28/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191337.993149:0:57843:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:2.0:1787191337.993157:0:57843:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00000020:00010000:2.0:1787191337.993166:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b53cc5b78 (ffff936b47a17998/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191337.993168:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1d30 (ffff936b47a17998/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191337.993176:0:57843:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xbc:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191337.993183:0:57843:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xbc:0x0], offset: 0, type: (null) 00000080:00200000:2.0:1787191337.993188:0:57843:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xbc:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:2.0:1787191337.993192:0:57843:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xbc:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191337.993195:0:57843:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191337.993197:0:57843:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xbc:0x0] 00000008:00010000:2.0:1787191337.993204:0:57843:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191337.993207:0:57843:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1d30, osc lock ffff936b44e62130, flags 0x400000400001002 00010000:00010000:2.0:1787191337.993216:0:57843:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00010000:00010000:2.0:1787191337.993230:0:57843:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00000020:00200000:2.0:1787191337.993238:0:57843:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191337.993241:0:57843:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00010000:00010000:2.0:1787191337.993249:0:57843:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00000020:00200000:2.0:1787191337.993258:0:57843:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191337.993263:0:57843:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xbc:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191337.993265:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c38000 (ffff936b47a17998/0) at cl_lock_release():245 00000020:00010000:2.0:1787191337.993268:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c38000 (ffff936b47a17998/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191337.993270:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1d30 (ffff936b47a17a28/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191337.993273:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c38000 (ffff936b47a17998/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191337.993275:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1d30 (ffff936b47a17998/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191337.993281:0:57843:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xbc:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191337.993288:0:57843:0:(file.c:5244:ll_file_seek()) COMPLETED file f70.sanity-flr:[0x200000405:0xbc:0x0], offset: 0, type: (null), rc = 5 00000080:00200080:2.0:1787191337.993294:0:57843:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xbc:0x0](ffff936b53969988) cmd=400866b1 arg=0 00000080:00200080:2.0:1787191338.010410:0:57843:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xbc:0x0](ffff936b53969988) cmd=400866b1 arg=2 00000080:00200008:2.0:1787191338.010429:0:57843:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xbc:0x0](ffff936b53969988), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191338.010438:0:57843:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xbc:0x0](ffff936b53969988),name=f70.sanity-flr 00000002:00010000:2.0:1787191338.010460:0:57843:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xbc:0x0]) in obj [0x200000405:0xbc:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191338.010477:0:57843:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc884839bb0 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603e6d expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00010000:00010000:2.0:1787191338.010493:0:57843:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc884839bb0 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603e6d expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00000080:00200000:2.0:1787191338.010502:0:57843:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xbc:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191338.010509:0:57843:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xbc:0x0](ffff936b53969988) 00000080:00010000:2.0:1787191338.010513:0:57843:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xbc:0x0](ffff936b53969988) for lock 0xe5129dc884839bb0 00000080:00010000:2.0:1787191338.010521:0:57843:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839bb0 from it ffffa3fb42173cd8 00010000:00010000:2.0:1787191338.010525:0:57843:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc884839bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4603e6d expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00010000:00010000:2.0:1787191338.010534:0:57843:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc884839bb0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603e6d expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00000080:00200000:2.0:1787191338.010563:0:57843:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xbc:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:2.0:1787191338.010575:0:57843:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xbc:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191338.010578:0:57843:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191338.010582:0:57843:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xbc:0x0] 00000008:00010000:2.0:1787191338.010602:0:57843:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191338.010604:0:57843:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1d30, osc lock ffff936b44e62130, flags 0x400000400001002 00010000:00010000:2.0:1787191338.010619:0:57843:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00010000:00010000:2.0:1787191338.010630:0:57843:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00000020:00200000:2.0:1787191338.010641:0:57843:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191338.010645:0:57843:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00010000:00010000:2.0:1787191338.010652:0:57843:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00000020:00200000:2.0:1787191338.010662:0:57843:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191338.010672:0:57843:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xbc:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191338.010677:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c38000 (ffff936b47a17998/0) at cl_lock_release():245 00000020:00010000:2.0:1787191338.010679:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c38000 (ffff936b47a17998/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191338.010682:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1d30 (ffff936b47a17a28/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191338.010686:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c38000 (ffff936b47a17998/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191338.010688:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1d30 (ffff936b47a17998/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191338.010700:0:57843:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xbc:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191338.010727:0:57843:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xbc:0x0](ffff936b53969988) current size 5, valid attrs 2068, mode 0, uid -1322410190, gid -1, new size 5, atime 1787191338.000000000, mtime 1787191338.000000000, ctime 1787191338.000000000 00010000:00010000:2.0:1787191338.010747:0:57843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc884839bb0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4603e6d expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00010000:00010000:2.0:1787191338.010759:0:57843:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caee00/0xe5129dc884839ba2 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xbc:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603e51 expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191338.010797:0:57843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc884839bb0 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4603e6d expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00010000:00010000:2.0:1787191338.010803:0:57843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191338.010806:0:57843:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc884839bb0 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xbc:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4603e6d expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00000020:00100000:2.0:1787191338.012092:0:57843:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1787191338.012101:0:57843:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb480 x1874004626601728/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787191338.012123:0:57843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57843:1874004626601728:192.168.202.101@tcp:36:lfs.0 00000100:00100000:2.0:1787191338.012196:0:57843:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787191338.017818:0:57843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57843:1874004626601728:192.168.202.101@tcp:36:lfs.0 00000080:00200000:2.0:1787191338.018825:0:57843:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 2 00000080:00200000:2.0:1787191338.019149:0:57843:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xbc:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:2.0:1787191338.019174:0:57843:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x11 00000080:00200000:2.0:1787191338.019195:0:57843:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:2.0:1787191338.019208:0:57843:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1787191338.019212:0:57843:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b52359e70, osc lock ffff936b44e62130, flags 0x0 00000008:00010000:2.0:1787191338.019216:0:57843:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1787191338.019218:0:57843:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b52359eb0, osc lock ffff936b44e63a20, flags 0x0 00010000:00010000:2.0:1787191338.019276:0:57843:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc884839c0b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.019291:0:57843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc884839c0b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.019302:0:57843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc884839c0b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191338.019320:0:57843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57843:1874004626601984:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191338.019429:0:57843:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359780 going to sleep for 11 seconds 00000100:00100000:2.0:1787191338.023263:0:57843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57843:1874004626601984:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191338.023300:0:57843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc884839c0b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603f7e expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.023319:0:57843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc884839c0b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603f7e expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.023334:0:57843:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc884839c0b lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603f7e expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1787191338.023346:0:57843:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 4096, setting rss=4096; kms=4096, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc884839c0b lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4603f7e expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.023360:0:57843:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc884839c0b lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4603f7e expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.023368:0:57843:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc884839c0b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4603f7e expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.023439:0:57843:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884839c12 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.023448:0:57843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884839c12 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.023458:0:57843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884839c12 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191338.023477:0:57843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57843:1874004626602112:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191338.023551:0:57843:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359780 going to sleep for 11 seconds 00000100:00100000:2.0:1787191338.032566:0:57843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57843:1874004626602112:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191338.032603:0:57843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884839c12 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603f85 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.032623:0:57843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884839c12 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603f85 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.032643:0:57843:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884839c12 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603f85 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1787191338.032655:0:57843:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884839c12 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4603f85 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.032669:0:57843:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884839c12 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4603f85 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.032677:0:57843:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884839c12 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4603f85 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191338.032855:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626602240:192.168.202.101@tcp:10:lfs.0 00000100:00100000:3.0:1787191338.033147:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787191338.033155:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626602368:192.168.202.101@tcp:10:lfs.0 00000080:00200000:1.0:1787191338.035440:0:57847:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191338.035476:0:57847:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.035495:0:57847:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.035510:0:57847:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.035519:0:57847:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.035527:0:57847:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.035530:0:57847:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.035538:0:57847:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4211bb58 00010000:00010000:1.0:1787191338.035542:0:57847:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.035551:0:57847:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.035567:0:57847:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.035575:0:57847:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:1.0:1787191338.035582:0:57847:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.035593:0:57847:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:1.0:1787191338.035597:0:57847:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191338.035610:0:57847:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191338.035741:0:57847:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c19 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.035749:0:57847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c19 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.035760:0:57847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c19 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.035787:0:57847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b5058ed80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57847:1874004626602496:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.036108:0:57847:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893180 going to sleep for 11 seconds 00000100:00100000:3.0:1787191338.037606:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626602240:192.168.202.101@tcp:10:lfs.0 00000100:00100000:3.0:1787191338.040259:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626602368:192.168.202.101@tcp:10:lfs.0 00000100:00100000:1.0:1787191338.040302:0:57847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b5058ed80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57847:1874004626602496:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191338.040319:0:57847:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c19 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00000080:00200000:2.0:1787191338.040327:0:57843:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xbc:0x0] updating i_size 5 i_blocks 8 00010000:00010000:1.0:1787191338.040332:0:57847:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c19 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00010000:2.0:1787191338.040333:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b53cc5b78 (ffff936b47a17998/0) at cl_lock_release():245 00000020:00010000:2.0:1787191338.040337:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b53cc5b78 (ffff936b47a17998/0) at cl_lock_cancel():142 00010000:00010000:1.0:1787191338.040339:0:57847:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c19 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00010000:2.0:1787191338.040342:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b52359e70 (ffff936b47a17a28/1) at cl_lock_cancel():142 00010000:00010000:1.0:1787191338.040346:0:57847:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c19 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.040351:0:57843:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc884839c0b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4603f7e expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.040355:0:57847:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c19 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.040363:0:57843:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc884839c0b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4603f7e expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.040367:0:57847:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b587bce00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191338.040372:0:57847:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c19 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.040378:0:57847:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c19 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00010000:2.0:1787191338.040379:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b52359eb0 (ffff936b47a17ab8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191338.040383:0:57843:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884839c12 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4603f85 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.040386:0:57847:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c19 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.040393:0:57847:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191338.040393:0:57843:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884839c12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4603f85 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.040399:0:57847:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c19 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00010000:2.0:1787191338.040401:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b53cc5b78 (ffff936b47a17998/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191338.040404:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b52359e70 (ffff936b47a17998/1) at cl_lock_fini():72 00010000:00010000:1.0:1787191338.040405:0:57847:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c19 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00010000:2.0:1787191338.040408:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b52359eb0 (ffff936b47a17998/1) at cl_lock_fini():72 00000002:00100000:1.0:1787191338.040428:0:57847:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b5058ed80 x1874004626602496/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191338.040428:0:57843:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xbc:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191338.040440:0:57843:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xbc:0x0](ffff936b53969988) current size 5, valid attrs 10002168, mode 0, uid -1322410190, gid -1, new size 5, atime 1787191338.000000000, mtime 1787191338.000000000, ctime 1787191338.000000000, rc 0 00000080:00200000:1.0:1787191338.040443:0:57847:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200080:2.0:1787191338.040458:0:57843:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xbc:0x0](ffff936b53969988) cmd=400866b1 arg=0 00000080:00200008:2.0:1787191338.040484:0:57843:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xbc:0x0](ffff936b53969988) current size 5, valid attrs 101f0, mode a3fb, uid 1628899440, gid -27797, new size 18446624687906003336, atime 1787191337.000000000, mtime 1787191337.000000000, ctime 1787191338.000000000 00000080:00200000:1.0:1787191338.040519:0:57847:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191338.040530:0:57847:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00000020:00100000:2.0:1787191338.040531:0:57843:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1787191338.040537:0:57843:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bad80 x1874004626602752/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1787191338.040541:0:57847:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.040551:0:57847:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.040556:0:57847:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000100:00100000:2.0:1787191338.040558:0:57843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57843:1874004626602752:192.168.202.101@tcp:36:lfs.0 00000080:00010000:1.0:1787191338.040562:0:57847:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.040565:0:57847:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.040570:0:57847:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4211bbe8 00010000:00010000:1.0:1787191338.040573:0:57847:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.040579:0:57847:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.040588:0:57847:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.040593:0:57847:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000080:00200000:1.0:1787191338.040599:0:57847:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.040611:0:57847:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:1.0:1787191338.040616:0:57847:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191338.040629:0:57847:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191338.040660:0:57847:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839c20 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.040667:0:57847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839c20 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191338.040671:0:57843:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359e40 going to sleep for 11 seconds 00010000:00010000:1.0:1787191338.040676:0:57847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839c20 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.040688:0:57847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b5058ed80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57847:1874004626602880:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.040713:0:57847:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893180 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.046013:0:57847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b5058ed80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57847:1874004626602880:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191338.046028:0:57847:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839c20 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.046040:0:57847:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839c20 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.046047:0:57847:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839c20 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.046065:0:57847:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839c20 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.046073:0:57847:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839c20 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.046079:0:57847:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b587bde00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191338.046084:0:57847:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839c20 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.046090:0:57847:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839c20 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.046099:0:57847:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839c20 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.046105:0:57847:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191338.046112:0:57847:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839c20 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.046118:0:57847:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839c20 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.046142:0:57847:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b5058ed80 x1874004626602880/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191338.046235:0:57847:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191338.047032:0:57847:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191338.047051:0:57847:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.047072:0:57847:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.047084:0:57847:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.047092:0:57847:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.047097:0:57847:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.047100:0:57847:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.047106:0:57847:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4211bb58 00010000:00010000:1.0:1787191338.047110:0:57847:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.047118:0:57847:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.047129:0:57847:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.047136:0:57847:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:1.0:1787191338.047145:0:57847:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:1.0:1787191338.047243:0:57847:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:1.0:1787191338.047255:0:57847:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.047266:0:57847:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 72 lru_type: 1 00010000:00010000:1.0:1787191338.047331:0:57847:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 72 lru_type: 1 00000002:00010000:1.0:1787191338.047394:0:57847:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.047431:0:57847:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839c2e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.047439:0:57847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839c2e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.047450:0:57847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839c2e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.047467:0:57847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b5058ed80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57847:1874004626603136:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.047521:0:57847:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893180 going to sleep for 11 seconds 00000100:00100000:2.0:1787191338.050742:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191338.050777:0:51131:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787191338.050791:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634866304 00000100:00100000:2.0:1787191338.050797:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634866304 00000100:00100000:2.0:1787191338.050871:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1265 00000100:00100000:2.0:1787191338.052163:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b50883050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8720:x1874004634866304:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191338.052185:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:2.0:1787191338.052284:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191338.052291:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b50883050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8720:x1874004634866304:12345-192.168.202.101@tcp:104: Request processed in 155us (1557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191338.052298:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1265 00010000:00010000:1.0:1787191338.052590:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191338.052598:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:1.0:1787191338.052608:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cafe00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191338.052623:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800428400000000 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00000080:00200000:1.0:1787191338.052645:0:57627:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xbc:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1787191338.052659:0:57627:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xbc:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1787191338.052705:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400000020 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:1.0:1787191338.052718:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191338.052750:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400000020 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:1.0:1787191338.052759:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839bc5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1a0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400000020 nid: local remote: 0x7130d520e4603ea5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:1.0:1787191338.052775:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191338.052777:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191338.052778:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191338.052786:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787191338.052811:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b5058d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626603264:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191338.055063:0:57847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b5058ed80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57847:1874004626603136:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191338.055087:0:57847:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839c2e lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603fcb expref: -99 pid: 57847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.055100:0:57847:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839c2e lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603fcb expref: -99 pid: 57847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.055112:0:57847:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839c2e lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603fcb expref: -99 pid: 57847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.055123:0:57847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839c2e lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603fcb expref: -99 pid: 57847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.055135:0:57847:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839c2e lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603fcb expref: -99 pid: 57847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.055144:0:57847:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839c2e lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603fcb expref: -99 pid: 57847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.055160:0:57847:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839c2e lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603fcb expref: -99 pid: 57847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.055172:0:57847:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b5058ed80 x1874004626603136/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191338.055187:0:57847:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839c2e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603fcb expref: -99 pid: 57847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.055198:0:57847:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:1.0:1787191338.055207:0:57847:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839c2e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603fcb expref: -99 pid: 57847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.055214:0:57847:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839c2e lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603fcb expref: -99 pid: 57847 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:1.0:1787191338.055240:0:57847:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.055251:0:57847:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 144 lru_type: 1 00010000:00010000:1.0:1787191338.055262:0:57847:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 144 lru_type: 1 00010000:00010000:1.0:1787191338.055270:0:57847:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 144 lru_type: 1 00010000:00010000:1.0:1787191338.055288:0:57847:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 145 lru_type: 1 00000080:00200000:1.0:1787191338.055301:0:57847:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191338.055311:0:57847:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:1.0:1787191338.055315:0:57847:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:1.0:1787191338.055321:0:57847:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb4211bcb8 00010000:00010000:1.0:1787191338.055324:0:57847:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 72 lru_type: 1 00010000:00010000:1.0:1787191338.055341:0:57847:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 73 lru_type: 1 00000002:00010000:1.0:1787191338.055362:0:57847:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.055369:0:57847:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839c2e lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603fcb expref: -99 pid: 57847 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.055377:0:57847:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839c2e lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603fcb expref: -99 pid: 57847 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.055385:0:57847:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839c2e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603fcb expref: -99 pid: 57847 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.055393:0:57847:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839c2e lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603fcb expref: -99 pid: 57847 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:1.0:1787191338.055400:0:57847:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.055405:0:57847:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 145 lru_type: 1 00010000:00010000:1.0:1787191338.055413:0:57847:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 145 lru_type: 1 00010000:00010000:1.0:1787191338.055420:0:57847:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 145 lru_type: 1 00010000:00010000:1.0:1787191338.055427:0:57847:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 146 lru_type: 1 00000080:00200008:1.0:1787191338.056032:0:57847:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:1.0:1787191338.056039:0:57847:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191338.056065:0:57847:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.056075:0:57847:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.056085:0:57847:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.056092:0:57847:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.056098:0:57847:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.056101:0:57847:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.056106:0:57847:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4211bcb8 00010000:00010000:1.0:1787191338.056109:0:57847:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.056121:0:57847:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.056240:0:57847:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191338.056248:0:57847:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.056255:0:57847:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.056264:0:57847:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.056270:0:57847:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.056274:0:57847:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.056277:0:57847:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.056280:0:57847:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4211bb58 00010000:00010000:1.0:1787191338.056283:0:57847:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.056291:0:57847:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.056300:0:57847:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.056305:0:57847:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:1.0:1787191338.056311:0:57847:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.056321:0:57847:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:1.0:1787191338.056325:0:57847:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191338.056336:0:57847:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191338.056373:0:57847:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c35 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.056380:0:57847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c35 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.056390:0:57847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c35 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.056409:0:57847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b5058ed80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57847:1874004626603392:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.057604:0:57847:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893180 going to sleep for 11 seconds 00000100:00100000:3.0:1787191338.058044:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:1.0:1787191338.059533:0:57843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57843:1874004626603008:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191338.059564:0:57843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000002db1e9aa/0xe5129dc884839c27 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000020000 nid: local remote: 0x7130d520e4603fbd expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.059579:0:57843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000002db1e9aa/0xe5129dc884839c27 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e4603fbd expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.059588:0:57843:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000002db1e9aa/0xe5129dc884839c27 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e4603fbd expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191338.059997:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634866432 00000100:00100000:3.0:1787191338.060005:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634866432 00000100:00100000:3.0:1787191338.060096:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1266 00000100:00100000:3.0:1787191338.060106:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:6490:x1874004634866432:12345-192.168.202.101@tcp:105: 00010000:00010000:3.0:1787191338.060117:0:40922:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000002db1e9aa/0xe5129dc884839c27 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e4603fbd expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.060128:0:40922:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000002db1e9aa/0xe5129dc884839c27 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e4603fbd expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.060137:0:40922:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000002db1e9aa/0xe5129dc884839c27 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000020000 nid: local remote: 0x7130d520e4603fbd expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.060146:0:40922:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000002db1e9aa/0xe5129dc884839c27 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080000020000 nid: local remote: 0x7130d520e4603fbd expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.060154:0:40922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000002db1e9aa/0xe5129dc884839c27 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080000020000 nid: local remote: 0x7130d520e4603fbd expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.060164:0:40922:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000002db1e9aa/0xe5129dc884839c27 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000020000 nid: local remote: 0x7130d520e4603fbd expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.060191:0:40922:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b44caec00) 00010000:00010000:1.0:1787191338.060224:0:57843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000002db1e9aa/0xe5129dc884839c27 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e4603fbd expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.060233:0:57843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000002db1e9aa/0xe5129dc884839c27 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e4603fbd expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191338.060240:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:6490:x1874004634866432:12345-192.168.202.101@tcp:105: Request processed in 137us (2199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191338.060247:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1266 00010000:00010000:1.0:1787191338.060252:0:57843:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000002db1e9aa/0xe5129dc884839c27 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000020000 nid: local remote: 0x7130d520e4603fbd expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191338.060264:0:57843:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 5, setting rss=5; kms=5, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000002db1e9aa/0xe5129dc884839c27 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000020000 nid: local remote: 0x7130d520e4603fbd expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.060276:0:57843:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000002db1e9aa/0xe5129dc884839c27 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4603fbd expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.060284:0:57843:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000002db1e9aa/0xe5129dc884839c27 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4603fbd expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.060382:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b5058ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626603520:192.168.202.101@tcp:2:lfs.0 00000100:00100000:1.0:1787191338.060470:0:57847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b5058ed80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57847:1874004626603392:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191338.060481:0:57847:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c35 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.060491:0:57847:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c35 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.060497:0:57847:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c35 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.060504:0:57847:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c35 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.060515:0:57847:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c35 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.060521:0:57847:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b587bce00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191338.060526:0:57847:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c35 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.060533:0:57847:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c35 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.060539:0:57847:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c35 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.060546:0:57847:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191338.060552:0:57847:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c35 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.060558:0:57847:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c35 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.060575:0:57847:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b5058ed80 x1874004626603392/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191338.060589:0:57847:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1787191338.060629:0:57847:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839c2e lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603fcb expref: -99 pid: 57847 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191338.060639:0:57847:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839c2e lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603fcb expref: -99 pid: 57847 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:1.0:1787191338.060649:0:57847:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839c2e from it ffffa3fb4211b930 00010000:00010000:1.0:1787191338.060653:0:57847:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839c2e lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603fcb expref: -99 pid: 57847 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191338.060660:0:57847:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839c2e lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603fcb expref: -99 pid: 57847 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191338.060739:0:57847:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191338.060752:0:57847:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.060758:0:57847:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.060764:0:57847:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.060768:0:57847:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.060772:0:57847:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.060775:0:57847:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.060778:0:57847:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4211bbf8 00010000:00010000:1.0:1787191338.060780:0:57847:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.060785:0:57847:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.060792:0:57847:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.060797:0:57847:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191338.060800:0:57847:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.060805:0:57847:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:1.0:1787191338.060807:0:57847:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:1.0:1787191338.060810:0:57847:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b589fa900, open_flags a141, mode 81b6 opened 0 00000080:00200000:1.0:1787191338.060817:0:57847:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:1.0:1787191338.060863:0:57847:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xbf:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:1.0:1787191338.060874:0:57847:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839c2e lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4603fcb expref: -99 pid: 57847 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191338.060914:0:57847:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839c2e lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4603fcb expref: -99 pid: 57847 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191338.060922:0:57847:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191338.060925:0:57847:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839c2e lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4603fcb expref: -99 pid: 57847 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191338.060959:0:57847:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839c3c lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.060966:0:57847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839c3c lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191338.060992:0:57847:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191338.061000:0:57847:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b5058ed80 x1874004626603776/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191338.061008:0:57847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839c3c lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.061018:0:57847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b5058ed80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57847:1874004626603776:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.061417:0:57847:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893180 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.064579:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b5058d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626603264:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191338.066366:0:57847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b5058ed80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57847:1874004626603776:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.066367:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b5058ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626603520:192.168.202.101@tcp:2:lfs.0 00010000:00010000:2.0:1787191338.066392:0:57847:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839c3c lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603ffc expref: -99 pid: 57847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.066434:0:57847:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839c3c lrc: 4/0,1 mode: --/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603ffc expref: -99 pid: 57847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.066442:0:57847:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839c3c lrc: 4/0,1 mode: --/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603ffc expref: -99 pid: 57847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.066454:0:57847:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839c3c lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603ffc expref: -99 pid: 57847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.066466:0:57847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839c3c lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603ffc expref: -99 pid: 57847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.066480:0:57847:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839c3c lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603ffc expref: -99 pid: 57847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.066486:0:57847:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839c3c lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603ffc expref: -99 pid: 57847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.066492:0:57847:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839c3c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4603ffc expref: -99 pid: 57847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191338.066503:0:57847:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b5058ed80 x1874004626603776/t8589936662(8589936662) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191338.066517:0:57847:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b5058ed80 x1874004626603776/t8589936662(8589936662) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191338.066528:0:57847:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839c3c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4603ffc expref: -99 pid: 57847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.066540:0:57847:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/191 (0 0) 00000080:00200000:2.0:1787191338.066547:0:57847:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191338.066557:0:57847:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:2.0:1787191338.066587:0:57847:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xbf:0x0](ffff936b48989988) 00000080:00200000:2.0:1787191338.066593:0:57847:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xbf:0x0], updating i_size 0 00000080:00200000:2.0:1787191338.066624:0:57847:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xbf:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:2.0:1787191338.066627:0:57847:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xbf:0x0](ffff936b48989988) 00000080:00010000:2.0:1787191338.066631:0:57847:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xbf:0x0](ffff936b48989988) for lock 0xe5129dc884839c3c 00000080:00010000:2.0:1787191338.066640:0:57847:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xbf:0x0](ffff936b48989988) 00000080:00200008:2.0:1787191338.066653:0:57847:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xbf:0x0](ffff936b48989988), flags 120501 00000002:00100000:2.0:1787191338.066670:0:57847:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b5058ed80 x1874004626603776/t8589936662(8589936662) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1787191338.066706:0:57847:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839c3c from it ffff936b5339fd80 00010000:00010000:2.0:1787191338.066710:0:57847:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839c3c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4603ffc expref: -99 pid: 57847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.066718:0:57847:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839c3c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4603ffc expref: -99 pid: 57847 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191338.066734:0:57847:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xbf:0x0](ffff936b48989988), inode mode 81a4 mask 40 00000080:00200000:2.0:1787191338.066786:0:57847:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xbf:0x0](ffff936b48989988), inode mode 81a4 mask 2 00000080:00200000:2.0:1787191338.067099:0:57847:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xbf:0x0](ffff936b48989988), xattr lov 00000002:00010000:2.0:1787191338.067119:0:57847:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xbf:0x0]) in obj [0x200000405:0xbf:0x0], intent: open flags 040000002 00010000:00010000:2.0:1787191338.067158:0:57847:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839c43 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xbf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.067165:0:57847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839c43 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xbf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191338.067175:0:57847:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:2.0:1787191338.067181:0:57847:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9180 x1874004626604288/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191338.067190:0:57847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839c43 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xbf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191338.067202:0:57847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57847:1874004626604288:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191338.069442:0:57847:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359780 going to sleep for 11 seconds 00000100:00100000:3.0:1787191338.072951:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191338.073668:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634866560 00000100:00100000:2.0:1787191338.073680:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634866560 00000100:00100000:3.0:1787191338.073740:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1267 00000100:00100000:3.0:1787191338.073754:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634866560:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191338.073774:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839c3c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4603ffc expref: -99 pid: 57847 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.073894:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191338.073901:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634866560:12345-192.168.202.101@tcp:104: Request processed in 152us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191338.073908:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1267 00010000:00010000:1.0:1787191338.074004:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191338.074013:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839c3c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4603ffc expref: -99 pid: 57847 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.074022:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b587bd000 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191338.074027:0:40929:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839c3c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4603ffc expref: -99 pid: 57847 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.074047:0:40929:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839c3c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4603ffc expref: -99 pid: 57847 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.074066:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839c3c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4603ffc expref: -99 pid: 57847 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191338.074087:0:40929:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xbf:0x0]: losing layout lock 00010000:00010000:1.0:1787191338.074129:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839c3c lrc: 2/0,0 mode: --/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4603ffc expref: -99 pid: 57847 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.074136:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787191338.074230:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191338.074253:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634866688 00000100:00100000:3.0:1787191338.074257:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634866688 00000100:00100000:3.0:1787191338.074285:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1268 00000100:00100000:3.0:1787191338.074292:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6508:x1874004634866688:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191338.074302:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caee00/0xe5129dc884839ba2 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xbc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4603e51 expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191338.074481:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839c3c lrc: 1/0,0 mode: --/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4603ffc expref: -99 pid: 57847 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.074491:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839c3c lrc: 0/0,0 mode: --/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4603ffc expref: -99 pid: 57847 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.074507:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191338.074509:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191338.074511:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191338.074520:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1787191338.074581:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191338.074588:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6508:x1874004634866688:12345-192.168.202.101@tcp:104: Request processed in 296us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191338.074596:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1268 00000100:00100000:1.0:1787191338.074717:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b5058d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626604416:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191338.081919:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b5058d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626604416:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191338.083476:0:57847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57847:1874004626604288:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191338.083503:0:57847:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839c43 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xbf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.083521:0:57847:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839c43 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xbf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.083529:0:57847:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839c43 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xbf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.083538:0:57847:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839c43 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xbf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.083548:0:57847:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839c43 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xbf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.083554:0:57847:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd4400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191338.083558:0:57847:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839c43 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xbf:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.083566:0:57847:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839c43 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xbf:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.083574:0:57847:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839c43 lrc: 5/0,0 mode: --/CR res: [0x200000405:0xbf:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.083582:0:57847:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191338.083591:0:57847:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839c43 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xbf:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.083599:0:57847:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839c43 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xbf:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57847 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191338.083639:0:57847:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b513b9180 x1874004626604288/t8589936664(8589936664) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191338.083653:0:57847:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9180 x1874004626604288/t8589936664(8589936664) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191338.083669:0:57847:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xbf:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1787191338.083720:0:57847:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xbf:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1787191338.083731:0:57847:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xbf:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191338.083787:0:57847:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xbf:0x0], updating i_size 0 00000002:00100000:2.0:1787191338.083808:0:57847:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9180 x1874004626604288/t8589936664(8589936664) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191338.083895:0:57847:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513b9180 x1874004626604288/t8589936664(8589936664) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191338.083906:0:57847:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:2.0:1787191338.083912:0:57847:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb800 x1874004626604800/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191338.083932:0:57847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57847:1874004626604800:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191338.084016:0:57847:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359780 going to sleep for 11 seconds 00000100:00100000:2.0:1787191338.091215:0:57847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57847:1874004626604800:192.168.202.101@tcp:35:lfs.0 00000002:00100000:2.0:1787191338.091251:0:57847:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513b9180 x1874004626604288/t8589936664(8589936664) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:2.0:1787191338.091313:0:57847:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xbf:0x0](ffff936b48989988), flags 100001 00000002:00100000:2.0:1787191338.091363:0:57847:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b5058ed80 x1874004626603776/t8589936662(8589936662) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191354 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191338.091373:0:57847:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191338.091378:0:57847:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8a80 x1874004626605184/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191338.091400:0:57847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57847:1874004626605184:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191338.091477:0:57847:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359780 going to sleep for 11 seconds 00000100:00100000:3.0:1787191338.115386:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191338.115437:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191338.115463:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634867840 00000100:00100000:3.0:1787191338.115471:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634867840 00000100:00100000:3.0:1787191338.115511:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634867968 00000100:00100000:3.0:1787191338.115514:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634867968 00000100:00100000:3.0:1787191338.115527:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1269 00000100:00100000:3.0:1787191338.115536:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8419:x1874004634867840:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191338.115554:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc884839bf6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4603f1c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.115638:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191338.115645:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8419:x1874004634867840:12345-192.168.202.101@tcp:104: Request processed in 110us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191338.115652:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1269 00000100:00100000:3.0:1787191338.115668:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1270 00000100:00100000:3.0:1787191338.115674:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30511:x1874004634867968:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191338.115681:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000729b914c/0xe5129dc884839bef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4603f15 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191338.115719:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787191338.115724:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30511:x1874004634867968:12345-192.168.202.101@tcp:104: Request processed in 51us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191338.115730:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1270 00010000:00010000:1.0:1787191338.117653:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191338.117799:0:57847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57847:1874004626605184:192.168.202.101@tcp:35:lfs.0 00000002:00100000:2.0:1787191338.117858:0:57847:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b5058ed80 x1874004626603776/t8589936662(8589936662) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191338.124959:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191338.124988:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.125006:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.125022:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.125031:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.125039:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.125042:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.125050:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:1.0:1787191338.125063:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.125073:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.125091:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.125100:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191338.125106:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.125120:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:1.0:1787191338.125125:0:57570:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b589fbb00, open_flags 8241, mode 81b6 opened 0 00000080:00200000:1.0:1787191338.125134:0:57570:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:1.0:1787191338.125163:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xc0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0101102 00010000:00010000:1.0:1787191338.125221:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839c51 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.125231:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839c51 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191338.125245:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191338.125259:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b5058d180 x1874004626605696/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191338.125269:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839c51 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.125290:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b5058d180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626605696:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191338.125458:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893480 going to sleep for 11 seconds 00010000:00010000:1.0:1787191338.131121:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191338.131907:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b5058d180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626605696:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191338.131933:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839c51 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460405e expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.131964:0:57570:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839c51 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460405e expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.131973:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839c51 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460405e expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.131985:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839c51 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460405e expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.131996:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839c51 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460405e expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.132008:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839c51 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460405e expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.132017:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839c51 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460405e expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.132026:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839c51 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460405e expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.132037:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x2b, status=0 req@ffff936b5058d180 x1874004626605696/t8589936667(8589936667) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191338.132051:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b5058d180 x1874004626605696/t8589936667(8589936667) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191338.132077:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839c51 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460405e expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191338.132091:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839c51 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460405e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.132100:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/191 (0 0) 00000080:00200000:1.0:1787191338.132106:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191338.132165:0:57570:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xbf:0x0](ffff936b48989988): rc = 0 00000080:00200000:1.0:1787191338.132183:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xbf:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:1.0:1787191338.132190:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xbf:0x0](ffff936b48989988) for lock 0xe5129dc884839c51 00000080:00010000:1.0:1787191338.132202:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xbf:0x0](ffff936b48989988) 00000080:00200008:1.0:1787191338.132217:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xbf:0x0](ffff936b48989988), flags 101101 00000002:00100000:1.0:1787191338.132243:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b5058d180 x1874004626605696/t8589936667(8589936667) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191338.132278:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839c51 from it ffff936b5339f7e0 00010000:00010000:1.0:1787191338.132283:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839c51 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460405e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.132292:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839c51 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460405e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191338.132313:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xbf:0x0](ffff936b48989988), inode mode 81a4 mask 42 00000002:00010000:1.0:1787191338.132354:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xbf:0x0], intent: getxattr flags 0 00010000:00010000:1.0:1787191338.132392:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839c58 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.132399:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839c58 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.132408:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839c58 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.132428:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b5058c000 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626606080:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191338.132509:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893480 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.138923:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b5058c000 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626606080:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191338.138944:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839c58 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460407a expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.138976:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839c58 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460407a expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.139003:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839c58 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460407a expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.139023:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b5058c000 x1874004626606080/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191338.139043:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839c58 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460407a expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.139073:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/191 (0 0) 00000080:00200000:1.0:1787191338.139079:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xbf:0x0] suppgids 0 -1: rc 0 00000080:00010000:1.0:1787191338.139101:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xbf:0x0](ffff936b48989988) for lock 0xe5129dc884839c58 00000080:00010000:1.0:1787191338.139110:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839c58 from it ffffa3fb41caba38 00010000:00010000:1.0:1787191338.139116:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839c58 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460407a expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.139130:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839c58 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460407a expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:1.0:1787191338.139169:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xbf:0x0](ffff936b48989988) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191338.000000000, mtime 1787191338.000000000, ctime 1787191338.000000000 00010000:00010000:1.0:1787191338.139194:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839c51 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e460405e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191338.139227:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xbf:0x0]: losing layout lock 00010000:00010000:1.0:1787191338.139257:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839c51 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460405e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.139266:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191338.139269:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839c51 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460405e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1787191338.139292:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 36, max 7 00000100:00100000:1.0:1787191338.139301:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b5058c000 x1874004626606592/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787191338.139315:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b5058c000 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626606592:192.168.202.101@tcp:36:bash.0 00000100:00100000:1.0:1787191338.140473:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893480 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.150322:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b5058c000 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626606592:192.168.202.101@tcp:36:bash.0 00000080:00200000:1.0:1787191338.150360:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:1.0:1787191338.150369:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xbf:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:1.0:1787191338.150382:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xbf:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:1.0:1787191338.150389:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xbf:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191338.150393:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xbf:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:1.0:1787191338.150400:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xbf:0x0](ffff936b48989988) 00000002:00010000:1.0:1787191338.150409:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xbf:0x0]) in obj [0x200000405:0xbf:0x0], intent: layout flags 02 00010000:00010000:1.0:1787191338.150426:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafc00/0xe5129dc884839c5f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xbf:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4604088 expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191338.150446:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xbf:0x0]: losing layout lock 00010000:00010000:1.0:1787191338.150483:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafc00/0xe5129dc884839c5f lrc: 1/0,0 mode: --/CR res: [0x200000405:0xbf:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604088 expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.150490:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191338.150493:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafc00/0xe5129dc884839c5f lrc: 0/0,0 mode: --/CR res: [0x200000405:0xbf:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604088 expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.150514:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c6d lrc: 3/0,1 mode: --/EX res: [0x200000405:0xbf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.150520:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c6d lrc: 3/0,1 mode: --/EX res: [0x200000405:0xbf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191338.150529:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191338.150537:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b5058f480 x1874004626606976/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191338.150546:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c6d lrc: 3/0,1 mode: --/EX res: [0x200000405:0xbf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.150561:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b5058f480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626606976:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191338.150604:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893480 going to sleep for 11 seconds 00000100:00100000:2.0:1787191338.155599:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191338.155798:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634868096 00000100:00100000:3.0:1787191338.155807:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634868096 00000100:00100000:3.0:1787191338.155884:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1271 00000100:00100000:3.0:1787191338.155893:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634868096:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191338.155912:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc884839c66 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e46040a4 expref: -99 pid: 57843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.155986:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191338.155992:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634868096:12345-192.168.202.101@tcp:104: Request processed in 101us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191338.156003:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1271 00010000:00010000:1.0:1787191338.156089:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191338.156099:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc884839c66 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xbf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e46040a4 expref: -99 pid: 57843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.156111:0:40930:0:(ldlm_lockd.c:1935:ldlm_handle_bl_callback()) Lock ffff936b44caf000 is referenced, will be cancelled later 00010000:00010000:1.0:1787191338.156114:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc884839c66 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xbf:0x0].0x0 bits 0x2/0xa rrc: 4 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e46040a4 expref: -99 pid: 57843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.156121:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191338.156123:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191338.156124:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000002:00010000:1.0:1787191338.160633:0:57843:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc884839c66 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0xa rrc: 4 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e46040a4 expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.160646:0:57843:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/191 (0 0) 00000080:00200000:1.0:1787191338.160651:0:57843:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xbf:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787191338.160705:0:57843:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xbf:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:1.0:1787191338.160709:0:57843:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xbf:0x0](ffff936b48989988) for lock 0xe5129dc884839c66 00000080:00010000:1.0:1787191338.160713:0:57843:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xbf:0x0](ffff936b48989988) 00000080:00010000:1.0:1787191338.160715:0:57843:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839c66 from it ffffa3fb42173cd8 00010000:00010000:1.0:1787191338.160717:0:57843:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc884839c66 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0xa rrc: 4 type: IBT gid 0 flags: 0x10420400000000 nid: local remote: 0x7130d520e46040a4 expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.160723:0:57843:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc884839c66 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0xa rrc: 4 type: IBT gid 0 flags: 0x10420400000000 nid: local remote: 0x7130d520e46040a4 expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.160740:0:57843:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000080:00200000:1.0:1787191338.160759:0:57843:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xbf:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:1.0:1787191338.160768:0:57843:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xbf:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191338.160770:0:57843:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191338.160773:0:57843:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xbf:0x0] 00000008:00010000:1.0:1787191338.160902:0:57843:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191338.160906:0:57843:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b628937b0, osc lock ffff936b46837690, flags 0x400000400001002 00000008:00010000:1.0:1787191338.160912:0:57843:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191338.160914:0:57843:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b628937f0, osc lock ffff936b46836980, flags 0x400000400001002 00010000:00010000:1.0:1787191338.160953:0:57843:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a9aa9dbe/0xe5129dc884839c74 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.160967:0:57843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a9aa9dbe/0xe5129dc884839c74 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.160976:0:57843:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b5058ca80 x1874004626607232/t0(0) o101->lustre-OST0001-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191338.161016:0:57843:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000be535028/0xe5129dc884839c7b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.161027:0:57843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000be535028/0xe5129dc884839c7b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.161033:0:57843:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b5058e300 x1874004626607360/t0(0) o101->lustre-OST0000-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:1.0:1787191338.161043:0:57843:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 2 items remaining. 00000100:00100000:3.0:1787191338.170497:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191338.170535:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191338.170562:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:1.0:1787191338.170662:0:40920:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787191338.170693:0:40920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634869376 00000100:00100000:1.0:1787191338.170701:0:40920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634869376 00000100:00100000:1.0:1787191338.170738:0:40920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634869504 00000100:00100000:1.0:1787191338.170741:0:40920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634869504 00000100:00100000:1.0:1787191338.170756:0:40920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 33 00000100:00100000:1.0:1787191338.170765:0:40920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:37089:x1874004634869376:12345-192.168.202.101@tcp:104: 00010000:00010000:1.0:1787191338.170784:0:40920:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc884839c0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4603f7e expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.170873:0:40920:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787191338.170880:0:40920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:37089:x1874004634869376:12345-192.168.202.101@tcp:104: Request processed in 116us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787191338.170887:0:40920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 33 00000100:00100000:1.0:1787191338.170903:0:40920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 34 00000100:00100000:1.0:1787191338.170909:0:40920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b42a36850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:8422:x1874004634869504:12345-192.168.202.101@tcp:104: 00010000:00010000:1.0:1787191338.170917:0:40920:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884839c12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4603f85 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.170946:0:40920:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787191338.170952:0:40920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b42a36850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:8422:x1874004634869504:12345-192.168.202.101@tcp:104: Request processed in 43us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787191338.170958:0:40920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 34 00010000:00010000:1.0:1787191338.170987:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787191338.170993:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc884839c0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4603f7e expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.171001:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd4e00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191338.171007:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc884839c0b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e4603f7e expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.171046:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc884839c0b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4603f7e expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.171081:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191338.171099:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc884839c0b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4603f7e expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.171113:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc884839c0b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4603f7e expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.171131:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191338.171135:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884839c12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4603f85 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.171150:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd5c00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191338.171153:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884839c12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e4603f85 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.171173:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884839c12 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4603f85 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.171179:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191338.171184:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884839c12 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4603f85 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.171192:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc884839c12 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4603f85 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.171203:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191338.171204:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191338.171206:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191338.171211:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191338.171239:0:57570:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589936672 gen 1 00000100:00100000:1.0:1787191338.171299:0:57570:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b5058d180 x1874004626605696/t8589936667(8589936667) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787191338.171310:0:57570:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b6a475180 x1874004626606336/t8589936670(8589936670) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787191338.171325:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b5058f480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626606976:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191338.171340:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c6d lrc: 4/0,1 mode: --/EX res: [0x200000405:0xbf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46040b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.171350:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c6d lrc: 4/0,1 mode: --/CR res: [0x200000405:0xbf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46040b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.171361:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c6d lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xbf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46040b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.171371:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c6d lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xbf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46040b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.171383:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c6d lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xbf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46040b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.171391:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c6d lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xbf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46040b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.171399:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c6d lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xbf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46040b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.171414:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b5058f480 x1874004626606976/t8589936672(8589936672) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191338.171430:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c6d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xbf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46040b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191338.171441:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c6d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xbf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46040b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.171451:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/191 (0 0) 00000080:00200000:1.0:1787191338.171457:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xbf:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191338.171466:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xbf:0x0](ffff936b48989988) for lock 0xe5129dc884839c6d 00000080:00010000:1.0:1787191338.171473:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839c6d from it ffffa3fb41cab930 00010000:00010000:1.0:1787191338.171476:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c6d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xbf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46040b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.171485:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c6d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xbf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46040b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191338.171499:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:1.0:1787191338.171505:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xbf:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:1.0:1787191338.171517:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c6d lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xbf:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46040b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.171526:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c6d lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xbf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46040b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:1.0:1787191338.171540:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xbf:0x0](0000000042749bba) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c6d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xbf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46040b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.171570:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c6d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xbf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46040b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.171576:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c6d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xbf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46040b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000100:00100000:2.0:1787191338.171780:0:40922:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787191338.171791:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634869248 00000100:00100000:2.0:1787191338.171794:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634869248 00000100:00100000:2.0:1787191338.171820:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1272 00000100:00100000:2.0:1787191338.171827:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b50880850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8420:x1874004634869248:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191338.171861:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000211232bf/0xe5129dc884839b6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4603d94 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191338.171893:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191338.171899:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b50880850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8420:x1874004634869248:12345-192.168.202.101@tcp:104: Request processed in 72us (1416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191338.171905:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1272 00000100:00100000:3.0:1787191338.171997:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00010000:00010000:1.0:1787191338.173142:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:1.0:1787191338.174267:0:57843:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xbf:0x0] updating i_size 0 i_blocks 0 00000020:00010000:1.0:1787191338.174273:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b516569a0 (ffff936b465cc248/0) at cl_lock_release():245 00000020:00010000:1.0:1787191338.174277:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b516569a0 (ffff936b465cc248/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191338.174282:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b628937b0 (ffff936b465cc488/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191338.174286:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b628937f0 (ffff936b465ccb48/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191338.174290:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b516569a0 (ffff936b465cc248/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191338.174292:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b628937b0 (ffff936b465cc248/1) at cl_lock_fini():72 00000020:00010000:1.0:1787191338.174296:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b628937f0 (ffff936b465cc248/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191338.174321:0:57843:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xbf:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:1.0:1787191338.175041:0:57843:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c6d lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xbf:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46040b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191338.175062:0:57843:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c6d lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xbf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46040b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:1.0:1787191338.175071:0:57843:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xbf:0x0](0000000042749bba) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c6d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xbf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46040b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191338.175079:0:57843:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c6d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xbf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46040b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191338.175087:0:57843:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c6d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xbf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46040b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1787191338.175096:0:57843:0:(vvp_io.c:397:vvp_io_fini()) [0x200000405:0xbf:0x0] layout changed from 3 to 4. 00000080:00200000:1.0:1787191338.175101:0:57843:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xbf:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00020000:00200000:1.0:1787191338.175106:0:57843:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xbf:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 1, mirror count: 2 00020000:00200000:1.0:1787191338.175109:0:57843:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191338.175112:0:57843:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xbf:0x0] 00000008:00010000:1.0:1787191338.175122:0:57843:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191338.175124:0:57843:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b47d7d0b0, osc lock ffff936b46836980, flags 0x400000400001002 00010000:00010000:1.0:1787191338.175131:0:57843:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b52377800 type 11 mode 6 res 10737419265/420 (0 1048575) 00010000:00010000:1.0:1787191338.175159:0:57843:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c382f70b/0xe5129dc884839c89 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1a4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.175167:0:57843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c382f70b/0xe5129dc884839c89 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1a4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.175177:0:57843:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b453a8e00 x1874004626608128/t0(0) o101->lustre-OST0000-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:1.0:1787191338.175204:0:57843:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:3.0:1787191338.186721:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191338.187045:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634869760 00000100:00100000:2.0:1787191338.187065:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634869760 00000100:00100000:2.0:1787191338.187127:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1273 00000100:00100000:2.0:1787191338.187144:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30353:x1874004634869760:12345-192.168.202.101@tcp:106: 00010000:00010000:2.0:1787191338.187162:0:40921:0:(ldlm_lockd.c:2541:ldlm_callback_handler()) ### glimpse ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839c82 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1a4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.187177:0:40921:0:(ldlm_lockd.c:2123:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839c82 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1a4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00010000:2.0:1787191338.187204:0:40921:0:(cl_object.c:322:cl_object_glimpse()) header@0000000099e33c7a[0x110, 1, [0x200000405:0xbf:0x0] hash] 00000020:00010000:2.0:1787191338.187206:0:40921:0:(cl_object.c:322:cl_object_glimpse()) size: 0 mtime: 1787191338 atime: 1787191338 ctime: 1787191338 blocks: 0 00000020:00010000:2.0:1787191338.187210:0:40921:0:(cl_object.c:322:cl_object_glimpse()) header@00000000e826995f[0x110, 2, [0x280000401:0x1a4:0x0] hash] 00000020:00010000:2.0:1787191338.187212:0:40921:0:(cl_object.c:322:cl_object_glimpse()) size: 0 mtime: 1787191338 atime: 1787191338 ctime: 1787191338 blocks: 0 00000100:00100000:2.0:1787191338.187265:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30353:x1874004634869760:12345-192.168.202.101@tcp:106: Request processed in 129us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191338.187273:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1273 00000100:00100000:1.0:1787191338.189445:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626607872:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191338.189480:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626607744:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787191338.190094:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000c283bfdf/0xe5129dc884839c90 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.190103:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000c283bfdf/0xe5129dc884839c90 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.190113:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000c283bfdf/0xe5129dc884839c90 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191338.190135:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626608256:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191338.190871:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359e40 going to sleep for 11 seconds 00000080:00200000:1.0:1787191338.192127:0:57843:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xbf:0x0] updating i_size 0 i_blocks 0 00000020:00010000:1.0:1787191338.192134:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b516569a0 (ffff936b465cc248/0) at cl_lock_release():245 00000020:00010000:1.0:1787191338.192138:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b516569a0 (ffff936b465cc248/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191338.192155:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7d0b0 (ffff936b465ccb48/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191338.192159:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b516569a0 (ffff936b465cc248/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191338.192162:0:57843:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7d0b0 (ffff936b465cc248/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191338.192176:0:57843:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xbf:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1787191338.192225:0:57843:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xbf:0x0](ffff936b48989988), flags 154000 00000002:00100000:1.0:1787191338.192285:0:57843:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a475180 x1874004626606336/t8589936670(8589936670) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191338.192298:0:57843:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191338.192305:0:57843:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453aa300 x1874004626608512/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191338.192398:0:57843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57843:1874004626608512:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191338.192556:0:57843:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893780 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.193782:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626608256:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191338.193801:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000c283bfdf/0xe5129dc884839c90 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46040f1 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.193818:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000c283bfdf/0xe5129dc884839c90 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e46040f1 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.193868:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000c283bfdf/0xe5129dc884839c90 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e46040f1 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.193889:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000c283bfdf/0xe5129dc884839c90 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e46040f1 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191338.193901:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000c283bfdf/0xe5129dc884839c90 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e46040f1 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.193912:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000c283bfdf/0xe5129dc884839c90 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46040f1 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.193920:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000c283bfdf/0xe5129dc884839c90 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46040f1 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.194508:0:57843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57843:1874004626608512:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191338.194544:0:57843:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a475180 x1874004626606336/t8589936670(8589936670) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191338.194742:0:57843:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191338.194760:0:57843:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.194772:0:57843:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.194782:0:57843:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.194790:0:57843:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.194797:0:57843:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.194800:0:57843:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.194806:0:57843:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42173bf8 00010000:00010000:1.0:1787191338.194810:0:57843:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.194819:0:57843:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.194870:0:57843:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.194877:0:57843:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191338.194931:0:57843:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.194947:0:57843:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b589faa80, open_flags d902, mode 0 opened 0 00000080:00200000:1.0:1787191338.194954:0:57843:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:1.0:1787191338.194967:0:57843:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154403 00010000:00010000:1.0:1787191338.195001:0:57843:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839c97 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.195009:0:57843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839c97 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57843 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191338.195019:0:57843:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191338.195025:0:57843:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453aa300 x1874004626609024/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191338.195034:0:57843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839c97 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.195049:0:57843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57843:1874004626609024:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.195447:0:57843:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893780 going to sleep for 11 seconds 00000080:00200000:2.0:1787191338.200866:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xbf:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191338.200874:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b42ff6998 (ffff936b465cc368/0) at cl_lock_release():245 00000020:00010000:2.0:1787191338.200878:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42ff6998 (ffff936b465cc368/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191338.200883:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99030 (ffff936b465cc3f8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191338.200893:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839c82 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46040ea expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.200909:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839c82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46040ea expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191338.200925:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99070 (ffff936b43ab8128/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191338.200929:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000c283bfdf/0xe5129dc884839c90 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46040f1 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.200937:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000c283bfdf/0xe5129dc884839c90 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46040f1 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191338.200944:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42ff6998 (ffff936b465cc368/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191338.200947:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99030 (ffff936b465cc368/1) at cl_lock_fini():72 00000020:00010000:2.0:1787191338.200952:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99070 (ffff936b465cc368/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191338.201002:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xbf:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191338.201022:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xbf:0x0](ffff936b48989988) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191338.000000000, mtime 1787191338.000000000, ctime 1787191338.000000000, rc 0 00000080:00200008:2.0:1787191338.201115:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xbf:0x0], ppos: 0, count: 5 00000080:00200000:2.0:1787191338.201127:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191338.201133:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:2.0:1787191338.201200:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:2.0:1787191338.201205:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1787191338.201211:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@0000000099e33c7a[0x110, 1, [0x200000405:0xbf:0x0] hash] 00000020:00200000:2.0:1787191338.201213:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:2.0:1787191338.201217:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xbf:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:2.0:1787191338.201229:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xbf:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:2.0:1787191338.201233:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xbf:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191338.201236:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1787191338.201240:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1787191338.201247:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:2.0:1787191338.201250:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1787191338.201266:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:2.0:1787191338.201280:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1787191338.201285:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d15b0, osc lock ffff936b44e63a20, flags 0x0 00010000:00010000:2.0:1787191338.201302:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839c82 lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x1a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46040ea expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191338.201314:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839c82 lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46040ea expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191338.201389:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839c82 lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46040ea expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191338.201466:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839c82 lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46040ea expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191338.201474:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839c82 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46040ea expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191338.201487:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:2.0:1787191338.201496:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191338.201759:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:2.0:1787191338.201768:0:57570:0:(rw26.c:927:ll_write_end()) page@00000000044fe5ff[3 000000007b24d413 2 1 0000000097471822 0 0 0] 00000080:00200000:2.0:1787191338.201772:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @00000000d4496d12 17ffffc0001001 3:0 ffff936b43a1e1c0 0 lru 00000080:00200000:2.0:1787191338.201780:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@000000006f298e4c 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000a2a44f55 00000000e7365a8f > 3< 0 0 > 4< 0 0 8 378634240 - | - - - - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1787191338.201783:0:57570:0:(rw26.c:927:ll_write_end()) end page@00000000044fe5ff 00000080:00200000:2.0:1787191338.201784:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:2.0:1787191338.201788:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:2.0:1787191338.201809:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 00000000f372b5d0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839c82 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46040ea expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191338.201828:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b48989b38, count 1, dirtied 1 00000080:00200000:2.0:1787191338.201850:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:2.0:1787191338.201853:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:2.0:1787191338.201869:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b53cc5b78 (ffff936b47a17998/0) at cl_lock_release():245 00000020:00010000:2.0:1787191338.201872:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b53cc5b78 (ffff936b47a17998/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191338.201874:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d15b0 (ffff936b47a17ab8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191338.201879:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839c82 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46040ea expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191338.201889:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839c82 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46040ea expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:2.0:1787191338.201901:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b53cc5b78 (ffff936b47a17998/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191338.201904:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d15b0 (ffff936b47a17998/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191338.201911:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:2.0:1787191338.201915:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1787191338.201922:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xbf:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191338.201926:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:2.0:1787191338.201931:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xbf:0x0] updating i_size 5 i_blocks 0 00000080:00200000:2.0:1787191338.201935:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:2.0:1787191338.201954:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xbf:0x0](ffff936b48989988), flags 100001 00000002:00100000:2.0:1787191338.202015:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b5058d180 x1874004626605696/t8589936667(8589936667) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191338.202026:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:2.0:1787191338.202032:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8700 x1874004626609280/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191338.202063:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626609280:192.168.202.101@tcp:35:bash.0 00000100:00100000:2.0:1787191338.202258:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b523596c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.202361:0:57843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57843:1874004626609024:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191338.202378:0:57843:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839c97 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460410d expref: -99 pid: 57843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.202404:0:57843:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839c97 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460410d expref: -99 pid: 57843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.202413:0:57843:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839c97 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460410d expref: -99 pid: 57843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.202424:0:57843:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839c97 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460410d expref: -99 pid: 57843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.202436:0:57843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839c97 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460410d expref: -99 pid: 57843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.202448:0:57843:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839c97 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460410d expref: -99 pid: 57843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.202456:0:57843:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839c97 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460410d expref: -99 pid: 57843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.202463:0:57843:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839c97 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460410d expref: -99 pid: 57843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.202472:0:57843:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b453aa300 x1874004626609024/t8589936674(8589936674) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191338.202485:0:57843:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453aa300 x1874004626609024/t8589936674(8589936674) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191338.202497:0:57843:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839c97 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460410d expref: -99 pid: 57843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191338.202815:0:57843:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839c97 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460410d expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.202826:0:57843:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/191 (0 0) 00000080:00200000:1.0:1787191338.202850:0:57843:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191338.202892:0:57843:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xbf:0x0](ffff936b48989988): rc = 0 00000080:00200000:1.0:1787191338.202905:0:57843:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xbf:0x0]: layout version change: 4 -> 4 00000080:00010000:1.0:1787191338.202911:0:57843:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xbf:0x0](ffff936b48989988) for lock 0xe5129dc884839c97 00000080:00010000:1.0:1787191338.202923:0:57843:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xbf:0x0](ffff936b48989988) 00000080:00200008:1.0:1787191338.202935:0:57843:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xbf:0x0](ffff936b48989988), flags 154402 00000002:00100000:1.0:1787191338.202953:0:57843:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453aa300 x1874004626609024/t8589936674(8589936674) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191338.203004:0:57843:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839c97 from it ffff936b5339fc60 00010000:00010000:1.0:1787191338.203008:0:57843:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839c97 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460410d expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.203017:0:57843:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839c97 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460410d expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191338.203038:0:57843:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xbf:0x0](ffff936b48989988), inode mode 81a4 mask 46 00000080:00200080:1.0:1787191338.203100:0:57843:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xbf:0x0](ffff936b48989988) cmd=800466af arg=7ffca49be10c 00000080:00200080:1.0:1787191338.203114:0:57843:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xbf:0x0](ffff936b48989988) cmd=80086601 arg=7ffca49be0a8 00000100:00100000:1.0:1787191338.203150:0:57843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57843:1874004626609408:192.168.202.101@tcp:33:lfs.0 00000100:00100000:1.0:1787191338.203188:0:57843:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893780 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.206227:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626609280:192.168.202.101@tcp:35:bash.0 00000002:00100000:1.0:1787191338.206266:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b5058d180 x1874004626605696/t8589936667(8589936667) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191338.210749:0:57848:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191338.210773:0:57848:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.210787:0:57848:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.210801:0:57848:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.210809:0:57848:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.210816:0:57848:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.210820:0:57848:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.210826:0:57848:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4214bb58 00010000:00010000:1.0:1787191338.210847:0:57848:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.210857:0:57848:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.210872:0:57848:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.210881:0:57848:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:1.0:1787191338.210887:0:57848:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.210891:0:57848:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=8 00000080:00200008:1.0:1787191338.210896:0:57848:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xbf:0x0](ffff936b48989988), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191338.210901:0:57848:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xbf:0x0](ffff936b48989988),name=f70.sanity-flr 00000002:00010000:1.0:1787191338.210913:0:57848:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xbf:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.210920:0:57848:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839c97 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460410d expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.210928:0:57848:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839c97 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460410d expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191338.210935:0:57848:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.210939:0:57848:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xbf:0x0](ffff936b48989988) 00000080:00010000:1.0:1787191338.210941:0:57848:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xbf:0x0](ffff936b48989988) for lock 0xe5129dc884839c97 00000080:00010000:1.0:1787191338.210945:0:57848:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839c97 from it ffffa3fb4214bcb8 00010000:00010000:1.0:1787191338.210947:0:57848:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839c97 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460410d expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.210955:0:57848:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839c97 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460410d expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191338.210976:0:57848:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xbf:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:1.0:1787191338.210987:0:57848:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xbf:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191338.210990:0:57848:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191338.210993:0:57848:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xbf:0x0] 00000008:00010000:1.0:1787191338.211013:0:57848:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191338.211017:0:57848:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b47d7d0b0, osc lock ffff936b46836980, flags 0x400000400001002 00010000:00010000:1.0:1787191338.211033:0:57848:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839c82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46040ea expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191338.211045:0:57848:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839c82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46040ea expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1787191338.211068:0:57848:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191338.211072:0:57848:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839c82 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46040ea expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191338.211106:0:57848:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839c82 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46040ea expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:1.0:1787191338.211118:0:57848:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191338.211127:0:57848:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xbf:0x0] updating i_size 5 i_blocks 0 00000020:00010000:1.0:1787191338.211132:0:57848:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b516569a0 (ffff936b465cc248/0) at cl_lock_release():245 00000020:00010000:1.0:1787191338.211135:0:57848:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b516569a0 (ffff936b465cc248/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191338.212166:0:57848:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7d0b0 (ffff936b465ccb48/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191338.212174:0:57848:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b516569a0 (ffff936b465cc248/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191338.212177:0:57848:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7d0b0 (ffff936b465cc248/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191338.212189:0:57848:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xbf:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191338.212228:0:57848:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191338.212244:0:57848:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.212253:0:57848:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.212264:0:57848:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.212276:0:57848:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.212282:0:57848:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.212286:0:57848:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.212291:0:57848:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4214bc10 00010000:00010000:1.0:1787191338.212294:0:57848:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.212301:0:57848:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.212311:0:57848:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.212316:0:57848:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:1.0:1787191338.212332:0:57848:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.212340:0:57848:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:1.0:1787191338.212344:0:57848:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:1.0:1787191338.212349:0:57848:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:1.0:1787191338.212389:0:57848:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c6d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xbf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46040b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1787191338.212404:0:57848:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xbf:0x0]: losing layout lock 00010000:00010000:1.0:1787191338.212418:0:57848:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839c97 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e460410d expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191338.212426:0:57848:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xbf:0x0]: losing layout lock 00010000:00010000:1.0:1787191338.212432:0:57848:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839c58 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e460407a expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.212477:0:57848:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c6d lrc: 1/0,0 mode: --/CR res: [0x200000405:0xbf:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46040b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191338.212485:0:57848:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839c97 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460410d expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191338.212491:0:57848:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839c58 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e460407a expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.212497:0:57848:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:1.0:1787191338.212500:0:57848:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839c6d lrc: 0/0,0 mode: --/CR res: [0x200000405:0xbf:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46040b2 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191338.212519:0:57848:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839c97 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460410d expref: -99 pid: 57843 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191338.212528:0:57848:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839c58 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xbf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e460407a expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1787191338.212544:0:57848:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 36, max 7 00000100:00100000:1.0:1787191338.212556:0:57848:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453abb80 x1874004626609920/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787191338.212581:0:57848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57848:1874004626609920:192.168.202.101@tcp:36:rm.0 00000100:00100000:1.0:1787191338.212676:0:57848:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893480 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.217254:0:57848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57848:1874004626609920:192.168.202.101@tcp:36:rm.0 00000080:00200000:1.0:1787191338.227910:0:57849:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191338.227941:0:57849:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.227959:0:57849:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.227974:0:57849:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.227983:0:57849:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.227992:0:57849:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.227995:0:57849:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.228003:0:57849:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4212bb58 00010000:00010000:1.0:1787191338.228007:0:57849:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.228016:0:57849:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.228032:0:57849:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.228040:0:57849:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:1.0:1787191338.228046:0:57849:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.228067:0:57849:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:1.0:1787191338.228071:0:57849:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191338.228085:0:57849:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191338.228136:0:57849:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839ca5 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.228145:0:57849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839ca5 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.228158:0:57849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839ca5 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.228183:0:57849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57849:1874004626610304:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.228278:0:57849:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893480 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.229984:0:57849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57849:1874004626610304:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191338.229995:0:57849:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839ca5 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.230008:0:57849:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839ca5 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.230015:0:57849:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839ca5 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.230021:0:57849:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839ca5 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.230028:0:57849:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839ca5 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.230034:0:57849:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b587bd600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191338.230038:0:57849:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839ca5 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.230045:0:57849:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839ca5 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.230062:0:57849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839ca5 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.230070:0:57849:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191338.230076:0:57849:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839ca5 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.230083:0:57849:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839ca5 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.230104:0:57849:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b453aad80 x1874004626610304/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191338.230117:0:57849:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191338.230193:0:57849:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191338.230203:0:57849:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.230211:0:57849:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.230220:0:57849:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.230227:0:57849:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.230231:0:57849:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.230234:0:57849:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.230239:0:57849:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4212bbe8 00010000:00010000:1.0:1787191338.230243:0:57849:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.230251:0:57849:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.230267:0:57849:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.230274:0:57849:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000080:00200000:1.0:1787191338.230280:0:57849:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.230293:0:57849:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:1.0:1787191338.230297:0:57849:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191338.230308:0:57849:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191338.230343:0:57849:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839cb3 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.230350:0:57849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839cb3 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.230357:0:57849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839cb3 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.230368:0:57849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57849:1874004626610560:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.230391:0:57849:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893480 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.233764:0:57849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57849:1874004626610560:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191338.233777:0:57849:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839cb3 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.233787:0:57849:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839cb3 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.233793:0:57849:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839cb3 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.233800:0:57849:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839cb3 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.233808:0:57849:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839cb3 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.233814:0:57849:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b587bd400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191338.233819:0:57849:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839cb3 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.233826:0:57849:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839cb3 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.233862:0:57849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839cb3 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.233869:0:57849:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191338.233874:0:57849:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839cb3 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.233881:0:57849:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839cb3 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.233903:0:57849:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b453aad80 x1874004626610560/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191338.233914:0:57849:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191338.233994:0:57849:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191338.234005:0:57849:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.234014:0:57849:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.234024:0:57849:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.234031:0:57849:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.234036:0:57849:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.234040:0:57849:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.234044:0:57849:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4212bb58 00010000:00010000:1.0:1787191338.234046:0:57849:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.234124:0:57849:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.234136:0:57849:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.234184:0:57849:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:1.0:1787191338.234191:0:57849:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:1.0:1787191338.234195:0:57849:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:1.0:1787191338.234204:0:57849:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.234210:0:57849:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 73 lru_type: 1 00010000:00010000:1.0:1787191338.234215:0:57849:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 73 lru_type: 1 00000002:00010000:1.0:1787191338.234221:0:57849:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.234248:0:57849:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839cba lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.234253:0:57849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839cba lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.234262:0:57849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839cba lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.234273:0:57849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57849:1874004626610944:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.234320:0:57849:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893480 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.237251:0:57849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57849:1874004626610944:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191338.237273:0:57849:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839cba lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460418b expref: -99 pid: 57849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.237283:0:57849:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839cba lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460418b expref: -99 pid: 57849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.237296:0:57849:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839cba lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460418b expref: -99 pid: 57849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.237308:0:57849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839cba lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460418b expref: -99 pid: 57849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.237319:0:57849:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839cba lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460418b expref: -99 pid: 57849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.237339:0:57849:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839cba lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460418b expref: -99 pid: 57849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.237346:0:57849:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839cba lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460418b expref: -99 pid: 57849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.237361:0:57849:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b453aad80 x1874004626610944/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191338.237374:0:57849:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839cba lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460418b expref: -99 pid: 57849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.237383:0:57849:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:1.0:1787191338.237389:0:57849:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839cba lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460418b expref: -99 pid: 57849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.237407:0:57849:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839cba lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460418b expref: -99 pid: 57849 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:1.0:1787191338.237436:0:57849:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.237447:0:57849:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 146 lru_type: 1 00010000:00010000:1.0:1787191338.237458:0:57849:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 146 lru_type: 1 00010000:00010000:1.0:1787191338.237465:0:57849:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 146 lru_type: 1 00010000:00010000:1.0:1787191338.237472:0:57849:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 147 lru_type: 1 00000080:00200000:1.0:1787191338.237484:0:57849:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191338.237493:0:57849:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:1.0:1787191338.237497:0:57849:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:1.0:1787191338.237505:0:57849:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb4212bcb8 00010000:00010000:1.0:1787191338.237518:0:57849:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 73 lru_type: 1 00010000:00010000:1.0:1787191338.237526:0:57849:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 74 lru_type: 1 00000002:00010000:1.0:1787191338.237542:0:57849:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.237548:0:57849:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839cba lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460418b expref: -99 pid: 57849 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.237556:0:57849:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839cba lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460418b expref: -99 pid: 57849 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.237564:0:57849:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839cba lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460418b expref: -99 pid: 57849 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.237572:0:57849:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839cba lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460418b expref: -99 pid: 57849 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:1.0:1787191338.237578:0:57849:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.237583:0:57849:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 147 lru_type: 1 00010000:00010000:1.0:1787191338.237590:0:57849:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 147 lru_type: 1 00010000:00010000:1.0:1787191338.237613:0:57849:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 147 lru_type: 1 00010000:00010000:1.0:1787191338.237619:0:57849:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 148 lru_type: 1 00000080:00200008:1.0:1787191338.238165:0:57849:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:1.0:1787191338.238174:0:57849:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191338.238190:0:57849:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.238201:0:57849:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.238210:0:57849:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.238217:0:57849:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.238222:0:57849:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.238225:0:57849:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.238229:0:57849:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4212bcb8 00010000:00010000:1.0:1787191338.238233:0:57849:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.238240:0:57849:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.238351:0:57849:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191338.238360:0:57849:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.238367:0:57849:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.238376:0:57849:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.238382:0:57849:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.238386:0:57849:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.238388:0:57849:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.238392:0:57849:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4212bb58 00010000:00010000:1.0:1787191338.238395:0:57849:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.238402:0:57849:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.238411:0:57849:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.238418:0:57849:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:1.0:1787191338.238424:0:57849:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.238435:0:57849:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:1.0:1787191338.238440:0:57849:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191338.238454:0:57849:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191338.238496:0:57849:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839cc1 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.238504:0:57849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839cc1 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.238514:0:57849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839cc1 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.238536:0:57849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57849:1874004626611072:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.238622:0:57849:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893480 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.244486:0:57849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57849:1874004626611072:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191338.244510:0:57849:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839cc1 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.244524:0:57849:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839cc1 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.244531:0:57849:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839cc1 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.244538:0:57849:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839cc1 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.244548:0:57849:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839cc1 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.244554:0:57849:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b587bd000 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191338.244558:0:57849:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839cc1 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.244566:0:57849:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839cc1 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.244573:0:57849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839cc1 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.244580:0:57849:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191338.244588:0:57849:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839cc1 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.244594:0:57849:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839cc1 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.244623:0:57849:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b453aad80 x1874004626611072/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191338.244641:0:57849:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1787191338.244676:0:57849:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839cba lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460418b expref: -99 pid: 57849 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191338.244692:0:57849:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839cba lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460418b expref: -99 pid: 57849 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:1.0:1787191338.244701:0:57849:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839cba from it ffffa3fb4212b930 00010000:00010000:1.0:1787191338.244705:0:57849:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839cba lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460418b expref: -99 pid: 57849 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191338.244712:0:57849:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839cba lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460418b expref: -99 pid: 57849 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191338.244780:0:57849:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191338.244793:0:57849:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.244799:0:57849:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.244805:0:57849:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.244813:0:57849:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.244817:0:57849:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.244820:0:57849:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.244823:0:57849:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4212bbf8 00010000:00010000:1.0:1787191338.244825:0:57849:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.244829:0:57849:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.244868:0:57849:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.244876:0:57849:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191338.244882:0:57849:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.244886:0:57849:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:1.0:1787191338.244888:0:57849:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:1.0:1787191338.244891:0:57849:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b5871e180, open_flags a141, mode 81b6 opened 0 00000080:00200000:1.0:1787191338.244898:0:57849:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:1.0:1787191338.244914:0:57849:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xc1:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:1.0:1787191338.244923:0:57849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839cba lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e460418b expref: -99 pid: 57849 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191338.244963:0:57849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839cba lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e460418b expref: -99 pid: 57849 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191338.244968:0:57849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191338.244970:0:57849:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839cba lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e460418b expref: -99 pid: 57849 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191338.244995:0:57849:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839cc8 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.245000:0:57849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839cc8 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191338.245008:0:57849:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191338.245013:0:57849:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453aad80 x1874004626611328/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191338.245019:0:57849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839cc8 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.245034:0:57849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57849:1874004626611328:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.245154:0:57849:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893480 going to sleep for 11 seconds 00000080:00200000:2.0:1787191338.246536:0:57850:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191338.246558:0:57850:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191338.246571:0:57850:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191338.246584:0:57850:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191338.246590:0:57850:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191338.246597:0:57850:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191338.246600:0:57850:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191338.246676:0:57850:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4211bbf8 00010000:00010000:2.0:1787191338.246680:0:57850:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191338.246690:0:57850:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191338.246705:0:57850:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191338.246714:0:57850:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191338.246719:0:57850:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:1.0:1787191338.248273:0:57849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57849:1874004626611328:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191338.248298:0:57849:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839cc8 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46041bc expref: -99 pid: 57849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.248385:0:57849:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839cc8 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46041bc expref: -99 pid: 57849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.248444:0:57849:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839cc8 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46041bc expref: -99 pid: 57849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.248456:0:57849:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839cc8 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46041bc expref: -99 pid: 57849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.248473:0:57849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839cc8 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46041bc expref: -99 pid: 57849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.248485:0:57849:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839cc8 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46041bc expref: -99 pid: 57849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.248493:0:57849:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839cc8 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46041bc expref: -99 pid: 57849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.248499:0:57849:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839cc8 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46041bc expref: -99 pid: 57849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.248511:0:57849:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b453aad80 x1874004626611328/t8589936680(8589936680) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191338.248524:0:57849:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453aad80 x1874004626611328/t8589936680(8589936680) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191338.248537:0:57849:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46041bc expref: -99 pid: 57849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.248546:0:57849:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/193 (0 0) 00000080:00200000:1.0:1787191338.248552:0:57849:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191338.248562:0:57849:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:1.0:1787191338.248590:0:57849:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xc1:0x0](ffff936b539580c8) 00000080:00200000:1.0:1787191338.248599:0:57849:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xc1:0x0], updating i_size 0 00000080:00200000:1.0:1787191338.248705:0:57849:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc1:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:1.0:1787191338.248711:0:57849:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xc1:0x0](ffff936b539580c8) 00000080:00010000:1.0:1787191338.248715:0:57849:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc1:0x0](ffff936b539580c8) for lock 0xe5129dc884839cc8 00000080:00010000:1.0:1787191338.248724:0:57849:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc1:0x0](ffff936b539580c8) 00000080:00200008:1.0:1787191338.248739:0:57849:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc1:0x0](ffff936b539580c8), flags 120501 00000002:00100000:1.0:1787191338.248760:0:57849:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453aad80 x1874004626611328/t8589936680(8589936680) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191338.248793:0:57849:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839cc8 from it ffff936b5339fc60 00010000:00010000:1.0:1787191338.248797:0:57849:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46041bc expref: -99 pid: 57849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.248806:0:57849:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839cc8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46041bc expref: -99 pid: 57849 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191338.248879:0:57849:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc1:0x0](ffff936b539580c8), inode mode 81a4 mask 40 00000080:00200000:1.0:1787191338.248939:0:57849:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc1:0x0](ffff936b539580c8), inode mode 81a4 mask 2 00000080:00200000:1.0:1787191338.248950:0:57849:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xc1:0x0](ffff936b539580c8), xattr lov 00000080:00200000:2.0:1787191338.249006:0:57850:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:2.0:1787191338.249014:0:57850:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc1:0x0](ffff936b539580c8), inode mode 81a4 mask 44 00000080:00200008:2.0:1787191338.249020:0:57850:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc1:0x0](ffff936b539580c8), flags 154400 00000002:00010000:2.0:1787191338.249032:0:57850:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc1:0x0]) in obj [0x200000405:0xc1:0x0], intent: open flags 0100240114401 00000002:00010000:1.0:1787191338.249082:0:57849:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc1:0x0]) in obj [0x200000405:0xc1:0x0], intent: open flags 040000002 00010000:00010000:2.0:1787191338.249093:0:57850:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839ccf lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.249100:0:57850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839ccf lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.249102:0:57849:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839cd6 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.249108:0:57849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839cd6 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191338.249111:0:57850:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000020:00100000:1.0:1787191338.249113:0:57849:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:1.0:1787191338.249117:0:57849:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453ab480 x1874004626611840/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191338.249117:0:57850:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8000 x1874004626611712/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191338.249128:0:57849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839cd6 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.249128:0:57850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839ccf lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.249148:0:57849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57849:1874004626611840:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191338.249150:0:57850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57850:1874004626611712:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.249385:0:57849:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893480 going to sleep for 11 seconds 00000100:00100000:2.0:1787191338.249707:0:57850:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b52359e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191338.251499:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191338.251544:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634869888 00000100:00100000:2.0:1787191338.251552:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634869888 00000100:00100000:2.0:1787191338.251716:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1274 00000100:00100000:2.0:1787191338.251727:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634869888:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191338.251743:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839cc8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46041bc expref: -99 pid: 57849 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191338.251819:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191338.251827:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634869888:12345-192.168.202.101@tcp:104: Request processed in 102us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191338.251853:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1274 00010000:00010000:1.0:1787191338.251860:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191338.251867:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839cc8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46041bc expref: -99 pid: 57849 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.252684:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b587bd400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191338.252691:0:43384:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839cc8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46041bc expref: -99 pid: 57849 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.252700:0:43384:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839cc8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46041bc expref: -99 pid: 57849 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.252707:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839cc8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e46041bc expref: -99 pid: 57849 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191338.252722:0:43384:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc1:0x0]: losing layout lock 00010000:00010000:1.0:1787191338.252758:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839cc8 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46041bc expref: -99 pid: 57849 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.252765:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191338.252792:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839cc8 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46041bc expref: -99 pid: 57849 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.252800:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839cc8 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46041bc expref: -99 pid: 57849 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.252811:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191338.252813:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191338.252815:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191338.252877:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787191338.252889:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626612224:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191338.256483:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626612224:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191338.256875:0:57849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57849:1874004626611840:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191338.256887:0:57849:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839cd6 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.256896:0:57849:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839cd6 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.256902:0:57849:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839cd6 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.256908:0:57849:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839cd6 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.256914:0:57849:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839cd6 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.256918:0:57849:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b587bd600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191338.256921:0:57849:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839cd6 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.256926:0:57849:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839cd6 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.256930:0:57849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839cd6 lrc: 5/0,0 mode: --/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.256934:0:57849:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191338.256939:0:57849:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839cd6 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.256943:0:57849:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839cd6 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57849 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.256959:0:57849:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b453ab480 x1874004626611840/t8589936683(8589936683) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191338.256967:0:57849:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453ab480 x1874004626611840/t8589936683(8589936683) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191338.256977:0:57849:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xc1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787191338.257011:0:57849:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc1:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00000080:00200000:1.0:1787191338.257018:0:57849:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc1:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191338.257065:0:57849:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xc1:0x0], updating i_size 0 00000002:00100000:1.0:1787191338.257084:0:57849:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453ab480 x1874004626611840/t8589936683(8589936683) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191338.257114:0:57849:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453ab480 x1874004626611840/t8589936683(8589936683) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191338.257122:0:57849:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:1.0:1787191338.257126:0:57849:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8a80 x1874004626612736/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191338.257227:0:57849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57849:1874004626612736:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191338.257443:0:57849:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893480 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.260744:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626612864:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.262992:0:57849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57849:1874004626612736:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191338.263034:0:57849:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453ab480 x1874004626611840/t8589936683(8589936683) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1787191338.263107:0:57849:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc1:0x0](ffff936b539580c8), flags 100001 00000002:00100000:1.0:1787191338.263169:0:57849:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453aad80 x1874004626611328/t8589936680(8589936680) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191354 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191338.263177:0:57849:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191338.263181:0:57849:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9500 x1874004626613248/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191338.263198:0:57849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57849:1874004626613248:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191338.263261:0:57849:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893480 going to sleep for 11 seconds 00010000:00010000:1.0:1787191338.264146:0:2389:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839ce4 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57850 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.264168:0:2389:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839ce4 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604217 expref: -99 pid: 57850 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.264183:0:2389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839ce4 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604217 expref: -99 pid: 57850 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.264196:0:2389:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839ce4 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604217 expref: -99 pid: 57850 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191338.264212:0:2389:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839ce4 lrc: 5/2,0 mode: PR/PR res: [0x280000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604217 expref: -99 pid: 57850 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1787191338.264230:0:2389:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191338.264236:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839ce4 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4604217 expref: -99 pid: 57850 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.264244:0:2389:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839ce4 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4604217 expref: -99 pid: 57850 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.264252:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839ce4 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4604217 expref: -99 pid: 57850 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.264261:0:2389:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839ce4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604217 expref: -99 pid: 57850 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1787191338.264278:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626612864:192.168.202.101@tcp:101:lfs.0 00000080:00200000:2.0:1787191338.264979:0:57850:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc1:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191338.264986:0:57850:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51654940 (ffff936b465ccc68/0) at cl_lock_release():245 00000020:00010000:2.0:1787191338.264989:0:57850:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51654940 (ffff936b465ccc68/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191338.264993:0:57850:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f993f0 (ffff936b47a176c8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191338.264998:0:57850:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99430 (ffff936b465cc758/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191338.265000:0:57850:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51654940 (ffff936b465ccc68/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191338.265004:0:57850:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f993f0 (ffff936b465ccc68/1) at cl_lock_fini():72 00000020:00010000:2.0:1787191338.265008:0:57850:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99430 (ffff936b465ccc68/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191338.265066:0:57850:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc1:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:1.0:1787191338.265487:0:57849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57849:1874004626613248:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191338.265513:0:57849:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453aad80 x1874004626611328/t8589936680(8589936680) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:2.0:1787191338.265730:0:57850:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc1:0x0](ffff936b539580c8), flags 154000 00000002:00100000:2.0:1787191338.265788:0:57850:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a474000 x1874004626612480/t8589936684(8589936684) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191338.265799:0:57850:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191338.265805:0:57850:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb100 x1874004626613504/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191338.265824:0:57850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57850:1874004626613504:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191338.266019:0:57850:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.269848:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626613760:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191338.269875:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839cf2 lrc: 4/0,1 mode: --/CW res: [0x200000405:0xc1:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460422c expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.269890:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839cf2 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xc1:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460422c expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.269901:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839cf2 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xc1:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460422c expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.269915:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x200002b, status=0 req@ffff936b6a477100 x1874004626613760/t8589936688(8589936688) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191338.269927:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477100 x1874004626613760/t8589936688(8589936688) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191338.269938:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839cf2 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xc1:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460422c expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191338.269949:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839cf2 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xc1:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460422c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.269959:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 8 res 8589935621/193 (0 0) 00000080:00200000:1.0:1787191338.269963:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000405:0xc1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787191338.270019:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc1:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:1.0:1787191338.270024:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc1:0x0](ffff936b539580c8) for lock 0xe5129dc884839cf2 00000080:00010000:1.0:1787191338.270030:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839cf2 from it ffffa3fb41cabbf0 00010000:00010000:1.0:1787191338.270034:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839cf2 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xc1:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460422c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.270043:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839cf2 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xc1:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460422c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000002:00100000:1.0:1787191338.270082:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477100 x1874004626613760/t8589936688(8589936688) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191338.270130:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xc1:0x0], intent: getxattr flags 0 00010000:00010000:1.0:1787191338.270194:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839d00 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.270201:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839d00 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.270207:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839d00 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.270225:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8000 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626614016:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191338.270309:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893480 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.273221:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8000 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626614016:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191338.273247:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839d00 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604241 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.273260:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839d00 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604241 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.273272:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839d00 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604241 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.273285:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b453a8000 x1874004626614016/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191338.273296:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839d00 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604241 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.273314:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/193 (0 0) 00000080:00200000:1.0:1787191338.273378:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xc1:0x0] suppgids 0 -1: rc 0 00000080:00010000:1.0:1787191338.273411:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc1:0x0](ffff936b539580c8) for lock 0xe5129dc884839d00 00000080:00010000:1.0:1787191338.273418:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839d00 from it ffffa3fb41caba38 00010000:00010000:1.0:1787191338.273422:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839d00 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604241 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.273431:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839d00 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604241 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:1.0:1787191338.273467:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xc1:0x0](ffff936b539580c8) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191338.000000000, mtime 1787191338.000000000, ctime 1787191338.000000000 00010000:00010000:1.0:1787191338.273488:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839cf2 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xc1:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e460422c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191338.275810:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc1:0x0]: losing layout lock 00010000:00010000:1.0:1787191338.275882:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839cf2 lrc: 1/0,0 mode: --/CW res: [0x200000405:0xc1:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460422c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.275890:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191338.275893:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839cf2 lrc: 0/0,0 mode: --/CW res: [0x200000405:0xc1:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460422c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1787191338.275910:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1787191338.275916:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8000 x1874004626614656/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787191338.275936:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8000 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626614656:192.168.202.101@tcp:36:bash.0 00000100:00100000:1.0:1787191338.276165:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893480 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.278894:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8000 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626614656:192.168.202.101@tcp:36:bash.0 00000080:00200000:1.0:1787191338.278940:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:1.0:1787191338.278946:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc1:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00010000:00010000:1.0:1787191338.278963:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/193 (0 0) 00000080:00010000:1.0:1787191338.278974:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xc1:0x0](ffff936b539580c8) 00000002:00010000:1.0:1787191338.278983:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc1:0x0]) in obj [0x200000405:0xc1:0x0], intent: layout flags 0 00010000:00010000:1.0:1787191338.279028:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839d07 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.279036:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839d07 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.279046:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839d07 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.279080:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626614912:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191338.279202:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893480 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.281204:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626614912:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191338.281235:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839d07 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604272 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.281251:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839d07 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604272 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.281267:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b453a9180 x1874004626614912/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191338.281285:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839d07 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604272 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191338.281299:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839d07 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604272 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.281311:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/193 (0 0) 00000080:00200000:1.0:1787191338.281317:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xc1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191338.281416:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc1:0x0](ffff936b539580c8) for lock 0xe5129dc884839d07 00000080:00010000:1.0:1787191338.281426:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839d07 from it ffffa3fb41cab8c8 00010000:00010000:1.0:1787191338.281432:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839d07 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604272 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.281443:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839d07 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604272 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.281771:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839d07 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604272 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.281786:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839d07 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604272 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:1.0:1787191338.281794:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xc1:0x0](000000006e2576ea) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839d07 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604272 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191338.281862:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc1:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:1.0:1787191338.281867:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839d07 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604272 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.281876:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839d07 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604272 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:1.0:1787191338.281892:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xc1:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:1.0:1787191338.281900:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc1:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191338.281905:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xc1:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:1.0:1787191338.281913:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xc1:0x0](ffff936b539580c8) 00000002:00010000:1.0:1787191338.281932:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc1:0x0]) in obj [0x200000405:0xc1:0x0], intent: layout flags 02 00010000:00010000:1.0:1787191338.281945:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839d07 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4604272 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191338.281958:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc1:0x0]: losing layout lock 00010000:00010000:1.0:1787191338.281986:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839d07 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604272 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191338.281993:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191338.281996:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839d07 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604272 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191338.282015:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839d0e lrc: 3/0,1 mode: --/EX res: [0x200000405:0xc1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.282022:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839d0e lrc: 3/0,1 mode: --/EX res: [0x200000405:0xc1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191338.282033:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191338.282039:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9180 x1874004626615168/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191338.282049:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839d0e lrc: 3/0,1 mode: --/EX res: [0x200000405:0xc1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.282082:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626615168:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191338.282209:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893480 going to sleep for 11 seconds 00000100:00100000:3.0:1787191338.288906:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191338.288958:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634870528 00000100:00100000:2.0:1787191338.288968:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634870528 00000100:00100000:2.0:1787191338.289038:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1275 00000100:00100000:2.0:1787191338.289048:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:29543:x1874004634870528:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191338.289079:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839c82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e46040ea expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191338.289156:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191338.289163:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:29543:x1874004634870528:12345-192.168.202.101@tcp:104: Request processed in 117us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191338.289170:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1275 00010000:00010000:2.0:1787191338.289197:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787191338.289202:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839c82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e46040ea expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191338.289211:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cafc00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:2.0:1787191338.289217:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839c82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e46040ea expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191338.289265:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839c82 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e46040ea expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191338.289273:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191338.289292:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839c82 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e46040ea expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191338.289300:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839c82 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e46040ea expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191338.289320:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191338.289322:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191338.289324:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191338.291029:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626615296:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191338.292608:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000080:00200000:1.0:1787191338.292865:0:57851:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191338.292891:0:57851:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.292909:0:57851:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.292924:0:57851:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.292931:0:57851:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.292940:0:57851:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.292943:0:57851:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.292951:0:57851:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42183bf8 00010000:00010000:1.0:1787191338.292955:0:57851:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.292964:0:57851:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.292980:0:57851:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.292988:0:57851:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191338.292993:0:57851:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.293007:0:57851:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b5089a300, open_flags d900, mode 0 opened 0 00000080:00200000:1.0:1787191338.293014:0:57851:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:1.0:1787191338.293030:0:57851:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00000100:00100000:3.0:1787191338.293449:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634870656 00000100:00100000:3.0:1787191338.293459:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634870656 00000100:00100000:3.0:1787191338.293510:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1276 00000100:00100000:3.0:1787191338.293521:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:37089:x1874004634870656:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191338.293539:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000be535028/0xe5129dc884839c7b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e46040d5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.293621:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191338.293931:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:37089:x1874004634870656:12345-192.168.202.101@tcp:104: Request processed in 110us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191338.293940:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1276 00010000:00010000:3.0:1787191338.293963:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191338.293969:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000be535028/0xe5129dc884839c7b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e46040d5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.293983:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b587bcc00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191338.293989:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000be535028/0xe5129dc884839c7b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e46040d5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.294032:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000be535028/0xe5129dc884839c7b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e46040d5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.294039:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191338.294071:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000be535028/0xe5129dc884839c7b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e46040d5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.294079:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000be535028/0xe5129dc884839c7b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e46040d5 expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.294100:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191338.294102:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191338.294104:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191338.294120:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626615424:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787191338.294794:0:57851:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839d1c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.294803:0:57851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839d1c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57851 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191338.294813:0:57851:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191338.294820:0:57851:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8700 x1874004626615808/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191338.294829:0:57851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839d1c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.294939:0:57851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57851:1874004626615808:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.295110:0:57851:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191338.295259:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191338.295287:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191338.296510:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626615296:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191338.296549:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634871296 00000100:00100000:3.0:1787191338.296554:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634871296 00000100:00100000:3.0:1787191338.296595:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634871424 00000100:00100000:3.0:1787191338.296598:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634871424 00000100:00100000:3.0:1787191338.296614:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1277 00000100:00100000:3.0:1787191338.296622:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+5:8420:x1874004634871296:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191338.296643:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000c283bfdf/0xe5129dc884839c90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e46040f1 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.296710:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191338.296717:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+5:8420:x1874004634871296:12345-192.168.202.101@tcp:104: Request processed in 96us (1460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191338.296724:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1277 00010000:00010000:1.0:1787191338.296731:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191338.296738:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000c283bfdf/0xe5129dc884839c90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e46040f1 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1787191338.296740:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1278 00000100:00100000:3.0:1787191338.296746:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8422:x1874004634871424:12345-192.168.202.101@tcp:104: 00010000:00010000:1.0:1787191338.296747:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd5e00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191338.296752:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000c283bfdf/0xe5129dc884839c90 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e46040f1 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.296754:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a9aa9dbe/0xe5129dc884839c74 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e46040dc expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.296791:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1787191338.296794:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000c283bfdf/0xe5129dc884839c90 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e46040f1 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1787191338.296796:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8422:x1874004634871424:12345-192.168.202.101@tcp:104: Request processed in 51us (1509us total) trans 0 rc 0/0 00010000:00010000:1.0:1787191338.296802:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787191338.296803:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1278 00010000:00010000:1.0:1787191338.296820:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000c283bfdf/0xe5129dc884839c90 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e46040f1 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.296827:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000c283bfdf/0xe5129dc884839c90 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e46040f1 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.297726:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191338.297731:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a9aa9dbe/0xe5129dc884839c74 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e46040dc expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.297739:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b587bde00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191338.297744:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a9aa9dbe/0xe5129dc884839c74 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e46040dc expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.297773:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a9aa9dbe/0xe5129dc884839c74 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e46040dc expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.297780:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191338.297788:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a9aa9dbe/0xe5129dc884839c74 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e46040dc expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.297795:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a9aa9dbe/0xe5129dc884839c74 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e46040dc expref: -99 pid: 57843 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.297806:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191338.297808:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191338.297810:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191338.297826:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626615936:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191338.299050:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626615424:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191338.300094:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626615552:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191338.300124:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc884839d15 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46042a3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.300154:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc884839d15 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e46042a3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.300167:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc884839d15 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e46042a3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.300186:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc884839d15 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e46042a3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191338.300199:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc884839d15 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e46042a3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.300211:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc884839d15 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46042a3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.300218:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc884839d15 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46042a3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.300289:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000211232bf/0xe5129dc884839d23 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.300311:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000211232bf/0xe5129dc884839d23 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.300324:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000211232bf/0xe5129dc884839d23 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.300347:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626616192:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191338.300426:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.302262:0:57851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57851:1874004626615808:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191338.302287:0:57851:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839d1c lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46042bf expref: -99 pid: 57851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.302310:0:57851:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839d1c lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46042bf expref: -99 pid: 57851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.302461:0:57851:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839d1c lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46042bf expref: -99 pid: 57851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.302472:0:57851:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839d1c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46042bf expref: -99 pid: 57851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.302482:0:57851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839d1c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46042bf expref: -99 pid: 57851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.302494:0:57851:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839d1c lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46042bf expref: -99 pid: 57851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.302507:0:57851:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839d1c lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46042bf expref: -99 pid: 57851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.302586:0:57851:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839d1c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46042bf expref: -99 pid: 57851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.302893:0:57851:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b453a8700 x1874004626615808/t8589936694(8589936694) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191338.302911:0:57851:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8700 x1874004626615808/t8589936694(8589936694) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191338.302925:0:57851:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839d1c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46042bf expref: -99 pid: 57851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191338.302939:0:57851:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839d1c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46042bf expref: -99 pid: 57851 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.302949:0:57851:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/193 (0 0) 00000080:00200000:1.0:1787191338.302956:0:57851:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191338.303012:0:57851:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xc1:0x0](ffff936b539580c8): rc = 0 00000080:00200000:1.0:1787191338.303030:0:57851:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc1:0x0]: layout version change: 4 -> 4 00000080:00010000:1.0:1787191338.303037:0:57851:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc1:0x0](ffff936b539580c8) for lock 0xe5129dc884839d1c 00000080:00010000:1.0:1787191338.303061:0:57851:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc1:0x0](ffff936b539580c8) 00000080:00200008:1.0:1787191338.303076:0:57851:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc1:0x0](ffff936b539580c8), flags 154400 00000100:00100000:1.0:1787191338.303107:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626615936:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191338.303226:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626616192:192.168.202.101@tcp:101:bash.0 00010000:00010000:2.0:1787191338.303239:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000211232bf/0xe5129dc884839d23 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46042cd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.303253:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000211232bf/0xe5129dc884839d23 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e46042cd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.303264:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000211232bf/0xe5129dc884839d23 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e46042cd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.303276:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000211232bf/0xe5129dc884839d23 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e46042cd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1787191338.303288:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000211232bf/0xe5129dc884839d23 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e46042cd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.303299:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000211232bf/0xe5129dc884839d23 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46042cd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.303306:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000211232bf/0xe5129dc884839d23 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46042cd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191338.303425:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626616448:192.168.202.101@tcp:10:bash.0 00000100:00100000:3.0:1787191338.303452:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626616320:192.168.202.101@tcp:10:bash.0 00000002:00100000:1.0:1787191338.303505:0:57851:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8700 x1874004626615808/t8589936694(8589936694) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191338.303787:0:57851:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839d1c from it ffff936b5339fd20 00010000:00010000:1.0:1787191338.303792:0:57851:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839d1c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46042bf expref: -99 pid: 57851 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.303801:0:57851:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839d1c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46042bf expref: -99 pid: 57851 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191338.303826:0:57851:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc1:0x0](ffff936b539580c8), inode mode 81a4 mask 44 00000080:00200000:1.0:1787191338.303947:0:57851:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc1:0x0](ffff936b539580c8), inode mode 81a4 mask 4 00000080:00200000:1.0:1787191338.303954:0:57851:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xc1:0x0](ffff936b539580c8), xattr lov 00000080:00200008:1.0:1787191338.303981:0:57851:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc1:0x0](ffff936b539580c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191338.303987:0:57851:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc1:0x0](ffff936b539580c8),name=f70.sanity-flr 00000002:00010000:1.0:1787191338.304006:0:57851:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc1:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.304016:0:57851:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839d1c lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46042bf expref: -99 pid: 57851 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.304026:0:57851:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839d1c lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46042bf expref: -99 pid: 57851 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191338.304034:0:57851:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.304040:0:57851:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc1:0x0](ffff936b539580c8) 00000080:00010000:1.0:1787191338.304043:0:57851:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc1:0x0](ffff936b539580c8) for lock 0xe5129dc884839d1c 00000080:00010000:1.0:1787191338.304047:0:57851:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839d1c from it ffffa3fb42183cd8 00010000:00010000:1.0:1787191338.304061:0:57851:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839d1c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46042bf expref: -99 pid: 57851 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.304074:0:57851:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839d1c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46042bf expref: -99 pid: 57851 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191338.304091:0:57851:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc1:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:1.0:1787191338.304101:0:57851:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc1:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191338.304104:0:57851:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191338.304106:0:57851:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc1:0x0] 00000008:00010000:1.0:1787191338.304120:0:57851:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191338.304123:0:57851:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b47d7d0b0, osc lock ffff936b46836980, flags 0x400000400001002 00010000:00010000:1.0:1787191338.304134:0:57851:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc884839d15 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46042a3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.304191:0:57851:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc884839d15 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46042a3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1787191338.304198:0:57851:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191338.304201:0:57851:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc884839d15 lrc: 7/0,2 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46042a3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.304205:0:57851:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc884839d15 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46042a3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1787191338.304209:0:57851:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191338.304218:0:57851:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc1:0x0] updating i_size 0 i_blocks 0 00000020:00010000:1.0:1787191338.304221:0:57851:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51656060 (ffff936b465ccb48/0) at cl_lock_release():245 00000020:00010000:1.0:1787191338.304223:0:57851:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51656060 (ffff936b465ccb48/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191338.304226:0:57851:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7d0b0 (ffff936b465cc488/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191338.304229:0:57851:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51656060 (ffff936b465ccb48/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191338.304231:0:57851:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7d0b0 (ffff936b465ccb48/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191338.304239:0:57851:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc1:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1787191338.304273:0:57851:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc1:0x0](ffff936b539580c8), flags 154000 00000002:00100000:1.0:1787191338.304303:0:57851:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a8700 x1874004626615808/t8589936694(8589936694) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191338.304311:0:57851:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191338.304315:0:57851:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453ab100 x1874004626616704/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191338.304331:0:57851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57851:1874004626616704:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191338.305257:0:57851:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191338.306575:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626616320:192.168.202.101@tcp:10:bash.0 00000100:00100000:3.0:1787191338.306606:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626616448:192.168.202.101@tcp:10:bash.0 00000080:00200000:2.0:1787191338.306680:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc1:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191338.306687:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b42ff65d8 (ffff936b465cc248/0) at cl_lock_release():245 00000020:00010000:2.0:1787191338.306691:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42ff65d8 (ffff936b465cc248/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191338.306695:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f996f0 (ffff936b47a17bd8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191338.306705:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc884839d15 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46042a3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.306719:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc884839d15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46042a3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191338.306735:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99730 (ffff936b47a175a8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191338.306740:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000211232bf/0xe5129dc884839d23 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46042cd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.306748:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000211232bf/0xe5129dc884839d23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46042cd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191338.306757:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42ff65d8 (ffff936b465cc248/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191338.306760:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f996f0 (ffff936b465cc248/1) at cl_lock_fini():72 00000020:00010000:2.0:1787191338.306765:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99730 (ffff936b465cc248/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191338.306812:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc1:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191338.306986:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xc1:0x0](ffff936b539580c8) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191338.000000000, mtime 1787191338.000000000, ctime 1787191338.000000000, rc 0 00000080:00200008:2.0:1787191338.307080:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xc1:0x0], ppos: 0, count: 5 00000080:00200000:2.0:1787191338.307094:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191338.307098:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:2.0:1787191338.307103:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:2.0:1787191338.307107:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1787191338.307111:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@00000000defc741f[0x110, 1, [0x200000405:0xc1:0x0] hash] 00000020:00200000:2.0:1787191338.307113:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:2.0:1787191338.307117:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc1:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:2.0:1787191338.307127:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xc1:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:2.0:1787191338.307131:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc1:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191338.307133:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1787191338.307137:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1787191338.307142:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:2.0:1787191338.307145:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1787191338.307159:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:2.0:1787191338.307170:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1787191338.307173:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d15b0, osc lock ffff936b44e63a20, flags 0x0 00010000:00010000:2.0:1787191338.307187:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc884839d15 lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46042a3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191338.307197:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc884839d15 lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46042a3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191338.307205:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc884839d15 lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46042a3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191338.307210:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc884839d15 lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46042a3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191338.307214:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc884839d15 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46042a3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191338.307222:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:2.0:1787191338.307228:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191338.307266:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:2.0:1787191338.307272:0:57570:0:(rw26.c:927:ll_write_end()) page@00000000a29b94d0[3 000000007d7573ff 2 1 0000000097471822 0 0 0] 00000080:00200000:2.0:1787191338.307274:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @000000006d99d0c6 17ffffc0001001 3:0 ffff936b43a1e620 0 lru 00000080:00200000:2.0:1787191338.307280:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@000000000a8fb213 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000ef00a996 00000000280494ef > 3< 0 0 > 4< 0 0 8 444854272 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1787191338.307281:0:57570:0:(rw26.c:927:ll_write_end()) end page@00000000a29b94d0 00000080:00200000:2.0:1787191338.307282:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:2.0:1787191338.307285:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:2.0:1787191338.307300:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 00000000f287428f ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc884839d15 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46042a3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191338.307314:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b53958278, count 1, dirtied 1 00000080:00200000:2.0:1787191338.307317:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:2.0:1787191338.307709:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:2.0:1787191338.307726:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b53cc5b78 (ffff936b47a17998/0) at cl_lock_release():245 00000020:00010000:2.0:1787191338.307729:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b53cc5b78 (ffff936b47a17998/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191338.307732:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d15b0 (ffff936b47a17ab8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191338.307736:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc884839d15 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46042a3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191338.307745:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc884839d15 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46042a3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:2.0:1787191338.307757:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b53cc5b78 (ffff936b47a17998/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191338.307760:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d15b0 (ffff936b47a17998/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191338.307766:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:2.0:1787191338.307771:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1787191338.307777:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc1:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191338.307780:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:2.0:1787191338.307787:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc1:0x0] updating i_size 5 i_blocks 0 00000080:00200000:2.0:1787191338.307791:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:2.0:1787191338.307809:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc1:0x0](ffff936b539580c8), flags 100001 00000002:00100000:2.0:1787191338.309152:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a477100 x1874004626613760/t8589936688(8589936688) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191338.309166:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:2.0:1787191338.309172:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8000 x1874004626616960/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191338.309193:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626616960:192.168.202.101@tcp:35:bash.0 00000100:00100000:2.0:1787191338.309275:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f300 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.309737:0:57851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57851:1874004626616704:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191338.310223:0:57851:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a8700 x1874004626615808/t8589936694(8589936694) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191338.310677:0:57851:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191338.310698:0:57851:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.310716:0:57851:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.310731:0:57851:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.310740:0:57851:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.310747:0:57851:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.310751:0:57851:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.310760:0:57851:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42183b58 00010000:00010000:1.0:1787191338.310764:0:57851:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.310800:0:57851:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.310819:0:57851:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.310827:0:57851:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191338.310890:0:57851:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.310895:0:57851:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=9 00000080:00200008:1.0:1787191338.310903:0:57851:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc1:0x0](ffff936b539580c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191338.310908:0:57851:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc1:0x0](ffff936b539580c8),name=f70.sanity-flr 00000002:00010000:1.0:1787191338.310920:0:57851:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc1:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.310928:0:57851:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839d1c lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46042bf expref: -99 pid: 57851 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191338.310935:0:57851:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839d1c lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46042bf expref: -99 pid: 57851 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191338.310941:0:57851:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.310944:0:57851:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc1:0x0](ffff936b539580c8) 00000080:00010000:1.0:1787191338.310946:0:57851:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc1:0x0](ffff936b539580c8) for lock 0xe5129dc884839d1c 00000080:00010000:1.0:1787191338.310950:0:57851:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839d1c from it ffffa3fb42183cb8 00010000:00010000:1.0:1787191338.310953:0:57851:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839d1c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46042bf expref: -99 pid: 57851 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191338.310965:0:57851:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839d1c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46042bf expref: -99 pid: 57851 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191338.310986:0:57851:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc1:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:1.0:1787191338.310997:0:57851:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc1:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191338.311001:0:57851:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191338.311004:0:57851:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc1:0x0] 00000008:00010000:1.0:1787191338.311024:0:57851:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191338.311028:0:57851:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b47d7d0b0, osc lock ffff936b46836980, flags 0x400000400001002 00010000:00010000:1.0:1787191338.311044:0:57851:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc884839d15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46042a3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191338.311065:0:57851:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc884839d15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46042a3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1787191338.311075:0:57851:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191338.311079:0:57851:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc884839d15 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46042a3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191338.311086:0:57851:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc884839d15 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46042a3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:1.0:1787191338.311095:0:57851:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191338.311104:0:57851:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc1:0x0] updating i_size 5 i_blocks 0 00000020:00010000:1.0:1787191338.311110:0:57851:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51656060 (ffff936b465ccb48/0) at cl_lock_release():245 00000020:00010000:1.0:1787191338.311113:0:57851:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51656060 (ffff936b465ccb48/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191338.311117:0:57851:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7d0b0 (ffff936b465cc488/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191338.311121:0:57851:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51656060 (ffff936b465ccb48/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191338.311123:0:57851:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7d0b0 (ffff936b465ccb48/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191338.311134:0:57851:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc1:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191338.311162:0:57851:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191338.311169:0:57851:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.311175:0:57851:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.311183:0:57851:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.311190:0:57851:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.311194:0:57851:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.311196:0:57851:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.311201:0:57851:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42183bf8 00010000:00010000:1.0:1787191338.311204:0:57851:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.311212:0:57851:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.311220:0:57851:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.311224:0:57851:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191338.311228:0:57851:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.311231:0:57851:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:1.0:1787191338.311235:0:57851:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc1:0x0](ffff936b539580c8), inode mode 81a4 mask 46 00000080:00200008:1.0:1787191338.311243:0:57851:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc1:0x0](ffff936b539580c8), flags 154402 00000002:00010000:1.0:1787191338.311258:0:57851:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc1:0x0]) in obj [0x200000405:0xc1:0x0], intent: open flags 0104240114403 00010000:00010000:1.0:1787191338.311301:0:57851:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839d2a lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.311309:0:57851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839d2a lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57851 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191338.311586:0:57851:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191338.311597:0:57851:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453ab100 x1874004626617216/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191338.311608:0:57851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839d2a lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.311628:0:57851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57851:1874004626617216:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.311810:0:57851:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.312199:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626616960:192.168.202.101@tcp:35:bash.0 00000002:00100000:1.0:1787191338.312222:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a477100 x1874004626613760/t8589936688(8589936688) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787191338.313865:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191338.313898:0:40921:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787191338.313913:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634871552 00000100:00100000:3.0:1787191338.313921:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634871552 00000100:00100000:3.0:1787191338.313963:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1279 00000100:00100000:3.0:1787191338.313973:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b50881c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634871552:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191338.313989:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839d1c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46042bf expref: -99 pid: 57851 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191338.314063:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191338.314071:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b50881c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634871552:12345-192.168.202.101@tcp:104: Request processed in 99us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191338.314078:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1279 00000100:00100000:1.0:1787191338.317427:0:57851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57851:1874004626617216:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191338.317446:0:57851:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CW ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839d2a lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46042db expref: -99 pid: 57851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.317457:0:57851:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839d2a lrc: 4/1,0 mode: --/CW res: [0x200000405:0xc1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46042db expref: -99 pid: 57851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.317469:0:57851:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839d2a lrc: 4/1,0 mode: CW/CW res: [0x200000405:0xc1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46042db expref: -99 pid: 57851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.317486:0:57851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839d2a lrc: 4/1,0 mode: CW/CW res: [0x200000405:0xc1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46042db expref: -99 pid: 57851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.317500:0:57851:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839d2a lrc: 5/1,1 mode: CW/CW res: [0x200000405:0xc1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46042db expref: -99 pid: 57851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.317508:0:57851:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839d2a lrc: 5/1,1 mode: CW/CW res: [0x200000405:0xc1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46042db expref: -99 pid: 57851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.317516:0:57851:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839d2a lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xc1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46042db expref: -99 pid: 57851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.317527:0:57851:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x200002b, status=0 req@ffff936b453ab100 x1874004626617216/t8589936697(8589936697) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191338.317540:0:57851:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453ab100 x1874004626617216/t8589936697(8589936697) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191338.317554:0:57851:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839d2a lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xc1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46042db expref: -99 pid: 57851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.317565:0:57851:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 8 res 8589935621/193 (0 0) 00000080:00200000:1.0:1787191338.317571:0:57851:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xc1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191338.317619:0:57851:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc1:0x0](ffff936b539580c8) for lock 0xe5129dc884839d2a 00000080:00010000:1.0:1787191338.317627:0:57851:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839d2a from it ffffa3fb42183bf0 00010000:00010000:1.0:1787191338.317631:0:57851:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839d2a lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xc1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46042db expref: -99 pid: 57851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.317644:0:57851:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839d2a lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xc1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46042db expref: -99 pid: 57851 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00100000:1.0:1787191338.317669:0:57851:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453ab100 x1874004626617216/t8589936697(8589936697) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191338.317784:0:57851:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc1:0x0](ffff936b539580c8), inode mode 81a4 mask 4 00000080:00200000:1.0:1787191338.317792:0:57851:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xc1:0x0](ffff936b539580c8), xattr lov 00000080:00200008:1.0:1787191338.317815:0:57851:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc1:0x0](ffff936b539580c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191338.317821:0:57851:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc1:0x0](ffff936b539580c8),name=f70.sanity-flr 00000002:00010000:1.0:1787191338.317969:0:57851:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc1:0x0]) in obj [0x200000405:0xc1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.317976:0:57851:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 30 res 8589935621/193 (0 0) 00010000:00010000:1.0:1787191338.318012:0:57851:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839d31 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.318018:0:57851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839d31 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.318024:0:57851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839d31 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.318038:0:57851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57851:1874004626617472:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.318426:0:57851:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00000080:00200000:2.0:1787191338.320075:0:57852:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000100:00100000:3.0:1787191338.320093:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000002:00010000:2.0:1787191338.320098:0:57852:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191338.320112:0:57852:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000100:00100000:3.0:1787191338.320123:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634871680 00010000:00010000:2.0:1787191338.320125:0:57852:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000100:00100000:3.0:1787191338.320129:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634871680 00000080:00200000:2.0:1787191338.320133:0:57852:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000100:00100000:3.0:1787191338.320171:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1280 00000100:00100000:3.0:1787191338.320181:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634871680:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191338.320194:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839d2a lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xc1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e46042db expref: -99 pid: 57851 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00010000:2.0:1787191338.320197:0:57852:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191338.320200:0:57852:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191338.320206:0:57852:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4214bb58 00010000:00010000:2.0:1787191338.320210:0:57852:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191338.320217:0:57852:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191338.320236:0:57852:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191338.320244:0:57852:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191338.320249:0:57852:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191338.320260:0:57852:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:2.0:1787191338.320265:0:57852:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191338.320277:0:57852:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1787191338.320303:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191338.320309:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634871680:12345-192.168.202.101@tcp:104: Request processed in 130us (219us total) trans 0 rc 0/0 00010000:00010000:2.0:1787191338.320314:0:57852:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839d38 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191338.320316:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1280 00010000:00010000:2.0:1787191338.320321:0:57852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839d38 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.320330:0:57852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839d38 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191338.320347:0:57852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57852:1874004626617600:192.168.202.101@tcp:101:rm.0 00000100:00100000:2.0:1787191338.320386:0:57852:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.321108:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626617728:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191338.322789:0:57851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57851:1874004626617472:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191338.322814:0:57851:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839d31 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46042f0 expref: -99 pid: 57851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.322824:0:57851:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839d31 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46042f0 expref: -99 pid: 57851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.322857:0:57851:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839d31 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46042f0 expref: -99 pid: 57851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.322873:0:57851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839d31 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46042f0 expref: -99 pid: 57851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.322884:0:57851:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839d31 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46042f0 expref: -99 pid: 57851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.322893:0:57851:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839d31 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46042f0 expref: -99 pid: 57851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.322900:0:57851:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839d31 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46042f0 expref: -99 pid: 57851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191338.322910:0:57851:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b453a8700 x1874004626617472/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/976 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191338.322921:0:57851:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839d31 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46042f0 expref: -99 pid: 57851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191338.322934:0:57851:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839d31 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46042f0 expref: -99 pid: 57851 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.322944:0:57851:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/193 (0 0) 00000080:00200000:2.0:1787191338.322949:0:57851:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xc1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1787191338.323004:0:57851:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc1:0x0]: layout version change: 4 -> 4 00000080:00010000:2.0:1787191338.323009:0:57851:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc1:0x0](ffff936b539580c8) for lock 0xe5129dc884839d31 00000080:00010000:2.0:1787191338.323014:0:57851:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc1:0x0](ffff936b539580c8) 00000080:00010000:2.0:1787191338.323017:0:57851:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839d31 from it ffffa3fb42183cd8 00010000:00010000:2.0:1787191338.323020:0:57851:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839d31 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46042f0 expref: -99 pid: 57851 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.323029:0:57851:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839d31 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46042f0 expref: -99 pid: 57851 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191338.323068:0:57851:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc1:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:2.0:1787191338.323077:0:57851:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc1:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191338.323080:0:57851:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191338.323083:0:57851:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc1:0x0] 00000008:00010000:2.0:1787191338.323099:0:57851:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191338.323102:0:57851:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1430, osc lock ffff936b44e63a20, flags 0x400000400001002 00010000:00010000:2.0:1787191338.323117:0:57851:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc884839d15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46042a3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191338.323130:0:57851:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc884839d15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46042a3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:2.0:1787191338.323145:0:57851:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191338.323149:0:57851:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc884839d15 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46042a3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191338.323158:0:57851:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc884839d15 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46042a3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:2.0:1787191338.323167:0:57851:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191338.323174:0:57851:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc1:0x0] updating i_size 5 i_blocks 0 00000020:00010000:2.0:1787191338.323179:0:57851:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c38000 (ffff936b47a17998/0) at cl_lock_release():245 00000020:00010000:2.0:1787191338.323183:0:57851:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c38000 (ffff936b47a17998/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191338.323185:0:57851:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1430 (ffff936b47a17ab8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191338.323189:0:57851:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c38000 (ffff936b47a17998/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191338.323192:0:57851:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1430 (ffff936b47a17998/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191338.323201:0:57851:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc1:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200080:2.0:1787191338.323284:0:57851:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc1:0x0](ffff936b539580c8) cmd=c00c66f3 arg=1ede2e0 00000002:00010000:2.0:1787191338.323305:0:57851:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc1:0x0]) in obj [0x200000405:0xc1:0x0], intent: open flags 05004040000002 00010000:00010000:2.0:1787191338.323342:0:57851:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839d3f lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.323349:0:57851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839d3f lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57851 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191338.323359:0:57851:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191338.323365:0:57851:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8700 x1874004626617984/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191338.323374:0:57851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839d3f lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x81000000000000 pid: 57851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191338.323390:0:57851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57851:1874004626617984:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191338.323597:0:57851:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f300 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.326177:0:57852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57852:1874004626617600:192.168.202.101@tcp:101:rm.0 00010000:00010000:1.0:1787191338.326200:0:57852:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839d38 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460430c expref: -99 pid: 57852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.326221:0:57852:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839d38 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460430c expref: -99 pid: 57852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.326228:0:57852:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839d38 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460430c expref: -99 pid: 57852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.326237:0:57852:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839d38 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460430c expref: -99 pid: 57852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.326248:0:57852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839d38 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460430c expref: -99 pid: 57852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.326258:0:57852:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839d38 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460430c expref: -99 pid: 57852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.326265:0:57852:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839d38 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460430c expref: -99 pid: 57852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.326271:0:57852:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839d38 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460430c expref: -99 pid: 57852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.326282:0:57852:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b513bb100 x1874004626617600/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/976 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191338.326292:0:57852:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839d38 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460430c expref: -99 pid: 57852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191338.326309:0:57852:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839d38 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460430c expref: -99 pid: 57852 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.326319:0:57852:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839d31 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46042f0 expref: -99 pid: 57851 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.326330:0:57852:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839d31 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46042f0 expref: -99 pid: 57851 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.326337:0:57852:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839d38 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460430c expref: -99 pid: 57852 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.326343:0:57852:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839d38 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x7130d520e460430c expref: -99 pid: 57852 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.326349:0:57852:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839d38 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x7130d520e460430c expref: -99 pid: 57852 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.326371:0:57852:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000080:00200000:1.0:1787191338.326378:0:57852:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191338.326433:0:57852:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xc1:0x0](ffff936b539580c8): rc = 0 00000080:00200000:1.0:1787191338.326449:0:57852:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc1:0x0]: layout version change: 4 -> 4 00000080:00010000:1.0:1787191338.326453:0:57852:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc1:0x0](ffff936b539580c8) for lock 0xe5129dc884839d31 00000080:00010000:1.0:1787191338.326466:0:57852:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc1:0x0](ffff936b539580c8) 00000080:00010000:1.0:1787191338.326469:0:57852:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839d31 from it ffffa3fb4214bb20 00010000:00010000:1.0:1787191338.326473:0:57852:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839d31 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46042f0 expref: -99 pid: 57851 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.326571:0:57852:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839d31 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46042f0 expref: -99 pid: 57851 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200008:1.0:1787191338.326620:0:57852:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc1:0x0](ffff936b539580c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191338.326631:0:57852:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc1:0x0](ffff936b539580c8),name=f70.sanity-flr 00000002:00010000:1.0:1787191338.326652:0:57852:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc1:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00000100:00100000:3.0:1787191338.327988:0:57851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57851:1874004626617984:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191338.328003:0:57851:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839d3f lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e460431a expref: -99 pid: 57851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.328012:0:57851:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839d3f lrc: 4/1,0 mode: --/PW res: [0x200000405:0xc1:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e460431a expref: -99 pid: 57851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.328024:0:57851:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839d3f lrc: 4/1,0 mode: PW/PW res: [0x200000405:0xc1:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e460431a expref: -99 pid: 57851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.328031:0:57851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839d3f lrc: 4/1,0 mode: PW/PW res: [0x200000405:0xc1:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e460431a expref: -99 pid: 57851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.328038:0:57851:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839d3f lrc: 5/1,1 mode: PW/PW res: [0x200000405:0xc1:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e460431a expref: -99 pid: 57851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.328043:0:57851:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839d3f lrc: 5/1,1 mode: PW/PW res: [0x200000405:0xc1:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e460431a expref: -99 pid: 57851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.328047:0:57851:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839d3f lrc: 4/0,1 mode: PW/PW res: [0x200000405:0xc1:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e460431a expref: -99 pid: 57851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191338.328065:0:57851:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x600002b, status=0 req@ffff936b513b8700 x1874004626617984/t8589936698(8589936698) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191338.328077:0:57851:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b8700 x1874004626617984/t8589936698(8589936698) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191338.328090:0:57851:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839d3f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xc1:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e460431a expref: -99 pid: 57851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.328099:0:57851:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 2 res 8589935621/193 (0 0) 00000080:00200000:3.0:1787191338.328105:0:57851:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xc1:0x0] suppgids 0 0: rc 0 00000002:00100000:3.0:1787191338.328123:0:57851:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b8700 x1874004626617984/t8589936698(8589936698) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1787191338.328131:0:57851:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc1:0x0](ffff936b539580c8) for lock 0xe5129dc884839d3f 00000080:00010000:3.0:1787191338.328143:0:57851:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839d3f from it ffffa3fb42183cc0 00010000:00010000:3.0:1787191338.328147:0:57851:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839d3f lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xc1:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e460431a expref: -99 pid: 57851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.328268:0:57851:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839d3f lrc: 2/0,0 mode: PW/PW res: [0x200000405:0xc1:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e460431a expref: -99 pid: 57851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1787191338.328321:0:57851:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc1:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:3.0:1787191338.328332:0:57851:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc1:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191338.328335:0:57851:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191338.328341:0:57851:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191338.328351:0:57851:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000100:00100000:2.0:1787191338.328418:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626618240:192.168.202.101@tcp:1:lfs.0 00010000:00010000:1.0:1787191338.328438:0:57852:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839d31 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46042f0 expref: -99 pid: 57851 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191338.328449:0:57852:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839d31 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46042f0 expref: -99 pid: 57851 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191338.328458:0:57852:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.328464:0:57852:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc1:0x0](ffff936b539580c8) 00000080:00010000:1.0:1787191338.328468:0:57852:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc1:0x0](ffff936b539580c8) for lock 0xe5129dc884839d31 00000080:00010000:1.0:1787191338.328472:0:57852:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839d31 from it ffffa3fb4214bcb8 00010000:00010000:1.0:1787191338.328475:0:57852:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839d31 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46042f0 expref: -99 pid: 57851 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191338.328483:0:57852:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839d31 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46042f0 expref: -99 pid: 57851 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1787191338.328502:0:57852:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc1:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:1.0:1787191338.328508:0:57852:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc1:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191338.328511:0:57852:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191338.328514:0:57852:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc1:0x0] 00000008:00010000:1.0:1787191338.328528:0:57852:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191338.328531:0:57852:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b47d7d0b0, osc lock ffff936b46836980, flags 0x400000400001002 00010000:00010000:1.0:1787191338.328547:0:57852:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc884839d15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46042a3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191338.328557:0:57852:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc884839d15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46042a3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:1.0:1787191338.328568:0:57852:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191338.328572:0:57852:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc884839d15 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46042a3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191338.328579:0:57852:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc884839d15 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46042a3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000020:00200000:1.0:1787191338.328590:0:57852:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191338.328599:0:57852:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc1:0x0] updating i_size 5 i_blocks 0 00000020:00010000:1.0:1787191338.328606:0:57852:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51656060 (ffff936b465ccb48/0) at cl_lock_release():245 00000020:00010000:1.0:1787191338.328609:0:57852:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51656060 (ffff936b465ccb48/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191338.328612:0:57852:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7d0b0 (ffff936b465cc488/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191338.328616:0:57852:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51656060 (ffff936b465ccb48/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191338.328618:0:57852:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7d0b0 (ffff936b465ccb48/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191338.328627:0:57852:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc1:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191338.328731:0:57852:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191338.328744:0:57852:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.328752:0:57852:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.328765:0:57852:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.328771:0:57852:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.328775:0:57852:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.328777:0:57852:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.328781:0:57852:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4214bc10 00010000:00010000:1.0:1787191338.328785:0:57852:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.328792:0:57852:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.328801:0:57852:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.328807:0:57852:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:1.0:1787191338.328812:0:57852:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.328819:0:57852:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:1.0:1787191338.328822:0:57852:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:1.0:1787191338.328827:0:57852:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:1.0:1787191338.329075:0:57852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839d3f lrc: 2/0,0 mode: PW/PW res: [0x200000405:0xc1:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81008400000000 nid: local remote: 0x7130d520e460431a expref: -99 pid: 57851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.329088:0:57852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839d0e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc1:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4604280 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1787191338.329100:0:57852:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc1:0x0]: losing layout lock 00010000:00010000:1.0:1787191338.329108:0:57852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839d31 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46042f0 expref: -99 pid: 57851 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1787191338.329116:0:57852:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc1:0x0]: losing layout lock 00010000:00010000:1.0:1787191338.329123:0:57852:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839d00 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4604241 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.329251:0:57852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839d3f lrc: 1/0,0 mode: --/PW res: [0x200000405:0xc1:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x85809400000020 nid: local remote: 0x7130d520e460431a expref: -99 pid: 57851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.329258:0:57852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839d0e lrc: 1/0,0 mode: --/CR res: [0x200000405:0xc1:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604280 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191338.329264:0:57852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839d31 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46042f0 expref: -99 pid: 57851 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191338.329270:0:57852:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839d00 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4604241 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.329274:0:57852:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 4 locks packed 00010000:00010000:1.0:1787191338.329277:0:57852:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839d3f lrc: 0/0,0 mode: --/PW res: [0x200000405:0xc1:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x85809400000020 nid: local remote: 0x7130d520e460431a expref: -99 pid: 57851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.329288:0:57852:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839d0e lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc1:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604280 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191338.329298:0:57852:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839d31 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46042f0 expref: -99 pid: 57851 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191338.329306:0:57852:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839d00 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4604241 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1787191338.329600:0:57852:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1787191338.329610:0:57852:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8700 x1874004626618496/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 512/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787191338.329682:0:57852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57852:1874004626618496:192.168.202.101@tcp:36:rm.0 00000100:00100000:1.0:1787191338.329725:0:57852:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893180 going to sleep for 11 seconds 00000100:00100000:3.0:1787191338.331606:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191338.331634:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634871808 00000100:00100000:3.0:1787191338.331642:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634871808 00000100:00100000:3.0:1787191338.331683:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1281 00000100:00100000:3.0:1787191338.331694:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:29543:x1874004634871808:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191338.331709:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc884839d15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420080000000 nid: local remote: 0x7130d520e46042a3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1787191338.332087:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191338.332094:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:29543:x1874004634871808:12345-192.168.202.101@tcp:104: Request processed in 402us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191338.332102:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1281 00000100:00100000:1.0:1787191338.333099:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626618624:192.168.202.101@tcp:4:bash.0 00000100:00100000:1.0:1787191338.336265:0:57852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57852:1874004626618496:192.168.202.101@tcp:36:rm.0 00000008:00010000:1.0:1787191338.341193:0:2390:0:(osc_cache.c:917:osc_extent_finish()) ### extent: 00000000f287428f ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc884839d15 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800429480000000 nid: local remote: 0x7130d520e46042a3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000008:00010000:1.0:1787191338.341278:0:2390:0:(osc_cache.c:497:__osc_extent_remove()) ### extent: 00000000f287428f ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc884839d15 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800429480000000 nid: local remote: 0x7130d520e46042a3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000100:00100000:1.0:1787191338.341310:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626618624:192.168.202.101@tcp:4:bash.0 00000080:00200000:2.0:1787191338.341373:0:43384:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc1:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1787191338.341477:0:43384:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc1:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:2.0:1787191338.342067:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc884839d15 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69480000020 nid: local remote: 0x7130d520e46042a3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1787191338.342083:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787191338.342140:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626618752:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787191338.342242:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc884839d15 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69480000020 nid: local remote: 0x7130d520e46042a3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1787191338.342253:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc884839d15 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69480000020 nid: local remote: 0x7130d520e46042a3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1787191338.342272:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191338.342275:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191338.342277:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191338.346494:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626618240:192.168.202.101@tcp:1:lfs.0 00000100:00100000:3.0:1787191338.346594:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626618752:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191338.349467:0:57853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57853:1874004626618880:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191338.349490:0:57853:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc884839d46 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.349504:0:57853:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc884839d46 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.349560:0:57853:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc884839d46 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.349566:0:57853:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc884839d46 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.349572:0:57853:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc884839d46 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.349579:0:57853:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44caf000 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191338.349583:0:57853:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc884839d46 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.349588:0:57853:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc884839d46 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.349593:0:57853:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc884839d46 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.349597:0:57853:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191338.349651:0:57853:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc884839d46 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.349656:0:57853:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc884839d46 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57853 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191338.349674:0:57853:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b6a474000 x1874004626618880/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191338.349686:0:57853:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191338.349760:0:57853:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191338.349774:0:57853:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191338.349784:0:57853:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191338.349793:0:57853:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191338.349797:0:57853:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191338.349801:0:57853:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191338.349804:0:57853:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191338.349808:0:57853:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4218bbe8 00010000:00010000:2.0:1787191338.349810:0:57853:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191338.349816:0:57853:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191338.349826:0:57853:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191338.349901:0:57853:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000080:00200000:2.0:1787191338.349907:0:57853:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191338.349916:0:57853:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:2.0:1787191338.349920:0:57853:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191338.349928:0:57853:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191338.349960:0:57853:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839d4d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.349965:0:57853:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839d4d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.349971:0:57853:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839d4d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191338.349984:0:57853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57853:1874004626619264:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191338.350129:0:57853:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787191338.353699:0:57851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57851:1874004626619520:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191338.353718:0:57851:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513b8700 x1874004626617984/t8589936698(8589936698) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:3.0:1787191338.353889:0:57851:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc1:0x0](ffff936b539580c8), flags 154002 00000002:00100000:3.0:1787191338.353918:0:57851:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453ab100 x1874004626617216/t8589936697(8589936697) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191338.353928:0:57851:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191338.353933:0:57851:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1c380 x1874004626619904/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191338.353945:0:57851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57851:1874004626619904:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191338.354706:0:57851:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787191338.357279:0:57851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57851:1874004626619904:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191338.357302:0:57851:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453ab100 x1874004626617216/t8589936697(8589936697) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191338.357356:0:57851:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc1:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1787191338.357367:0:57851:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc1:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191338.357371:0:57851:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191338.357377:0:57851:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191338.357390:0:57851:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1787191338.357418:0:57851:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc1:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191338.357425:0:57851:0:(llite_lib.c:2066:ll_clear_inode()) VFS Op:inode=[0x200000405:0xc1:0x0](ffff936b539580c8) 00000008:00010000:3.0:1787191338.357463:0:57851:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191338 1787191338 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000211232bf/0xe5129dc884839d23 lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x1a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46042cd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1787191338.368791:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191338.368821:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634871936 00000100:00100000:3.0:1787191338.368829:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634871936 00000100:00100000:3.0:1787191338.368895:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1282 00000100:00100000:3.0:1787191338.368905:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634871936:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191338.368922:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc884839d62 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46043ad expref: -99 pid: 57853 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.368989:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191338.368995:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634871936:12345-192.168.202.101@tcp:104: Request processed in 92us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191338.369002:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1282 00000100:00100000:1.0:1787191338.369240:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626620672:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00200000:2.0:1787191338.371633:0:57854:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191338.371664:0:57854:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191338.371679:0:57854:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191338.371696:0:57854:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191338.371703:0:57854:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191338.371711:0:57854:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191338.371714:0:57854:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191338.371721:0:57854:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4214bbf8 00010000:00010000:2.0:1787191338.371725:0:57854:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191338.371734:0:57854:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191338.371750:0:57854:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191338.371758:0:57854:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191338.371764:0:57854:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191338.371778:0:57854:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b51c6af00, open_flags d900, mode 0 opened 0 00000080:00200000:2.0:1787191338.371785:0:57854:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:2.0:1787191338.371799:0:57854:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:2.0:1787191338.371912:0:57854:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839d70 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.371922:0:57854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839d70 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57854 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191338.371934:0:57854:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:2.0:1787191338.371946:0:57854:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb800 x1874004626620928/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191338.371956:0:57854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839d70 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191338.371977:0:57854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57854:1874004626620928:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191338.372149:0:57854:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.374201:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626620672:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191338.374797:0:57854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57854:1874004626620928:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191338.374809:0:57854:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839d70 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46043e5 expref: -99 pid: 57854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.374827:0:57854:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839d70 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46043e5 expref: -99 pid: 57854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.374862:0:57854:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839d70 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46043e5 expref: -99 pid: 57854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.374874:0:57854:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839d70 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46043e5 expref: -99 pid: 57854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.374883:0:57854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839d70 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46043e5 expref: -99 pid: 57854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.374892:0:57854:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839d70 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46043e5 expref: -99 pid: 57854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.374897:0:57854:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839d70 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46043e5 expref: -99 pid: 57854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.374906:0:57854:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839d70 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46043e5 expref: -99 pid: 57854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191338.374914:0:57854:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b513bb800 x1874004626620928/t8589936704(8589936704) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191338.374921:0:57854:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bb800 x1874004626620928/t8589936704(8589936704) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191338.374928:0:57854:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839d70 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46043e5 expref: -99 pid: 57854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191338.374936:0:57854:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839d70 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46043e5 expref: -99 pid: 57854 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.374942:0:57854:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/194 (0 0) 00000080:00200000:2.0:1787191338.374946:0:57854:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191338.376036:0:57854:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xc2:0x0](ffff936b53969988): rc = 0 00000080:00200000:2.0:1787191338.376067:0:57854:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc2:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:2.0:1787191338.376073:0:57854:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc2:0x0](ffff936b53969988) for lock 0xe5129dc884839d70 00000080:00010000:2.0:1787191338.376086:0:57854:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc2:0x0](ffff936b53969988) 00000080:00200008:2.0:1787191338.376099:0:57854:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc2:0x0](ffff936b53969988), flags 154400 00000002:00100000:2.0:1787191338.376114:0:57854:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bb800 x1874004626620928/t8589936704(8589936704) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1787191338.376891:0:57854:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839d70 from it ffff936b60dc45a0 00010000:00010000:2.0:1787191338.376899:0:57854:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839d70 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46043e5 expref: -99 pid: 57854 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.376915:0:57854:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839d70 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46043e5 expref: -99 pid: 57854 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191338.376940:0:57854:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc2:0x0](ffff936b53969988), inode mode 81a4 mask 44 00000080:00200000:2.0:1787191338.377049:0:57854:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc2:0x0](ffff936b53969988), inode mode 81a4 mask 4 00000080:00200000:2.0:1787191338.377067:0:57854:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xc2:0x0](ffff936b53969988), xattr lov 00000080:00200008:2.0:1787191338.377096:0:57854:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc2:0x0](ffff936b53969988), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191338.377101:0:57854:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc2:0x0](ffff936b53969988),name=f70.sanity-flr 00000002:00010000:2.0:1787191338.377119:0:57854:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc2:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191338.377130:0:57854:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839d70 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46043e5 expref: -99 pid: 57854 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191338.377923:0:57854:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839d70 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46043e5 expref: -99 pid: 57854 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191338.377933:0:57854:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191338.377939:0:57854:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc2:0x0](ffff936b53969988) 00000080:00010000:2.0:1787191338.377942:0:57854:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc2:0x0](ffff936b53969988) for lock 0xe5129dc884839d70 00000080:00010000:2.0:1787191338.377948:0:57854:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839d70 from it ffffa3fb4214bcd8 00010000:00010000:2.0:1787191338.377951:0:57854:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839d70 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46043e5 expref: -99 pid: 57854 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191338.377958:0:57854:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839d70 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46043e5 expref: -99 pid: 57854 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191338.377979:0:57854:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc2:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:2.0:1787191338.377990:0:57854:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc2:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191338.377993:0:57854:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191338.377997:0:57854:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc2:0x0] 00000008:00010000:2.0:1787191338.378013:0:57854:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191338.378016:0:57854:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d10b0, osc lock ffff936b44e63a20, flags 0x400000400001002 00010000:00010000:2.0:1787191338.378063:0:57854:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc884839d77 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57854 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.378073:0:57854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc884839d77 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57854 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.378083:0:57854:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b513b9180 x1874004626621568/t0(0) o101->lustre-OST0000-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:2.0:1787191338.378107:0:57854:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:2.0:1787191338.378121:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626621568:192.168.202.101@tcp:101:lfs.0 00000080:00200000:2.0:1787191338.382035:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191338.382067:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191338.382085:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191338.382099:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191338.382107:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191338.382113:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191338.382117:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191338.382124:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:2.0:1787191338.382129:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191338.382151:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191338.382167:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191338.382175:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191338.382181:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191338.382187:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:2.0:1787191338.382192:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc2:0x0](ffff936b53969988), inode mode 81a4 mask 42 00000080:00200008:2.0:1787191338.382198:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc2:0x0](ffff936b53969988), flags 101101 00000002:00010000:2.0:1787191338.382214:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc2:0x0]) in obj [0x200000405:0xc2:0x0], intent: open|creat flags 04240101102 00010000:00010000:2.0:1787191338.382224:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839d70 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46043e5 expref: -99 pid: 57854 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191338.382243:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc2:0x0]: losing layout lock 00010000:00010000:2.0:1787191338.382285:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839d70 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46043e5 expref: -99 pid: 57854 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191338.382292:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191338.382295:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839d70 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46043e5 expref: -99 pid: 57854 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191338.382327:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839d7e lrc: 3/0,1 mode: --/CW res: [0x200000405:0xc2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.382333:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839d7e lrc: 3/0,1 mode: --/CW res: [0x200000405:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191338.382345:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191338.382355:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9880 x1874004626621824/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191338.382365:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839d7e lrc: 3/0,1 mode: --/CW res: [0x200000405:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191338.382387:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626621824:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191338.382697:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1787191338.383474:0:2391:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc884839d77 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57854 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.383489:0:2391:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc884839d77 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46043f3 expref: -99 pid: 57854 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.383501:0:2391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc884839d77 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46043f3 expref: -99 pid: 57854 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.383517:0:2391:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc884839d77 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46043f3 expref: -99 pid: 57854 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1787191338.383527:0:2391:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc884839d77 lrc: 5/2,0 mode: PR/PR res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46043f3 expref: -99 pid: 57854 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:2.0:1787191338.383535:0:2391:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:2.0:1787191338.383548:0:2391:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc884839d77 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46043f3 expref: -99 pid: 57854 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.383554:0:2391:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc884839d77 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46043f3 expref: -99 pid: 57854 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.383559:0:2391:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc884839d77 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46043f3 expref: -99 pid: 57854 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.383564:0:2391:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc884839d77 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46043f3 expref: -99 pid: 57854 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:2.0:1787191338.383575:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626621568:192.168.202.101@tcp:101:lfs.0 00000080:00200000:1.0:1787191338.385284:0:57854:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc2:0x0] updating i_size 0 i_blocks 0 00000020:00010000:1.0:1787191338.385294:0:57854:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c38000 (ffff936b47a17998/0) at cl_lock_release():245 00000020:00010000:1.0:1787191338.385298:0:57854:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c38000 (ffff936b47a17998/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191338.385302:0:57854:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d10b0 (ffff936b47a17ab8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191338.385307:0:57854:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c38000 (ffff936b47a17998/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191338.385309:0:57854:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d10b0 (ffff936b47a17998/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191338.385322:0:57854:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc2:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:1.0:1787191338.385338:0:57854:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/194 (0 0) 00000080:00010000:1.0:1787191338.385348:0:57854:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xc2:0x0](ffff936b53969988) 00000002:00010000:1.0:1787191338.385359:0:57854:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc2:0x0]) in obj [0x200000405:0xc2:0x0], intent: layout flags 0 00010000:00010000:1.0:1787191338.385406:0:57854:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839d85 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.385414:0:57854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839d85 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.385425:0:57854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839d85 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.385448:0:57854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57854:1874004626621952:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.385565:0:57854:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893180 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.386150:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626621824:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191338.386165:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839d7e lrc: 4/0,1 mode: --/CW res: [0x200000405:0xc2:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604401 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.386178:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839d7e lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xc2:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604401 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.386188:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839d7e lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xc2:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604401 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.386201:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x200002b, status=0 req@ffff936b513b9880 x1874004626621824/t8589936707(8589936707) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191338.386220:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9880 x1874004626621824/t8589936707(8589936707) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191338.386233:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839d7e lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xc2:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604401 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191338.386245:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839d7e lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xc2:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604401 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.386265:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 8 res 8589935621/194 (0 0) 00000080:00200000:1.0:1787191338.386270:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000405:0xc2:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787191338.386341:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc2:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:1.0:1787191338.386347:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc2:0x0](ffff936b53969988) for lock 0xe5129dc884839d7e 00000080:00010000:1.0:1787191338.386353:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839d7e from it ffffa3fb41cabbf0 00010000:00010000:1.0:1787191338.386357:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839d7e lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xc2:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604401 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.386366:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839d7e lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xc2:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604401 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000002:00100000:1.0:1787191338.386389:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9880 x1874004626621824/t8589936707(8589936707) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191338.386454:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xc2:0x0], intent: getxattr flags 0 00010000:00010000:1.0:1787191338.386481:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839d8c lrc: 3/1,0 mode: --/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.386489:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839d8c lrc: 3/1,0 mode: --/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.386498:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839d8c lrc: 3/1,0 mode: --/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.386511:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626622080:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191338.386557:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628939c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.388106:0:57854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57854:1874004626621952:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191338.388128:0:57854:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839d85 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xc2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460440f expref: -99 pid: 57854 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.388140:0:57854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839d85 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xc2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460440f expref: -99 pid: 57854 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.388153:0:57854:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b453a8380 x1874004626621952/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191338.388162:0:57854:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839d85 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460440f expref: -99 pid: 57854 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191338.388173:0:57854:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839d85 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460440f expref: -99 pid: 57854 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.388182:0:57854:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/194 (0 0) 00000080:00200000:1.0:1787191338.388188:0:57854:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xc2:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191338.388204:0:57854:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc2:0x0](ffff936b53969988) for lock 0xe5129dc884839d85 00000080:00010000:1.0:1787191338.388210:0:57854:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839d85 from it ffffa3fb4214bbc8 00010000:00010000:1.0:1787191338.388214:0:57854:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839d85 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460440f expref: -99 pid: 57854 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.388228:0:57854:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839d85 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460440f expref: -99 pid: 57854 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.388316:0:57854:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839d7e lrc: 2/0,1 mode: CW/CW res: [0x200000405:0xc2:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604401 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.388402:0:57854:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839d7e lrc: 2/0,1 mode: CW/CW res: [0x200000405:0xc2:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604401 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:1.0:1787191338.388412:0:57854:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xc2:0x0](00000000d7469e7d) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839d7e lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xc2:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604401 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.388422:0:57854:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839d7e lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xc2:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604401 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.388430:0:57854:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839d7e lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xc2:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604401 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200008:1.0:1787191338.388496:0:57854:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc2:0x0](ffff936b53969988), flags 154000 00000002:00100000:1.0:1787191338.388536:0:57854:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513bb800 x1874004626620928/t8589936704(8589936704) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191338.388547:0:57854:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191338.388552:0:57854:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8380 x1874004626622336/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191338.388570:0:57854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57854:1874004626622336:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191338.388826:0:57854:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893180 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.389176:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626622080:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191338.389189:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839d8c lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460441d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.389199:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839d8c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460441d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.389208:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839d8c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460441d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.389219:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b453ab800 x1874004626622080/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191338.389228:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839d8c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460441d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.389235:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/194 (0 0) 00000080:00200000:1.0:1787191338.389240:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xc2:0x0] suppgids 0 -1: rc 0 00000080:00010000:1.0:1787191338.389271:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc2:0x0](ffff936b53969988) for lock 0xe5129dc884839d8c 00000080:00010000:1.0:1787191338.389277:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839d8c from it ffffa3fb41caba38 00010000:00010000:1.0:1787191338.389280:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839d8c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460441d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.389288:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839d8c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460441d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:1.0:1787191338.389315:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xc2:0x0](ffff936b53969988) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191338.000000000, mtime 1787191338.000000000, ctime 1787191338.000000000 00010000:00010000:1.0:1787191338.389350:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839d7e lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xc2:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4604401 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191338.389367:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839d85 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460440f expref: -99 pid: 57854 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191338.389400:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839d7e lrc: 1/0,0 mode: --/CW res: [0x200000405:0xc2:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604401 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191338.389407:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191338.389410:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc884839d7e lrc: 0/0,0 mode: --/CW res: [0x200000405:0xc2:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604401 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000020:00100000:1.0:1787191338.389426:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 36, max 7 00000100:00100000:1.0:1787191338.389432:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453ab800 x1874004626622592/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787191338.389445:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626622592:192.168.202.101@tcp:36:bash.0 00000100:00100000:1.0:1787191338.389476:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628939c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.391507:0:57854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57854:1874004626622336:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191338.391533:0:57854:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513bb800 x1874004626620928/t8589936704(8589936704) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191338.391703:0:57854:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191338.391720:0:57854:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.391733:0:57854:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.391751:0:57854:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.391758:0:57854:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.391763:0:57854:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.391767:0:57854:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.391773:0:57854:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4214bbf8 00010000:00010000:1.0:1787191338.391777:0:57854:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.391785:0:57854:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.391798:0:57854:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.391806:0:57854:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191338.391812:0:57854:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.391824:0:57854:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b5089be00, open_flags d900, mode 0 opened 0 00000100:00100000:3.0:1787191338.392387:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626622592:192.168.202.101@tcp:36:bash.0 00000080:00200000:3.0:1787191338.392430:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:3.0:1787191338.392436:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc2:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:3.0:1787191338.392445:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xc2:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:3.0:1787191338.392450:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc2:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191338.392453:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xc2:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:3.0:1787191338.392459:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xc2:0x0](ffff936b53969988) 00000002:00010000:3.0:1787191338.392464:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc2:0x0]) in obj [0x200000405:0xc2:0x0], intent: layout flags 02 00010000:00010000:3.0:1787191338.392478:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839d85 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e460440f expref: -99 pid: 57854 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191338.392492:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc2:0x0]: losing layout lock 00010000:00010000:3.0:1787191338.392533:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839d85 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xc2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e460440f expref: -99 pid: 57854 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191338.392540:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191338.392543:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839d85 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e460440f expref: -99 pid: 57854 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191338.392562:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884839d93 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xc2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.392569:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884839d93 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xc2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191338.392579:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191338.392585:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1d500 x1874004626622848/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191338.392595:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884839d93 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xc2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191338.392613:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626622848:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191338.392683:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cf00 going to sleep for 11 seconds 00000080:00200000:1.0:1787191338.392691:0:57854:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:1.0:1787191338.392709:0:57854:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:1.0:1787191338.392740:0:57854:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839d9a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.392748:0:57854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839d9a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57854 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191338.392755:0:57854:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:1.0:1787191338.392761:0:57854:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8380 x1874004626623104/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191338.392769:0:57854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839d9a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.392779:0:57854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57854:1874004626623104:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.392919:0:57854:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893180 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.397883:0:57854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57854:1874004626623104:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191338.397906:0:57854:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839d9a lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.397919:0:57854:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839d9a lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.397925:0:57854:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839d9a lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.397932:0:57854:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839d9a lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.397940:0:57854:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839d9a lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.397946:0:57854:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b587bce00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191338.397950:0:57854:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839d9a lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.397956:0:57854:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839d9a lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.397963:0:57854:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839d9a lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.397971:0:57854:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191338.397976:0:57854:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839d9a lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.397982:0:57854:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839d9a lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57854 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.398008:0:57854:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b453a8380 x1874004626623104/t8589936711(8589936711) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191338.398022:0:57854:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8380 x1874004626623104/t8589936711(8589936711) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191338.398038:0:57854:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191338.398099:0:57854:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc2:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00020000:00200000:1.0:1787191338.398109:0:57854:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc2:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191338.398113:0:57854:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191338.398118:0:57854:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191338.398128:0:57854:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191338.398145:0:57854:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc2:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:1.0:1787191338.398160:0:57854:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc884839d77 lrc: 1/0,0 mode: PR/PR res: [0x280000401:0x1a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46043f3 expref: -99 pid: 57854 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191338.398242:0:57854:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xc2:0x0](ffff936b53969988): rc = 0 00000080:00010000:1.0:1787191338.398316:0:57854:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc2:0x0](ffff936b53969988) for lock 0x0 00000080:00200008:1.0:1787191338.398472:0:57854:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc2:0x0](ffff936b53969988), flags 154400 00000002:00100000:1.0:1787191338.398497:0:57854:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8380 x1874004626623104/t8589936711(8589936711) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191338.398569:0:57854:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc2:0x0](ffff936b53969988), inode mode 81a4 mask 44 00000080:00200000:1.0:1787191338.398704:0:57854:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc2:0x0](ffff936b53969988), inode mode 81a4 mask 4 00000080:00200000:1.0:1787191338.398712:0:57854:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xc2:0x0](ffff936b53969988), xattr lov 00000080:00200008:1.0:1787191338.398740:0:57854:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc2:0x0](ffff936b53969988), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191338.398747:0:57854:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc2:0x0](ffff936b53969988),name=f70.sanity-flr 00000002:00010000:1.0:1787191338.398761:0:57854:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc2:0x0]) in obj [0x200000405:0xc2:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.398771:0:57854:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 30 res 8589935621/194 (0 0) 00010000:00010000:1.0:1787191338.398815:0:57854:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839da1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.398823:0:57854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839da1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.398873:0:57854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839da1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.398894:0:57854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57854:1874004626623232:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.398978:0:57854:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893180 going to sleep for 11 seconds 00000100:00100000:3.0:1787191338.407157:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191338.407218:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191338.407270:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634872576 00000100:00100000:3.0:1787191338.407278:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634872576 00000100:00100000:3.0:1787191338.407320:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634873216 00000100:00100000:3.0:1787191338.407323:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634873216 00000100:00100000:3.0:1787191338.407339:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1283 00000100:00100000:3.0:1787191338.407348:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:37089:x1874004634872576:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191338.407366:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc884839ceb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e460421e expref: -99 pid: 57850 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.407431:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191338.407437:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:37089:x1874004634872576:12345-192.168.202.101@tcp:104: Request processed in 91us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191338.407444:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1283 00000100:00100000:3.0:1787191338.407460:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1284 00000100:00100000:3.0:1787191338.407466:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8420:x1874004634873216:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191338.407474:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839ce4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4604217 expref: -99 pid: 57850 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.407499:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787191338.407503:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8420:x1874004634873216:12345-192.168.202.101@tcp:104: Request processed in 39us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191338.407508:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1284 00010000:00010000:3.0:1787191338.407525:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787191338.407531:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc884839ceb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e460421e expref: -99 pid: 57850 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.407539:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cafa00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191338.407544:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc884839ceb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e460421e expref: -99 pid: 57850 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.407583:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc884839ceb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e460421e expref: -99 pid: 57850 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.407590:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191338.407609:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc884839ceb lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e460421e expref: -99 pid: 57850 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.407617:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc884839ceb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e460421e expref: -99 pid: 57850 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.407648:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191338.407652:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839ce4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4604217 expref: -99 pid: 57850 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.407659:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cafe00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191338.407663:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839ce4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e4604217 expref: -99 pid: 57850 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.407683:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839ce4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4604217 expref: -99 pid: 57850 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.407690:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191338.407696:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839ce4 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4604217 expref: -99 pid: 57850 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.407704:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839ce4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4604217 expref: -99 pid: 57850 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.407716:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191338.407718:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191338.407719:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191338.407725:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191338.407738:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626623360:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191338.407788:0:2392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787191338.407794:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626623488:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191338.408270:0:57854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57854:1874004626623232:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191338.408282:0:57854:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839da1 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604463 expref: -99 pid: 57854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.408289:0:57854:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839da1 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604463 expref: -99 pid: 57854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.408297:0:57854:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839da1 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604463 expref: -99 pid: 57854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.408307:0:57854:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839da1 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604463 expref: -99 pid: 57854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.408315:0:57854:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839da1 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604463 expref: -99 pid: 57854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.408332:0:57854:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839da1 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604463 expref: -99 pid: 57854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.408339:0:57854:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839da1 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604463 expref: -99 pid: 57854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.408350:0:57854:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b453a9180 x1874004626623232/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/976 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191338.408361:0:57854:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839da1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604463 expref: -99 pid: 57854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.408372:0:57854:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/194 (0 0) 00000080:00200000:1.0:1787191338.408376:0:57854:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xc2:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191338.408418:0:57854:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc2:0x0](ffff936b53969988) for lock 0xe5129dc884839da1 00000080:00010000:1.0:1787191338.408423:0:57854:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc2:0x0](ffff936b53969988) 00000080:00010000:1.0:1787191338.408426:0:57854:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839da1 from it ffffa3fb4214bcd8 00010000:00010000:1.0:1787191338.408430:0:57854:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839da1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604463 expref: -99 pid: 57854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.408438:0:57854:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839da1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604463 expref: -99 pid: 57854 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191338.408459:0:57854:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc2:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00020000:00200000:1.0:1787191338.408464:0:57854:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc2:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191338.408468:0:57854:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191338.408470:0:57854:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc2:0x0] 00000008:00010000:1.0:1787191338.408478:0:57854:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191338.408480:0:57854:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b47d7df30, osc lock ffff936b46836980, flags 0x400000400001002 00010000:00010000:1.0:1787191338.408490:0:57854:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc884839d77 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1a8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46043f3 expref: -99 pid: 57854 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.408500:0:57854:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc884839d77 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46043f3 expref: -99 pid: 57854 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000008:00010000:1.0:1787191338.408514:0:57854:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc884839d77 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x1a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46043f3 expref: -99 pid: 57854 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1787191338.408524:0:57854:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191338.408528:0:57854:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc884839d77 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46043f3 expref: -99 pid: 57854 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.408536:0:57854:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc884839d77 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46043f3 expref: -99 pid: 57854 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1787191338.408556:0:57854:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191338.408566:0:57854:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc2:0x0] updating i_size 0 i_blocks 0 00000020:00010000:1.0:1787191338.408569:0:57854:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c38000 (ffff936b47a17998/0) at cl_lock_release():245 00000020:00010000:1.0:1787191338.408572:0:57854:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c38000 (ffff936b47a17998/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191338.408576:0:57854:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7df30 (ffff936b47a17ab8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191338.408580:0:57854:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c38000 (ffff936b47a17998/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191338.408582:0:57854:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7df30 (ffff936b47a17998/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191338.408591:0:57854:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc2:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1787191338.409565:0:57854:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc2:0x0](ffff936b53969988), flags 154000 00000002:00100000:1.0:1787191338.409630:0:57854:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a8380 x1874004626623104/t8589936711(8589936711) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191338.409642:0:57854:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191338.409648:0:57854:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9180 x1874004626623872/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191338.409666:0:57854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57854:1874004626623872:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191338.409716:0:57854:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893180 going to sleep for 11 seconds 00000100:00100000:3.0:1787191338.413651:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626623488:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191338.413671:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626623360:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191338.414398:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191338.414466:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634873344 00000100:00100000:3.0:1787191338.414474:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634873344 00000100:00100000:3.0:1787191338.414532:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1285 00000100:00100000:3.0:1787191338.414543:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8420:x1874004634873344:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191338.414560:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc884839d77 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000010000 nid: local remote: 0x7130d520e46043f3 expref: -99 pid: 57854 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191338.414912:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191338.414920:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8420:x1874004634873344:12345-192.168.202.101@tcp:104: Request processed in 379us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191338.414926:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1285 00000100:00100000:3.0:1787191338.416350:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626623616:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191338.416377:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc884839da8 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e460447f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.416389:0:57570:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc884839da8 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e460447f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.416403:0:57570:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc884839da8 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e460447f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.416935:0:57854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57854:1874004626623872:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191338.416962:0:57854:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a8380 x1874004626623104/t8589936711(8589936711) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191338.417080:0:57854:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191338.417096:0:57854:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.417111:0:57854:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.417123:0:57854:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.417131:0:57854:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.417136:0:57854:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.417141:0:57854:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.417148:0:57854:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4214bbf8 00010000:00010000:1.0:1787191338.417153:0:57854:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.417161:0:57854:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.417175:0:57854:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.417183:0:57854:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191338.417188:0:57854:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.417203:0:57854:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b5089a900, open_flags d902, mode 0 opened 0 00000080:00200000:1.0:1787191338.417209:0:57854:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:1.0:1787191338.417223:0:57854:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154403 00010000:00010000:1.0:1787191338.417282:0:57854:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839daf lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.417290:0:57854:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839daf lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57854 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191338.417301:0:57854:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191338.417308:0:57854:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9180 x1874004626624128/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191338.417486:0:57854:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839daf lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.417510:0:57854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57854:1874004626624128:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.417684:0:57854:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893180 going to sleep for 11 seconds 00000100:00100000:2.0:1787191338.420904:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191338.420939:0:40921:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787191338.420953:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634873472 00000100:00100000:2.0:1787191338.420961:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634873472 00000100:00100000:2.0:1787191338.421003:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1286 00000100:00100000:2.0:1787191338.421013:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b4121c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8419:x1874004634873472:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191338.421027:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000211232bf/0xe5129dc884839d23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e46042cd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191338.421091:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191338.421098:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b4121c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8419:x1874004634873472:12345-192.168.202.101@tcp:104: Request processed in 87us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191338.421106:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1286 00000100:00100000:1.0:1787191338.421713:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626624384:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191338.423971:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191338.424005:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634873600 00000100:00100000:2.0:1787191338.424012:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634873600 00000100:00100000:2.0:1787191338.424064:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1287 00000100:00100000:2.0:1787191338.424074:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:6490:x1874004634873600:12345-192.168.202.101@tcp:105: 00010000:00010000:2.0:1787191338.424087:0:40922:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc884839da8 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e460447f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.424099:0:40922:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc884839da8 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e460447f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.424107:0:40922:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc884839da8 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e460447f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.424117:0:40922:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc884839da8 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080080020000 nid: local remote: 0x7130d520e460447f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.424125:0:40922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc884839da8 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080080020000 nid: local remote: 0x7130d520e460447f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.424136:0:40922:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc884839da8 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80080020000 nid: local remote: 0x7130d520e460447f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.424398:0:40922:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b44cae800) 00000100:00100000:2.0:1787191338.424438:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:6490:x1874004634873600:12345-192.168.202.101@tcp:105: Request processed in 366us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191338.424447:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1287 00000100:00100000:1.0:1787191338.426919:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626624384:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191338.428704:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626624768:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191338.428723:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc884839db6 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46044b0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.428739:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc884839db6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e46044b0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.428750:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc884839db6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e46044b0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.428763:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc884839db6 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e46044b0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191338.428774:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc884839db6 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e46044b0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.428785:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc884839db6 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46044b0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.428793:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc884839db6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46044b0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.428899:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626625024:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191338.428950:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787191338.428956:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626625152:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191338.429449:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626624256:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191338.432140:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626625024:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191338.432158:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626625152:192.168.202.101@tcp:10:bash.0 00000080:00200000:2.0:1787191338.432270:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc2:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191338.432277:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b42ff6c68 (ffff936b465ccd88/0) at cl_lock_release():245 00000020:00010000:2.0:1787191338.432280:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42ff6c68 (ffff936b465ccd88/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191338.432285:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99630 (ffff936b465cc008/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191338.432295:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc884839da8 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e460447f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.432308:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc884839da8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460447f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191338.432322:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99670 (ffff936b465ccbd8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191338.432327:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc884839db6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46044b0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.432335:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc884839db6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46044b0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191338.432344:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42ff6c68 (ffff936b465ccd88/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191338.432347:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99630 (ffff936b465ccd88/1) at cl_lock_fini():72 00000020:00010000:2.0:1787191338.432351:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99670 (ffff936b465ccd88/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191338.432368:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc2:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191338.432395:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xc2:0x0](ffff936b53969988) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191338.000000000, mtime 1787191338.000000000, ctime 1787191338.000000000, rc 0 00000080:00200008:2.0:1787191338.432460:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xc2:0x0], ppos: 0, count: 5 00000080:00200000:2.0:1787191338.432473:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191338.432479:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:2.0:1787191338.432485:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:2.0:1787191338.432489:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1787191338.432495:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@00000000f5e2c747[0x110, 1, [0x200000405:0xc2:0x0] hash] 00000020:00200000:2.0:1787191338.432497:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:2.0:1787191338.432500:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc2:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191338.432521:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xc2:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:2.0:1787191338.432524:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc2:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191338.432526:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1787191338.432530:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1787191338.432536:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:2.0:1787191338.432538:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1787191338.432550:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:2.0:1787191338.432561:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1787191338.432565:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1a30, osc lock ffff936b44e62130, flags 0x0 00010000:00010000:2.0:1787191338.432578:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc884839da8 lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460447f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191338.432587:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc884839da8 lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460447f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191338.432598:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc884839da8 lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e460447f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191338.432606:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc884839da8 lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e460447f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191338.432614:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc884839da8 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e460447f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191338.432625:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:2.0:1787191338.432634:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191338.432678:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:2.0:1787191338.432686:0:57570:0:(rw26.c:927:ll_write_end()) page@00000000a29b94d0[3 0000000070e5b239 2 1 00000000631ca0a8 0 0 0] 00000080:00200000:2.0:1787191338.432690:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @0000000080b1bf19 17ffffc0001021 2:0 ffff936b43a1e620 0 lru 00000080:00200000:2.0:1787191338.432699:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@000000000a8fb213 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000a2a44f55 000000006a0566da > 3< 0 0 > 4< 0 0 8 378605568 - | - - - - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1787191338.432701:0:57570:0:(rw26.c:927:ll_write_end()) end page@00000000a29b94d0 00000080:00200000:2.0:1787191338.432702:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:2.0:1787191338.432707:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:2.0:1787191338.432727:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 00000000f287428f ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc884839da8 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460447f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191338.432743:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b53969b38, count 1, dirtied 1 00000080:00200000:2.0:1787191338.432747:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:2.0:1787191338.432750:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:2.0:1787191338.432763:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b504217b8 (ffff936b465ccbd8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191338.432766:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b504217b8 (ffff936b465ccbd8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191338.432768:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1a30 (ffff936b465cc008/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191338.432772:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc884839da8 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e460447f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191338.432961:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc884839da8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460447f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:2.0:1787191338.432969:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b504217b8 (ffff936b465ccbd8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191338.432971:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1a30 (ffff936b465ccbd8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191338.432976:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:2.0:1787191338.432980:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1787191338.432984:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc2:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191338.432986:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:2.0:1787191338.432991:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc2:0x0] updating i_size 5 i_blocks 0 00000080:00200000:2.0:1787191338.432993:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:2.0:1787191338.433006:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc2:0x0](ffff936b53969988), flags 100001 00000002:00100000:2.0:1787191338.433047:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513b9880 x1874004626621824/t8589936707(8589936707) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191338.433066:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191338.433069:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8e00 x1874004626625408/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191338.433084:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626625408:192.168.202.101@tcp:35:bash.0 00000100:00100000:2.0:1787191338.433302:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f300 going to sleep for 11 seconds 00000100:00100000:3.0:1787191338.440181:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626625408:192.168.202.101@tcp:35:bash.0 00000002:00100000:3.0:1787191338.440218:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513b9880 x1874004626621824/t8589936707(8589936707) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191338.441386:0:57855:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191338.441593:0:57855:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.441609:0:57855:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.441625:0:57855:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.441634:0:57855:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.441641:0:57855:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.441645:0:57855:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.441652:0:57855:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42193bf8 00010000:00010000:1.0:1787191338.441657:0:57855:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.441665:0:57855:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.441681:0:57855:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.441688:0:57855:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191338.441695:0:57855:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.441699:0:57855:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:1.0:1787191338.441703:0:57855:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc2:0x0](ffff936b53969988), inode mode 81a4 mask 44 00000080:00200008:1.0:1787191338.441708:0:57855:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc2:0x0](ffff936b53969988), flags 154400 00000002:00010000:1.0:1787191338.441726:0:57855:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc2:0x0]) in obj [0x200000405:0xc2:0x0], intent: open flags 0104240114401 00010000:00010000:1.0:1787191338.441774:0:57855:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839dbd lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x10000000000000 pid: 57855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.441781:0:57855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839dbd lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x0 pid: 57855 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191338.441794:0:57855:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191338.441805:0:57855:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9500 x1874004626625664/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191338.441815:0:57855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839dbd lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x0 pid: 57855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.441929:0:57855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57855:1874004626625664:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.442348:0:57855:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000080:00200000:2.0:1787191338.446084:0:57856:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191338.446117:0:57856:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191338.446134:0:57856:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191338.446150:0:57856:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191338.446157:0:57856:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191338.446164:0:57856:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191338.446168:0:57856:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191338.446176:0:57856:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42183b58 00010000:00010000:2.0:1787191338.446180:0:57856:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191338.446189:0:57856:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191338.446205:0:57856:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191338.446212:0:57856:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191338.446217:0:57856:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191338.446222:0:57856:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=8 00000080:00200008:2.0:1787191338.446228:0:57856:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc2:0x0](ffff936b53969988), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191338.446233:0:57856:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc2:0x0](ffff936b53969988),name=f70.sanity-flr 00000002:00010000:2.0:1787191338.446245:0:57856:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc2:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191338.446253:0:57856:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839da1 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604463 expref: -99 pid: 57854 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191338.446261:0:57856:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839da1 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604463 expref: -99 pid: 57854 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191338.446268:0:57856:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191338.446272:0:57856:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc2:0x0](ffff936b53969988) 00000080:00010000:2.0:1787191338.446274:0:57856:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc2:0x0](ffff936b53969988) for lock 0xe5129dc884839da1 00000080:00010000:2.0:1787191338.446279:0:57856:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839da1 from it ffffa3fb42183cb8 00010000:00010000:2.0:1787191338.446281:0:57856:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839da1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604463 expref: -99 pid: 57854 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191338.446289:0:57856:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839da1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604463 expref: -99 pid: 57854 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191338.446310:0:57856:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc2:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:2.0:1787191338.446323:0:57856:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc2:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191338.446326:0:57856:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191338.446330:0:57856:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc2:0x0] 00000008:00010000:2.0:1787191338.446349:0:57856:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191338.446353:0:57856:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1a30, osc lock ffff936b44e62130, flags 0x400000400001002 00010000:00010000:2.0:1787191338.446370:0:57856:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc884839da8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460447f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191338.446383:0:57856:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc884839da8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460447f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:2.0:1787191338.446392:0:57856:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191338.446395:0:57856:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc884839da8 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e460447f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191338.446403:0:57856:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc884839da8 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460447f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:2.0:1787191338.446414:0:57856:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191338.446423:0:57856:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc2:0x0] updating i_size 5 i_blocks 0 00000020:00010000:2.0:1787191338.446429:0:57856:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51656750 (ffff936b465ccbd8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191338.446433:0:57856:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51656750 (ffff936b465ccbd8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191338.446436:0:57856:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1a30 (ffff936b465cc008/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191338.446440:0:57856:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51656750 (ffff936b465ccbd8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191338.446442:0:57856:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1a30 (ffff936b465ccbd8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191338.446454:0:57856:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc2:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191338.446474:0:57856:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191338.446481:0:57856:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191338.446488:0:57856:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191338.446496:0:57856:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191338.446506:0:57856:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191338.446510:0:57856:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191338.446513:0:57856:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191338.446517:0:57856:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42183c10 00010000:00010000:2.0:1787191338.446520:0:57856:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191338.446527:0:57856:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191338.446535:0:57856:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191338.446539:0:57856:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191338.446542:0:57856:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191338.446548:0:57856:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:2.0:1787191338.446551:0:57856:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:2.0:1787191338.446556:0:57856:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:2.0:1787191338.446578:0:57856:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884839d93 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc2:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4604432 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191338.446590:0:57856:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc2:0x0]: losing layout lock 00010000:00010000:2.0:1787191338.446601:0:57856:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839daf lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46044a2 expref: -99 pid: 57854 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191338.446609:0:57856:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc2:0x0]: losing layout lock 00010000:00010000:2.0:1787191338.446616:0:57856:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839da1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4604463 expref: -99 pid: 57854 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191338.446630:0:57856:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839d8c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e460441d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191338.446675:0:57856:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884839d93 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xc2:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604432 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191338.446682:0:57856:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839daf lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46044a2 expref: -99 pid: 57854 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191338.446689:0:57856:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839da1 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4604463 expref: -99 pid: 57854 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191338.446696:0:57856:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839d8c lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e460441d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191338.446702:0:57856:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 4 locks packed 00010000:00010000:2.0:1787191338.446705:0:57856:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc884839d93 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc2:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604432 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191338.446715:0:57856:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839daf lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46044a2 expref: -99 pid: 57854 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191338.446721:0:57856:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839da1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4604463 expref: -99 pid: 57854 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191338.446726:0:57856:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839d8c lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e460441d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:2.0:1787191338.446743:0:57856:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 36, max 7 00000100:00100000:2.0:1787191338.446753:0:57856:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bad80 x1874004626625920/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 512/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787191338.446773:0:57856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57856:1874004626625920:192.168.202.101@tcp:36:rm.0 00000100:00100000:2.0:1787191338.447018:0:57856:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.447698:0:57855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57855:1874004626625664:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191338.447717:0:57855:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839dbd lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc2:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46044be expref: -99 pid: 57855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.447731:0:57855:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839dbd lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xc2:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46044be expref: -99 pid: 57855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.447742:0:57855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839dbd lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xc2:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46044be expref: -99 pid: 57855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.447759:0:57855:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x200002b, status=0 req@ffff936b453a9500 x1874004626625664/t8589936717(8589936717) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191338.447771:0:57855:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9500 x1874004626625664/t8589936717(8589936717) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191338.447782:0:57855:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839dbd lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc2:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46044be expref: -99 pid: 57855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191338.447795:0:57855:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839dbd lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc2:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46044be expref: -99 pid: 57855 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.447804:0:57855:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/194 (0 0) 00000080:00200000:1.0:1787191338.447808:0:57855:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xc2:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787191338.448106:0:57855:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc2:0x0]: layout version change: 4294967294 -> 4 00000080:00010000:1.0:1787191338.448112:0:57855:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc2:0x0](ffff936b53969988) for lock 0xe5129dc884839dbd 00000080:00010000:1.0:1787191338.448118:0:57855:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839dbd from it ffffa3fb42193bf0 00010000:00010000:1.0:1787191338.448121:0:57855:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839dbd lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc2:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46044be expref: -99 pid: 57855 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.448129:0:57855:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839dbd lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc2:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46044be expref: -99 pid: 57855 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000002:00100000:1.0:1787191338.448213:0:57855:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9500 x1874004626625664/t8589936717(8589936717) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191338.448351:0:57855:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc2:0x0](ffff936b53969988), inode mode 81a4 mask 4 00000080:00200000:1.0:1787191338.448361:0:57855:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xc2:0x0](ffff936b53969988), xattr lov 00000080:00200008:1.0:1787191338.448389:0:57855:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc2:0x0](ffff936b53969988), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191338.448394:0:57855:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc2:0x0](ffff936b53969988),name=f70.sanity-flr 00000002:00010000:1.0:1787191338.448406:0:57855:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc2:0x0]) in obj [0x200000405:0xc2:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.448412:0:57855:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 30 res 8589935621/194 (0 0) 00010000:00010000:1.0:1787191338.448444:0:57855:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839dc4 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.448451:0:57855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839dc4 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.448461:0:57855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839dc4 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.448476:0:57855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57855:1874004626626048:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.448604:0:57855:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:3.0:1787191338.449364:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191338.449433:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634873728 00000100:00100000:2.0:1787191338.449441:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634873728 00000100:00100000:2.0:1787191338.449970:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1288 00000100:00100000:2.0:1787191338.449979:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634873728:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191338.449993:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839dbd lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc2:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46044be expref: -99 pid: 57855 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191338.450046:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191338.450066:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634873728:12345-192.168.202.101@tcp:104: Request processed in 75us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191338.450073:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1288 00000100:00100000:1.0:1787191338.450425:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626626176:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191338.453927:0:57856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57856:1874004626625920:192.168.202.101@tcp:36:rm.0 00000100:00100000:1.0:1787191338.454317:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626626176:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191338.454477:0:57855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57855:1874004626626048:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191338.454493:0:57855:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839dc4 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46044e8 expref: -99 pid: 57855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.454507:0:57855:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839dc4 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46044e8 expref: -99 pid: 57855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.454704:0:57855:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839dc4 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46044e8 expref: -99 pid: 57855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.454721:0:57855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839dc4 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46044e8 expref: -99 pid: 57855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.454734:0:57855:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839dc4 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46044e8 expref: -99 pid: 57855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.454742:0:57855:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839dc4 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46044e8 expref: -99 pid: 57855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.454751:0:57855:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839dc4 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46044e8 expref: -99 pid: 57855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.454764:0:57855:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b453a8a80 x1874004626626048/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/976 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191338.454776:0:57855:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46044e8 expref: -99 pid: 57855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191338.454789:0:57855:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46044e8 expref: -99 pid: 57855 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.454799:0:57855:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/194 (0 0) 00000080:00200000:1.0:1787191338.454804:0:57855:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xc2:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787191338.455476:0:57855:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc2:0x0]: layout version change: 4294967294 -> 4 00000080:00010000:1.0:1787191338.455484:0:57855:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc2:0x0](ffff936b53969988) for lock 0xe5129dc884839dc4 00000080:00010000:1.0:1787191338.455491:0:57855:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc2:0x0](ffff936b53969988) 00000080:00010000:1.0:1787191338.455494:0:57855:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839dc4 from it ffffa3fb42193cd8 00010000:00010000:1.0:1787191338.455498:0:57855:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46044e8 expref: -99 pid: 57855 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.455567:0:57855:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd000/0xe5129dc884839dc4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46044e8 expref: -99 pid: 57855 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191338.456093:0:57855:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc2:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:1.0:1787191338.456105:0:57855:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc2:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191338.456109:0:57855:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191338.456112:0:57855:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc2:0x0] 00000008:00010000:1.0:1787191338.456131:0:57855:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191338.456191:0:57855:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b47d7d1b0, osc lock ffff936b46836980, flags 0x400000400001002 00010000:00010000:1.0:1787191338.456214:0:57855:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc884839da8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460447f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191338.456228:0:57855:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc884839da8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460447f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:1.0:1787191338.456239:0:57855:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191338.456243:0:57855:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc884839da8 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e460447f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191338.456251:0:57855:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc884839da8 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460447f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:1.0:1787191338.456262:0:57855:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191338.456270:0:57855:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc2:0x0] updating i_size 5 i_blocks 0 00000020:00010000:1.0:1787191338.456276:0:57855:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c38000 (ffff936b47a17998/0) at cl_lock_release():245 00000020:00010000:1.0:1787191338.456279:0:57855:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c38000 (ffff936b47a17998/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191338.456282:0:57855:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7d1b0 (ffff936b47a17ab8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191338.456286:0:57855:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c38000 (ffff936b47a17998/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191338.456289:0:57855:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7d1b0 (ffff936b47a17998/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191338.456298:0:57855:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc2:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1787191338.456346:0:57855:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc2:0x0](ffff936b53969988), flags 154000 00000002:00100000:1.0:1787191338.456479:0:57855:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a9500 x1874004626625664/t8589936717(8589936717) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191338.456492:0:57855:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191338.456498:0:57855:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8a80 x1874004626626432/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191338.456518:0:57855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57855:1874004626626432:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191338.456608:0:57855:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.458954:0:57855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57855:1874004626626432:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191338.458990:0:57855:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a9500 x1874004626625664/t8589936717(8589936717) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191338.459045:0:57855:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc2:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00020000:00200000:1.0:1787191338.459068:0:57855:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc2:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191338.459071:0:57855:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191338.459078:0:57855:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191338.459087:0:57855:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000008:00010000:1.0:1787191338.459104:0:57855:0:(osc_cache.c:1183:osc_extent_make_ready()) ### extent: 00000000f287428f ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc884839da8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460447f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000008:00010000:1.0:1787191338.459130:0:57855:0:(osc_cache.c:917:osc_extent_finish()) ### extent: 00000000f287428f ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc884839da8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460447f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000008:00010000:1.0:1787191338.459160:0:57855:0:(osc_cache.c:497:__osc_extent_remove()) ### extent: 00000000f287428f ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc884839da8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460447f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1787191338.459182:0:57855:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc2:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191338.459279:0:57855:0:(llite_lib.c:2066:ll_clear_inode()) VFS Op:inode=[0x200000405:0xc2:0x0](ffff936b53969988) 00000008:00010000:1.0:1787191338.459307:0:57855:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 5 blocks 0 [cma]time 1787191338 1787191338 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc884839da8 lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460447f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000008:00010000:1.0:1787191338.459333:0:57855:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191338 1787191338 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc884839db6 lrc: 1/0,0 mode: PW/PW res: [0x2c0000401:0x1ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46044b0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191338.459652:0:57855:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191338.459670:0:57855:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.459683:0:57855:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.459695:0:57855:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.459703:0:57855:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.459707:0:57855:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.459711:0:57855:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.459717:0:57855:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42193b58 00010000:00010000:1.0:1787191338.459721:0:57855:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.459731:0:57855:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.459746:0:57855:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.459753:0:57855:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191338.459759:0:57855:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.459769:0:57855:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=9 00000080:00200000:1.0:1787191338.459774:0:57855:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191338.459785:0:57855:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191338.459824:0:57855:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839dcb lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.459936:0:57855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839dcb lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.459948:0:57855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839dcb lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.459970:0:57855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57855:1874004626626560:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.460096:0:57855:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:3.0:1787191338.464503:0:57855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57855:1874004626626560:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191338.464535:0:57855:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839dcb lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.464552:0:57855:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839dcb lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.464559:0:57855:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839dcb lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.464566:0:57855:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839dcb lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.464575:0:57855:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839dcb lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.464581:0:57855:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b587bd400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191338.464586:0:57855:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839dcb lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.464597:0:57855:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839dcb lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.464614:0:57855:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839dcb lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.464622:0:57855:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191338.464628:0:57855:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839dcb lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.464634:0:57855:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839dcb lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57855 initiator: MDT0 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1787191338.464638:0:57857:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00100000:3.0:1787191338.464655:0:57855:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b453a8a80 x1874004626626560/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191338.464660:0:57857:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00000080:00200000:3.0:1787191338.464668:0:57855:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1787191338.464673:0:57857:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.464684:0:57857:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.464695:0:57857:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.464699:0:57857:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.464703:0:57857:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.464707:0:57857:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4210bb58 00010000:00010000:1.0:1787191338.464711:0:57857:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.464718:0:57857:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.464732:0:57857:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.464740:0:57857:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:1.0:1787191338.464745:0:57857:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.464755:0:57857:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:1.0:1787191338.464759:0:57857:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191338.464768:0:57857:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191338.467188:0:57857:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839dd2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.467202:0:57857:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839dd2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.467213:0:57857:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839dd2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.467236:0:57857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57857:1874004626626688:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.467330:0:57857:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.469744:0:57857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57857:1874004626626688:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191338.469763:0:57857:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839dd2 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.469776:0:57857:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839dd2 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.469783:0:57857:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839dd2 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.469789:0:57857:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839dd2 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.469797:0:57857:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839dd2 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.469803:0:57857:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b587bcc00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191338.469807:0:57857:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839dd2 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.469814:0:57857:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839dd2 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.469820:0:57857:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839dd2 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.469825:0:57857:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191338.469850:0:57857:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839dd2 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.469858:0:57857:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839dd2 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.469883:0:57857:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b453a9500 x1874004626626688/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191338.469899:0:57857:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191338.469972:0:57857:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191338.469982:0:57857:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.469989:0:57857:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.469998:0:57857:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.470002:0:57857:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.470005:0:57857:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.470008:0:57857:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.470011:0:57857:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4210bbe8 00010000:00010000:1.0:1787191338.470013:0:57857:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.470018:0:57857:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.470029:0:57857:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.470034:0:57857:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000080:00200000:1.0:1787191338.470038:0:57857:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.470045:0:57857:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:1.0:1787191338.470048:0:57857:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191338.470071:0:57857:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191338.470114:0:57857:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839dd9 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.470121:0:57857:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839dd9 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.470129:0:57857:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839dd9 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.470147:0:57857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57857:1874004626626816:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.470221:0:57857:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.472759:0:57857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57857:1874004626626816:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191338.472777:0:57857:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839dd9 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.472789:0:57857:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839dd9 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.472796:0:57857:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839dd9 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.472803:0:57857:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839dd9 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.472812:0:57857:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839dd9 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.472818:0:57857:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b587bd600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191338.472823:0:57857:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839dd9 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.472902:0:57857:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839dd9 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.472910:0:57857:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839dd9 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.472916:0:57857:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191338.472922:0:57857:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839dd9 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.472928:0:57857:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd600/0xe5129dc884839dd9 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.472946:0:57857:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b453a9500 x1874004626626816/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191338.472961:0:57857:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191338.473034:0:57857:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191338.473047:0:57857:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.473084:0:57857:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.473096:0:57857:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.473103:0:57857:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.473107:0:57857:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.473110:0:57857:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.473115:0:57857:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4210bb58 00010000:00010000:1.0:1787191338.473119:0:57857:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.473125:0:57857:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.473139:0:57857:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.473146:0:57857:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:1.0:1787191338.473153:0:57857:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:1.0:1787191338.473158:0:57857:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:1.0:1787191338.473168:0:57857:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.473174:0:57857:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 75 lru_type: 1 00010000:00010000:1.0:1787191338.473181:0:57857:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 75 lru_type: 1 00000002:00010000:1.0:1787191338.473190:0:57857:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.473224:0:57857:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839de0 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.473230:0:57857:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839de0 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.473239:0:57857:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839de0 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.473257:0:57857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57857:1874004626626944:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.473356:0:57857:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.475176:0:57857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57857:1874004626626944:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191338.475196:0:57857:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839de0 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460453c expref: -99 pid: 57857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.475207:0:57857:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839de0 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460453c expref: -99 pid: 57857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.475217:0:57857:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839de0 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460453c expref: -99 pid: 57857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.475227:0:57857:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839de0 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460453c expref: -99 pid: 57857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.475237:0:57857:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839de0 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460453c expref: -99 pid: 57857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.475245:0:57857:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839de0 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460453c expref: -99 pid: 57857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.475252:0:57857:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839de0 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460453c expref: -99 pid: 57857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.475263:0:57857:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b453a9500 x1874004626626944/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191338.475277:0:57857:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839de0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460453c expref: -99 pid: 57857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.475286:0:57857:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:1.0:1787191338.475294:0:57857:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839de0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460453c expref: -99 pid: 57857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.475303:0:57857:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839de0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460453c expref: -99 pid: 57857 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:1.0:1787191338.475325:0:57857:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.475335:0:57857:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 150 lru_type: 1 00010000:00010000:1.0:1787191338.475345:0:57857:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 150 lru_type: 1 00010000:00010000:1.0:1787191338.475354:0:57857:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 150 lru_type: 1 00010000:00010000:1.0:1787191338.475362:0:57857:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 151 lru_type: 1 00000080:00200000:1.0:1787191338.475374:0:57857:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191338.475381:0:57857:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:1.0:1787191338.475384:0:57857:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:1.0:1787191338.475390:0:57857:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb4210bcb8 00010000:00010000:1.0:1787191338.475393:0:57857:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 75 lru_type: 1 00010000:00010000:1.0:1787191338.475401:0:57857:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 76 lru_type: 1 00000002:00010000:1.0:1787191338.475420:0:57857:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.475426:0:57857:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839de0 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460453c expref: -99 pid: 57857 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.475434:0:57857:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839de0 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460453c expref: -99 pid: 57857 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.475443:0:57857:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839de0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460453c expref: -99 pid: 57857 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.475449:0:57857:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839de0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460453c expref: -99 pid: 57857 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:1.0:1787191338.475457:0:57857:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.475462:0:57857:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 151 lru_type: 1 00010000:00010000:1.0:1787191338.475471:0:57857:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 151 lru_type: 1 00010000:00010000:1.0:1787191338.475477:0:57857:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 151 lru_type: 1 00010000:00010000:1.0:1787191338.475484:0:57857:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 152 lru_type: 1 00000080:00200000:2.0:1787191338.480812:0:57858:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191338.480858:0:57858:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191338.480873:0:57858:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191338.480889:0:57858:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191338.480904:0:57858:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191338.480912:0:57858:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191338.480915:0:57858:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191338.480922:0:57858:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4219bbf8 00010000:00010000:2.0:1787191338.480926:0:57858:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191338.480935:0:57858:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191338.480950:0:57858:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191338.480956:0:57858:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191338.480962:0:57858:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191338.480971:0:57858:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b484def00, open_flags d900, mode 0 opened 0 00000080:00200000:2.0:1787191338.480977:0:57858:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:2.0:1787191338.480989:0:57858:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:2.0:1787191338.481037:0:57858:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839de7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.481044:0:57858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839de7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57858 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191338.481068:0:57858:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191338.481079:0:57858:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb480 x1874004626627200/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191338.481090:0:57858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839de7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191338.481111:0:57858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57858:1874004626627200:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191338.481703:0:57858:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787191338.484689:0:57858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57858:1874004626627200:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191338.484710:0:57858:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839de7 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.484724:0:57858:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839de7 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.484730:0:57858:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839de7 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.484736:0:57858:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839de7 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.484750:0:57858:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839de7 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.484757:0:57858:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd4400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191338.484762:0:57858:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839de7 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.484770:0:57858:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839de7 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.484778:0:57858:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839de7 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.484786:0:57858:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191338.484797:0:57858:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839de7 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.484803:0:57858:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc884839de7 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57858 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191338.484822:0:57858:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x7, status=0 req@ffff936b513bb480 x1874004626627200/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/608 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191338.484858:0:57858:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1787191338.484887:0:57858:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839de0 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460453c expref: -99 pid: 57857 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191338.484898:0:57858:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839de0 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460453c expref: -99 pid: 57857 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:3.0:1787191338.484906:0:57858:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839de0 from it ffffa3fb4219b9a0 00010000:00010000:3.0:1787191338.484911:0:57858:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839de0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460453c expref: -99 pid: 57857 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191338.484918:0:57858:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839de0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460453c expref: -99 pid: 57857 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200008:1.0:1787191338.485047:0:57857:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:1.0:1787191338.485066:0:57857:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191338.485081:0:57857:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.485090:0:57857:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.485098:0:57857:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.485104:0:57857:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.485109:0:57857:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.485113:0:57857:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.485118:0:57857:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4210bcb8 00010000:00010000:1.0:1787191338.485121:0:57857:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.485129:0:57857:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191338.485152:0:57858:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191338.485161:0:57858:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191338.485166:0:57858:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191338.485175:0:57858:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191338.485181:0:57858:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191338.485185:0:57858:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191338.485187:0:57858:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191338.485191:0:57858:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4219bb58 00010000:00010000:3.0:1787191338.485193:0:57858:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191338.485200:0:57858:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191338.485207:0:57858:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191338.485213:0:57858:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191338.485218:0:57858:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191338.485221:0:57858:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=9 00000080:00200000:1.0:1787191338.485347:0:57857:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191338.485355:0:57857:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.485361:0:57857:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.485370:0:57857:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.485376:0:57857:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.485379:0:57857:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.485382:0:57857:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.485386:0:57857:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4210bb58 00010000:00010000:1.0:1787191338.485388:0:57857:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.485447:0:57857:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.485456:0:57857:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.485460:0:57857:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:1.0:1787191338.485463:0:57857:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.485466:0:57857:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=8 00000080:00200000:1.0:1787191338.485483:0:57857:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191338.485489:0:57857:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.485494:0:57857:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.485503:0:57857:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.485509:0:57857:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.485512:0:57857:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.485514:0:57857:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.485518:0:57857:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4210bbf8 00010000:00010000:1.0:1787191338.485521:0:57857:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.485528:0:57857:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.485536:0:57857:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.485539:0:57857:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191338.485542:0:57857:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.485546:0:57857:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:1.0:1787191338.485549:0:57857:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:1.0:1787191338.485554:0:57857:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b51ef0300, open_flags a141, mode 81b6 opened 0 00000080:00200000:1.0:1787191338.485562:0:57857:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:1.0:1787191338.485578:0:57857:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xc3:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:1.0:1787191338.485587:0:57857:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839de0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e460453c expref: -99 pid: 57857 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191338.485683:0:57857:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839de0 lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e460453c expref: -99 pid: 57857 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191338.485691:0:57857:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191338.485693:0:57857:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839de0 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e460453c expref: -99 pid: 57857 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191338.485855:0:57857:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839dee lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.485862:0:57857:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839dee lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191338.485872:0:57857:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191338.485880:0:57857:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9500 x1874004626627456/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191338.485888:0:57857:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839dee lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191338.485908:0:57857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57857:1874004626627456:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191338.486119:0:57857:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.488945:0:57857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57857:1874004626627456:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191338.488974:0:57857:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839dee lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460456d expref: -99 pid: 57857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.489000:0:57857:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839dee lrc: 4/0,1 mode: --/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460456d expref: -99 pid: 57857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.489011:0:57857:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839dee lrc: 4/0,1 mode: --/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460456d expref: -99 pid: 57857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.489023:0:57857:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839dee lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460456d expref: -99 pid: 57857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.489033:0:57857:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839dee lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460456d expref: -99 pid: 57857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.489045:0:57857:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839dee lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460456d expref: -99 pid: 57857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.489063:0:57857:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839dee lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460456d expref: -99 pid: 57857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.489070:0:57857:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839dee lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460456d expref: -99 pid: 57857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.489083:0:57857:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b453a9500 x1874004626627456/t8589936720(8589936720) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191338.489097:0:57857:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9500 x1874004626627456/t8589936720(8589936720) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191338.489108:0:57857:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839dee lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460456d expref: -99 pid: 57857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.489118:0:57857:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/195 (0 0) 00000080:00200000:1.0:1787191338.489124:0:57857:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191338.489137:0:57857:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:2.0:1787191338.489244:0:57857:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xc3:0x0](ffff936b4898ec08) 00000080:00200000:2.0:1787191338.489252:0:57857:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xc3:0x0], updating i_size 0 00000080:00200000:2.0:1787191338.489292:0:57857:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc3:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:2.0:1787191338.489297:0:57857:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xc3:0x0](ffff936b4898ec08) 00000080:00010000:2.0:1787191338.489300:0:57857:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc3:0x0](ffff936b4898ec08) for lock 0xe5129dc884839dee 00000080:00010000:2.0:1787191338.489312:0:57857:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc3:0x0](ffff936b4898ec08) 00000080:00200008:2.0:1787191338.489332:0:57857:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc3:0x0](ffff936b4898ec08), flags 120501 00000002:00100000:2.0:1787191338.489350:0:57857:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9500 x1874004626627456/t8589936720(8589936720) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1787191338.489378:0:57857:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839dee from it ffff936b5339f240 00010000:00010000:2.0:1787191338.489381:0:57857:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839dee lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460456d expref: -99 pid: 57857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.489388:0:57857:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839dee lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460456d expref: -99 pid: 57857 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191338.489407:0:57857:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc3:0x0](ffff936b4898ec08), inode mode 81a4 mask 40 00000080:00200000:2.0:1787191338.489468:0:57857:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc3:0x0](ffff936b4898ec08), inode mode 81a4 mask 2 00000080:00200000:2.0:1787191338.489480:0:57857:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xc3:0x0](ffff936b4898ec08), xattr lov 00000002:00010000:2.0:1787191338.489494:0:57857:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc3:0x0]) in obj [0x200000405:0xc3:0x0], intent: open flags 040000002 00010000:00010000:2.0:1787191338.489545:0:57857:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839df5 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.489550:0:57857:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839df5 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191338.489558:0:57857:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191338.489562:0:57857:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb480 x1874004626627712/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191338.489567:0:57857:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839df5 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191338.489582:0:57857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57857:1874004626627712:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191338.489750:0:57857:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787191338.491910:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191338.492070:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634873856 00000100:00100000:2.0:1787191338.492081:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634873856 00000100:00100000:2.0:1787191338.492131:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1289 00000100:00100000:2.0:1787191338.492139:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634873856:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191338.492157:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839dee lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e460456d expref: -99 pid: 57857 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191338.492218:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191338.492224:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634873856:12345-192.168.202.101@tcp:104: Request processed in 86us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191338.492230:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1289 00010000:00010000:3.0:1787191338.492688:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191338.492696:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839dee lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e460456d expref: -99 pid: 57857 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.492704:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd5400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191338.492709:0:40930:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839dee lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e460456d expref: -99 pid: 57857 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.492717:0:40930:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839dee lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e460456d expref: -99 pid: 57857 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.492726:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839dee lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e460456d expref: -99 pid: 57857 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191338.492747:0:40930:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc3:0x0]: losing layout lock 00010000:00010000:3.0:1787191338.492788:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839dee lrc: 2/0,0 mode: --/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e460456d expref: -99 pid: 57857 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.492794:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191338.492828:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839dee lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e460456d expref: -99 pid: 57857 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.492857:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc884839dee lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e460456d expref: -99 pid: 57857 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.492870:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191338.492872:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191338.492873:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191338.492881:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787191338.492893:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626627840:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191338.494732:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626627840:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191338.496502:0:57857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57857:1874004626627712:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191338.496534:0:57857:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839df5 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.496547:0:57857:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839df5 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.496554:0:57857:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839df5 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.496561:0:57857:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839df5 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.496569:0:57857:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839df5 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.496575:0:57857:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd5c00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191338.496579:0:57857:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839df5 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.496591:0:57857:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839df5 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.496607:0:57857:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839df5 lrc: 5/0,0 mode: --/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.496614:0:57857:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191338.496620:0:57857:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839df5 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.496633:0:57857:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839df5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57857 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191338.496653:0:57857:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b513bb480 x1874004626627712/t8589936721(8589936721) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191338.496666:0:57857:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bb480 x1874004626627712/t8589936721(8589936721) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191338.496680:0:57857:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xc3:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1787191338.496725:0:57857:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc3:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1787191338.496733:0:57857:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc3:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191338.496778:0:57857:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xc3:0x0], updating i_size 0 00000002:00100000:2.0:1787191338.496794:0:57857:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bb480 x1874004626627712/t8589936721(8589936721) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191338.496827:0:57857:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513bb480 x1874004626627712/t8589936721(8589936721) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191338.496857:0:57857:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191338.496863:0:57857:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8e00 x1874004626628096/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191338.496885:0:57857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57857:1874004626628096:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191338.496962:0:57857:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787191338.499594:0:57857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57857:1874004626628096:192.168.202.101@tcp:35:lfs.0 00000002:00100000:2.0:1787191338.499742:0:57857:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513bb480 x1874004626627712/t8589936721(8589936721) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:2.0:1787191338.499792:0:57857:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc3:0x0](ffff936b4898ec08), flags 100001 00000002:00100000:2.0:1787191338.499858:0:57857:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a9500 x1874004626627456/t8589936720(8589936720) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191354 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191338.499870:0:57857:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191338.499875:0:57857:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9880 x1874004626628352/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191338.499896:0:57857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57857:1874004626628352:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191338.499968:0:57857:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.502613:0:57857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57857:1874004626628352:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191338.502644:0:57857:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a9500 x1874004626627456/t8589936720(8589936720) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191338.504785:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191338.504808:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191338.504820:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191338.504853:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191338.504861:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191338.504869:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191338.504872:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191338.504879:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:3.0:1787191338.504882:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191338.504891:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191338.504905:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191338.504912:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191338.504918:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191338.506201:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:3.0:1787191338.506209:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc3:0x0](ffff936b4898ec08), inode mode 81a4 mask 42 00000080:00200008:3.0:1787191338.506215:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc3:0x0](ffff936b4898ec08), flags 101101 00000002:00010000:3.0:1787191338.506230:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc3:0x0]) in obj [0x200000405:0xc3:0x0], intent: open|creat flags 04240101102 00010000:00010000:3.0:1787191338.506242:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839dfc lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46045a5 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191338.506325:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc3:0x0]: losing layout lock 00010000:00010000:3.0:1787191338.506353:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839dfc lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46045a5 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.506359:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191338.506363:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839dfc lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46045a5 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.506383:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839e0a lrc: 3/0,1 mode: --/CW res: [0x200000405:0xc3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.506389:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839e0a lrc: 3/0,1 mode: --/CW res: [0x200000405:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191338.506441:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191338.506448:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1dc00 x1874004626628992/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191338.506455:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839e0a lrc: 3/0,1 mode: --/CW res: [0x200000405:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191338.506466:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626628992:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191338.506538:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c840 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.509520:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626629120:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.509581:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787191338.509587:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626629248:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191338.509789:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787191338.509796:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc884839e03 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46045c1 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.509804:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cae600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191338.509808:0:43384:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc884839e03 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46045c1 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.509816:0:43384:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc884839e03 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46045c1 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.509829:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc884839e03 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e46045c1 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000080:00200000:2.0:1787191338.510043:0:43384:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc3:0x0]: losing layout lock 00010000:00010000:2.0:1787191338.510087:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc884839e03 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46045c1 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.510095:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191338.510112:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc884839e03 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46045c1 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.510119:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc884839e03 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46045c1 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.510131:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191338.510133:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191338.510135:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191338.510147:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626629376:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787191338.511267:0:2389:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839e11 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.511288:0:2389:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839e11 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46045cf expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.511302:0:2389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839e11 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46045cf expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.511314:0:2389:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839e11 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46045cf expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191338.511338:0:2389:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839e11 lrc: 5/2,0 mode: PR/PR res: [0x280000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46045cf expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1787191338.511349:0:2389:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191338.511354:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839e11 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46045cf expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.511371:0:2389:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839e11 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46045cf expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.511379:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839e11 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46045cf expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.511388:0:2389:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839e11 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46045cf expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1787191338.511404:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626629120:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191338.513220:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626629376:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787191338.513822:0:2389:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc884839e18 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.513861:0:2389:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc884839e18 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46045dd expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.513871:0:2389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc884839e18 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46045dd expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.513880:0:2389:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc884839e18 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46045dd expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191338.513891:0:2389:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc884839e18 lrc: 5/2,0 mode: PR/PR res: [0x2c0000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46045dd expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1787191338.513899:0:2389:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1787191338.513909:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc884839e18 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46045dd expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.513915:0:2389:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc884839e18 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46045dd expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.513920:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc884839e18 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46045dd expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.513925:0:2389:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc884839e18 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46045dd expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1787191338.513936:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626629248:192.168.202.101@tcp:101:lfs.0 00000080:00200000:3.0:1787191338.514035:0:57859:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc3:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1787191338.514042:0:57859:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c38b90 (ffff936b47a17098/0) at cl_lock_release():245 00000020:00010000:3.0:1787191338.514045:0:57859:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c38b90 (ffff936b47a17098/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191338.514058:0:57859:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99b70 (ffff936b47a17518/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191338.514064:0:57859:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99bb0 (ffff936b47a177e8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191338.514066:0:57859:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c38b90 (ffff936b47a17098/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191338.514069:0:57859:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99b70 (ffff936b47a17098/1) at cl_lock_fini():72 00000020:00010000:3.0:1787191338.514074:0:57859:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99bb0 (ffff936b47a17098/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191338.514085:0:57859:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc3:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:3.0:1787191338.514102:0:57859:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/195 (0 0) 00000080:00010000:3.0:1787191338.514113:0:57859:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xc3:0x0](ffff936b4898ec08) 00000002:00010000:3.0:1787191338.514122:0:57859:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc3:0x0]) in obj [0x200000405:0xc3:0x0], intent: layout flags 0 00010000:00010000:3.0:1787191338.514159:0:57859:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884839e1f lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.514168:0:57859:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884839e1f lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.514178:0:57859:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884839e1f lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191338.514201:0:57859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57859:1874004626629504:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191338.514280:0:57859:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787191338.516007:0:57859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57859:1874004626629504:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191338.516023:0:57859:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884839e1f lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46045e4 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.516032:0:57859:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884839e1f lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46045e4 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191338.516041:0:57859:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b51d1f800 x1874004626629504/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191338.516063:0:57859:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884839e1f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46045e4 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191338.516079:0:57859:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884839e1f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46045e4 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.516086:0:57859:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/195 (0 0) 00000080:00200000:3.0:1787191338.516091:0:57859:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xc3:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1787191338.516103:0:57859:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc3:0x0](ffff936b4898ec08) for lock 0xe5129dc884839e1f 00000080:00010000:3.0:1787191338.516108:0:57859:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839e1f from it ffffa3fb42083bc8 00010000:00010000:3.0:1787191338.516111:0:57859:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884839e1f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46045e4 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.516119:0:57859:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884839e1f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46045e4 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.516135:0:57859:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884839e1f lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46045e4 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.516146:0:57859:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884839e1f lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46045e4 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:3.0:1787191338.516155:0:57859:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xc3:0x0](00000000cef45b51) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884839e1f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46045e4 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191338.516186:0:57859:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc3:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:3.0:1787191338.516191:0:57859:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884839e1f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46045e4 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.516199:0:57859:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc884839e1f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46045e4 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200008:3.0:1787191338.516260:0:57859:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc3:0x0](ffff936b4898ec08), flags 154000 00000002:00100000:3.0:1787191338.516293:0:57859:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a474380 x1874004626628608/t8589936724(8589936724) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191338.516304:0:57859:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191338.516309:0:57859:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1f800 x1874004626629888/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191338.516385:0:57859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57859:1874004626629888:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191338.516467:0:57859:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787191338.525494:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191338.526551:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634873984 00000100:00100000:2.0:1787191338.526560:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634873984 00000100:00100000:2.0:1787191338.526606:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1290 00000100:00100000:2.0:1787191338.526615:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634873984:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191338.526640:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc884839e2d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4604615 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.526734:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191338.526740:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634873984:12345-192.168.202.101@tcp:104: Request processed in 127us (1254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191338.526747:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1290 00010000:00010000:1.0:1787191338.527066:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191338.527072:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc884839e2d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4604615 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.527080:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cae200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191338.527085:0:40929:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc884839e2d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1a/0x1a rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4604615 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.527094:0:40929:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc884839e2d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1a/0x1a rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4604615 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.527106:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc884839e2d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1a/0x1a rrc: 5 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4604615 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1787191338.527120:0:40929:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc3:0x0]: losing layout lock 00010000:00010000:1.0:1787191338.527158:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc884839e2d lrc: 2/0,0 mode: --/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1a/0x1a rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4604615 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.527166:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191338.527188:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc884839e2d lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1a/0x1a rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4604615 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.527196:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc884839e2d lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1a/0x1a rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4604615 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.527209:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191338.527211:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191338.527213:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191338.527220:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787191338.527233:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626630784:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191338.532702:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626630784:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191338.542796:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191338.542966:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191338.543065:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191338.543081:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634875136 00000100:00100000:2.0:1787191338.543089:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634875136 00000100:00100000:3.0:1787191338.543112:0:40922:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787191338.543125:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634875392 00000100:00100000:3.0:1787191338.543125:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634875264 00000100:00100000:2.0:1787191338.543127:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634875392 00000100:00100000:3.0:1787191338.543127:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634875264 00000100:00100000:2.0:1787191338.543141:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1291 00000100:00100000:2.0:1787191338.543150:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8720:x1874004634875136:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191338.543166:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc884839da8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080030000 nid: local remote: 0x7130d520e460447f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000100:00100000:3.0:1787191338.543260:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1292 00000100:00100000:3.0:1787191338.543268:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b50883c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634875392:12345-192.168.202.101@tcp:105: 00010000:00010000:2.0:1787191338.543271:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1787191338.543277:0:40922:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839e3b lrc: 5/1,0 mode: --/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604631 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191338.543278:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8720:x1874004634875136:12345-192.168.202.101@tcp:104: Request processed in 129us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191338.543285:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1291 00010000:00010000:3.0:1787191338.543286:0:40922:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839e3b lrc: 5/1,0 mode: --/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604631 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.543294:0:40922:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839e3b lrc: 5/1,0 mode: --/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604631 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191338.543301:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1293 00000100:00100000:2.0:1787191338.543306:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30510:x1874004634875264:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191338.543309:0:40922:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839e3b lrc: 5/1,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x10080000000000 nid: local remote: 0x7130d520e4604631 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.543314:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc884839db6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e46044b0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.543317:0:40922:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839e3b lrc: 6/1,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x10080000000000 nid: local remote: 0x7130d520e4604631 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.543327:0:40922:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839e3b lrc: 6/1,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x80000000000 nid: local remote: 0x7130d520e4604631 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.543401:0:40922:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b44caea00) 00000100:00100000:3.0:1787191338.543420:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b50883c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634875392:12345-192.168.202.101@tcp:105: Request processed in 153us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191338.543426:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1292 00010000:00010000:1.0:1787191338.543571:0:57859:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839e3b lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604631 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.543583:0:57859:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839e3b lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604631 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.543599:0:57859:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b6a474e00 x1874004626630912/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/344 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191338.543612:0:57859:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839e3b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604631 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.543622:0:57859:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/195 (0 0) 00000080:00200000:1.0:1787191338.543628:0:57859:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xc3:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191338.543646:0:57859:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc3:0x0](ffff936b4898ec08) for lock 0xe5129dc884839e3b 00000080:00010000:1.0:1787191338.543654:0:57859:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839e3b from it ffffa3fb42083bc8 00010000:00010000:1.0:1787191338.543659:0:57859:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839e3b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604631 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.543668:0:57859:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839e3b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604631 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1787191338.543698:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626631040:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191338.543755:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787191338.543762:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626631168:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787191338.543940:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1787191338.543946:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30510:x1874004634875264:12345-192.168.202.101@tcp:104: Request processed in 639us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191338.543955:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1293 00010000:00010000:1.0:1787191338.544579:0:57859:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839e3b lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604631 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.544593:0:57859:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839e3b lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604631 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:1.0:1787191338.544603:0:57859:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xc3:0x0](00000000cef45b51) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839e3b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604631 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1787191338.544647:0:57859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57859:1874004626631296:192.168.202.101@tcp:49:lfs.0 00000100:00100000:1.0:1787191338.544694:0:57859:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.547950:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626631168:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191338.547963:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626631040:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191338.549237:0:57859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57859:1874004626631296:192.168.202.101@tcp:49:lfs.0 00010000:00010000:1.0:1787191338.549281:0:57859:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839e3b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604631 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.549288:0:57859:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839e3b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604631 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191338.549303:0:57859:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc3:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00020000:00200000:1.0:1787191338.549312:0:57859:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc3:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191338.549314:0:57859:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191338.549320:0:57859:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:1.0:1787191338.549351:0:57859:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc3:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:1.0:1787191338.549371:0:57859:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839e3b lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604631 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191338.549382:0:57859:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839e3b lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604631 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:1.0:1787191338.549388:0:57859:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xc3:0x0](00000000cef45b51) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839e3b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604631 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191338.549570:0:57859:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc3:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1787191338.549574:0:57859:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc3:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191338.549576:0:57859:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191338.549578:0:57859:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:1.0:1787191338.549586:0:57859:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc3:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:1.0:1787191338.549615:0:57859:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839e11 lrc: 1/0,0 mode: PR/PR res: [0x280000401:0x1ab:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46045cf expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:1.0:1787191338.549630:0:57859:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc884839e18 lrc: 1/0,0 mode: PR/PR res: [0x2c0000401:0x1ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46045dd expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191338.549682:0:57859:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc3:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:1.0:1787191338.549687:0:57859:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839e3b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604631 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191338.549696:0:57859:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839e3b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604631 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191338.549715:0:57859:0:(vvp_io.c:397:vvp_io_fini()) [0x200000405:0xc3:0x0] layout changed from 3 to 4. 00000080:00200000:1.0:1787191338.549719:0:57859:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc3:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00020000:00200000:1.0:1787191338.549724:0:57859:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc3:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 1, mirror count: 2 00020000:00200000:1.0:1787191338.549726:0:57859:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191338.549729:0:57859:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc3:0x0] 00000008:00010000:1.0:1787191338.549742:0:57859:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191338.549746:0:57859:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b47d7d330, osc lock ffff936b46836980, flags 0x400000400001002 00010000:00010000:1.0:1787191338.549786:0:57859:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000e1a61146/0xe5129dc884839e42 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.549794:0:57859:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000e1a61146/0xe5129dc884839e42 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.549943:0:57859:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b453ab480 x1874004626631424/t0(0) o101->lustre-OST0001-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:1.0:1787191338.549974:0:57859:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:1.0:1787191338.549994:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626631424:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191338.551926:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191338.552098:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634875520 00000100:00100000:2.0:1787191338.552105:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634875520 00000100:00100000:2.0:1787191338.552157:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1294 00000100:00100000:2.0:1787191338.552167:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30353:x1874004634875520:12345-192.168.202.101@tcp:106: 00010000:00010000:2.0:1787191338.552177:0:40922:0:(ldlm_lockd.c:2541:ldlm_callback_handler()) ### glimpse ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc884839e49 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604654 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.552186:0:40922:0:(ldlm_lockd.c:2123:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc884839e49 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604654 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00010000:2.0:1787191338.552208:0:40922:0:(cl_object.c:322:cl_object_glimpse()) header@0000000091340218[0x110, 1, [0x200000405:0xc3:0x0] hash] 00000020:00010000:2.0:1787191338.552210:0:40922:0:(cl_object.c:322:cl_object_glimpse()) size: 0 mtime: 1787191338 atime: 1787191338 ctime: 1787191338 blocks: 0 00000020:00010000:2.0:1787191338.552214:0:40922:0:(cl_object.c:322:cl_object_glimpse()) header@00000000e2389d26[0x110, 2, [0x2c0000401:0x1ad:0x0] hash] 00000020:00010000:2.0:1787191338.552216:0:40922:0:(cl_object.c:322:cl_object_glimpse()) size: 0 mtime: 1787191338 atime: 1787191338 ctime: 1787191338 blocks: 0 00000100:00100000:2.0:1787191338.552260:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30353:x1874004634875520:12345-192.168.202.101@tcp:106: Request processed in 94us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191338.552267:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1294 00010000:00010000:1.0:1787191338.553134:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839e50 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.553145:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839e50 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.553154:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839e50 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.553173:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626631680:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191338.553271:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00010000:00010000:1.0:1787191338.554592:0:2390:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000e1a61146/0xe5129dc884839e42 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.554664:0:2390:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000e1a61146/0xe5129dc884839e42 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.554682:0:2390:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000e1a61146/0xe5129dc884839e42 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.554691:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000e1a61146/0xe5129dc884839e42 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.554700:0:2390:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000e1a61146/0xe5129dc884839e42 lrc: 5/1,0 mode: --/PR res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191338.554712:0:2390:0:(osc_lock.c:187:osc_lock_lvb_update()) ### no dlm lock: acquired size 0, setting rss=0; leaving kms=0, end=18446744073709551615 00000020:00200000:1.0:1787191338.554717:0:2390:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1787191338.554732:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000e1a61146/0xe5129dc884839e42 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.554740:0:2390:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000e1a61146/0xe5129dc884839e42 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.554748:0:2390:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000e1a61146/0xe5129dc884839e42 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.554755:0:2390:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b587bce00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191338.554760:0:2390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000e1a61146/0xe5129dc884839e42 lrc: 5/0,0 mode: --/PR res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.554770:0:2390:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191338.554776:0:2390:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000e1a61146/0xe5129dc884839e42 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.554783:0:2390:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000e1a61146/0xe5129dc884839e42 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.554799:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626631424:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.557122:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626631680:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191338.557146:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839e50 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604662 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.557163:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839e50 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4604662 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.557175:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839e50 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4604662 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.557189:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839e50 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4604662 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191338.557201:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839e50 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4604662 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.557212:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839e50 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4604662 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.557221:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839e50 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4604662 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.561201:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626632192:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191338.561271:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626632064:192.168.202.101@tcp:10:bash.0 00000080:00200000:3.0:1787191338.561343:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc3:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1787191338.561351:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b53cc5308 (ffff936b47a17248/0) at cl_lock_release():245 00000020:00010000:3.0:1787191338.561355:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b53cc5308 (ffff936b47a17248/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191338.561359:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99db0 (ffff936b47a17368/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191338.561368:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc884839e49 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4604654 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.561382:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc884839e49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604654 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1787191338.561397:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99df0 (ffff936b47a17488/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191338.561402:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839e50 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4604662 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.561411:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839e50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604662 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1787191338.561420:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b53cc5308 (ffff936b47a17248/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191338.561423:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99db0 (ffff936b47a17248/1) at cl_lock_fini():72 00000020:00010000:3.0:1787191338.561427:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99df0 (ffff936b47a17248/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191338.561444:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc3:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191338.561457:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xc3:0x0](ffff936b4898ec08) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191338.000000000, mtime 1787191338.000000000, ctime 1787191338.000000000, rc 0 00000080:00200008:3.0:1787191338.561559:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xc3:0x0], ppos: 0, count: 5 00000080:00200000:3.0:1787191338.561571:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:3.0:1787191338.561577:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:3.0:1787191338.561582:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:3.0:1787191338.561586:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:3.0:1787191338.561592:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@0000000091340218[0x110, 1, [0x200000405:0xc3:0x0] hash] 00000020:00200000:3.0:1787191338.561594:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:3.0:1787191338.561609:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc3:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:3.0:1787191338.561620:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xc3:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:3.0:1787191338.561624:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc3:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191338.561628:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:3.0:1787191338.561632:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1787191338.561638:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:3.0:1787191338.561642:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1787191338.561657:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:3.0:1787191338.561670:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:3.0:1787191338.561674:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b506678b0, osc lock ffff936b44f65300, flags 0x0 00010000:00010000:3.0:1787191338.561690:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc884839e49 lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604654 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.561702:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc884839e49 lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604654 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.561715:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc884839e49 lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4604654 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.561722:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc884839e49 lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4604654 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.561730:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc884839e49 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4604654 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191338.561741:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:3.0:1787191338.561748:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:3.0:1787191338.561790:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:3.0:1787191338.561797:0:57570:0:(rw26.c:927:ll_write_end()) page@00000000d5b30f9b[3 0000000094642d63 2 1 00000000118cd9f7 0 0 0] 00000080:00200000:3.0:1787191338.561801:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @000000009f7c1500 17ffffc0001001 3:0 ffff936b508427e0 0 lru 00000080:00200000:3.0:1787191338.561808:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@000000004ca25fda 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000ef00a996 00000000f5ddd5d2 > 3< 0 0 > 4< 0 0 8 453263360 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1787191338.561810:0:57570:0:(rw26.c:927:ll_write_end()) end page@00000000d5b30f9b 00000080:00200000:3.0:1787191338.561811:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1787191338.561815:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:3.0:1787191338.562191:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 00000000b331cccb ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc884839e49 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604654 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191338.562212:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b4898edb8, count 1, dirtied 1 00000080:00200000:3.0:1787191338.562216:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:3.0:1787191338.562220:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:3.0:1787191338.562233:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b53cc5308 (ffff936b47a17248/0) at cl_lock_release():245 00000020:00010000:3.0:1787191338.562236:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b53cc5308 (ffff936b47a17248/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191338.562239:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b506678b0 (ffff936b47a17488/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191338.562243:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc884839e49 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4604654 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.562252:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc884839e49 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604654 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:3.0:1787191338.562263:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b53cc5308 (ffff936b47a17248/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191338.562266:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b506678b0 (ffff936b47a17248/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191338.562272:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:3.0:1787191338.562276:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1787191338.562281:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc3:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191338.562284:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:2.0:1787191338.562384:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc3:0x0] updating i_size 5 i_blocks 0 00000080:00200000:2.0:1787191338.562389:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:2.0:1787191338.562431:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc3:0x0](ffff936b4898ec08), flags 100001 00010000:00010000:2.0:1787191338.562452:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839e0a lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xc3:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46045c8 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000100:00100000:1.0:1787191338.567476:0:57859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57859:1874004626632704:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191338.567509:0:57859:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a475f80 x1874004626632448/t8589936732(8589936732) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191338.567573:0:57859:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839e57 from it ffff936b495dcc60 00010000:00010000:1.0:1787191338.567582:0:57859:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839e57 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460467e expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.567593:0:57859:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839e57 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460467e expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191338.567621:0:57859:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc3:0x0](ffff936b4898ec08), inode mode 81a4 mask 46 00000080:00200080:1.0:1787191338.567685:0:57859:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc3:0x0](ffff936b4898ec08) cmd=800466af arg=7fff829e847c 00000080:00200080:1.0:1787191338.567698:0:57859:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc3:0x0](ffff936b4898ec08) cmd=80086601 arg=7fff829e8418 00000100:00100000:1.0:1787191338.567732:0:57859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57859:1874004626632832:192.168.202.101@tcp:33:lfs.0 00000100:00100000:1.0:1787191338.567805:0:57859:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00010000:00010000:0.0:1787191338.569981:0:57860:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191338.569997:0:57860:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191338.570005:0:57860:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191338.570012:0:57860:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191338.570016:0:57860:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191338.570023:0:57860:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42183b58 00010000:00010000:0.0:1787191338.570026:0:57860:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191338.570032:0:57860:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191338.570043:0:57860:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191338.570059:0:57860:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:0.0:1787191338.570065:0:57860:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191338.570077:0:57860:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:0.0:1787191338.570081:0:57860:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:0.0:1787191338.570093:0:57860:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:0.0:1787191338.570144:0:57860:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839e5e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.570152:0:57860:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839e5e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57860 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.570163:0:57860:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839e5e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57860 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191338.570188:0:57860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57860:1874004626632960:192.168.202.101@tcp:101:rm.0 00000100:00100000:0.0:1787191338.570278:0:57860:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99000 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.570391:0:57859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57859:1874004626632832:192.168.202.101@tcp:33:lfs.0 00000080:00200080:1.0:1787191338.570422:0:57859:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc3:0x0](ffff936b4898ec08) cmd=c00c66f3 arg=7fff829e8404 00000002:00010000:1.0:1787191338.570439:0:57859:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc3:0x0]) in obj [0x200000405:0xc3:0x0], intent: open flags 01004040000002 00010000:00010000:1.0:1787191338.570449:0:57859:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839e0a lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xc3:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e46045c8 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191338.570485:0:57859:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839e0a lrc: 1/0,0 mode: --/CW res: [0x200000405:0xc3:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46045c8 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191338.570491:0:57859:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191338.570495:0:57859:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc884839e0a lrc: 0/0,0 mode: --/CW res: [0x200000405:0xc3:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46045c8 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191338.570513:0:57859:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839e65 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x10000000000000 pid: 57859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.570520:0:57859:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839e65 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x0 pid: 57859 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191338.570530:0:57859:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191338.570537:0:57859:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453abb80 x1874004626633216/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191338.570546:0:57859:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839e65 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x81000000000000 pid: 57859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.570557:0:57859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57859:1874004626633216:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.570683:0:57859:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:2.0:1787191338.572766:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191338.572866:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634875648 00000100:00100000:3.0:1787191338.572875:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634875648 00000100:00100000:3.0:1787191338.572924:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1295 00000100:00100000:3.0:1787191338.572934:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634875648:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191338.572946:0:40921:0:(ldlm_lockd.c:2455:ldlm_callback_handler()) callback on lock 0xe5129dc884839e0a - lock disappeared 00010000:00010000:3.0:1787191338.573002:0:40921:0:(ldlm_lockd.c:2352:ldlm_callback_errmsg()) @@@ Operate with invalid parameter, NID=12345-192.168.202.101@tcp lock=0xe5129dc884839e0a: rc = 0 req@ffff936b513b9180 x1874004634875648/t0(0) o104->f10005b0-4ec5-4888-9c81-49c0b11e82c4@192.168.202.101@tcp:649/0 lens 328/224 e 0 to 0 dl 1787191349 ref 1 fl Interpret:/0/0 rc -22/-22 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191338.573012:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634875648:12345-192.168.202.101@tcp:104: Request processed in 82us (256us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787191338.573019:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1295 00000100:00100000:1.0:1787191338.575371:0:57859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57859:1874004626633216:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191338.575390:0:57859:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839e65 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e46046af expref: -99 pid: 57859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.575402:0:57859:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839e65 lrc: 4/1,0 mode: --/PW res: [0x200000405:0xc3:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e46046af expref: -99 pid: 57859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.575414:0:57859:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839e65 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0xc3:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e46046af expref: -99 pid: 57859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.575424:0:57859:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839e65 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0xc3:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e46046af expref: -99 pid: 57859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.575437:0:57859:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839e65 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0xc3:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e46046af expref: -99 pid: 57859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.575446:0:57859:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839e65 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0xc3:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e46046af expref: -99 pid: 57859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.575452:0:57859:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839e65 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0xc3:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e46046af expref: -99 pid: 57859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.575463:0:57859:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x600002b, status=0 req@ffff936b453abb80 x1874004626633216/t8589936734(8589936734) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191338.575477:0:57859:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453abb80 x1874004626633216/t8589936734(8589936734) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191338.575490:0:57859:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839e65 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xc3:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e46046af expref: -99 pid: 57859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.575499:0:57859:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 2 res 8589935621/195 (0 0) 00000080:00200000:1.0:1787191338.575504:0:57859:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xc3:0x0] suppgids 0 0: rc 0 00000002:00100000:1.0:1787191338.575524:0:57859:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453abb80 x1874004626633216/t8589936734(8589936734) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191338.575532:0:57859:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc3:0x0](ffff936b4898ec08) for lock 0xe5129dc884839e65 00000080:00010000:1.0:1787191338.575539:0:57859:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839e65 from it ffffa3fb42083cc0 00010000:00010000:1.0:1787191338.575542:0:57859:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839e65 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xc3:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e46046af expref: -99 pid: 57859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.575555:0:57859:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839e65 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0xc3:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e46046af expref: -99 pid: 57859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00200080:1.0:1787191338.575612:0:57859:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc3:0x0](ffff936b4898ec08) cmd=c00c66f3 arg=81d2e0 00010000:00010000:1.0:1787191338.575667:0:57859:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839e65 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0xc3:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81008000000000 nid: local remote: 0x7130d520e46046af expref: -99 pid: 57859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.575677:0:57859:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839e65 lrc: 0/0,0 mode: --/PW res: [0x200000405:0xc3:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x85809400000000 nid: local remote: 0x7130d520e46046af expref: -99 pid: 57859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.575688:0:57859:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453abb80 x1874004626633216/t8589936734(8589936734) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191338.575694:0:57859:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191338.575698:0:57859:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453aa300 x1874004626633472/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191338.575712:0:57859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57859:1874004626633472:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191338.575776:0:57859:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:0.0:1787191338.576528:0:57860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57860:1874004626632960:192.168.202.101@tcp:101:rm.0 00010000:00010000:0.0:1787191338.576541:0:57860:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839e5e lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46046a1 expref: -99 pid: 57860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.576574:0:57860:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839e5e lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46046a1 expref: -99 pid: 57860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.576580:0:57860:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839e5e lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46046a1 expref: -99 pid: 57860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.576586:0:57860:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839e5e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46046a1 expref: -99 pid: 57860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.576591:0:57860:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839e5e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46046a1 expref: -99 pid: 57860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.576599:0:57860:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839e5e lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46046a1 expref: -99 pid: 57860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.576606:0:57860:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839e5e lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46046a1 expref: -99 pid: 57860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.576613:0:57860:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839e5e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46046a1 expref: -99 pid: 57860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191338.576639:0:57860:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b6a474700 x1874004626632960/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/976 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191338.576649:0:57860:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839e5e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46046a1 expref: -99 pid: 57860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191338.576981:0:57860:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839e5e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46046a1 expref: -99 pid: 57860 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.576993:0:57860:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/195 (0 0) 00000080:00200000:1.0:1787191338.576998:0:57860:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191338.577062:0:57860:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xc3:0x0](ffff936b4898ec08): rc = 0 00000080:00200000:1.0:1787191338.577079:0:57860:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc3:0x0]: layout version change: 4 -> 4 00000080:00010000:1.0:1787191338.577085:0:57860:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc3:0x0](ffff936b4898ec08) for lock 0xe5129dc884839e5e 00000080:00010000:1.0:1787191338.577099:0:57860:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc3:0x0](ffff936b4898ec08) 00000080:00010000:1.0:1787191338.577102:0:57860:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839e5e from it ffffa3fb42183b20 00010000:00010000:1.0:1787191338.577106:0:57860:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839e5e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46046a1 expref: -99 pid: 57860 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.577115:0:57860:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839e5e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46046a1 expref: -99 pid: 57860 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200008:1.0:1787191338.577156:0:57860:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc3:0x0](ffff936b4898ec08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191338.577164:0:57860:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc3:0x0](ffff936b4898ec08),name=f70.sanity-flr 00000002:00010000:1.0:1787191338.577185:0:57860:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc3:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.577192:0:57860:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839e57 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460467e expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.577203:0:57860:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839e57 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460467e expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191338.577210:0:57860:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.577216:0:57860:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc3:0x0](ffff936b4898ec08) 00000080:00010000:1.0:1787191338.577219:0:57860:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc3:0x0](ffff936b4898ec08) for lock 0xe5129dc884839e57 00000080:00010000:1.0:1787191338.577223:0:57860:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839e57 from it ffffa3fb42183cb8 00010000:00010000:1.0:1787191338.577226:0:57860:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839e57 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460467e expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.577233:0:57860:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839e57 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460467e expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191338.577252:0:57860:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc3:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:1.0:1787191338.577262:0:57860:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc3:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191338.577266:0:57860:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191338.577269:0:57860:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc3:0x0] 00000008:00010000:1.0:1787191338.577287:0:57860:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191338.577290:0:57860:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b47d7d230, osc lock ffff936b46837690, flags 0x400000400001002 00010000:00010000:1.0:1787191338.577306:0:57860:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc884839e49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604654 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191338.577316:0:57860:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc884839e49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604654 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1787191338.577394:0:57860:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191338.577398:0:57860:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc884839e49 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4604654 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191338.577406:0:57860:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc884839e49 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604654 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:1.0:1787191338.577417:0:57860:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191338.577426:0:57860:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc3:0x0] updating i_size 5 i_blocks 0 00000020:00010000:1.0:1787191338.577433:0:57860:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c3a060 (ffff936b47a17ab8/0) at cl_lock_release():245 00000020:00010000:1.0:1787191338.577436:0:57860:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c3a060 (ffff936b47a17ab8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191338.577439:0:57860:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7d230 (ffff936b465cc488/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191338.577443:0:57860:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c3a060 (ffff936b47a17ab8/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191338.577445:0:57860:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7d230 (ffff936b47a17ab8/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191338.577454:0:57860:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc3:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191338.577496:0:57860:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191338.577506:0:57860:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.577514:0:57860:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.577523:0:57860:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.577531:0:57860:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.577535:0:57860:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.577537:0:57860:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.577542:0:57860:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42183c10 00010000:00010000:1.0:1787191338.577545:0:57860:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.577552:0:57860:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.577562:0:57860:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.577569:0:57860:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:1.0:1787191338.577574:0:57860:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.577580:0:57860:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:1.0:1787191338.577584:0:57860:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:1.0:1787191338.577588:0:57860:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:1.0:1787191338.577610:0:57860:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafc00/0xe5129dc884839e34 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e460462a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191338.578094:0:57860:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc3:0x0]: losing layout lock 00010000:00010000:1.0:1787191338.578108:0:57860:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839e3b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4604631 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1787191338.578122:0:57860:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc3:0x0]: losing layout lock 00010000:00010000:1.0:1787191338.578127:0:57860:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839e5e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46046a1 expref: -99 pid: 57860 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191338.578134:0:57860:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc3:0x0]: losing layout lock 00010000:00010000:1.0:1787191338.578141:0:57860:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839e57 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e460467e expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191338.578148:0:57860:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc3:0x0]: losing layout lock 00010000:00010000:1.0:1787191338.578153:0:57860:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc884839e26 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e46045f2 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.578195:0:57860:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafc00/0xe5129dc884839e34 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xc3:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e460462a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.578203:0:57860:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839e3b lrc: 1/0,0 mode: --/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604631 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191338.578210:0:57860:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839e5e lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46046a1 expref: -99 pid: 57860 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.578216:0:57860:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839e57 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460467e expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191338.578223:0:57860:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc884839e26 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46045f2 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.578229:0:57860:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 5 locks packed 00010000:00010000:1.0:1787191338.578232:0:57860:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafc00/0xe5129dc884839e34 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc3:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e460462a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.578243:0:57860:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839e3b lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604631 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191338.578252:0:57860:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839e5e lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46046a1 expref: -99 pid: 57860 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.578260:0:57860:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839e57 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460467e expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191338.578268:0:57860:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc884839e26 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46045f2 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1787191338.578285:0:57860:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 36, max 7 00000100:00100000:1.0:1787191338.578294:0:57860:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9c00 x1874004626633728/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 520/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787191338.578313:0:57860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9c00 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57860:1874004626633728:192.168.202.101@tcp:36:rm.0 00000100:00100000:2.0:1787191338.578378:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:1.0:1787191338.578489:0:57860:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893180 going to sleep for 11 seconds 00000100:00100000:2.0:1787191338.578526:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191338.578623:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191338.579156:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634875776 00000100:00100000:3.0:1787191338.579165:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634875776 00000100:00100000:3.0:1787191338.579206:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634875904 00000100:00100000:3.0:1787191338.579209:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634875904 00000100:00100000:3.0:1787191338.579223:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1296 00000100:00100000:3.0:1787191338.579231:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+6:35858:x1874004634875776:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191338.579240:0:51131:0:(ldlm_lockd.c:2455:ldlm_callback_handler()) callback on lock 0xe5129dc884839e3b - lock disappeared 00010000:00010000:3.0:1787191338.579272:0:51131:0:(ldlm_lockd.c:2352:ldlm_callback_errmsg()) @@@ Operate with invalid parameter, NID=12345-192.168.202.101@tcp lock=0xe5129dc884839e3b: rc = 0 req@ffff936b513bb800 x1874004634875776/t0(0) o104->f10005b0-4ec5-4888-9c81-49c0b11e82c4@192.168.202.101@tcp:649/0 lens 328/224 e 0 to 0 dl 1787191349 ref 1 fl Interpret:/0/0 rc -22/-22 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191338.579284:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+6:35858:x1874004634875776:12345-192.168.202.101@tcp:104: Request processed in 54us (908us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787191338.579290:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1296 00000100:00100000:3.0:1787191338.579306:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1297 00000100:00100000:3.0:1787191338.579313:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35858:x1874004634875904:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191338.579379:0:51131:0:(ldlm_lockd.c:2455:ldlm_callback_handler()) callback on lock 0xe5129dc884839e34 - lock disappeared 00010000:00010000:3.0:1787191338.579520:0:51131:0:(ldlm_lockd.c:2352:ldlm_callback_errmsg()) @@@ Operate with invalid parameter, NID=12345-192.168.202.101@tcp lock=0xe5129dc884839e34: rc = 0 req@ffff936b513b8700 x1874004634875904/t0(0) o104->f10005b0-4ec5-4888-9c81-49c0b11e82c4@192.168.202.101@tcp:649/0 lens 328/224 e 0 to 0 dl 1787191349 ref 1 fl Interpret:/0/0 rc -22/-22 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191338.579530:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35858:x1874004634875904:12345-192.168.202.101@tcp:104: Request processed in 219us (1005us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787191338.579535:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1297 00000100:00100000:2.0:1787191338.579611:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191338.579659:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191338.579683:0:40922:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787191338.579694:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634876032 00000100:00100000:2.0:1787191338.579697:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634876032 00000100:00100000:3.0:1787191338.579710:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634876160 00000100:00100000:2.0:1787191338.579712:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634876288 00000100:00100000:3.0:1787191338.579713:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634876160 00000100:00100000:2.0:1787191338.579714:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634876288 00000100:00100000:2.0:1787191338.579725:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1298 00000100:00100000:3.0:1787191338.579734:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1299 00000100:00100000:3.0:1787191338.579743:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b4121d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+7:35858:x1874004634876288:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191338.579748:0:51131:0:(ldlm_lockd.c:2455:ldlm_callback_handler()) callback on lock 0xe5129dc884839e26 - lock disappeared 00010000:00010000:3.0:1787191338.579770:0:51131:0:(ldlm_lockd.c:2352:ldlm_callback_errmsg()) @@@ Operate with invalid parameter, NID=12345-192.168.202.101@tcp lock=0xe5129dc884839e26: rc = 0 req@ffff936b4121d050 x1874004634876288/t0(0) o104->f10005b0-4ec5-4888-9c81-49c0b11e82c4@192.168.202.101@tcp:649/0 lens 328/224 e 0 to 0 dl 1787191349 ref 1 fl Interpret:/0/0 rc -22/-22 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191338.579779:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b4121d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+7:35858:x1874004634876288:12345-192.168.202.101@tcp:104: Request processed in 38us (122us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787191338.579786:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1299 00000100:00100000:2.0:1787191338.579788:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+7:35858:x1874004634876032:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191338.579793:0:40922:0:(ldlm_lockd.c:2455:ldlm_callback_handler()) callback on lock 0xe5129dc884839e5e - lock disappeared 00000100:00100000:3.0:1787191338.579798:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1300 00000100:00100000:3.0:1787191338.579803:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+6:35858:x1874004634876160:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191338.579808:0:51131:0:(ldlm_lockd.c:2455:ldlm_callback_handler()) callback on lock 0xe5129dc884839e57 - lock disappeared 00010000:00010000:2.0:1787191338.579813:0:40922:0:(ldlm_lockd.c:2352:ldlm_callback_errmsg()) @@@ Operate with invalid parameter, NID=12345-192.168.202.101@tcp lock=0xe5129dc884839e5e: rc = 0 req@ffff936b513b8a80 x1874004634876032/t0(0) o104->f10005b0-4ec5-4888-9c81-49c0b11e82c4@192.168.202.101@tcp:649/0 lens 328/224 e 0 to 0 dl 1787191349 ref 1 fl Interpret:/0/0 rc -22/-22 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:3.0:1787191338.579822:0:51131:0:(ldlm_lockd.c:2352:ldlm_callback_errmsg()) @@@ Operate with invalid parameter, NID=12345-192.168.202.101@tcp lock=0xe5129dc884839e57: rc = 0 req@ffff936b513b9c00 x1874004634876160/t0(0) o104->f10005b0-4ec5-4888-9c81-49c0b11e82c4@192.168.202.101@tcp:649/0 lens 328/224 e 0 to 0 dl 1787191349 ref 1 fl Interpret:/0/0 rc -22/-22 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787191338.579823:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+6:35858:x1874004634876032:12345-192.168.202.101@tcp:104: Request processed in 94us (1200us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787191338.579889:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1298 00000100:00100000:3.0:1787191338.579893:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+6:35858:x1874004634876160:12345-192.168.202.101@tcp:104: Request processed in 90us (283us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787191338.579899:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1300 00000100:00100000:1.0:1787191338.584269:0:57859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57859:1874004626633472:192.168.202.101@tcp:35:lfs.0 00000080:00020000:1.0:1787191338.584288:0:57859:0:(file.c:251:ll_close_inode_openhandle()) lustre-clilmv-ffff936b581fb000: inode [0x200000405:0xc3:0x0] mdc close failed: rc = -1 00000002:00100000:1.0:1787191338.584308:0:57859:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453abb80 x1874004626633216/t8589936734(8589936734) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191338.584343:0:57859:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xc3:0x0](ffff936b4898ec08) 00000002:00010000:1.0:1787191338.584353:0:57859:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc3:0x0]) in obj [0x200000405:0xc3:0x0], intent: layout flags 0 00010000:00010000:1.0:1787191338.584415:0:57859:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839e6c lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.584425:0:57859:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839e6c lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57859 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.584435:0:57859:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839e6c lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57859 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.584455:0:57859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57859:1874004626633856:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.584597:0:57859:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.585900:0:57860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9c00 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57860:1874004626633728:192.168.202.101@tcp:36:rm.0 00000100:00100000:1.0:1787191338.588275:0:57859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57859:1874004626633856:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191338.588302:0:57859:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839e6c lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46046d9 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.588317:0:57859:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839e6c lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46046d9 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.588340:0:57859:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b453abb80 x1874004626633856/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191338.588351:0:57859:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839e6c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46046d9 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191338.588363:0:57859:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839e6c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46046d9 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.588372:0:57859:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/195 (0 0) 00000080:00200000:1.0:1787191338.588379:0:57859:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xc3:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191338.588411:0:57859:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc3:0x0](ffff936b4898ec08) for lock 0xe5129dc884839e6c 00000080:00010000:1.0:1787191338.588419:0:57859:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839e6c from it ffffa3fb42083bc8 00010000:00010000:1.0:1787191338.588423:0:57859:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839e6c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46046d9 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.588431:0:57859:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839e6c lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46046d9 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.588452:0:57859:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839e6c lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46046d9 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.588462:0:57859:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839e6c lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46046d9 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:1.0:1787191338.588469:0:57859:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xc3:0x0](00000000cef45b51) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839e6c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46046d9 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191338.588508:0:57859:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc3:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:1.0:1787191338.588514:0:57859:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839e6c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46046d9 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.588521:0:57859:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bce00/0xe5129dc884839e6c lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46046d9 expref: -99 pid: 57859 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200008:1.0:1787191338.588653:0:57859:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc3:0x0](ffff936b4898ec08), flags 154002 00000002:00100000:1.0:1787191338.588693:0:57859:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1dc00 x1874004626628992/t8589936725(8589936725) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191338.588710:0:57859:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191338.588715:0:57859:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453abb80 x1874004626634112/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191338.588734:0:57859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57859:1874004626634112:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191338.588805:0:57859:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.592047:0:57859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57859:1874004626634112:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191338.592096:0:57859:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1dc00 x1874004626628992/t8589936725(8589936725) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191338.592147:0:57859:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc3:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00020000:00200000:1.0:1787191338.592166:0:57859:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc3:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191338.592169:0:57859:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191338.592175:0:57859:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191338.592185:0:57859:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000008:00010000:1.0:1787191338.592202:0:57859:0:(osc_cache.c:1183:osc_extent_make_ready()) ### extent: 00000000b331cccb ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc884839e49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604654 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1787191338.592229:0:57859:0:(osc_cache.c:917:osc_extent_finish()) ### extent: 00000000b331cccb ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc884839e49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604654 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1787191338.592250:0:57859:0:(osc_cache.c:497:__osc_extent_remove()) ### extent: 00000000b331cccb ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc884839e49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604654 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191338.592271:0:57859:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc3:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191338.592300:0:57859:0:(llite_lib.c:2066:ll_clear_inode()) VFS Op:inode=[0x200000405:0xc3:0x0](ffff936b4898ec08) 00000008:00010000:1.0:1787191338.592337:0:57859:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 5 blocks 0 [cma]time 1787191338 1787191338 1787191338 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc884839e49 lrc: 1/0,0 mode: PW/PW res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604654 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1787191338.592358:0:57859:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191338 1787191338 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839e50 lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x1aa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604662 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191338.606551:0:57861:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191338.606579:0:57861:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191338.606595:0:57861:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191338.606611:0:57861:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191338.606619:0:57861:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191338.606639:0:57861:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191338.606643:0:57861:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191338.606652:0:57861:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42193b58 00010000:00010000:2.0:1787191338.606656:0:57861:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191338.606665:0:57861:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191338.606681:0:57861:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191338.606689:0:57861:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:2.0:1787191338.606695:0:57861:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191338.606705:0:57861:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:2.0:1787191338.606709:0:57861:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191338.606723:0:57861:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191338.606771:0:57861:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839e73 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.606778:0:57861:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839e73 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.606789:0:57861:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839e73 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191338.606812:0:57861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57861:1874004626634240:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191338.607033:0:57861:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5fa80 going to sleep for 11 seconds 00000080:00200000:1.0:1787191338.610322:0:57862:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191338.610352:0:57862:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.610368:0:57862:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.610383:0:57862:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.610390:0:57862:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.610399:0:57862:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.610403:0:57862:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.610410:0:57862:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4210bbf8 00010000:00010000:1.0:1787191338.610414:0:57862:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.610422:0:57862:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.610438:0:57862:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.610446:0:57862:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191338.610452:0:57862:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:3.0:1787191338.611393:0:57861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57861:1874004626634240:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191338.611412:0:57861:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839e73 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.611422:0:57861:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839e73 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.611428:0:57861:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839e73 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.611434:0:57861:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839e73 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.611446:0:57861:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839e73 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.611452:0:57861:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd5200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191338.611456:0:57861:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839e73 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.611464:0:57861:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839e73 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.611470:0:57861:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839e73 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.611477:0:57861:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191338.611483:0:57861:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839e73 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.611490:0:57861:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839e73 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191338.611579:0:57861:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513bb100 x1874004626634240/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191338.611597:0:57861:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191338.611737:0:57861:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191338.611750:0:57861:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191338.611759:0:57861:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191338.611770:0:57861:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191338.611776:0:57861:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191338.611781:0:57861:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191338.611783:0:57861:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191338.611787:0:57861:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42193be8 00010000:00010000:3.0:1787191338.611790:0:57861:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191338.611797:0:57861:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191338.611808:0:57861:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191338.611813:0:57861:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000080:00200000:3.0:1787191338.611817:0:57861:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191338.611827:0:57861:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:3.0:1787191338.611898:0:57861:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:3.0:1787191338.611911:0:57861:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1787191338.611956:0:57861:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839e7a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.611964:0:57861:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839e7a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.611973:0:57861:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839e7a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191338.611994:0:57861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57861:1874004626634368:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191338.612107:0:57861:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787191338.616619:0:57861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57861:1874004626634368:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191338.616651:0:57861:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839e7a lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.616664:0:57861:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839e7a lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.616671:0:57861:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839e7a lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.616677:0:57861:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839e7a lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.616685:0:57861:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839e7a lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.616692:0:57861:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9b000 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191338.616696:0:57861:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839e7a lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.616704:0:57861:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839e7a lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.616711:0:57861:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839e7a lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.616719:0:57861:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191338.616725:0:57861:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839e7a lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.616731:0:57861:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839e7a lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191338.616758:0:57861:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b51d1ea00 x1874004626634368/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191338.616772:0:57861:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191338.616903:0:57861:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191338.616919:0:57861:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191338.616929:0:57861:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191338.616940:0:57861:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191338.616948:0:57861:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191338.616953:0:57861:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191338.616956:0:57861:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191338.616961:0:57861:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42193b58 00010000:00010000:3.0:1787191338.616964:0:57861:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191338.616971:0:57861:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191338.616985:0:57861:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191338.616991:0:57861:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:3.0:1787191338.617000:0:57861:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:3.0:1787191338.617005:0:57861:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:3.0:1787191338.617016:0:57861:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191338.617022:0:57861:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 76 lru_type: 1 00010000:00010000:3.0:1787191338.617030:0:57861:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 76 lru_type: 1 00000002:00010000:3.0:1787191338.617039:0:57861:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191338.617090:0:57861:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc884839e81 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.617097:0:57861:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc884839e81 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.617105:0:57861:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc884839e81 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191338.617125:0:57861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57861:1874004626634496:192.168.202.101@tcp:101:lfs.0 00000080:00200000:1.0:1787191338.617316:0:57862:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b494a4f00, open_flags d900, mode 0 opened 0 00000080:00200000:1.0:1787191338.617326:0:57862:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:1.0:1787191338.617341:0:57862:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:1.0:1787191338.617369:0:57862:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839e88 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.617377:0:57862:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839e88 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57862 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191338.617386:0:57862:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191338.617401:0:57862:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453abb80 x1874004626634752/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191338.617410:0:57862:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839e88 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.617422:0:57862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57862:1874004626634752:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.617580:0:57862:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:3.0:1787191338.619687:0:57861:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.620171:0:57862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57862:1874004626634752:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191338.620191:0:57862:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839e88 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.620205:0:57862:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839e88 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.620212:0:57862:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839e88 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.620219:0:57862:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839e88 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.620231:0:57862:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839e88 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.620238:0:57862:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b587bcc00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191338.620242:0:57862:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839e88 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.620249:0:57862:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839e88 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.620257:0:57862:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839e88 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.620263:0:57862:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191338.620269:0:57862:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839e88 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.620275:0:57862:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839e88 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57862 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.620292:0:57862:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x7, status=0 req@ffff936b453abb80 x1874004626634752/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/608 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191338.620307:0:57862:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1787191338.620332:0:57862:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 30 res 8589937616/5 (0 0) 00000080:00200000:1.0:1787191338.620587:0:57862:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191338.620603:0:57862:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.620612:0:57862:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.620627:0:57862:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.620633:0:57862:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.620639:0:57862:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.620642:0:57862:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.620647:0:57862:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4210bb58 00010000:00010000:1.0:1787191338.620651:0:57862:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.620658:0:57862:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.620672:0:57862:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.620680:0:57862:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191338.620685:0:57862:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.620697:0:57862:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=9 00000080:00200000:1.0:1787191338.620701:0:57862:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191338.620713:0:57862:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191338.620747:0:57862:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839e8f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.620755:0:57862:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839e8f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.620764:0:57862:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839e8f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.620787:0:57862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57862:1874004626634880:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.620858:0:57862:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:3.0:1787191338.621979:0:57861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57861:1874004626634496:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191338.621997:0:57861:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc884839e81 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460472d expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.622010:0:57861:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc884839e81 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460472d expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.622024:0:57861:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc884839e81 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460472d expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.622036:0:57861:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc884839e81 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460472d expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.622047:0:57861:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc884839e81 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460472d expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.622065:0:57861:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc884839e81 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460472d expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.622071:0:57861:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc884839e81 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460472d expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191338.622082:0:57861:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b51d1ea00 x1874004626634496/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191338.622095:0:57861:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc884839e81 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460472d expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.622104:0:57861:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:3.0:1787191338.622112:0:57861:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc884839e81 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460472d expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.622121:0:57861:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc884839e81 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460472d expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:3.0:1787191338.622153:0:57861:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191338.622163:0:57861:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 152 lru_type: 1 00010000:00010000:3.0:1787191338.622174:0:57861:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 152 lru_type: 1 00010000:00010000:3.0:1787191338.622184:0:57861:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 152 lru_type: 1 00010000:00010000:3.0:1787191338.622192:0:57861:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 153 lru_type: 1 00000080:00200000:3.0:1787191338.622204:0:57861:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1787191338.622210:0:57861:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:3.0:1787191338.622214:0:57861:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:3.0:1787191338.622220:0:57861:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb42193cb8 00010000:00010000:3.0:1787191338.622223:0:57861:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 76 lru_type: 1 00010000:00010000:3.0:1787191338.622230:0:57861:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 77 lru_type: 1 00000002:00010000:3.0:1787191338.622243:0:57861:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191338.622250:0:57861:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc884839e81 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460472d expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.622258:0:57861:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc884839e81 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460472d expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.622265:0:57861:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc884839e81 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460472d expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.622271:0:57861:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc884839e81 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460472d expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:3.0:1787191338.622279:0:57861:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191338.622284:0:57861:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 153 lru_type: 1 00010000:00010000:3.0:1787191338.622292:0:57861:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 153 lru_type: 1 00010000:00010000:3.0:1787191338.622300:0:57861:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 153 lru_type: 1 00010000:00010000:3.0:1787191338.622308:0:57861:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 154 lru_type: 1 00000080:00200008:3.0:1787191338.622873:0:57861:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:3.0:1787191338.622879:0:57861:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191338.622892:0:57861:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191338.622901:0:57861:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191338.622911:0:57861:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191338.622917:0:57861:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191338.622922:0:57861:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191338.622925:0:57861:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191338.622929:0:57861:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42193cb8 00010000:00010000:3.0:1787191338.622933:0:57861:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191338.622940:0:57861:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191338.623058:0:57861:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191338.623067:0:57861:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191338.623073:0:57861:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191338.623081:0:57861:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191338.623087:0:57861:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191338.623091:0:57861:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191338.623093:0:57861:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191338.623097:0:57861:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42193b58 00010000:00010000:3.0:1787191338.623100:0:57861:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191338.623108:0:57861:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191338.623115:0:57861:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191338.623122:0:57861:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:3.0:1787191338.623127:0:57861:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:1.0:1787191338.624340:0:57862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57862:1874004626634880:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191338.624359:0:57862:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839e8f lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.624371:0:57862:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839e8f lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.624378:0:57862:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839e8f lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.624385:0:57862:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839e8f lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.624445:0:57862:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839e8f lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.624453:0:57862:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b587bde00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191338.624457:0:57862:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839e8f lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.624464:0:57862:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839e8f lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.624470:0:57862:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839e8f lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.624477:0:57862:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191338.624484:0:57862:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839e8f lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.624490:0:57862:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839e8f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57862 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.624575:0:57862:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b453abb80 x1874004626634880/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191338.624592:0:57862:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1787191338.624718:0:57862:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc884839e81 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460472d expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191338.624730:0:57862:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc884839e81 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460472d expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191338.624861:0:57861:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:3.0:1787191338.624867:0:57861:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:3.0:1787191338.624888:0:57861:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1787191338.624937:0:57861:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839e96 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.624945:0:57861:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839e96 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.624953:0:57861:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839e96 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191338.624974:0:57861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57861:1874004626635008:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191338.625065:0:57861:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cf00 going to sleep for 11 seconds 00000080:00010000:1.0:1787191338.625806:0:57862:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839e81 from it ffffa3fb4210b930 00010000:00010000:1.0:1787191338.625814:0:57862:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc884839e81 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460472d expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191338.625824:0:57862:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc884839e81 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460472d expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000100:00100000:1.0:1787191338.627650:0:57861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57861:1874004626635008:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191338.627670:0:57861:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839e96 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.627682:0:57861:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839e96 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.627694:0:57861:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839e96 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.627701:0:57861:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839e96 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.627709:0:57861:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839e96 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.627715:0:57861:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9ac00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191338.627719:0:57861:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839e96 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.627726:0:57861:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839e96 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.627733:0:57861:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839e96 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.627740:0:57861:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191338.627745:0:57861:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839e96 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.627751:0:57861:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc884839e96 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.627765:0:57861:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b51d1ea00 x1874004626635008/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191338.627779:0:57861:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1787191338.627803:0:57861:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc884839e81 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460472d expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191338.627814:0:57861:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc884839e81 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460472d expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00010000:1.0:1787191338.627823:0:57861:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839e81 from it ffffa3fb42193930 00010000:00010000:1.0:1787191338.627826:0:57861:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc884839e81 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460472d expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191338.627867:0:57861:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc884839e81 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460472d expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1787191338.627932:0:57861:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191338.627947:0:57861:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.627954:0:57861:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.627961:0:57861:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.627967:0:57861:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.627972:0:57861:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.627976:0:57861:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.627980:0:57861:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42193bf8 00010000:00010000:1.0:1787191338.627983:0:57861:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.627989:0:57861:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.628001:0:57861:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.628007:0:57861:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191338.628011:0:57861:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.628016:0:57861:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:1.0:1787191338.628019:0:57861:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:1.0:1787191338.628023:0:57861:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b494a5200, open_flags a141, mode 81b6 opened 0 00000080:00200000:1.0:1787191338.628032:0:57861:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:1.0:1787191338.628062:0:57861:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xc4:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:1.0:1787191338.628073:0:57861:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc884839e81 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e460472d expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191338.628127:0:57861:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc884839e81 lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e460472d expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191338.628270:0:57861:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191338.628273:0:57861:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc884839e81 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e460472d expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191338.628307:0:57861:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839e9d lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.628314:0:57861:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839e9d lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191338.628325:0:57861:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191338.628332:0:57861:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453abb80 x1874004626635264/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191338.628348:0:57861:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839e9d lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.628366:0:57861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57861:1874004626635264:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.628493:0:57861:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.631503:0:57861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57861:1874004626635264:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191338.631538:0:57861:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839e9d lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604773 expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.631562:0:57861:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839e9d lrc: 4/0,1 mode: --/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604773 expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.631569:0:57861:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839e9d lrc: 4/0,1 mode: --/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604773 expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.631580:0:57861:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839e9d lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604773 expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.631590:0:57861:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839e9d lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604773 expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.631603:0:57861:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839e9d lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604773 expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.631611:0:57861:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839e9d lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604773 expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.631623:0:57861:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839e9d lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604773 expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.631644:0:57861:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b453abb80 x1874004626635264/t8589936738(8589936738) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191338.631656:0:57861:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453abb80 x1874004626635264/t8589936738(8589936738) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191338.631667:0:57861:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839e9d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604773 expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.631676:0:57861:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/196 (0 0) 00000080:00200000:1.0:1787191338.631681:0:57861:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191338.631693:0:57861:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:1.0:1787191338.631721:0:57861:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xc4:0x0](ffff936b5395b248) 00000080:00200000:1.0:1787191338.631728:0:57861:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xc4:0x0], updating i_size 0 00000080:00200000:1.0:1787191338.631762:0:57861:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc4:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:1.0:1787191338.631766:0:57861:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xc4:0x0](ffff936b5395b248) 00000080:00010000:1.0:1787191338.631769:0:57861:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc4:0x0](ffff936b5395b248) for lock 0xe5129dc884839e9d 00000080:00010000:1.0:1787191338.631779:0:57861:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc4:0x0](ffff936b5395b248) 00000080:00200008:1.0:1787191338.631795:0:57861:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc4:0x0](ffff936b5395b248), flags 120501 00000002:00100000:1.0:1787191338.631813:0:57861:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453abb80 x1874004626635264/t8589936738(8589936738) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191338.632010:0:57861:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839e9d from it ffff936b5339fd20 00010000:00010000:1.0:1787191338.632015:0:57861:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839e9d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604773 expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.632025:0:57861:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839e9d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604773 expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191338.632045:0:57861:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc4:0x0](ffff936b5395b248), inode mode 81a4 mask 40 00000080:00200000:1.0:1787191338.632105:0:57861:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc4:0x0](ffff936b5395b248), inode mode 81a4 mask 2 00000080:00200000:1.0:1787191338.632115:0:57861:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xc4:0x0](ffff936b5395b248), xattr lov 00000002:00010000:1.0:1787191338.632131:0:57861:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc4:0x0]) in obj [0x200000405:0xc4:0x0], intent: open flags 040000002 00010000:00010000:1.0:1787191338.632238:0:57861:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc884839ea4 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.632246:0:57861:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc884839ea4 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191338.632256:0:57861:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191338.632262:0:57861:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8e00 x1874004626635520/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191338.632271:0:57861:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc884839ea4 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.632289:0:57861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57861:1874004626635520:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.632705:0:57861:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:3.0:1787191338.643802:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000080:00200000:0.0:1787191338.646031:0:57863:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191338.646481:0:57863:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191338.646498:0:57863:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191338.646567:0:57863:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191338.646576:0:57863:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191338.646584:0:57863:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191338.646588:0:57863:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191338.646595:0:57863:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421a3bf8 00010000:00010000:0.0:1787191338.646599:0:57863:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191338.646607:0:57863:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191338.646676:0:57863:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191338.646686:0:57863:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191338.646692:0:57863:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191338.646697:0:57863:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:0.0:1787191338.646700:0:57863:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc4:0x0](ffff936b5395b248), inode mode 81a4 mask 44 00000080:00200008:0.0:1787191338.646707:0:57863:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc4:0x0](ffff936b5395b248), flags 154400 00000002:00010000:0.0:1787191338.646722:0:57863:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc4:0x0]) in obj [0x200000405:0xc4:0x0], intent: open flags 0100240114401 00010000:00010000:0.0:1787191338.646769:0:57863:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc884839eab lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.646776:0:57863:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc884839eab lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57863 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191338.646788:0:57863:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:0.0:1787191338.646799:0:57863:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477100 x1874004626635776/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191338.646808:0:57863:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc884839eab lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191338.646827:0:57863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57863:1874004626635776:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191338.647251:0:57863:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99000 going to sleep for 11 seconds 00000100:00100000:2.0:1787191338.648275:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634876416 00000100:00100000:2.0:1787191338.648285:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634876416 00000100:00100000:2.0:1787191338.648342:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1301 00000100:00100000:2.0:1787191338.648351:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634876416:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191338.648367:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839e9d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4604773 expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191338.648429:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191338.648436:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634876416:12345-192.168.202.101@tcp:104: Request processed in 86us (4644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191338.648443:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1301 00010000:00010000:0.0:1787191338.649021:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191338.649030:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839e9d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4604773 expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191338.649038:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b587bd400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191338.649043:0:43384:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839e9d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4604773 expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191338.649062:0:43384:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839e9d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4604773 expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191338.649075:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839e9d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4604773 expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191338.649095:0:43384:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc4:0x0]: losing layout lock 00010000:00010000:0.0:1787191338.649146:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839e9d lrc: 2/0,0 mode: --/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4604773 expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191338.649154:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191338.649177:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839e9d lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4604773 expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191338.649185:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839e9d lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4604773 expref: -99 pid: 57861 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191338.649197:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191338.649199:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191338.649201:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191338.649215:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626635904:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191338.650081:0:57863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57863:1874004626635776:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191338.650096:0:57863:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc884839eab lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.650106:0:57863:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc884839eab lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.650113:0:57863:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc884839eab lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.650121:0:57863:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc884839eab lrc: 3/0,0 mode: --/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.650132:0:57863:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc884839eab lrc: 4/0,0 mode: --/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.650220:0:57863:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44caf000 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191338.650224:0:57863:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc884839eab lrc: 4/0,0 mode: --/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.650231:0:57863:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc884839eab lrc: 4/0,0 mode: --/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.650237:0:57863:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc884839eab lrc: 5/0,0 mode: --/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.650243:0:57863:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191338.650247:0:57863:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc884839eab lrc: 3/0,0 mode: --/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.650254:0:57863:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc884839eab lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57863 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191338.650271:0:57863:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b6a477100 x1874004626635776/t8589936739(8589936739) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191338.650285:0:57863:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477100 x1874004626635776/t8589936739(8589936739) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191338.650297:0:57863:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xc4:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787191338.650316:0:57863:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xc4:0x0], updating i_size 0 00000002:00100000:0.0:1787191338.650335:0:57863:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477100 x1874004626635776/t8589936739(8589936739) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191338.650501:0:57863:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc4:0x0](ffff936b5395b248), inode mode 81a4 mask 4 00000080:00200000:0.0:1787191338.650895:0:57863:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xc4:0x0](ffff936b5395b248), xattr lov 00000080:00200008:0.0:1787191338.650943:0:57863:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc4:0x0](ffff936b5395b248), flags 154000 00000002:00100000:0.0:1787191338.650995:0:57863:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a477100 x1874004626635776/t8589936739(8589936739) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191354 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191338.651007:0:57863:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:0.0:1787191338.651012:0:57863:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475c00 x1874004626636160/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191338.651032:0:57863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57863:1874004626636160:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191338.651619:0:57863:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99000 going to sleep for 11 seconds 00000100:00100000:0.0:1787191338.652546:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626635904:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191338.657225:0:57861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57861:1874004626635520:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191338.657246:0:57861:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc884839ea4 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.657260:0:57861:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc884839ea4 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.657268:0:57861:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc884839ea4 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.657275:0:57861:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc884839ea4 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.657283:0:57861:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc884839ea4 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.657289:0:57861:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b4150b800 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191338.657293:0:57861:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc884839ea4 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.657299:0:57861:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc884839ea4 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.657306:0:57861:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc884839ea4 lrc: 5/0,0 mode: --/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.657313:0:57861:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191338.657319:0:57861:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc884839ea4 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.657326:0:57861:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc884839ea4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57861 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.657349:0:57861:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b453a8e00 x1874004626635520/t8589936740(8589936740) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191338.657361:0:57861:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8e00 x1874004626635520/t8589936740(8589936740) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191338.657378:0:57861:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xc4:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787191338.657424:0:57861:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc4:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1787191338.657433:0:57861:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191338.657481:0:57861:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xc4:0x0], updating i_size 0 00000002:00100000:1.0:1787191338.657499:0:57861:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8e00 x1874004626635520/t8589936740(8589936740) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191338.657547:0:57861:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a8e00 x1874004626635520/t8589936740(8589936740) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191338.657555:0:57861:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191338.657560:0:57861:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9f80 x1874004626636416/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191338.657579:0:57861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57861:1874004626636416:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191338.657658:0:57861:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:0.0:1787191338.657736:0:57863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57863:1874004626636160:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191338.657754:0:57863:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a477100 x1874004626635776/t8589936739(8589936739) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191338.658439:0:57863:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191338.658457:0:57863:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191338.658474:0:57863:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191338.658487:0:57863:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191338.658494:0:57863:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191338.658502:0:57863:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191338.658505:0:57863:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191338.658511:0:57863:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421a3bf8 00010000:00010000:0.0:1787191338.658515:0:57863:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191338.658523:0:57863:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191338.658538:0:57863:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191338.658545:0:57863:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191338.658551:0:57863:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191338.658563:0:57863:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b44d04000, open_flags d900, mode 0 opened 0 00000080:00200000:0.0:1787191338.658569:0:57863:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:0.0:1787191338.658582:0:57863:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:0.0:1787191338.658635:0:57863:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839eb2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.658644:0:57863:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839eb2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57863 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191338.658654:0:57863:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:0.0:1787191338.658660:0:57863:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474a80 x1874004626636672/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191338.658669:0:57863:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839eb2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191338.658685:0:57863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57863:1874004626636672:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191338.658828:0:57863:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99000 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.661896:0:57861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57861:1874004626636416:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191338.661928:0:57861:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a8e00 x1874004626635520/t8589936740(8589936740) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1787191338.661976:0:57861:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc4:0x0](ffff936b5395b248), flags 100001 00000002:00100000:1.0:1787191338.662012:0:57861:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453abb80 x1874004626635264/t8589936738(8589936738) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191354 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191338.662020:0:57861:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191338.662023:0:57861:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9500 x1874004626636928/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191338.662038:0:57861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57861:1874004626636928:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191338.662113:0:57861:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:0.0:1787191338.662122:0:57863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57863:1874004626636672:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191338.662137:0:57863:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839eb2 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46047c0 expref: -99 pid: 57863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.662171:0:57863:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839eb2 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46047c0 expref: -99 pid: 57863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.662179:0:57863:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839eb2 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46047c0 expref: -99 pid: 57863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.662190:0:57863:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839eb2 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46047c0 expref: -99 pid: 57863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.662202:0:57863:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839eb2 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46047c0 expref: -99 pid: 57863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.662215:0:57863:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839eb2 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46047c0 expref: -99 pid: 57863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.662223:0:57863:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839eb2 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46047c0 expref: -99 pid: 57863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.662230:0:57863:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839eb2 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46047c0 expref: -99 pid: 57863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191338.662240:0:57863:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b6a474a80 x1874004626636672/t8589936742(8589936742) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191338.662252:0:57863:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474a80 x1874004626636672/t8589936742(8589936742) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191338.662263:0:57863:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46047c0 expref: -99 pid: 57863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191338.662275:0:57863:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46047c0 expref: -99 pid: 57863 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.662284:0:57863:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/196 (0 0) 00000080:00200000:0.0:1787191338.662290:0:57863:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191338.662343:0:57863:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xc4:0x0](ffff936b5395b248): rc = 0 00000080:00200000:0.0:1787191338.662359:0:57863:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc4:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:0.0:1787191338.662364:0:57863:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc4:0x0](ffff936b5395b248) for lock 0xe5129dc884839eb2 00000080:00010000:0.0:1787191338.662377:0:57863:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc4:0x0](ffff936b5395b248) 00000080:00200008:0.0:1787191338.662389:0:57863:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc4:0x0](ffff936b5395b248), flags 154400 00000002:00100000:0.0:1787191338.662419:0:57863:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474a80 x1874004626636672/t8589936742(8589936742) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191338.662464:0:57863:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839eb2 from it ffff936b495dc9c0 00010000:00010000:0.0:1787191338.662469:0:57863:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46047c0 expref: -99 pid: 57863 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.662478:0:57863:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839eb2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46047c0 expref: -99 pid: 57863 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191338.662500:0:57863:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc4:0x0](ffff936b5395b248), inode mode 81a4 mask 44 00000080:00200000:0.0:1787191338.662558:0:57863:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc4:0x0](ffff936b5395b248), inode mode 81a4 mask 4 00000080:00200000:0.0:1787191338.662566:0:57863:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xc4:0x0](ffff936b5395b248), xattr lov 00000080:00200008:0.0:1787191338.662618:0:57863:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc4:0x0](ffff936b5395b248), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191338.662623:0:57863:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc4:0x0](ffff936b5395b248),name=f70.sanity-flr 00000002:00010000:0.0:1787191338.662635:0:57863:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc4:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191338.662641:0:57863:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839eb2 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46047c0 expref: -99 pid: 57863 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191338.662648:0:57863:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839eb2 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46047c0 expref: -99 pid: 57863 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191338.662653:0:57863:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191338.662657:0:57863:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc4:0x0](ffff936b5395b248) 00000080:00010000:0.0:1787191338.662659:0:57863:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc4:0x0](ffff936b5395b248) for lock 0xe5129dc884839eb2 00000080:00010000:0.0:1787191338.662662:0:57863:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839eb2 from it ffffa3fb421a3cd8 00010000:00010000:0.0:1787191338.662664:0:57863:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46047c0 expref: -99 pid: 57863 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191338.662668:0:57863:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839eb2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46047c0 expref: -99 pid: 57863 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191338.662681:0:57863:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc4:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:0.0:1787191338.662689:0:57863:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc4:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191338.662691:0:57863:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191338.662693:0:57863:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc4:0x0] 00000008:00010000:0.0:1787191338.662710:0:57863:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191338.662712:0:57863:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b46b50930, osc lock ffff936b50b63300, flags 0x400000400001002 00010000:00010000:0.0:1787191338.662738:0:57863:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839eb9 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57863 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.662750:0:57863:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839eb9 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57863 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.662756:0:57863:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b6a475180 x1874004626637056/t0(0) o101->lustre-OST0000-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:0.0:1787191338.662787:0:57863:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:0.0:1787191338.662798:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787191338.662810:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626637056:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.664380:0:57861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57861:1874004626636928:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191338.664408:0:57861:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453abb80 x1874004626635264/t8589936738(8589936738) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1787191338.666579:0:2389:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839eb9 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57863 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.666605:0:2389:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839eb9 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46047ce expref: -99 pid: 57863 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.666619:0:2389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839eb9 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46047ce expref: -99 pid: 57863 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.666631:0:2389:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839eb9 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46047ce expref: -99 pid: 57863 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191338.666648:0:2389:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839eb9 lrc: 5/2,0 mode: PR/PR res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46047ce expref: -99 pid: 57863 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1787191338.666658:0:2389:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1787191338.666680:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839eb9 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46047ce expref: -99 pid: 57863 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.666689:0:2389:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839eb9 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46047ce expref: -99 pid: 57863 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.666696:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839eb9 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46047ce expref: -99 pid: 57863 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.666704:0:2389:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839eb9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46047ce expref: -99 pid: 57863 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1787191338.666722:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626637056:192.168.202.101@tcp:101:lfs.0 00000080:00200000:1.0:1787191338.666804:0:57863:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc4:0x0] updating i_size 0 i_blocks 0 00000020:00010000:1.0:1787191338.666810:0:57863:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c3a500 (ffff936b47a17f38/0) at cl_lock_release():245 00000020:00010000:1.0:1787191338.666813:0:57863:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c3a500 (ffff936b47a17f38/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191338.666818:0:57863:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b46b50930 (ffff936b47a17998/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191338.666822:0:57863:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c3a500 (ffff936b47a17f38/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191338.666825:0:57863:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b46b50930 (ffff936b47a17f38/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191338.666856:0:57863:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc4:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191338.666889:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000080:00200008:1.0:1787191338.666902:0:57863:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc4:0x0](ffff936b5395b248), flags 154000 00000002:00010000:2.0:1787191338.666909:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191338.666918:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191338.666929:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191338.666935:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191338.666941:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000002:00100000:1.0:1787191338.666945:0:57863:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a474a80 x1874004626636672/t8589936742(8589936742) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1787191338.666945:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191338.666950:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:2.0:1787191338.666953:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000020:00100000:1.0:1787191338.666955:0:57863:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191338.666960:0:57863:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8a80 x1874004626637312/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191338.666961:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191338.666971:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191338.666977:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000100:00100000:1.0:1787191338.666981:0:57863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57863:1874004626637312:192.168.202.101@tcp:35:lfs.0 00000080:00200000:2.0:1787191338.666983:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191338.666988:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:2.0:1787191338.666994:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc4:0x0](ffff936b5395b248), inode mode 81a4 mask 42 00000080:00200008:2.0:1787191338.667000:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc4:0x0](ffff936b5395b248), flags 101101 00000002:00010000:2.0:1787191338.667013:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc4:0x0]) in obj [0x200000405:0xc4:0x0], intent: open|creat flags 04240101102 00010000:00010000:2.0:1787191338.667023:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839eb2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46047c0 expref: -99 pid: 57863 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191338.667037:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc4:0x0]: losing layout lock 00000100:00100000:1.0:1787191338.667063:0:57863:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00010000:00010000:2.0:1787191338.667079:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839eb2 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46047c0 expref: -99 pid: 57863 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191338.667086:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191338.667089:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc884839eb2 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46047c0 expref: -99 pid: 57863 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191338.667121:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839ec0 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xc4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.667128:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839ec0 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xc4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191338.667148:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:2.0:1787191338.667154:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9f80 x1874004626637568/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191338.667162:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839ec0 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xc4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191338.667174:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626637568:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191338.667249:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f300 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.670825:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626637568:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191338.670887:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839ec0 lrc: 4/0,1 mode: --/CW res: [0x200000405:0xc4:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46047dc expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.670902:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839ec0 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xc4:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46047dc expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.670913:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839ec0 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xc4:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46047dc expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.670927:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x200002b, status=0 req@ffff936b513b9f80 x1874004626637568/t8589936746(8589936746) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191338.670941:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9f80 x1874004626637568/t8589936746(8589936746) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191338.670953:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839ec0 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xc4:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46047dc expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191338.670966:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839ec0 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xc4:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46047dc expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.670976:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 8 res 8589935621/196 (0 0) 00000080:00200000:1.0:1787191338.670981:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000405:0xc4:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787191338.671035:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc4:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:1.0:1787191338.671041:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc4:0x0](ffff936b5395b248) for lock 0xe5129dc884839ec0 00000080:00010000:1.0:1787191338.671046:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839ec0 from it ffffa3fb41cabbf0 00010000:00010000:1.0:1787191338.671061:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839ec0 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xc4:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46047dc expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.671070:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839ec0 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xc4:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46047dc expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000002:00100000:1.0:1787191338.671094:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9f80 x1874004626637568/t8589936746(8589936746) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191338.671163:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xc4:0x0], intent: getxattr flags 0 00010000:00010000:1.0:1787191338.671203:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc884839ec7 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.671210:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc884839ec7 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.671219:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc884839ec7 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.671238:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626637696:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191338.671303:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893180 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.674354:0:57863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57863:1874004626637312:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191338.674390:0:57863:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a474a80 x1874004626636672/t8589936742(8589936742) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191338.674465:0:57863:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191338.674483:0:57863:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.674498:0:57863:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.674510:0:57863:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.674518:0:57863:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.674524:0:57863:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.674527:0:57863:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.674534:0:57863:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421a3bf8 00010000:00010000:1.0:1787191338.674539:0:57863:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.674547:0:57863:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.674561:0:57863:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.674568:0:57863:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191338.674573:0:57863:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.674585:0:57863:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b494a5200, open_flags d902, mode 0 opened 0 00000080:00200000:1.0:1787191338.674592:0:57863:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:1.0:1787191338.674606:0:57863:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154403 00010000:00010000:1.0:1787191338.674665:0:57863:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839ece lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.674674:0:57863:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839ece lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57863 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191338.674683:0:57863:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191338.674688:0:57863:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8a80 x1874004626637952/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191338.674696:0:57863:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839ece lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.674714:0:57863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57863:1874004626637952:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.674899:0:57863:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:3.0:1787191338.677094:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626637696:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191338.677118:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc884839ec7 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46047f1 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.677133:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc884839ec7 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46047f1 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.677151:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc884839ec7 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46047f1 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191338.677164:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b453a9180 x1874004626637696/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191338.677175:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc884839ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46047f1 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.677189:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/196 (0 0) 00000080:00200000:3.0:1787191338.677195:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xc4:0x0] suppgids 0 -1: rc 0 00000080:00010000:3.0:1787191338.677219:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc4:0x0](ffff936b5395b248) for lock 0xe5129dc884839ec7 00000080:00010000:3.0:1787191338.677226:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839ec7 from it ffffa3fb41caba38 00010000:00010000:3.0:1787191338.677230:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc884839ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46047f1 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.677240:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc884839ec7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46047f1 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:3.0:1787191338.677276:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xc4:0x0](ffff936b5395b248) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191338.000000000, mtime 1787191338.000000000, ctime 1787191338.000000000 00010000:00010000:3.0:1787191338.677302:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839ec0 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xc4:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46047dc expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191338.677322:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc4:0x0]: losing layout lock 00010000:00010000:3.0:1787191338.677358:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839ec0 lrc: 1/0,0 mode: --/CW res: [0x200000405:0xc4:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46047dc expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.677365:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191338.677368:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc884839ec0 lrc: 0/0,0 mode: --/CW res: [0x200000405:0xc4:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46047dc expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:3.0:1787191338.677383:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 36, max 7 00000100:00100000:3.0:1787191338.677389:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1fb80 x1874004626638208/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191338.677418:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626638208:192.168.202.101@tcp:36:bash.0 00000100:00100000:3.0:1787191338.677491:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c180 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.680633:0:57863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57863:1874004626637952:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191338.680655:0:57863:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839ece lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460480d expref: -99 pid: 57863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.680672:0:57863:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839ece lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460480d expref: -99 pid: 57863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.680677:0:57863:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839ece lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460480d expref: -99 pid: 57863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.680682:0:57863:0:(ldlm_request.c:795:ldlm_cli_enqueue_fini()) ### enqueue reply includes blocking AST ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839ece lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e460480d expref: -99 pid: 57863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.680689:0:57863:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839ece lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e460480d expref: -99 pid: 57863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.680696:0:57863:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839ece lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e460480d expref: -99 pid: 57863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.680705:0:57863:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839ece lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e460480d expref: -99 pid: 57863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.680710:0:57863:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839ece lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e460480d expref: -99 pid: 57863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.680714:0:57863:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839ece lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e460480d expref: -99 pid: 57863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.680721:0:57863:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b453a8a80 x1874004626637952/t8589936748(8589936748) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191338.680734:0:57863:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8a80 x1874004626637952/t8589936748(8589936748) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191338.680743:0:57863:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839ece lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e460480d expref: -99 pid: 57863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191338.680752:0:57863:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839ece lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e460480d expref: -99 pid: 57863 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.680759:0:57863:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/196 (0 0) 00000080:00200000:1.0:1787191338.680764:0:57863:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191338.680804:0:57863:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xc4:0x0](ffff936b5395b248): rc = 0 00000080:00200000:1.0:1787191338.680814:0:57863:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc4:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:1.0:1787191338.680818:0:57863:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc4:0x0](ffff936b5395b248) for lock 0xe5129dc884839ece 00000080:00010000:1.0:1787191338.680828:0:57863:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc4:0x0](ffff936b5395b248) 00000080:00200008:1.0:1787191338.680882:0:57863:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc4:0x0](ffff936b5395b248), flags 154402 00000002:00100000:1.0:1787191338.680903:0:57863:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8a80 x1874004626637952/t8589936748(8589936748) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191338.680931:0:57863:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a8a80 x1874004626637952/t8589936748(8589936748) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191338.680938:0:57863:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191338.680941:0:57863:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453ab800 x1874004626638464/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191338.680955:0:57863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57863:1874004626638464:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191338.681012:0:57863:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:0.0:1787191338.684380:0:57863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57863:1874004626638464:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191338.684427:0:57863:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a8a80 x1874004626637952/t8589936748(8589936748) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191338.684500:0:57863:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839ece from it ffff936b5339f8a0 00010000:00010000:0.0:1787191338.684579:0:57863:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839ece lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10420400000000 nid: local remote: 0x7130d520e460480d expref: -99 pid: 57863 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.684591:0:57863:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839ece lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10420400000000 nid: local remote: 0x7130d520e460480d expref: -99 pid: 57863 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.684653:0:57863:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000080:00200000:0.0:1787191338.684667:0:57863:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc4:0x0](ffff936b5395b248), inode mode 81a4 mask 46 00000080:00200080:0.0:1787191338.684751:0:57863:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc4:0x0](ffff936b5395b248) cmd=800466af arg=7ffeb704c2cc 00000080:00200080:0.0:1787191338.684769:0:57863:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc4:0x0](ffff936b5395b248) cmd=80086601 arg=7ffeb704c268 00000100:00100000:0.0:1787191338.684814:0:57863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57863:1874004626638592:192.168.202.101@tcp:33:lfs.0 00000100:00100000:0.0:1787191338.684922:0:57863:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00010000:00010000:1.0:1787191338.686857:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191338.686869:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839ece lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e460480d expref: -99 pid: 57863 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.686881:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b4150ac00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191338.686887:0:40929:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839ece lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e460480d expref: -99 pid: 57863 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.686896:0:40929:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839ece lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e460480d expref: -99 pid: 57863 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.686905:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839ece lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e460480d expref: -99 pid: 57863 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1787191338.686926:0:40929:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc4:0x0]: losing layout lock 00010000:00010000:1.0:1787191338.686975:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839ece lrc: 2/0,0 mode: --/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e460480d expref: -99 pid: 57863 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.686981:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191338.687009:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839ece lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e460480d expref: -99 pid: 57863 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.687017:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839ece lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e460480d expref: -99 pid: 57863 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.687029:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191338.687031:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191338.687032:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191338.687043:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787191338.687068:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626638720:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191338.690316:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626638720:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191338.690408:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626638208:192.168.202.101@tcp:36:bash.0 00000080:00200000:3.0:1787191338.690446:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:3.0:1787191338.690452:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc4:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00010000:00010000:3.0:1787191338.690467:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/196 (0 0) 00000080:00010000:3.0:1787191338.690477:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xc4:0x0](ffff936b5395b248) 00000002:00010000:3.0:1787191338.690487:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc4:0x0]) in obj [0x200000405:0xc4:0x0], intent: layout flags 0 00010000:00010000:3.0:1787191338.690539:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839ed5 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.690549:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839ed5 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.690557:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839ed5 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191338.690576:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626638848:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191338.690656:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787191338.693044:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626638848:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191338.693082:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839ed5 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604822 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.693096:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839ed5 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604822 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191338.693112:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b51d1c000 x1874004626638848/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191338.693130:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839ed5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604822 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191338.693200:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839ed5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604822 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.693221:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/196 (0 0) 00000080:00200000:3.0:1787191338.693227:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xc4:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1787191338.693242:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc4:0x0](ffff936b5395b248) for lock 0xe5129dc884839ed5 00000080:00010000:3.0:1787191338.693250:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839ed5 from it ffffa3fb41cab8c8 00010000:00010000:3.0:1787191338.693255:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839ed5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604822 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.693266:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839ed5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604822 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.693290:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839ed5 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604822 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.693301:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839ed5 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604822 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:3.0:1787191338.693309:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xc4:0x0](000000003745bbc2) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839ed5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604822 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191338.693353:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc4:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:3.0:1787191338.693358:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839ed5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604822 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.693367:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839ed5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604822 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:3.0:1787191338.693383:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xc4:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:3.0:1787191338.693390:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc4:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191338.693394:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xc4:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:3.0:1787191338.693402:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xc4:0x0](ffff936b5395b248) 00000002:00010000:3.0:1787191338.693411:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc4:0x0]) in obj [0x200000405:0xc4:0x0], intent: layout flags 02 00010000:00010000:3.0:1787191338.693422:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839ed5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4604822 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191338.693434:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc4:0x0]: losing layout lock 00010000:00010000:3.0:1787191338.693460:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839ed5 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604822 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191338.693467:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191338.693471:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839ed5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604822 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191338.693494:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884839edc lrc: 3/0,1 mode: --/EX res: [0x200000405:0xc4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.693501:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884839edc lrc: 3/0,1 mode: --/EX res: [0x200000405:0xc4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191338.693648:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191338.693656:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1c000 x1874004626639104/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191338.693664:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884839edc lrc: 3/0,1 mode: --/EX res: [0x200000405:0xc4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191338.693684:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626639104:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191338.693756:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c180 going to sleep for 11 seconds 00000100:00100000:0.0:1787191338.693808:0:57863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57863:1874004626638592:192.168.202.101@tcp:33:lfs.0 00000080:00200080:0.0:1787191338.693859:0:57863:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc4:0x0](ffff936b5395b248) cmd=c00c66f3 arg=7ffeb704c254 00000080:00200008:0.0:1787191338.694008:0:57863:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc4:0x0](ffff936b5395b248), flags 154002 00000080:00200000:2.0:1787191338.703363:0:57864:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191338.703400:0:57864:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191338.703417:0:57864:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191338.703433:0:57864:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191338.703441:0:57864:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191338.703448:0:57864:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191338.703452:0:57864:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191338.703458:0:57864:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421abbf8 00010000:00010000:2.0:1787191338.703462:0:57864:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191338.703473:0:57864:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191338.703492:0:57864:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191338.703501:0:57864:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191338.703616:0:57864:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191338.703635:0:57864:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b484de600, open_flags d900, mode 0 opened 0 00000080:00200000:2.0:1787191338.703642:0:57864:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:2.0:1787191338.703663:0:57864:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:2.0:1787191338.703732:0:57864:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839ee3 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.703741:0:57864:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839ee3 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57864 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191338.703762:0:57864:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:2.0:1787191338.703778:0:57864:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8380 x1874004626639360/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191338.703788:0:57864:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839ee3 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191338.703815:0:57864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57864:1874004626639360:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191338.704189:0:57864:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191338.707392:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191338.707485:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634877056 00000100:00100000:3.0:1787191338.707494:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634877056 00000100:00100000:3.0:1787191338.707585:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1302 00000100:00100000:3.0:1787191338.707595:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8720:x1874004634877056:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191338.707612:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839e11 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e46045cf expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191338.707687:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191338.707694:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8720:x1874004634877056:12345-192.168.202.101@tcp:104: Request processed in 101us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191338.707701:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1302 00010000:00010000:0.0:1787191338.707744:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191338.707752:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839e11 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e46045cf expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191338.707761:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cafe00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191338.707767:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839e11 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e46045cf expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191338.707865:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839e11 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e46045cf expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191338.707873:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191338.707892:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839e11 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e46045cf expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191338.707899:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839e11 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e46045cf expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191338.707916:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191338.707918:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191338.707920:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191338.707928:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787191338.707941:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626639488:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191338.720491:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191338.720752:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191338.720794:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191338.720853:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634877184 00000100:00100000:2.0:1787191338.720862:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634877184 00000100:00100000:2.0:1787191338.720900:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634877824 00000100:00100000:2.0:1787191338.720902:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634877824 00000100:00100000:2.0:1787191338.720915:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634877952 00000100:00100000:2.0:1787191338.720917:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634877952 00000100:00100000:2.0:1787191338.720932:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1303 00000100:00100000:2.0:1787191338.720942:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30511:x1874004634877184:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191338.720960:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839e50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4604662 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191338.721099:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191338.721106:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30511:x1874004634877184:12345-192.168.202.101@tcp:104: Request processed in 166us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191338.721114:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1303 00000100:00100000:2.0:1787191338.721143:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1304 00000100:00100000:2.0:1787191338.721151:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+5:30353:x1874004634877824:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191338.721160:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc884839e18 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e46045dd expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000100:00100000:0.0:1787191338.721244:0:57864:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589936751 gen 1 00000100:00100000:0.0:1787191338.721320:0:57864:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b513b9f80 x1874004626637568/t8589936746(8589936746) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787191338.721335:0:57864:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff936b513b8380 x1874004626639360/t8589936752(8589936752) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191354 ref 3 fl Rpc:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787191338.721348:0:57864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57864:1874004626639360:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191338.721365:0:57864:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839ee3 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604868 expref: -99 pid: 57864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.721385:0:57864:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839ee3 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604868 expref: -99 pid: 57864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.721393:0:57864:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839ee3 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604868 expref: -99 pid: 57864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.721405:0:57864:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839ee3 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604868 expref: -99 pid: 57864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.721416:0:57864:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839ee3 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604868 expref: -99 pid: 57864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.721428:0:57864:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839ee3 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604868 expref: -99 pid: 57864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.721442:0:57864:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839ee3 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604868 expref: -99 pid: 57864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.721451:0:57864:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839ee3 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604868 expref: -99 pid: 57864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191338.721460:0:57864:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b513b8380 x1874004626639360/t8589936752(8589936752) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191338.721472:0:57864:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b8380 x1874004626639360/t8589936752(8589936752) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191338.721484:0:57864:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604868 expref: -99 pid: 57864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191338.721496:0:57864:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604868 expref: -99 pid: 57864 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.721517:0:57864:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/196 (0 0) 00000080:00200000:0.0:1787191338.721524:0:57864:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191338.721607:0:57864:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc4:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191338.721616:0:57864:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc4:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191338.721620:0:57864:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191338.721636:0:57864:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191338.721660:0:57864:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191338.721680:0:57864:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:0.0:1787191338.721695:0:57864:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839eb9 lrc: 1/0,0 mode: PR/PR res: [0x280000401:0x1ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46047ce expref: -99 pid: 57863 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191338.721779:0:57864:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xc4:0x0](ffff936b5395b248): rc = 0 00000080:00200000:0.0:1787191338.721798:0:57864:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc4:0x0]: layout version change: 4294967294 -> 4 00000080:00010000:0.0:1787191338.721803:0:57864:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc4:0x0](ffff936b5395b248) for lock 0xe5129dc884839ee3 00000080:00010000:0.0:1787191338.721819:0:57864:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc4:0x0](ffff936b5395b248) 00000080:00200008:0.0:1787191338.721851:0:57864:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc4:0x0](ffff936b5395b248), flags 154400 00000002:00100000:0.0:1787191338.721875:0:57864:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b8380 x1874004626639360/t8589936752(8589936752) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191338.721922:0:57864:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839ee3 from it ffff936b60dc4000 00010000:00010000:0.0:1787191338.721927:0:57864:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604868 expref: -99 pid: 57864 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.721936:0:57864:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839ee3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604868 expref: -99 pid: 57864 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191338.721959:0:57864:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc4:0x0](ffff936b5395b248), inode mode 81a4 mask 44 00000080:00200000:0.0:1787191338.722073:0:57864:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc4:0x0](ffff936b5395b248), inode mode 81a4 mask 4 00000080:00200000:0.0:1787191338.722081:0:57864:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xc4:0x0](ffff936b5395b248), xattr lov 00000080:00200008:0.0:1787191338.722108:0:57864:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc4:0x0](ffff936b5395b248), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191338.722115:0:57864:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc4:0x0](ffff936b5395b248),name=f70.sanity-flr 00000002:00010000:0.0:1787191338.722137:0:57864:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc4:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191338.722145:0:57864:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839ee3 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604868 expref: -99 pid: 57864 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191338.722156:0:57864:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839ee3 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604868 expref: -99 pid: 57864 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191338.722164:0:57864:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191338.722169:0:57864:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc4:0x0](ffff936b5395b248) 00000080:00010000:0.0:1787191338.722172:0:57864:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc4:0x0](ffff936b5395b248) for lock 0xe5129dc884839ee3 00000080:00010000:0.0:1787191338.722176:0:57864:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839ee3 from it ffffa3fb421abcd8 00010000:00010000:0.0:1787191338.722179:0:57864:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604868 expref: -99 pid: 57864 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191338.722186:0:57864:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839ee3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604868 expref: -99 pid: 57864 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191338.722201:0:57864:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc4:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1787191338.722206:0:57864:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc4:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191338.722209:0:57864:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191338.722212:0:57864:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc4:0x0] 00000008:00010000:0.0:1787191338.722224:0:57864:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191338.722227:0:57864:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b46b50930, osc lock ffff936b50b62850, flags 0x400000400001002 00010000:00010000:0.0:1787191338.722241:0:57864:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839eb9 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46047ce expref: -99 pid: 57863 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191338.722251:0:57864:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839eb9 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46047ce expref: -99 pid: 57863 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000008:00010000:0.0:1787191338.722264:0:57864:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839eb9 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46047ce expref: -99 pid: 57863 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:0.0:1787191338.722274:0:57864:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191338.722277:0:57864:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839eb9 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46047ce expref: -99 pid: 57863 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191338.722285:0:57864:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839eb9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46047ce expref: -99 pid: 57863 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:0.0:1787191338.722296:0:57864:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191338.722304:0:57864:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc4:0x0] updating i_size 0 i_blocks 0 00000020:00010000:0.0:1787191338.722308:0:57864:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c39bc0 (ffff936b47a17908/0) at cl_lock_release():245 00000020:00010000:0.0:1787191338.722311:0:57864:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c39bc0 (ffff936b47a17908/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191338.722314:0:57864:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b46b50930 (ffff936b47a17638/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191338.722318:0:57864:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c39bc0 (ffff936b47a17908/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191338.722320:0:57864:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b46b50930 (ffff936b47a17908/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191338.722327:0:57864:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc4:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1787191338.722361:0:57864:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc4:0x0](ffff936b5395b248), flags 154000 00000002:00100000:0.0:1787191338.722397:0:57864:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513b8380 x1874004626639360/t8589936752(8589936752) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191338.722406:0:57864:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:0.0:1787191338.722411:0:57864:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475c00 x1874004626639744/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191338.722430:0:57864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57864:1874004626639744:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191338.722487:0:57864:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00000100:00100000:3.0:1787191338.722983:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1305 00000100:00100000:3.0:1787191338.722996:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+5:8419:x1874004634877952:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191338.723007:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc884839e49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4604654 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191338.723137:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787191338.723145:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839e50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4604662 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.723153:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b587bd600 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191338.723159:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839e50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4604662 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.723191:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839e50 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4604662 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.723198:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191338.723218:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839e50 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4604662 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.723226:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839e50 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4604662 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.723242:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787191338.723246:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc884839e18 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e46045dd expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191338.723253:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cafa00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191338.723257:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc884839e18 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e46045dd expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191338.723282:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc884839e18 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e46045dd expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191338.723289:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191338.723294:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc884839e18 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e46045dd expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191338.723301:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc884839e18 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e46045dd expref: -99 pid: 57859 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191338.723314:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191338.723317:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc884839e49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4604654 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191338.723324:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44caf200 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191338.723327:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc884839e49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4604654 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191338.723344:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc884839e49 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4604654 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191338.723350:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191338.723355:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc884839e49 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4604654 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191338.723367:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc884839e49 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4604654 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191338.723378:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191338.723380:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191338.723382:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191338.723399:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626639872:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191338.723434:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626640128:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191338.723460:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787191338.723465:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626640000:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787191338.724502:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1787191338.724572:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+5:30353:x1874004634877824:12345-192.168.202.101@tcp:104: Request processed in 3420us (3817us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191338.724581:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1304 00000100:00100000:1.0:1787191338.725307:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626639488:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191338.725369:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626639104:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191338.725388:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884839edc lrc: 4/0,1 mode: --/EX res: [0x200000405:0xc4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604830 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.725400:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884839edc lrc: 4/0,1 mode: --/CR res: [0x200000405:0xc4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604830 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.725412:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884839edc lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xc4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604830 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.725422:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884839edc lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xc4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604830 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.725440:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884839edc lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xc4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604830 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.725448:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884839edc lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xc4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604830 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.725456:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884839edc lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xc4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604830 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.725467:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b51d1c000 x1874004626639104/t8589936751(8589936751) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191338.725485:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884839edc lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604830 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191338.725497:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884839edc lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604830 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.725700:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/196 (0 0) 00000080:00200000:1.0:1787191338.725709:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xc4:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191338.725723:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc4:0x0](ffff936b5395b248) for lock 0xe5129dc884839edc 00000080:00010000:1.0:1787191338.725732:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839edc from it ffffa3fb41cab930 00010000:00010000:1.0:1787191338.725736:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884839edc lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604830 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.725745:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884839edc lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604830 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191338.725768:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:1.0:1787191338.725776:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc4:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00020000:00200000:1.0:1787191338.725788:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xc4:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:1.0:1787191338.725792:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc4:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191338.725796:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00010000:00010000:0.0:1787191338.725905:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00020000:00200000:1.0:1787191338.725970:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191338.725994:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191338.725997:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:1.0:1787191338.726012:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:1.0:1787191338.726016:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b628939f0, osc lock ffff936b46837690, flags 0x80000000 00000008:00010000:1.0:1787191338.726020:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:1.0:1787191338.726021:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b62893a30, osc lock ffff936b46837b50, flags 0x80000000 00010000:00010000:1.0:1787191338.726032:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b52377800 type 11 mode 2 res 10737419265/428 (0 1048575) 00010000:00010000:1.0:1787191338.726078:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.726087:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.726097:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.726114:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626640256:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191338.726599:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893d80 going to sleep for 11 seconds 00010000:00010000:1.0:1787191338.726897:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191338.727344:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1787191338.727358:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8419:x1874004634877952:12345-192.168.202.101@tcp:104: Request processed in 4363us (6559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191338.727367:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1305 00000100:00100000:0.0:1787191338.728219:0:57864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57864:1874004626639744:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191338.728252:0:57864:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513b8380 x1874004626639360/t8589936752(8589936752) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191338.728624:0:57864:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191338.728703:0:57864:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191338.728719:0:57864:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191338.728733:0:57864:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191338.728742:0:57864:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191338.728748:0:57864:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191338.728752:0:57864:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191338.728758:0:57864:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421abb58 00010000:00010000:0.0:1787191338.728762:0:57864:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191338.728771:0:57864:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191338.728784:0:57864:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191338.728790:0:57864:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191338.728796:0:57864:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191338.728865:0:57864:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=9 00000080:00200008:0.0:1787191338.728874:0:57864:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc4:0x0](ffff936b5395b248), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191338.728879:0:57864:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc4:0x0](ffff936b5395b248),name=f70.sanity-flr 00000002:00010000:0.0:1787191338.728892:0:57864:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc4:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191338.728900:0:57864:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839ee3 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604868 expref: -99 pid: 57864 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191338.728908:0:57864:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839ee3 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604868 expref: -99 pid: 57864 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191338.728914:0:57864:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191338.728918:0:57864:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc4:0x0](ffff936b5395b248) 00000080:00010000:0.0:1787191338.728921:0:57864:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc4:0x0](ffff936b5395b248) for lock 0xe5129dc884839ee3 00000080:00010000:0.0:1787191338.728925:0:57864:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839ee3 from it ffffa3fb421abcb8 00010000:00010000:0.0:1787191338.728928:0:57864:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604868 expref: -99 pid: 57864 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191338.728936:0:57864:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839ee3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604868 expref: -99 pid: 57864 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191338.728955:0:57864:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc4:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:0.0:1787191338.728965:0:57864:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc4:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191338.728968:0:57864:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191338.728972:0:57864:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc4:0x0] 00000008:00010000:0.0:1787191338.728989:0:57864:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191338.728992:0:57864:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b46b50930, osc lock ffff936b50b62850, flags 0x400000400001002 00010000:00010000:0.0:1787191338.729007:0:57864:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839eb9 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1ac:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46047ce expref: -99 pid: 57863 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191338.729018:0:57864:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839eb9 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46047ce expref: -99 pid: 57863 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:0.0:1787191338.729029:0:57864:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191338.729033:0:57864:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839eb9 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46047ce expref: -99 pid: 57863 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191338.729040:0:57864:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839eb9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46047ce expref: -99 pid: 57863 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:2.0:1787191338.729448:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191338.729541:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634878080 00000100:00100000:3.0:1787191338.729550:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634878080 00000100:00100000:3.0:1787191338.729603:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1306 00000100:00100000:3.0:1787191338.729612:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:29543:x1874004634878080:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191338.729729:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839eb9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x1ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000010000 nid: local remote: 0x7130d520e46047ce expref: -99 pid: 57863 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191338.729792:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191338.729798:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:29543:x1874004634878080:12345-192.168.202.101@tcp:104: Request processed in 188us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191338.729816:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1306 00010000:00010000:3.0:1787191338.729865:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191338.729871:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839eb9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x1ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000010000 nid: local remote: 0x7130d520e46047ce expref: -99 pid: 57863 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191338.729879:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cae400 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191338.729884:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839eb9 lrc: 6/0,0 mode: PR/PR res: [0x280000401:0x1ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800428400010000 nid: local remote: 0x7130d520e46047ce expref: -99 pid: 57863 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787191338.729901:0:57627:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc4:0x0] ignore/verify layout 1/0, layout version 3 restore needed 0 00000080:00200000:3.0:1787191338.729911:0:57627:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:3.0:1787191338.729947:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839eb9 lrc: 5/0,0 mode: --/PR res: [0x280000401:0x1ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400010020 nid: local remote: 0x7130d520e46047ce expref: -99 pid: 57863 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191338.729955:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191338.729973:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839eb9 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x1ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400010020 nid: local remote: 0x7130d520e46047ce expref: -99 pid: 57863 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191338.729987:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191338.729989:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191338.729991:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191338.730417:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626640384:192.168.202.101@tcp:103:ldlm_bl.0 00000020:00200000:0.0:1787191338.731026:0:57864:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191338.731043:0:57864:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc4:0x0] updating i_size 0 i_blocks 0 00000020:00010000:0.0:1787191338.731057:0:57864:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c39bc0 (ffff936b47a17908/0) at cl_lock_release():245 00000020:00010000:0.0:1787191338.731060:0:57864:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c39bc0 (ffff936b47a17908/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191338.731064:0:57864:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b46b50930 (ffff936b47a17638/1) at cl_lock_cancel():142 00010000:00010000:0.0:1787191338.731069:0:57864:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839eb9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400010020 nid: local remote: 0x7130d520e46047ce expref: -99 pid: 57863 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00010000:0.0:1787191338.731085:0:57864:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c39bc0 (ffff936b47a17908/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191338.731088:0:57864:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b46b50930 (ffff936b47a17908/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191338.731098:0:57864:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc4:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191338.731196:0:57864:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191338.731216:0:57864:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191338.731229:0:57864:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191338.731240:0:57864:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191338.731247:0:57864:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191338.731253:0:57864:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191338.731257:0:57864:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191338.731263:0:57864:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421abbf8 00010000:00010000:0.0:1787191338.731267:0:57864:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191338.731275:0:57864:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191338.731286:0:57864:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191338.731293:0:57864:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191338.731299:0:57864:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191338.731303:0:57864:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:0.0:1787191338.731307:0:57864:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc4:0x0](ffff936b5395b248), inode mode 81a4 mask 46 00000080:00200008:0.0:1787191338.731315:0:57864:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc4:0x0](ffff936b5395b248), flags 154402 00000080:00200000:0.0:1787191338.731412:0:57864:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc4:0x0](ffff936b5395b248), inode mode 81a4 mask 4 00000080:00200000:0.0:1787191338.731419:0:57864:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xc4:0x0](ffff936b5395b248), xattr lov 00000080:00200008:0.0:1787191338.731444:0:57864:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc4:0x0](ffff936b5395b248), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191338.731448:0:57864:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc4:0x0](ffff936b5395b248),name=f70.sanity-flr 00000002:00010000:0.0:1787191338.731461:0:57864:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc4:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191338.731469:0:57864:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839ee3 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604868 expref: -99 pid: 57864 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191338.731477:0:57864:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839ee3 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604868 expref: -99 pid: 57864 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191338.731483:0:57864:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191338.731487:0:57864:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc4:0x0](ffff936b5395b248) 00000080:00010000:0.0:1787191338.731489:0:57864:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc4:0x0](ffff936b5395b248) for lock 0xe5129dc884839ee3 00000080:00010000:0.0:1787191338.731493:0:57864:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839ee3 from it ffffa3fb421abcd8 00010000:00010000:0.0:1787191338.731497:0:57864:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604868 expref: -99 pid: 57864 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191338.731504:0:57864:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839ee3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604868 expref: -99 pid: 57864 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000100:00100000:2.0:1787191338.732173:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626640256:192.168.202.101@tcp:101:bash.0 00010000:00010000:2.0:1787191338.732196:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.732207:0:57570:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.732216:0:57570:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191338.732734:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191338.732822:0:51131:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787191338.732871:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634878208 00000100:00100000:2.0:1787191338.732878:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634878208 00000100:00100000:2.0:1787191338.732919:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1307 00000100:00100000:2.0:1787191338.732928:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b50882050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30131:x1874004634878208:12345-192.168.202.101@tcp:105: 00010000:00010000:2.0:1787191338.732940:0:51131:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.732949:0:51131:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.732958:0:51131:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.732967:0:51131:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080080020000 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.732975:0:51131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080080020000 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.732984:0:51131:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80080020000 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.733006:0:51131:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b4150ac00) 00000100:00100000:2.0:1787191338.733066:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b50882050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30131:x1874004634878208:12345-192.168.202.101@tcp:105: Request processed in 139us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191338.733073:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1307 00010000:00010000:2.0:1787191338.733181:0:57570:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.733191:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.733204:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1787191338.733216:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080020000 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.733227:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.733236:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.733295:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc884839ef1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.733303:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc884839ef1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.733312:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc884839ef1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191338.733332:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626640512:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191338.733376:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787191338.735126:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626640384:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191338.735319:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626639872:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191338.735333:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626640128:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191338.735353:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626640000:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00200000:0.0:1787191338.735472:0:57864:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc4:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:0.0:1787191338.735483:0:57864:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc4:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191338.735487:0:57864:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191338.735491:0:57864:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc4:0x0] 00000008:00010000:0.0:1787191338.735580:0:57864:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191338.735584:0:57864:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b46b50930, osc lock ffff936b50b62850, flags 0x400000400001002 00010000:00010000:0.0:1787191338.735602:0:57864:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.735618:0:57864:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1787191338.735631:0:57864:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191338.735635:0:57864:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 7/0,2 mode: PW/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.735643:0:57864:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1787191338.735652:0:57864:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191338.735663:0:57864:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc4:0x0] updating i_size 0 i_blocks 0 00000020:00010000:0.0:1787191338.735668:0:57864:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c39bc0 (ffff936b47a17908/0) at cl_lock_release():245 00000020:00010000:0.0:1787191338.735671:0:57864:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c39bc0 (ffff936b47a17908/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191338.735674:0:57864:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b46b50930 (ffff936b47a17638/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191338.735678:0:57864:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c39bc0 (ffff936b47a17908/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191338.735681:0:57864:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b46b50930 (ffff936b47a17908/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191338.736664:0:57864:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc4:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200080:0.0:1787191338.736752:0:57864:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc4:0x0](ffff936b5395b248) cmd=c00c66f3 arg=dd32e0 00000080:00200008:0.0:1787191338.737336:0:57864:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc4:0x0](ffff936b5395b248), flags 154002 00000100:00100000:2.0:1787191338.742859:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626640512:192.168.202.101@tcp:101:bash.0 00010000:00010000:2.0:1787191338.742890:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc884839ef1 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e460487d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.742909:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc884839ef1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e460487d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.742923:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc884839ef1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e460487d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.742937:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc884839ef1 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e460487d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1787191338.742949:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc884839ef1 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e460487d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.742960:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc884839ef1 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460487d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.742969:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc884839ef1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460487d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191338.743083:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626640640:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191338.743321:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626640768:192.168.202.101@tcp:10:bash.0 00000100:00100000:0.0:1787191338.750149:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626640768:192.168.202.101@tcp:10:bash.0 00000100:00100000:3.0:1787191338.750149:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626640640:192.168.202.101@tcp:10:bash.0 00000080:00200000:2.0:1787191338.750275:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc4:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191338.750283:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b53cc5d58 (ffff936b47a17488/0) at cl_lock_release():245 00000020:00010000:2.0:1787191338.750286:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b53cc5d58 (ffff936b47a17488/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191338.750291:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b628939f0 (ffff936b47a17f38/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191338.750313:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.750330:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191338.750347:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62893a30 (ffff936b47a17998/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191338.750352:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc884839ef1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460487d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.750360:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc884839ef1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460487d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191338.750367:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b53cc5d58 (ffff936b47a17488/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191338.750369:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b628939f0 (ffff936b47a17488/1) at cl_lock_fini():72 00000020:00010000:2.0:1787191338.750374:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62893a30 (ffff936b47a17488/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191338.750865:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc4:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191338.750891:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xc4:0x0](ffff936b5395b248) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191338.000000000, mtime 1787191338.000000000, ctime 1787191338.000000000, rc 0 00000080:00200008:2.0:1787191338.750968:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xc4:0x0], ppos: 0, count: 5 00000080:00200000:2.0:1787191338.750981:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191338.750986:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:2.0:1787191338.750991:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:2.0:1787191338.750996:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1787191338.751002:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@00000000c8a6ee3a[0x110, 1, [0x200000405:0xc4:0x0] hash] 00000020:00200000:2.0:1787191338.751004:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:2.0:1787191338.751008:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc4:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:2.0:1787191338.751023:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xc4:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:2.0:1787191338.751028:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc4:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191338.751031:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1787191338.751035:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1787191338.751042:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:2.0:1787191338.751045:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1787191338.751073:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:2.0:1787191338.751087:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1787191338.751092:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d19b0, osc lock ffff936b44e62130, flags 0x0 00010000:00010000:2.0:1787191338.751110:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191338.751124:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191338.751208:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191338.751218:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191338.751225:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191338.751238:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:2.0:1787191338.751246:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191338.751288:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:2.0:1787191338.751296:0:57570:0:(rw26.c:927:ll_write_end()) page@000000009e16895d[3 000000002af24390 2 1 00000000631ca0a8 0 0 0] 00000080:00200000:2.0:1787191338.751300:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @0000000004521064 17ffffc0001001 3:0 ffff936b43a1e000 0 lru 00000080:00200000:2.0:1787191338.751308:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@0000000042776c1b 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000a2a44f55 00000000280494ef > 3< 0 0 > 4< 0 0 8 378576896 - | - - - - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1787191338.751310:0:57570:0:(rw26.c:927:ll_write_end()) end page@000000009e16895d 00000080:00200000:2.0:1787191338.751311:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:2.0:1787191338.751315:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:2.0:1787191338.751333:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 000000006982cee0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191338.751352:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b5395b3f8, count 1, dirtied 1 00000080:00200000:2.0:1787191338.751357:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:2.0:1787191338.751359:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:2.0:1787191338.751373:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b504217b8 (ffff936b465ccbd8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191338.751376:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b504217b8 (ffff936b465ccbd8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191338.751379:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d19b0 (ffff936b465cc008/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191338.751384:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191338.751607:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:2.0:1787191338.751621:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b504217b8 (ffff936b465ccbd8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191338.752260:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d19b0 (ffff936b465ccbd8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191338.752273:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:2.0:1787191338.752280:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1787191338.752288:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc4:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191338.752291:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:2.0:1787191338.752302:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc4:0x0] updating i_size 5 i_blocks 0 00000080:00200000:2.0:1787191338.752307:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:2.0:1787191338.752337:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc4:0x0](ffff936b5395b248), flags 100001 00000002:00100000:2.0:1787191338.752733:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513b9f80 x1874004626637568/t8589936746(8589936746) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191338.752747:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191338.752753:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb100 x1874004626641024/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191338.752777:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626641024:192.168.202.101@tcp:35:bash.0 00000100:00100000:2.0:1787191338.752907:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787191338.763300:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626641024:192.168.202.101@tcp:35:bash.0 00000002:00100000:0.0:1787191338.763338:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513b9f80 x1874004626637568/t8589936746(8589936746) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191338.766482:0:57866:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191338.766510:0:57866:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191338.766527:0:57866:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191338.766543:0:57866:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191338.766551:0:57866:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191338.766559:0:57866:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191338.766563:0:57866:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191338.766570:0:57866:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421a3b58 00010000:00010000:3.0:1787191338.766574:0:57866:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191338.766583:0:57866:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191338.766598:0:57866:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191338.766605:0:57866:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:3.0:1787191338.766611:0:57866:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191338.766614:0:57866:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=8 00000080:00200008:3.0:1787191338.766622:0:57866:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc4:0x0](ffff936b5395b248), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191338.766696:0:57866:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc4:0x0](ffff936b5395b248),name=f70.sanity-flr 00000002:00010000:0.0:1787191338.766713:0:57866:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc4:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191338.766721:0:57866:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839ee3 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604868 expref: -99 pid: 57864 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191338.766729:0:57866:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839ee3 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604868 expref: -99 pid: 57864 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1787191338.766735:0:57866:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191338.766740:0:57866:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc4:0x0](ffff936b5395b248) 00000080:00010000:0.0:1787191338.766742:0:57866:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc4:0x0](ffff936b5395b248) for lock 0xe5129dc884839ee3 00000080:00010000:0.0:1787191338.766747:0:57866:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839ee3 from it ffffa3fb421a3cb8 00010000:00010000:0.0:1787191338.766750:0:57866:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604868 expref: -99 pid: 57864 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191338.766762:0:57866:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839ee3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604868 expref: -99 pid: 57864 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00000080:00200000:0.0:1787191338.766783:0:57866:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc4:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:0.0:1787191338.766794:0:57866:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc4:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191338.766797:0:57866:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191338.766800:0:57866:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc4:0x0] 00000008:00010000:0.0:1787191338.766819:0:57866:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191338.766822:0:57866:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b46b50930, osc lock ffff936b50b62850, flags 0x400000400001002 00010000:00010000:0.0:1787191338.766852:0:57866:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191338.766864:0:57866:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:0.0:1787191338.766875:0:57866:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191338.766879:0:57866:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191338.766886:0:57866:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:0.0:1787191338.766896:0:57866:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191338.766905:0:57866:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc4:0x0] updating i_size 5 i_blocks 0 00000020:00010000:0.0:1787191338.766910:0:57866:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c39bc0 (ffff936b47a17908/0) at cl_lock_release():245 00000020:00010000:0.0:1787191338.766913:0:57866:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c39bc0 (ffff936b47a17908/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191338.766916:0:57866:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b46b50930 (ffff936b47a17638/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191338.766920:0:57866:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c39bc0 (ffff936b47a17908/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191338.766922:0:57866:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b46b50930 (ffff936b47a17908/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191338.766934:0:57866:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc4:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191338.766959:0:57866:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191338.766966:0:57866:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191338.766973:0:57866:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191338.766981:0:57866:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191338.766987:0:57866:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191338.766991:0:57866:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191338.766994:0:57866:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191338.766998:0:57866:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421a3c10 00010000:00010000:0.0:1787191338.767001:0:57866:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191338.767007:0:57866:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191338.767015:0:57866:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191338.767019:0:57866:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:0.0:1787191338.767023:0:57866:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191338.767028:0:57866:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:0.0:1787191338.767032:0:57866:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:0.0:1787191338.767037:0:57866:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:0.0:1787191338.767072:0:57866:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884839edc lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc4:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4604830 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191338.767089:0:57866:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc4:0x0]: losing layout lock 00010000:00010000:0.0:1787191338.767102:0:57866:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839ee3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4604868 expref: -99 pid: 57864 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00000080:00200000:0.0:1787191338.767111:0:57866:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc4:0x0]: losing layout lock 00010000:00010000:0.0:1787191338.767119:0:57866:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc884839ec7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e46047f1 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191338.767164:0:57866:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884839edc lrc: 1/0,0 mode: --/CR res: [0x200000405:0xc4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4604830 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191338.767171:0:57866:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839ee3 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604868 expref: -99 pid: 57864 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00010000:00010000:0.0:1787191338.767177:0:57866:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc884839ec7 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46047f1 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191338.767183:0:57866:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:0.0:1787191338.767186:0:57866:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc884839edc lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4604830 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191338.767197:0:57866:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839ee3 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604868 expref: -99 pid: 57864 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00010000:00010000:0.0:1787191338.767205:0:57866:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc884839ec7 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46047f1 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1787191338.767232:0:57866:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1787191338.767244:0:57866:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477100 x1874004626641280/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787191338.767266:0:57866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57866:1874004626641280:192.168.202.101@tcp:36:rm.0 00000100:00100000:0.0:1787191338.767360:0:57866:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00000080:00200000:1.0:1787191338.769754:0:57865:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191338.769784:0:57865:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.770006:0:57865:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.770024:0:57865:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.770032:0:57865:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.770041:0:57865:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.770045:0:57865:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.770062:0:57865:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421b3bf8 00010000:00010000:1.0:1787191338.770066:0:57865:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.770075:0:57865:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.770090:0:57865:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.770098:0:57865:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191338.770104:0:57865:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:0.0:1787191338.773292:0:57866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57866:1874004626641280:192.168.202.101@tcp:36:rm.0 00000080:00200000:0.0:1787191338.773359:0:57866:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc4:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00020000:00200000:0.0:1787191338.773370:0:57866:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc4:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191338.773374:0:57866:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191338.773379:0:57866:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191338.773389:0:57866:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000008:00010000:0.0:1787191338.773406:0:57866:0:(osc_cache.c:1183:osc_extent_make_ready()) ### extent: 000000006982cee0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1787191338.773434:0:57866:0:(osc_cache.c:917:osc_extent_finish()) ### extent: 000000006982cee0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1787191338.773458:0:57866:0:(osc_cache.c:497:__osc_extent_remove()) ### extent: 000000006982cee0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191338.773479:0:57866:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191338.773524:0:57866:0:(llite_lib.c:2066:ll_clear_inode()) VFS Op:inode=[0x200000405:0xc4:0x0](ffff936b5395b248) 00000008:00010000:0.0:1787191338.773552:0:57866:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 5 blocks 0 [cma]time 1787191338 1787191338 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1787191338.773580:0:57866:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191338 1787191338 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc884839ef1 lrc: 1/0,0 mode: PW/PW res: [0x2c0000401:0x1af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460487d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191338.774482:0:57865:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b51ef1080, open_flags d900, mode 0 opened 0 00000080:00200000:1.0:1787191338.774492:0:57865:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:1.0:1787191338.774514:0:57865:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:1.0:1787191338.774580:0:57865:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839ef8 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.774589:0:57865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839ef8 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57865 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191338.774598:0:57865:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191338.774608:0:57865:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453ab100 x1874004626641536/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191338.774617:0:57865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839ef8 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57865 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.774636:0:57865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57865:1874004626641536:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.774810:0:57865:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.779633:0:57865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57865:1874004626641536:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191338.779656:0:57865:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839ef8 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.779670:0:57865:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839ef8 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.779676:0:57865:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839ef8 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.779683:0:57865:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839ef8 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.779691:0:57865:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839ef8 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.779701:0:57865:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b4150bc00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191338.779706:0:57865:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839ef8 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.779713:0:57865:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839ef8 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.779719:0:57865:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839ef8 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.779725:0:57865:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191338.779731:0:57865:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839ef8 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.779738:0:57865:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839ef8 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57865 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.779759:0:57865:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x7, status=0 req@ffff936b453ab100 x1874004626641536/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/608 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191338.779773:0:57865:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191338.780024:0:57865:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191338.780040:0:57865:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.780062:0:57865:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.780075:0:57865:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.780084:0:57865:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.780090:0:57865:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.780094:0:57865:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.780100:0:57865:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421b3b58 00010000:00010000:1.0:1787191338.780103:0:57865:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.780110:0:57865:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.780126:0:57865:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.780139:0:57865:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191338.780144:0:57865:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.780155:0:57865:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=9 00000080:00200000:1.0:1787191338.780160:0:57865:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191338.780172:0:57865:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191338.780211:0:57865:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839eff lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.780218:0:57865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839eff lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.780228:0:57865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839eff lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57865 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.780250:0:57865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57865:1874004626641664:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.780336:0:57865:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.790249:0:57865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57865:1874004626641664:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191338.790274:0:57865:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839eff lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.790289:0:57865:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839eff lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.790297:0:57865:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839eff lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.790305:0:57865:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839eff lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.790315:0:57865:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839eff lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.790346:0:57865:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b4150b400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191338.790350:0:57865:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839eff lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.790357:0:57865:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839eff lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.790363:0:57865:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839eff lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.790370:0:57865:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191338.790376:0:57865:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839eff lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.790383:0:57865:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839eff lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57865 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.790405:0:57865:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b453ab100 x1874004626641664/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191338.790426:0:57865:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191338.803001:0:57867:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191338.803036:0:57867:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191338.803069:0:57867:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191338.803085:0:57867:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191338.803094:0:57867:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191338.803102:0:57867:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191338.803106:0:57867:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191338.803113:0:57867:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421bbb58 00010000:00010000:2.0:1787191338.803117:0:57867:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191338.803127:0:57867:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191338.803142:0:57867:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191338.803149:0:57867:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:2.0:1787191338.803154:0:57867:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191338.803165:0:57867:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:2.0:1787191338.803170:0:57867:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191338.803183:0:57867:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191338.803233:0:57867:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839f06 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.803241:0:57867:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839f06 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.803251:0:57867:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839f06 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191338.803276:0:57867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57867:1874004626641792:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191338.803372:0:57867:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f300 going to sleep for 11 seconds 00000100:00100000:2.0:1787191338.808166:0:57867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57867:1874004626641792:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191338.808190:0:57867:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839f06 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.808205:0:57867:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839f06 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.808213:0:57867:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839f06 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.808221:0:57867:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839f06 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.808231:0:57867:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839f06 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.808243:0:57867:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd5c00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191338.808248:0:57867:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839f06 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.808256:0:57867:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839f06 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.808264:0:57867:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839f06 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.808273:0:57867:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191338.808281:0:57867:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839f06 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.808288:0:57867:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc884839f06 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191338.811017:0:57867:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513b9180 x1874004626641792/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191338.811056:0:57867:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191338.811325:0:57867:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191338.811341:0:57867:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191338.811354:0:57867:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191338.811369:0:57867:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191338.811377:0:57867:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191338.811383:0:57867:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191338.811386:0:57867:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191338.811392:0:57867:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421bbbe8 00010000:00010000:3.0:1787191338.811396:0:57867:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191338.811405:0:57867:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191338.811432:0:57867:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191338.811439:0:57867:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000080:00200000:3.0:1787191338.811444:0:57867:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191338.811454:0:57867:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:3.0:1787191338.811458:0:57867:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:3.0:1787191338.811470:0:57867:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1787191338.811515:0:57867:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884839f0d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.811523:0:57867:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884839f0d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.811533:0:57867:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884839f0d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191338.811557:0:57867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57867:1874004626641920:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191338.811640:0:57867:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c240 going to sleep for 11 seconds 00000080:00200000:0.0:1787191338.817978:0:57868:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191338.818012:0:57868:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191338.818031:0:57868:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191338.818058:0:57868:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191338.818068:0:57868:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191338.818075:0:57868:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191338.818079:0:57868:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191338.818086:0:57868:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421c3bf8 00010000:00010000:0.0:1787191338.818091:0:57868:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191338.818099:0:57868:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191338.818115:0:57868:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191338.818123:0:57868:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191338.818130:0:57868:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:2.0:1787191338.818249:0:57867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57867:1874004626641920:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191338.818265:0:57867:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884839f0d lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.818275:0:57867:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884839f0d lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.818280:0:57867:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884839f0d lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.818290:0:57867:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884839f0d lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.818296:0:57867:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884839f0d lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.818301:0:57867:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9a000 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191338.818305:0:57867:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884839f0d lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.818311:0:57867:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884839f0d lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.818330:0:57867:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884839f0d lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.818337:0:57867:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191338.818343:0:57867:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884839f0d lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.818350:0:57867:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc884839f0d lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191338.818372:0:57867:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b51d1e300 x1874004626641920/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191338.818384:0:57867:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191338.818445:0:57867:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191338.818455:0:57867:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191338.818462:0:57867:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191338.818470:0:57867:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191338.818476:0:57867:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191338.818480:0:57867:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191338.818482:0:57867:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191338.818485:0:57867:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421bbb58 00010000:00010000:2.0:1787191338.818488:0:57867:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191338.818494:0:57867:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191338.818502:0:57867:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191338.818519:0:57867:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:2.0:1787191338.818528:0:57867:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:2.0:1787191338.818533:0:57867:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:2.0:1787191338.818545:0:57867:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191338.818552:0:57867:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 77 lru_type: 1 00010000:00010000:2.0:1787191338.818559:0:57867:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 77 lru_type: 1 00000002:00010000:2.0:1787191338.818567:0:57867:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191338.818610:0:57867:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc884839f14 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.818617:0:57867:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc884839f14 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.818626:0:57867:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc884839f14 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191338.818646:0:57867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57867:1874004626642048:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191338.818731:0:57867:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f300 going to sleep for 11 seconds 00000080:00200000:0.0:1787191338.818999:0:57868:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b44d05200, open_flags d900, mode 0 opened 0 00000080:00200000:0.0:1787191338.819007:0:57868:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:0.0:1787191338.819021:0:57868:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:0.0:1787191338.819060:0:57868:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f1b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.819068:0:57868:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f1b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57868 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191338.819077:0:57868:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191338.819084:0:57868:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a476a00 x1874004626642304/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191338.819093:0:57868:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f1b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57868 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191338.819104:0:57868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57868:1874004626642304:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191338.819238:0:57868:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00000100:00100000:2.0:1787191338.821781:0:57867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57867:1874004626642048:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191338.821816:0:57867:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc884839f14 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604909 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.821828:0:57867:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc884839f14 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604909 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.821876:0:57867:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc884839f14 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604909 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.821888:0:57867:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc884839f14 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604909 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.821899:0:57867:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc884839f14 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604909 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.821906:0:57867:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc884839f14 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604909 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.821917:0:57867:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc884839f14 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604909 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191338.821928:0:57867:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b513bb800 x1874004626642048/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191338.821941:0:57867:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc884839f14 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604909 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.821950:0:57867:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:2.0:1787191338.821957:0:57867:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc884839f14 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604909 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191338.821964:0:57867:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc884839f14 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604909 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:2.0:1787191338.821988:0:57867:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191338.821997:0:57867:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 154 lru_type: 1 00010000:00010000:2.0:1787191338.822008:0:57867:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 154 lru_type: 1 00010000:00010000:2.0:1787191338.822016:0:57867:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 154 lru_type: 1 00010000:00010000:2.0:1787191338.822023:0:57867:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 155 lru_type: 1 00000080:00200000:2.0:1787191338.822036:0:57867:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1787191338.822044:0:57867:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:2.0:1787191338.822060:0:57867:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:2.0:1787191338.822066:0:57867:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb421bbcb8 00010000:00010000:2.0:1787191338.822069:0:57867:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 77 lru_type: 1 00010000:00010000:2.0:1787191338.822076:0:57867:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 78 lru_type: 1 00000002:00010000:2.0:1787191338.822090:0:57867:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191338.822095:0:57867:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc884839f14 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604909 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191338.822103:0:57867:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc884839f14 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604909 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191338.822110:0:57867:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc884839f14 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604909 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191338.822117:0:57867:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc884839f14 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604909 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:2.0:1787191338.822125:0:57867:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191338.822131:0:57867:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 155 lru_type: 1 00010000:00010000:2.0:1787191338.822142:0:57867:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 155 lru_type: 1 00010000:00010000:2.0:1787191338.822148:0:57867:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 155 lru_type: 1 00010000:00010000:2.0:1787191338.822155:0:57867:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 156 lru_type: 1 00000080:00200008:3.0:1787191338.823431:0:57867:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:3.0:1787191338.823437:0:57867:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191338.823452:0:57867:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191338.823461:0:57867:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191338.823470:0:57867:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191338.823474:0:57867:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191338.823479:0:57867:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191338.823481:0:57867:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191338.823485:0:57867:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421bbcb8 00010000:00010000:3.0:1787191338.823487:0:57867:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191338.823493:0:57867:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191338.823610:0:57867:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191338.823617:0:57867:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191338.823622:0:57867:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191338.823627:0:57867:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191338.823631:0:57867:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191338.823634:0:57867:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191338.823636:0:57867:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191338.823638:0:57867:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421bbb58 00010000:00010000:3.0:1787191338.823640:0:57867:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191338.823645:0:57867:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191338.823650:0:57867:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191338.823654:0:57867:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:3.0:1787191338.823658:0:57867:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:0.0:1787191338.827776:0:57868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57868:1874004626642304:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191338.827795:0:57868:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f1b lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.827815:0:57868:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f1b lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.827819:0:57868:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f1b lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.827824:0:57868:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f1b lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.827861:0:57868:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f1b lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.827868:0:57868:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cae400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191338.827873:0:57868:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f1b lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.827880:0:57868:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f1b lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.827886:0:57868:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f1b lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.827891:0:57868:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191338.827896:0:57868:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f1b lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57868 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.827900:0:57868:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f1b lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57868 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191338.827915:0:57868:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x7, status=0 req@ffff936b6a476a00 x1874004626642304/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/608 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191338.827926:0:57868:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1787191338.827957:0:57868:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc884839f14 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604909 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191338.827965:0:57867:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00010000:00010000:0.0:1787191338.827969:0:57868:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc884839f14 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604909 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191338.827970:0:57867:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000080:00010000:0.0:1787191338.827977:0:57868:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839f14 from it ffffa3fb421c39a0 00010000:00010000:0.0:1787191338.827981:0:57868:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc884839f14 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604909 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191338.827988:0:57868:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc884839f14 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604909 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000002:00010000:3.0:1787191338.827990:0:57867:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1787191338.828030:0:57867:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884839f22 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.828041:0:57867:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884839f22 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.828062:0:57867:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884839f22 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191338.828082:0:57867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57867:1874004626642432:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191338.828213:0:57867:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ccc0 going to sleep for 11 seconds 00000080:00200000:0.0:1787191338.828236:0:57868:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191338.828247:0:57868:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191338.828254:0:57868:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191338.828262:0:57868:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191338.828268:0:57868:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191338.828273:0:57868:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191338.828276:0:57868:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191338.828281:0:57868:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421c3b58 00010000:00010000:0.0:1787191338.828284:0:57868:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191338.828290:0:57868:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191338.828298:0:57868:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191338.828304:0:57868:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191338.828310:0:57868:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191338.828312:0:57868:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=9 00000100:00100000:3.0:1787191338.832581:0:57867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57867:1874004626642432:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191338.832605:0:57867:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884839f22 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.832619:0:57867:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884839f22 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.832689:0:57867:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884839f22 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.832696:0:57867:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884839f22 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.832705:0:57867:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884839f22 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.832712:0:57867:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9a200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191338.832717:0:57867:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884839f22 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.832723:0:57867:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884839f22 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.832730:0:57867:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884839f22 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.832737:0:57867:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191338.832745:0:57867:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884839f22 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.832757:0:57867:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc884839f22 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191338.832777:0:57867:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b51d1f800 x1874004626642432/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191338.832792:0:57867:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1787191338.832824:0:57867:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc884839f14 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604909 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191338.832862:0:57867:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc884839f14 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604909 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00010000:3.0:1787191338.832871:0:57867:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839f14 from it ffffa3fb421bb930 00010000:00010000:3.0:1787191338.832876:0:57867:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc884839f14 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604909 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191338.832885:0:57867:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc884839f14 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604909 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:3.0:1787191338.832951:0:57867:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191338.833044:0:57867:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191338.833064:0:57867:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191338.833073:0:57867:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191338.833080:0:57867:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191338.833085:0:57867:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191338.833089:0:57867:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191338.833094:0:57867:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421bbbf8 00010000:00010000:3.0:1787191338.833097:0:57867:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191338.833104:0:57867:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191338.833113:0:57867:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191338.833121:0:57867:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191338.833128:0:57867:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191338.834894:0:57867:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:3.0:1787191338.834906:0:57867:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:3.0:1787191338.834914:0:57867:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b46084300, open_flags a141, mode 81b6 opened 0 00000080:00200000:3.0:1787191338.834926:0:57867:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:3.0:1787191338.834953:0:57867:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xc5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:3.0:1787191338.834968:0:57867:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc884839f14 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4604909 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191338.835056:0:57867:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc884839f14 lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4604909 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191338.835065:0:57867:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191338.835069:0:57867:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc884839f14 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4604909 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191338.835111:0:57867:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839f29 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.835119:0:57867:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839f29 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191338.835143:0:57867:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191338.835157:0:57867:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1f800 x1874004626642688/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191338.835167:0:57867:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839f29 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191338.835188:0:57867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57867:1874004626642688:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191338.835339:0:57867:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191338.840178:0:57867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57867:1874004626642688:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191338.840206:0:57867:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839f29 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604941 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.840234:0:57867:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839f29 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604941 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.840242:0:57867:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839f29 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604941 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.840259:0:57867:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839f29 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604941 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.840270:0:57867:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839f29 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604941 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.840284:0:57867:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839f29 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604941 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.840293:0:57867:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839f29 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604941 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.840300:0:57867:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839f29 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604941 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191338.840313:0:57867:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b51d1f800 x1874004626642688/t8589936756(8589936756) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191338.840328:0:57867:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1f800 x1874004626642688/t8589936756(8589936756) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191338.840340:0:57867:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839f29 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604941 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.840350:0:57867:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/197 (0 0) 00000080:00200000:3.0:1787191338.840356:0:57867:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191338.840368:0:57867:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:3.0:1787191338.840518:0:57867:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988) 00000080:00200000:3.0:1787191338.840527:0:57867:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xc5:0x0], updating i_size 0 00000080:00200000:3.0:1787191338.840560:0:57867:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc5:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:3.0:1787191338.840565:0:57867:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xc5:0x0](ffff936b489a9988) 00000080:00010000:3.0:1787191338.840569:0:57867:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc5:0x0](ffff936b489a9988) for lock 0xe5129dc884839f29 00000080:00010000:3.0:1787191338.840579:0:57867:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc5:0x0](ffff936b489a9988) 00000080:00200008:3.0:1787191338.840591:0:57867:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc5:0x0](ffff936b489a9988), flags 120501 00000002:00100000:3.0:1787191338.840613:0:57867:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1f800 x1874004626642688/t8589936756(8589936756) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1787191338.840727:0:57867:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839f29 from it ffff936b460334e0 00010000:00010000:3.0:1787191338.840732:0:57867:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839f29 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604941 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.840742:0:57867:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839f29 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604941 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191338.840765:0:57867:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988), inode mode 81a4 mask 40 00000080:00200000:3.0:1787191338.840810:0:57867:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988), inode mode 81a4 mask 2 00000080:00200000:3.0:1787191338.840820:0:57867:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988), xattr lov 00000002:00010000:3.0:1787191338.840861:0:57867:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc5:0x0]) in obj [0x200000405:0xc5:0x0], intent: open flags 040000002 00010000:00010000:3.0:1787191338.840908:0:57867:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839f30 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.840916:0:57867:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839f30 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191338.840928:0:57867:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191338.840936:0:57867:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1df80 x1874004626642944/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191338.840950:0:57867:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839f30 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191338.841043:0:57867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57867:1874004626642944:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191338.841488:0:57867:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191338.845118:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191338.845229:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634878336 00000100:00100000:3.0:1787191338.845239:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634878336 00000100:00100000:3.0:1787191338.845293:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1308 00000100:00100000:3.0:1787191338.845302:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634878336:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191338.845320:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839f29 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4604941 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.845393:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191338.845401:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634878336:12345-192.168.202.101@tcp:104: Request processed in 99us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191338.845408:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1308 00000080:00200000:0.0:1787191338.846436:0:57869:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00010000:00010000:1.0:1787191338.846459:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000002:00010000:0.0:1787191338.846466:0:57869:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.846470:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839f29 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4604941 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191338.846482:0:57869:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.846482:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9a800 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191338.846489:0:40930:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839f29 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4604941 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191338.846499:0:57869:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.846501:0:40930:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839f29 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4604941 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.846514:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839f29 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4604941 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191338.846533:0:40930:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc5:0x0]: losing layout lock 00010000:00010000:1.0:1787191338.846575:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839f29 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4604941 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.846582:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191338.846606:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839f29 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4604941 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.846614:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839f29 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4604941 expref: -99 pid: 57867 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.846625:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191338.846757:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191338.846759:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191338.846777:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626643072:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00200000:0.0:1787191338.847371:0:57869:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191338.847379:0:57869:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191338.847383:0:57869:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191338.847390:0:57869:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421cbbf8 00010000:00010000:0.0:1787191338.847394:0:57869:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191338.847404:0:57869:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191338.847420:0:57869:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191338.847432:0:57869:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191338.847599:0:57869:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191338.847615:0:57869:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b464ae000, open_flags d900, mode 0 opened 0 00000080:00200000:0.0:1787191338.847622:0:57869:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:0.0:1787191338.847641:0:57869:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:0.0:1787191338.847686:0:57869:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f37 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.847694:0:57869:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f37 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57869 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191338.847705:0:57869:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:0.0:1787191338.847715:0:57869:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a476a00 x1874004626643328/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191338.847725:0:57869:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f37 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191338.847742:0:57869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57869:1874004626643328:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191338.847962:0:57869:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.852536:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626643072:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191338.854762:0:57869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57869:1874004626643328:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191338.854786:0:57869:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f37 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.854809:0:57869:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f37 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.854816:0:57869:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f37 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.854823:0:57869:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f37 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.854858:0:57869:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f37 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.854865:0:57869:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cae400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191338.854870:0:57869:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f37 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.854880:0:57869:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f37 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.854885:0:57869:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f37 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.854893:0:57869:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191338.854899:0:57869:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f37 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.854905:0:57869:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f37 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57869 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191338.854932:0:57869:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b6a476a00 x1874004626643328/t8589936757(8589936757) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/608 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191338.854946:0:57869:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a476a00 x1874004626643328/t8589936757(8589936757) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/608 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191338.854959:0:57869:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191338.854979:0:57869:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xc5:0x0], updating i_size 0 00000080:00200000:0.0:1787191338.854982:0:57869:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xc5:0x0](ffff936b489a9988): rc = 0 00000080:00010000:0.0:1787191338.854986:0:57869:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc5:0x0](ffff936b489a9988) for lock 0x0 00000080:00200008:0.0:1787191338.855008:0:57869:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc5:0x0](ffff936b489a9988), flags 154400 00000002:00100000:0.0:1787191338.855030:0:57869:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a476a00 x1874004626643328/t8589936757(8589936757) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/608 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191338.855096:0:57869:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988), inode mode 81a4 mask 44 00000080:00200000:0.0:1787191338.855206:0:57869:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988), inode mode 81a4 mask 4 00000080:00200000:0.0:1787191338.855214:0:57869:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988), xattr lov 00000080:00200008:0.0:1787191338.855255:0:57869:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc5:0x0](ffff936b489a9988), flags 154000 00000002:00100000:0.0:1787191338.855300:0:57869:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a476a00 x1874004626643328/t8589936757(8589936757) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/608 e 0 to 0 dl 1787191354 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191338.855310:0:57869:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:0.0:1787191338.855315:0:57869:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a476d80 x1874004626643584/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191338.855335:0:57869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57869:1874004626643584:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191338.855416:0:57869:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00000100:00100000:3.0:1787191338.858374:0:57867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57867:1874004626642944:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191338.858405:0:57867:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839f30 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.858419:0:57867:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839f30 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.858427:0:57867:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839f30 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.858435:0:57867:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839f30 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.858448:0:57867:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839f30 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.858454:0:57867:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9aa00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191338.858459:0:57867:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839f30 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.858467:0:57867:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839f30 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.858474:0:57867:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839f30 lrc: 5/0,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.858480:0:57867:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191338.858487:0:57867:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839f30 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.858494:0:57867:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839f30 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57867 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191338.858518:0:57867:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b51d1df80 x1874004626642944/t8589936758(8589936758) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191338.858531:0:57867:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1df80 x1874004626642944/t8589936758(8589936758) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191338.858549:0:57867:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xc5:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1787191338.858598:0:57867:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1787191338.858606:0:57867:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191338.858671:0:57867:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xc5:0x0], updating i_size 0 00000002:00100000:3.0:1787191338.858692:0:57867:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1df80 x1874004626642944/t8589936758(8589936758) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191338.858730:0:57867:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1df80 x1874004626642944/t8589936758(8589936758) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191338.858739:0:57867:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191338.858745:0:57867:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1ed80 x1874004626643840/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191338.858767:0:57867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ed80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57867:1874004626643840:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191338.858931:0:57867:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191338.862726:0:57869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57869:1874004626643584:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191338.862764:0:57869:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a476a00 x1874004626643328/t8589936757(8589936757) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/608 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191338.862987:0:57869:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191338.863005:0:57869:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191338.863021:0:57869:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191338.863034:0:57869:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191338.863042:0:57869:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191338.863060:0:57869:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191338.863064:0:57869:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191338.863071:0:57869:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421cbbf8 00010000:00010000:0.0:1787191338.863075:0:57869:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191338.863089:0:57869:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191338.863103:0:57869:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191338.863110:0:57869:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191338.863116:0:57869:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191338.863127:0:57869:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b464afb00, open_flags d900, mode 0 opened 0 00000080:00200000:0.0:1787191338.863133:0:57869:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:0.0:1787191338.863146:0:57869:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:0.0:1787191338.863190:0:57869:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f3e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.863198:0:57869:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f3e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57869 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191338.863207:0:57869:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:0.0:1787191338.863214:0:57869:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477b80 x1874004626644096/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191338.863224:0:57869:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f3e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191338.863243:0:57869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57869:1874004626644096:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191338.863400:0:57869:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00000100:00100000:3.0:1787191338.867142:0:57867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ed80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57867:1874004626643840:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191338.867176:0:57867:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1df80 x1874004626642944/t8589936758(8589936758) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:3.0:1787191338.867233:0:57867:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc5:0x0](ffff936b489a9988), flags 100001 00000002:00100000:3.0:1787191338.867282:0:57867:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1f800 x1874004626642688/t8589936756(8589936756) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191354 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191338.867293:0:57867:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191338.867298:0:57867:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1d880 x1874004626644352/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191338.867318:0:57867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57867:1874004626644352:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191338.867407:0:57867:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191338.870561:0:57869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57869:1874004626644096:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191338.870588:0:57869:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f3e lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460499c expref: -99 pid: 57869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.870622:0:57869:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f3e lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460499c expref: -99 pid: 57869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.870632:0:57869:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f3e lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460499c expref: -99 pid: 57869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.870642:0:57869:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f3e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460499c expref: -99 pid: 57869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.870653:0:57869:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f3e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460499c expref: -99 pid: 57869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.870667:0:57869:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f3e lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460499c expref: -99 pid: 57869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.870675:0:57869:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f3e lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460499c expref: -99 pid: 57869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.870683:0:57869:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f3e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460499c expref: -99 pid: 57869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191338.870696:0:57869:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b6a477b80 x1874004626644096/t8589936761(8589936761) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191338.870709:0:57869:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477b80 x1874004626644096/t8589936761(8589936761) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191338.870722:0:57869:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f3e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460499c expref: -99 pid: 57869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191338.870739:0:57869:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f3e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460499c expref: -99 pid: 57869 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.870748:0:57869:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/197 (0 0) 00000080:00200000:0.0:1787191338.870754:0:57869:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191338.870995:0:57869:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xc5:0x0](ffff936b489a9988): rc = 0 00000080:00200000:0.0:1787191338.871015:0:57869:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc5:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:0.0:1787191338.871021:0:57869:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc5:0x0](ffff936b489a9988) for lock 0xe5129dc884839f3e 00000080:00010000:0.0:1787191338.871035:0:57869:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc5:0x0](ffff936b489a9988) 00000080:00200008:0.0:1787191338.871058:0:57869:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc5:0x0](ffff936b489a9988), flags 154400 00000002:00100000:0.0:1787191338.871081:0:57869:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477b80 x1874004626644096/t8589936761(8589936761) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191338.871126:0:57869:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839f3e from it ffff936b495dc900 00010000:00010000:0.0:1787191338.871131:0:57869:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f3e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460499c expref: -99 pid: 57869 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.871150:0:57869:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f3e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460499c expref: -99 pid: 57869 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191338.871175:0:57869:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988), inode mode 81a4 mask 44 00000080:00200000:0.0:1787191338.871233:0:57869:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988), inode mode 81a4 mask 4 00000080:00200000:0.0:1787191338.871240:0:57869:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988), xattr lov 00000080:00200008:0.0:1787191338.871273:0:57869:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc5:0x0](ffff936b489a9988), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191338.871279:0:57869:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988),name=f70.sanity-flr 00000002:00010000:0.0:1787191338.871297:0:57869:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191338.871306:0:57869:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f3e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460499c expref: -99 pid: 57869 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191338.871317:0:57869:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f3e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460499c expref: -99 pid: 57869 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191338.871324:0:57869:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191338.871329:0:57869:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc5:0x0](ffff936b489a9988) 00000080:00010000:0.0:1787191338.871332:0:57869:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc5:0x0](ffff936b489a9988) for lock 0xe5129dc884839f3e 00000080:00010000:0.0:1787191338.871337:0:57869:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839f3e from it ffffa3fb421cbcd8 00010000:00010000:0.0:1787191338.871340:0:57869:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f3e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460499c expref: -99 pid: 57869 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191338.871348:0:57869:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f3e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460499c expref: -99 pid: 57869 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191338.871365:0:57869:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc5:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1787191338.871376:0:57869:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc5:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191338.871379:0:57869:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191338.871383:0:57869:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc5:0x0] 00000008:00010000:0.0:1787191338.871402:0:57869:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191338.871405:0:57869:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f99630, osc lock ffff936b50b62850, flags 0x400000400001002 00000008:00010000:0.0:1787191338.871411:0:57869:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191338.871412:0:57869:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f99670, osc lock ffff936b50b63a20, flags 0x400000400001002 00010000:00010000:0.0:1787191338.871454:0:57869:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839f45 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57869 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.871465:0:57869:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839f45 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57869 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.871481:0:57869:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b6a475180 x1874004626644480/t0(0) o101->lustre-OST0000-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191338.871599:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626644480:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191338.871790:0:57869:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc884839f4c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57869 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.871941:0:57869:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc884839f4c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57869 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.871954:0:57869:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b6a474a80 x1874004626644608/t0(0) o101->lustre-OST0001-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191338.872322:0:57867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57867:1874004626644352:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191338.872345:0:57867:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1f800 x1874004626642688/t8589936756(8589936756) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787191338.872582:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787191338.872593:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626644608:192.168.202.101@tcp:101:lfs.0 00000020:00200000:0.0:1787191338.872740:0:57869:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 2 items remaining. 00000080:00200000:0.0:1787191338.874741:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191338.874768:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191338.874783:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191338.874797:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191338.874818:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191338.874826:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191338.874829:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191338.874857:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:0.0:1787191338.874861:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191338.874874:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191338.874889:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191338.874895:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191338.874901:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191338.874908:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:0.0:1787191338.874913:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988), inode mode 81a4 mask 42 00000080:00200008:0.0:1787191338.874920:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc5:0x0](ffff936b489a9988), flags 101101 00000002:00010000:0.0:1787191338.874936:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc5:0x0]) in obj [0x200000405:0xc5:0x0], intent: open|creat flags 04240101102 00010000:00010000:0.0:1787191338.874948:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f3e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e460499c expref: -99 pid: 57869 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191338.874966:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc5:0x0]: losing layout lock 00010000:00010000:0.0:1787191338.875008:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f3e lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460499c expref: -99 pid: 57869 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191338.875016:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191338.875019:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc884839f3e lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460499c expref: -99 pid: 57869 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191338.875083:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839f53 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xc5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.875090:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839f53 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191338.875102:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191338.875115:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474700 x1874004626644864/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191338.875125:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839f53 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191338.875365:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626644864:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191338.884864:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99840 going to sleep for 11 seconds 00010000:00010000:0.0:1787191338.885311:0:2390:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839f45 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57869 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.885390:0:2390:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839f45 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46049aa expref: -99 pid: 57869 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.885405:0:2390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839f45 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46049aa expref: -99 pid: 57869 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.885484:0:2390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839f45 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46049aa expref: -99 pid: 57869 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191338.885501:0:2390:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839f45 lrc: 5/2,0 mode: PR/PR res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46049aa expref: -99 pid: 57869 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1787191338.885570:0:2390:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191338.885575:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839f45 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46049aa expref: -99 pid: 57869 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.885583:0:2390:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839f45 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46049aa expref: -99 pid: 57869 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.885591:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839f45 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46049aa expref: -99 pid: 57869 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.885599:0:2390:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839f45 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46049aa expref: -99 pid: 57869 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1787191338.885619:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626644480:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191338.889589:0:2390:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc884839f4c lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57869 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.889609:0:2390:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc884839f4c lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46049b1 expref: -99 pid: 57869 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.889620:0:2390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc884839f4c lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46049b1 expref: -99 pid: 57869 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.889633:0:2390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc884839f4c lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46049b1 expref: -99 pid: 57869 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191338.889644:0:2390:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc884839f4c lrc: 5/2,0 mode: PR/PR res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46049b1 expref: -99 pid: 57869 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1787191338.889653:0:2390:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1787191338.889672:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc884839f4c lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46049b1 expref: -99 pid: 57869 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.889678:0:2390:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc884839f4c lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46049b1 expref: -99 pid: 57869 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.889683:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc884839f4c lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46049b1 expref: -99 pid: 57869 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.889688:0:2390:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc884839f4c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46049b1 expref: -99 pid: 57869 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1787191338.889703:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626644608:192.168.202.101@tcp:101:lfs.0 00000080:00200000:3.0:1787191338.889740:0:57869:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc5:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1787191338.889747:0:57869:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c39bc0 (ffff936b47a17908/0) at cl_lock_release():245 00000020:00010000:3.0:1787191338.889751:0:57869:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c39bc0 (ffff936b47a17908/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191338.889755:0:57869:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99630 (ffff936b47a17638/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191338.889760:0:57869:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99670 (ffff936b47a17878/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191338.889762:0:57869:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c39bc0 (ffff936b47a17908/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191338.889765:0:57869:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99630 (ffff936b47a17908/1) at cl_lock_fini():72 00000020:00010000:3.0:1787191338.889769:0:57869:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99670 (ffff936b47a17908/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191338.889781:0:57869:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc5:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:3.0:1787191338.889800:0:57869:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/197 (0 0) 00000080:00010000:3.0:1787191338.889809:0:57869:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xc5:0x0](ffff936b489a9988) 00000002:00010000:3.0:1787191338.889818:0:57869:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc5:0x0]) in obj [0x200000405:0xc5:0x0], intent: layout flags 0 00010000:00010000:3.0:1787191338.889876:0:57869:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839f5a lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.889886:0:57869:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839f5a lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.889895:0:57869:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839f5a lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191338.889915:0:57869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57869:1874004626644992:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191338.890001:0:57869:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191338.893618:0:57869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57869:1874004626644992:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191338.893650:0:57869:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839f5a lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46049cd expref: -99 pid: 57869 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.893666:0:57869:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839f5a lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46049cd expref: -99 pid: 57869 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191338.893683:0:57869:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b51d1c380 x1874004626644992/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191338.893694:0:57869:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839f5a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46049cd expref: -99 pid: 57869 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.893703:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626644864:192.168.202.101@tcp:101:bash.0 00000002:00010000:0.0:1787191338.893708:0:57869:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839f5a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46049cd expref: -99 pid: 57869 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.893721:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839f53 lrc: 4/0,1 mode: --/CW res: [0x200000405:0xc5:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46049bf expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.893722:0:57869:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/197 (0 0) 00000080:00200000:0.0:1787191338.893733:0:57869:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xc5:0x0] suppgids 0 0: rc 0 00010000:00010000:1.0:1787191338.893736:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839f53 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xc5:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46049bf expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.893748:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839f53 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xc5:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46049bf expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00010000:0.0:1787191338.893752:0:57869:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc5:0x0](ffff936b489a9988) for lock 0xe5129dc884839f5a 00000002:00100000:1.0:1787191338.893760:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x200002b, status=0 req@ffff936b6a474700 x1874004626644864/t8589936763(8589936763) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191338.893762:0:57869:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839f5a from it ffffa3fb421cbbc8 00010000:00010000:0.0:1787191338.893769:0:57869:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839f5a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46049cd expref: -99 pid: 57869 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.893777:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474700 x1874004626644864/t8589936763(8589936763) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1787191338.893783:0:57869:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839f5a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46049cd expref: -99 pid: 57869 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000002:00010000:1.0:1787191338.893793:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839f53 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xc5:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46049bf expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191338.893806:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839f53 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xc5:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46049bf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.893814:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 8 res 8589935621/197 (0 0) 00000080:00200000:1.0:1787191338.893819:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000405:0xc5:0x0] suppgids 0 0: rc 0 00010000:00010000:0.0:1787191338.893821:0:57869:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839f5a lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46049cd expref: -99 pid: 57869 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191338.893859:0:57869:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839f5a lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46049cd expref: -99 pid: 57869 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1787191338.893867:0:57869:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xc5:0x0](00000000fb2aac00) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839f5a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46049cd expref: -99 pid: 57869 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191338.893899:0:57869:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc5:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:0.0:1787191338.893904:0:57869:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839f5a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46049cd expref: -99 pid: 57869 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191338.893911:0:57869:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839f5a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46049cd expref: -99 pid: 57869 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200008:0.0:1787191338.893968:0:57869:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc5:0x0](ffff936b489a9988), flags 154000 00000080:00200000:1.0:1787191338.894794:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc5:0x0]: layout version change: 3 -> 3 00000080:00010000:1.0:1787191338.894804:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc5:0x0](ffff936b489a9988) for lock 0xe5129dc884839f53 00000080:00010000:1.0:1787191338.894811:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839f53 from it ffffa3fb41cabbf0 00010000:00010000:1.0:1787191338.894815:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839f53 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xc5:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46049bf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.894825:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839f53 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xc5:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46049bf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000002:00100000:0.0:1787191338.894926:0:57869:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a477b80 x1874004626644096/t8589936761(8589936761) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191338.894935:0:57869:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191338.894939:0:57869:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474a80 x1874004626645248/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191338.894955:0:57869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57869:1874004626645248:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191338.895033:0:57869:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191338.897337:0:57869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57869:1874004626645248:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191338.897382:0:57869:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a477b80 x1874004626644096/t8589936761(8589936761) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191338.897523:0:57869:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191338.897541:0:57869:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191338.897557:0:57869:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191338.897570:0:57869:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191338.897578:0:57869:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191338.897583:0:57869:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191338.897587:0:57869:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191338.897594:0:57869:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421cbbf8 00010000:00010000:0.0:1787191338.897596:0:57869:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191338.897610:0:57869:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191338.897622:0:57869:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191338.897628:0:57869:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191338.897632:0:57869:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191338.897642:0:57869:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b464af380, open_flags d902, mode 0 opened 0 00000080:00200000:0.0:1787191338.897647:0:57869:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:0.0:1787191338.897658:0:57869:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154403 00010000:00010000:0.0:1787191338.897695:0:57869:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafc00/0xe5129dc884839f61 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.897701:0:57869:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafc00/0xe5129dc884839f61 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57869 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191338.897709:0:57869:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191338.897713:0:57869:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474a80 x1874004626645504/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191338.897719:0:57869:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafc00/0xe5129dc884839f61 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57869 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191338.897732:0:57869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57869:1874004626645504:192.168.202.101@tcp:101:lfs.0 00000002:00100000:1.0:1787191338.897828:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474700 x1874004626644864/t8589936763(8589936763) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191338.897907:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xc5:0x0], intent: getxattr flags 0 00000100:00100000:0.0:1787191338.897922:0:57869:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787191338.897934:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839f68 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.897943:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839f68 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.897950:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839f68 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.897972:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626645632:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191338.898004:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191338.901528:0:57869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57869:1874004626645504:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191338.901547:0:57869:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafc00/0xe5129dc884839f61 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.901558:0:57869:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafc00/0xe5129dc884839f61 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.901565:0:57869:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafc00/0xe5129dc884839f61 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.901570:0:57869:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafc00/0xe5129dc884839f61 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.901576:0:57869:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafc00/0xe5129dc884839f61 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.901580:0:57869:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cafc00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191338.901583:0:57869:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafc00/0xe5129dc884839f61 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.901587:0:57869:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafc00/0xe5129dc884839f61 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.901592:0:57869:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafc00/0xe5129dc884839f61 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.901596:0:57869:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191338.901601:0:57869:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafc00/0xe5129dc884839f61 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57869 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.901610:0:57869:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafc00/0xe5129dc884839f61 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57869 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191338.901627:0:57869:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b6a474a80 x1874004626645504/t8589936765(8589936765) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191338.901636:0:57869:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474a80 x1874004626645504/t8589936765(8589936765) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191338.901648:0:57869:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191338.901689:0:57869:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xc5:0x0](ffff936b489a9988): rc = 0 00000080:00010000:0.0:1787191338.901692:0:57869:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc5:0x0](ffff936b489a9988) for lock 0x0 00000080:00200008:0.0:1787191338.901711:0:57869:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc5:0x0](ffff936b489a9988), flags 154402 00000002:00100000:0.0:1787191338.901727:0:57869:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474a80 x1874004626645504/t8589936765(8589936765) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191338.901752:0:57869:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a474a80 x1874004626645504/t8589936765(8589936765) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191338.901759:0:57869:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191338.901762:0:57869:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477b80 x1874004626645888/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191338.901776:0:57869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57869:1874004626645888:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191338.903059:0:57869:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.906128:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626645632:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191338.906310:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839f68 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46049fe expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.906333:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839f68 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46049fe expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.906344:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839f68 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46049fe expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.906359:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b453ab100 x1874004626645632/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191338.906370:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839f68 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46049fe expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.906380:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/197 (0 0) 00000080:00200000:1.0:1787191338.906385:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xc5:0x0] suppgids 0 -1: rc 0 00000080:00010000:1.0:1787191338.906417:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc5:0x0](ffff936b489a9988) for lock 0xe5129dc884839f68 00000080:00010000:1.0:1787191338.906425:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839f68 from it ffffa3fb41caba38 00010000:00010000:1.0:1787191338.906429:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839f68 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46049fe expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.906439:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839f68 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46049fe expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:1.0:1787191338.906475:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xc5:0x0](ffff936b489a9988) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191338.000000000, mtime 1787191338.000000000, ctime 1787191338.000000000 00010000:00010000:1.0:1787191338.906513:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839f53 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xc5:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46049bf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1787191338.909733:0:57869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57869:1874004626645888:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191338.909770:0:57869:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a474a80 x1874004626645504/t8589936765(8589936765) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1787191338.909931:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839f5a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46049cd expref: -99 pid: 57869 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191338.909995:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839f53 lrc: 1/0,0 mode: --/CW res: [0x200000405:0xc5:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46049bf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191338.910004:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191338.910007:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc884839f53 lrc: 0/0,0 mode: --/CW res: [0x200000405:0xc5:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46049bf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:2.0:1787191338.910028:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1787191338.910036:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8700 x1874004626646144/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787191338.910068:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626646144:192.168.202.101@tcp:36:bash.0 00000100:00100000:2.0:1787191338.910155:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f300 going to sleep for 11 seconds 00000080:00200000:3.0:1787191338.910930:0:57869:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988), inode mode 81a4 mask 46 00000100:00100000:1.0:1787191338.914592:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626646144:192.168.202.101@tcp:36:bash.0 00000080:00200000:1.0:1787191338.914640:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:1.0:1787191338.914647:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc5:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:1.0:1787191338.914658:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xc5:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:1.0:1787191338.914663:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc5:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191338.914666:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xc5:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:1.0:1787191338.914675:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xc5:0x0](ffff936b489a9988) 00000002:00010000:1.0:1787191338.914688:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc5:0x0]) in obj [0x200000405:0xc5:0x0], intent: layout flags 02 00010000:00010000:1.0:1787191338.914709:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839f5a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46049cd expref: -99 pid: 57869 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191338.914729:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc5:0x0]: losing layout lock 00010000:00010000:1.0:1787191338.914763:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839f5a lrc: 1/0,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46049cd expref: -99 pid: 57869 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191338.914767:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191338.914770:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc884839f5a lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46049cd expref: -99 pid: 57869 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191338.914786:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839f6f lrc: 3/0,1 mode: --/EX res: [0x200000405:0xc5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.914790:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839f6f lrc: 3/0,1 mode: --/EX res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191338.914798:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191338.914804:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453ab100 x1874004626646400/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191338.914814:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839f6f lrc: 3/0,1 mode: --/EX res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.914896:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626646400:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191338.914985:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00000080:00200080:2.0:1787191338.915202:0:57869:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988) cmd=800466af arg=7fff3a976d7c 00000080:00200080:2.0:1787191338.915230:0:57869:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988) cmd=80086601 arg=7fff3a976d18 00000100:00100000:2.0:1787191338.915254:0:57869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57869:1874004626646528:192.168.202.101@tcp:33:lfs.0 00000100:00100000:2.0:1787191338.915278:0:57869:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191338.919181:0:57869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57869:1874004626646528:192.168.202.101@tcp:33:lfs.0 00000080:00200080:2.0:1787191338.919228:0:57869:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988) cmd=c00c66f3 arg=7fff3a976d04 00000080:00200008:2.0:1787191338.919963:0:57869:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc5:0x0](ffff936b489a9988), flags 154002 00000100:00100000:0.0:1787191338.925232:0:57570:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589936769 gen 1 00000100:00100000:0.0:1787191338.925320:0:57570:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b6a474700 x1874004626644864/t8589936763(8589936763) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787191338.925339:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626646400:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191338.925359:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839f6f lrc: 4/0,1 mode: --/EX res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604a13 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.925371:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839f6f lrc: 4/0,1 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604a13 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.925383:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839f6f lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604a13 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.925400:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839f6f lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604a13 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.925480:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839f6f lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604a13 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.925490:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839f6f lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604a13 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.925497:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839f6f lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604a13 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191338.925566:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b453ab100 x1874004626646400/t8589936769(8589936769) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191338.925586:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839f6f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604a13 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191338.925599:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839f6f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604a13 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.925610:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/197 (0 0) 00000080:00200000:0.0:1787191338.925617:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xc5:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191338.925630:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc5:0x0](ffff936b489a9988) for lock 0xe5129dc884839f6f 00000080:00010000:0.0:1787191338.925640:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839f6f from it ffffa3fb41cab930 00010000:00010000:0.0:1787191338.925643:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839f6f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604a13 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.925658:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839f6f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604a13 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191338.925678:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:0.0:1787191338.925685:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc5:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:0.0:1787191338.925702:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839f6f lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604a13 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191338.925714:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839f6f lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604a13 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1787191338.925722:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xc5:0x0](00000000fb2aac00) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839f6f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604a13 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191338.925766:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839f6f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604a13 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191338.925773:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839f6f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604a13 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191338.925785:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191338.925794:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc5:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191338.925798:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191338.925804:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:0.0:1787191338.925895:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:0.0:1787191338.925909:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839f6f lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604a13 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191338.925922:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839f6f lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604a13 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:0.0:1787191338.925929:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xc5:0x0](00000000fb2aac00) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839f6f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604a13 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191338.925946:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191338.925950:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc5:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191338.925953:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191338.925955:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:0.0:1787191338.925977:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:0.0:1787191338.926012:0:57570:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839f45 lrc: 1/0,0 mode: PR/PR res: [0x280000401:0x1af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46049aa expref: -99 pid: 57869 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000008:00010000:0.0:1787191338.926029:0:57570:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc884839f4c lrc: 1/0,0 mode: PR/PR res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46049b1 expref: -99 pid: 57869 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191338.926094:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc5:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:0.0:1787191338.926099:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839f6f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604a13 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191338.926107:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839f6f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604a13 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00020000:00200000:0.0:1787191338.926118:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xc5:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:0.0:1787191338.926122:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc5:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191338.926124:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191338.926128:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191338.926278:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191338.926282:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:0.0:1787191338.926293:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:0.0:1787191338.926297:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f994b0, osc lock ffff936b50b62720, flags 0x80000000 00000008:00010000:0.0:1787191338.926301:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:0.0:1787191338.926303:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f994f0, osc lock ffff936b50b63560, flags 0x80000000 00010000:00010000:0.0:1787191338.926344:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.926353:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.926364:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191338.926384:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626646656:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191338.927676:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191338.927908:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191338.928041:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191338.928075:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634879744 00000100:00100000:3.0:1787191338.928084:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634879744 00000100:00100000:3.0:1787191338.928122:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634879616 00000100:00100000:3.0:1787191338.928124:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634879616 00000100:00100000:3.0:1787191338.928145:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1309 00000100:00100000:3.0:1787191338.928154:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8420:x1874004634879744:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191338.928171:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc884839ef1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e460487d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.928228:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191338.928234:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8420:x1874004634879744:12345-192.168.202.101@tcp:104: Request processed in 82us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191338.928241:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1309 00000100:00100000:3.0:1787191338.928258:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1310 00000100:00100000:3.0:1787191338.928264:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8419:x1874004634879616:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191338.928272:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080030000 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191338.928299:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787191338.928304:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8419:x1874004634879616:12345-192.168.202.101@tcp:104: Request processed in 40us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191338.928309:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1310 00010000:00010000:3.0:1787191338.928330:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787191338.928336:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc884839ef1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e460487d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.928345:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd4e00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191338.928351:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc884839ef1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e460487d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.928390:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc884839ef1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e460487d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.928397:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191338.928526:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191338.928532:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080030000 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191338.928539:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b4150ac00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191338.928543:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428480030000 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191338.928568:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480030020 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191338.928575:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191338.928592:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480030020 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191338.928599:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc884839eea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480030020 nid: local remote: 0x7130d520e4604876 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191338.928614:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191338.928616:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191338.928618:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191338.928631:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626646912:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787191338.928979:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc884839ef1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e460487d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.928989:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000847ae4f5/0xe5129dc884839ef1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e460487d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191338.929003:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191338.929004:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191338.929007:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191338.929018:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626646784:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191338.931057:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626646656:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191338.931085:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.931103:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.931115:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.931130:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191338.931149:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.931160:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.931168:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.931232:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839f7d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.931241:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839f7d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.931252:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839f7d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191338.931272:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626647040:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191338.931340:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000080:00200000:1.0:1787191338.933259:0:57870:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191338.933285:0:57870:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.933299:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.933313:0:57870:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.933320:0:57870:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.933328:0:57870:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.933331:0:57870:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.933338:0:57870:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421bbbf8 00010000:00010000:1.0:1787191338.933342:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.933350:0:57870:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.933365:0:57870:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.933373:0:57870:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191338.933379:0:57870:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.933391:0:57870:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b494a5500, open_flags d900, mode 0 opened 0 00000080:00200000:1.0:1787191338.933398:0:57870:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:1.0:1787191338.933412:0:57870:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:1.0:1787191338.933458:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f84 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.933465:0:57870:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f84 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57870 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191338.933476:0:57870:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191338.933487:0:57870:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9500 x1874004626647296/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191338.933496:0:57870:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f84 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57870 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.933514:0:57870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57870:1874004626647296:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.933661:0:57870:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191338.933664:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626646912:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191338.936956:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626647040:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191338.936983:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839f7d lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604a3d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.937002:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839f7d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4604a3d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.937014:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839f7d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4604a3d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.937028:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839f7d lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4604a3d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191338.937039:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839f7d lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4604a3d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.937063:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839f7d lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4604a3d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.937071:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839f7d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4604a3d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191338.937168:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787191338.937185:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626647424:192.168.202.101@tcp:10:bash.0 00000100:00100000:0.0:1787191338.937306:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787191338.937315:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626647552:192.168.202.101@tcp:10:bash.0 00000100:00100000:2.0:1787191338.937639:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626646784:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191338.939441:0:57870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57870:1874004626647296:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191338.939464:0:57870:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f84 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604a59 expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.939488:0:57870:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f84 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604a59 expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.939497:0:57870:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f84 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604a59 expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.939509:0:57870:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f84 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604a59 expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.939525:0:57870:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f84 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604a59 expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.939538:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f84 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604a59 expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.939546:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f84 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604a59 expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.939553:0:57870:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f84 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604a59 expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.939562:0:57870:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b453a9500 x1874004626647296/t8589936770(8589936770) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191338.939571:0:57870:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9500 x1874004626647296/t8589936770(8589936770) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191338.939580:0:57870:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f84 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604a59 expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191338.939590:0:57870:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f84 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604a59 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.939597:0:57870:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/197 (0 0) 00000080:00200000:1.0:1787191338.939602:0:57870:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191338.939650:0:57870:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xc5:0x0](ffff936b489a9988): rc = 0 00000080:00200000:1.0:1787191338.939665:0:57870:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc5:0x0]: layout version change: 4 -> 4 00000080:00010000:1.0:1787191338.939680:0:57870:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc5:0x0](ffff936b489a9988) for lock 0xe5129dc884839f84 00000080:00010000:1.0:1787191338.939693:0:57870:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc5:0x0](ffff936b489a9988) 00000080:00200008:1.0:1787191338.939706:0:57870:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc5:0x0](ffff936b489a9988), flags 154400 00000002:00100000:1.0:1787191338.939723:0:57870:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9500 x1874004626647296/t8589936770(8589936770) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191338.939767:0:57870:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839f84 from it ffff936b5339ff00 00010000:00010000:1.0:1787191338.939771:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f84 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604a59 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.939777:0:57870:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f84 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604a59 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191338.939796:0:57870:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988), inode mode 81a4 mask 44 00000080:00200000:1.0:1787191338.939922:0:57870:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988), inode mode 81a4 mask 4 00000080:00200000:1.0:1787191338.939928:0:57870:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988), xattr lov 00000080:00200008:1.0:1787191338.939948:0:57870:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc5:0x0](ffff936b489a9988), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191338.939952:0:57870:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988),name=f70.sanity-flr 00000002:00010000:1.0:1787191338.939967:0:57870:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.939973:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f84 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604a59 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.939981:0:57870:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f84 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604a59 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191338.939985:0:57870:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.939988:0:57870:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc5:0x0](ffff936b489a9988) 00000080:00010000:1.0:1787191338.939991:0:57870:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc5:0x0](ffff936b489a9988) for lock 0xe5129dc884839f84 00000080:00010000:1.0:1787191338.939993:0:57870:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839f84 from it ffffa3fb421bbcd8 00010000:00010000:1.0:1787191338.939995:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f84 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604a59 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.940000:0:57870:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f84 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604a59 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191338.940013:0:57870:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc5:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:1.0:1787191338.940021:0:57870:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc5:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191338.940023:0:57870:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191338.940025:0:57870:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc5:0x0] 00000008:00010000:1.0:1787191338.940038:0:57870:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191338.940040:0:57870:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b47d7dab0, osc lock ffff936b468365f0, flags 0x400000400001002 00010000:00010000:1.0:1787191338.940065:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.940074:0:57870:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1787191338.940082:0:57870:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191338.940084:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 7/0,2 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.940089:0:57870:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1787191338.940094:0:57870:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191338.940101:0:57870:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc5:0x0] updating i_size 0 i_blocks 0 00000020:00010000:1.0:1787191338.940104:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51657530 (ffff936b465cc488/0) at cl_lock_release():245 00000020:00010000:1.0:1787191338.940106:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51657530 (ffff936b465cc488/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191338.940108:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7dab0 (ffff936b465cce18/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191338.940111:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51657530 (ffff936b465cc488/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191338.940113:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7dab0 (ffff936b465cc488/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191338.940119:0:57870:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc5:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1787191338.940148:0:57870:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc5:0x0](ffff936b489a9988), flags 154000 00000002:00100000:1.0:1787191338.940183:0:57870:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a9500 x1874004626647296/t8589936770(8589936770) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191338.940193:0:57870:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191338.940198:0:57870:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8700 x1874004626647808/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191338.940218:0:57870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57870:1874004626647808:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191338.940744:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626647552:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191338.940862:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626647424:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191338.940913:0:57870:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893cc0 going to sleep for 11 seconds 00000080:00200000:0.0:1787191338.941105:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc5:0x0] updating i_size 0 i_blocks 0 00000020:00010000:0.0:1787191338.941110:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b53cc58a8 (ffff936b47a17ab8/0) at cl_lock_release():245 00000020:00010000:0.0:1787191338.941114:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b53cc58a8 (ffff936b47a17ab8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191338.941118:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f994b0 (ffff936b47a17908/1) at cl_lock_cancel():142 00010000:00010000:0.0:1787191338.941125:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.941136:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:0.0:1787191338.941149:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f994f0 (ffff936b47a17b48/1) at cl_lock_cancel():142 00010000:00010000:0.0:1787191338.941154:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839f7d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4604a3d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191338.941161:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839f7d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604a3d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:0.0:1787191338.941170:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b53cc58a8 (ffff936b47a17ab8/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191338.941172:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f994b0 (ffff936b47a17ab8/1) at cl_lock_fini():72 00000020:00010000:0.0:1787191338.941176:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f994f0 (ffff936b47a17ab8/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191338.941191:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc5:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1787191338.941203:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xc5:0x0](ffff936b489a9988) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191338.000000000, mtime 1787191338.000000000, ctime 1787191338.000000000, rc 0 00000080:00200008:0.0:1787191338.941399:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xc5:0x0], ppos: 0, count: 5 00000080:00200000:0.0:1787191338.941412:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:0.0:1787191338.941418:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:0.0:1787191338.941424:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:0.0:1787191338.941429:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:0.0:1787191338.941434:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@000000003dfeb733[0x110, 1, [0x200000405:0xc5:0x0] hash] 00000020:00200000:0.0:1787191338.941436:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:0.0:1787191338.941441:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc5:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:0.0:1787191338.941451:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xc5:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:0.0:1787191338.941456:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc5:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191338.941459:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:0.0:1787191338.941463:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:0.0:1787191338.941470:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:0.0:1787191338.941473:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1787191338.941485:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:0.0:1787191338.941496:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:0.0:1787191338.941501:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b46b502b0, osc lock ffff936b50b63560, flags 0x0 00010000:00010000:0.0:1787191338.941513:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191338.941524:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191338.941534:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191338.941543:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191338.941551:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191338.941560:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:0.0:1787191338.941567:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:0.0:1787191338.941607:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:0.0:1787191338.941615:0:57570:0:(rw26.c:927:ll_write_end()) page@00000000b2903f9c[3 00000000a86f6315 2 1 000000002bde12f5 0 0 0] 00000080:00200000:0.0:1787191338.941618:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @0000000041a20145 17ffffc0001001 3:0 ffff936b522c4000 0 lru 00000080:00200000:0.0:1787191338.941625:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@00000000efdfe8b8 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000ef00a996 00000000f9406232 > 3< 0 0 > 4< 0 0 8 453234688 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1787191338.941627:0:57570:0:(rw26.c:927:ll_write_end()) end page@00000000b2903f9c 00000080:00200000:0.0:1787191338.941628:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:0.0:1787191338.941634:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:0.0:1787191338.941652:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 00000000f286e072 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191338.941771:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b489a9b38, count 1, dirtied 1 00000080:00200000:0.0:1787191338.941776:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:0.0:1787191338.941778:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:0.0:1787191338.941789:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b53cc58a8 (ffff936b47a17ab8/0) at cl_lock_release():245 00000020:00010000:0.0:1787191338.941791:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b53cc58a8 (ffff936b47a17ab8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191338.941793:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b46b502b0 (ffff936b47a17b48/1) at cl_lock_cancel():142 00010000:00010000:0.0:1787191338.941796:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191338.941801:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:0.0:1787191338.941809:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b53cc58a8 (ffff936b47a17ab8/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191338.941811:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b46b502b0 (ffff936b47a17ab8/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191338.941814:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:0.0:1787191338.941817:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:0.0:1787191338.941821:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc5:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191338.941823:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:0.0:1787191338.941828:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc5:0x0] updating i_size 5 i_blocks 0 00000080:00200000:0.0:1787191338.941906:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:0.0:1787191338.941919:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc5:0x0](ffff936b489a9988), flags 100001 00000002:00100000:0.0:1787191338.941956:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a474700 x1874004626644864/t8589936763(8589936763) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191338.941964:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:0.0:1787191338.941967:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477100 x1874004626648064/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191338.941979:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626648064:192.168.202.101@tcp:35:bash.0 00000100:00100000:0.0:1787191338.942066:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00000100:00100000:1.0:1787191338.950116:0:57870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57870:1874004626647808:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191338.950148:0:57870:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a9500 x1874004626647296/t8589936770(8589936770) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787191338.950339:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626648064:192.168.202.101@tcp:35:bash.0 00000002:00100000:0.0:1787191338.950358:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a474700 x1874004626644864/t8589936763(8589936763) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191338.951115:0:57870:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191338.951136:0:57870:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.951151:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.951166:0:57870:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.951175:0:57870:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.951181:0:57870:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.951184:0:57870:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.951191:0:57870:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421bbb58 00010000:00010000:1.0:1787191338.951194:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.951203:0:57870:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.951219:0:57870:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.951226:0:57870:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191338.951232:0:57870:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.951236:0:57870:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=9 00000080:00200008:1.0:1787191338.951311:0:57870:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc5:0x0](ffff936b489a9988), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191338.951318:0:57870:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988),name=f70.sanity-flr 00000002:00010000:1.0:1787191338.951331:0:57870:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.951339:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f84 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604a59 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191338.951348:0:57870:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f84 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604a59 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191338.951355:0:57870:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.951359:0:57870:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc5:0x0](ffff936b489a9988) 00000080:00010000:1.0:1787191338.951361:0:57870:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc5:0x0](ffff936b489a9988) for lock 0xe5129dc884839f84 00000080:00010000:1.0:1787191338.951366:0:57870:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839f84 from it ffffa3fb421bbcb8 00010000:00010000:1.0:1787191338.951369:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f84 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604a59 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191338.951376:0:57870:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f84 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604a59 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191338.951398:0:57870:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc5:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:1.0:1787191338.951410:0:57870:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc5:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191338.951413:0:57870:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191338.951416:0:57870:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc5:0x0] 00000008:00010000:1.0:1787191338.951435:0:57870:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191338.951438:0:57870:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b47d7dab0, osc lock ffff936b468365f0, flags 0x400000400001002 00010000:00010000:1.0:1787191338.951455:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191338.951466:0:57870:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1787191338.951477:0:57870:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191338.951481:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191338.951489:0:57870:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:1.0:1787191338.951501:0:57870:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191338.951511:0:57870:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc5:0x0] updating i_size 5 i_blocks 0 00000020:00010000:1.0:1787191338.951517:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51657530 (ffff936b465cc488/0) at cl_lock_release():245 00000020:00010000:1.0:1787191338.951520:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51657530 (ffff936b465cc488/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191338.951523:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7dab0 (ffff936b465cce18/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191338.951527:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51657530 (ffff936b465cc488/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191338.951530:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7dab0 (ffff936b465cc488/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191338.951542:0:57870:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc5:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191338.951565:0:57870:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191338.951573:0:57870:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.951578:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.951587:0:57870:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.951594:0:57870:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.951598:0:57870:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.951600:0:57870:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.951604:0:57870:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421bbbf8 00010000:00010000:1.0:1787191338.951608:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.951614:0:57870:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.951623:0:57870:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.951627:0:57870:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191338.951630:0:57870:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.951634:0:57870:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:1.0:1787191338.951638:0:57870:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988), inode mode 81a4 mask 46 00000080:00200008:1.0:1787191338.951647:0:57870:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc5:0x0](ffff936b489a9988), flags 154402 00000002:00010000:1.0:1787191338.951659:0:57870:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc5:0x0]) in obj [0x200000405:0xc5:0x0], intent: open flags 0104240114403 00010000:00010000:1.0:1787191338.951707:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839f8b lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.951714:0:57870:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839f8b lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57870 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191338.951725:0:57870:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191338.951734:0:57870:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8700 x1874004626648320/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191338.951743:0:57870:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839f8b lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57870 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.951761:0:57870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57870:1874004626648320:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.951947:0:57870:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893cc0 going to sleep for 11 seconds 00000080:00200000:1.0:1787191338.955205:0:57871:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191338.955232:0:57871:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.955538:0:57871:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.955556:0:57871:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.955565:0:57871:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.955573:0:57871:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.955576:0:57871:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.955583:0:57871:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421a3b58 00010000:00010000:1.0:1787191338.955588:0:57871:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.955596:0:57871:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.955612:0:57871:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.955620:0:57871:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:1.0:1787191338.955625:0:57871:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.955629:0:57871:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=8 00000080:00200008:1.0:1787191338.955635:0:57871:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc5:0x0](ffff936b489a9988), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191338.955640:0:57871:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988),name=f70.sanity-flr 00000002:00010000:1.0:1787191338.955652:0:57871:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.955660:0:57871:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f84 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604a59 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191338.955668:0:57871:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f84 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604a59 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191338.955675:0:57871:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.955678:0:57871:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc5:0x0](ffff936b489a9988) 00000080:00010000:1.0:1787191338.955680:0:57871:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc5:0x0](ffff936b489a9988) for lock 0xe5129dc884839f84 00000080:00010000:1.0:1787191338.955684:0:57871:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839f84 from it ffffa3fb421a3cb8 00010000:00010000:1.0:1787191338.955687:0:57871:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f84 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604a59 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191338.955694:0:57871:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f84 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604a59 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1787191338.955719:0:57871:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc5:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:1.0:1787191338.955731:0:57871:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc5:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191338.955734:0:57871:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191338.955738:0:57871:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc5:0x0] 00000008:00010000:1.0:1787191338.955756:0:57871:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191338.955759:0:57871:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b47d7dab0, osc lock ffff936b468365f0, flags 0x400000400001002 00010000:00010000:1.0:1787191338.955776:0:57871:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191338.956036:0:57871:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:1.0:1787191338.956059:0:57871:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191338.956063:0:57871:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191338.956071:0:57871:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:1.0:1787191338.956081:0:57871:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191338.956090:0:57871:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc5:0x0] updating i_size 5 i_blocks 0 00000020:00010000:1.0:1787191338.956095:0:57871:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51657530 (ffff936b465cc488/0) at cl_lock_release():245 00000020:00010000:1.0:1787191338.956098:0:57871:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51657530 (ffff936b465cc488/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191338.956101:0:57871:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7dab0 (ffff936b465cce18/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191338.956105:0:57871:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51657530 (ffff936b465cc488/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191338.956108:0:57871:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7dab0 (ffff936b465cc488/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191338.956118:0:57871:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc5:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191338.956144:0:57871:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191338.956153:0:57871:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.956160:0:57871:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.956169:0:57871:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.956176:0:57871:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191338.956180:0:57871:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191338.956183:0:57871:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191338.956187:0:57871:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421a3c10 00010000:00010000:1.0:1787191338.956190:0:57871:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191338.956198:0:57871:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191338.956207:0:57871:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.956211:0:57871:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:1.0:1787191338.956215:0:57871:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191338.956221:0:57871:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:1.0:1787191338.956224:0:57871:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:1.0:1787191338.956229:0:57871:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:1.0:1787191338.956319:0:57871:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839f6f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4604a13 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191338.956341:0:57871:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc5:0x0]: losing layout lock 00010000:00010000:1.0:1787191338.956354:0:57871:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f84 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4604a59 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1787191338.956362:0:57871:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc5:0x0]: losing layout lock 00010000:00010000:1.0:1787191338.956370:0:57871:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839f68 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e46049fe expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.956415:0:57871:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839f6f lrc: 1/0,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604a13 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191338.956422:0:57871:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f84 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604a59 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191338.956429:0:57871:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839f68 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46049fe expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191338.956434:0:57871:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:1.0:1787191338.956437:0:57871:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839f6f lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604a13 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191338.956451:0:57871:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f84 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604a59 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191338.956460:0:57871:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839f68 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46049fe expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1787191338.956474:0:57871:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 36, max 7 00000100:00100000:1.0:1787191338.956487:0:57871:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9500 x1874004626648576/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787191338.956511:0:57871:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57871:1874004626648576:192.168.202.101@tcp:36:rm.0 00000100:00100000:1.0:1787191338.956599:0:57871:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893480 going to sleep for 11 seconds 00000080:00200000:3.0:1787191338.961984:0:37:0:(vvp_io.c:1826:vvp_io_init()) [0x240000405:0x19:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1787191338.962002:0:37:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1787191338.962028:0:37:0:(vvp_io.c:304:vvp_io_fini()) [0x240000405:0x19:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:3.0:1787191338.964817:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191338.964880:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634879872 00000100:00100000:2.0:1787191338.964890:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634879872 00000100:00100000:2.0:1787191338.964942:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1311 00000100:00100000:2.0:1787191338.964952:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634879872:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191338.964965:0:40922:0:(ldlm_lockd.c:2455:ldlm_callback_handler()) callback on lock 0xe5129dc884839f84 - lock disappeared 00010000:00010000:2.0:1787191338.965026:0:40922:0:(ldlm_lockd.c:2352:ldlm_callback_errmsg()) @@@ Operate with invalid parameter, NID=12345-192.168.202.101@tcp lock=0xe5129dc884839f84: rc = 0 req@ffff936b51d1ce00 x1874004634879872/t0(0) o104->f10005b0-4ec5-4888-9c81-49c0b11e82c4@192.168.202.101@tcp:649/0 lens 328/224 e 0 to 0 dl 1787191349 ref 1 fl Interpret:/0/0 rc -22/-22 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787191338.965038:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634879872:12345-192.168.202.101@tcp:104: Request processed in 89us (231us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787191338.965056:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1311 00000100:00100000:1.0:1787191338.971396:0:57870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57870:1874004626648320:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191338.971426:0:57870:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CW ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839f8b lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604a6e expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.971439:0:57870:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839f8b lrc: 4/1,0 mode: --/CW res: [0x200000405:0xc5:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604a6e expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.971446:0:57870:0:(ldlm_request.c:795:ldlm_cli_enqueue_fini()) ### enqueue reply includes blocking AST ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839f8b lrc: 4/1,0 mode: --/CW res: [0x200000405:0xc5:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4604a6e expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.971516:0:57870:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839f8b lrc: 4/1,0 mode: CW/CW res: [0x200000405:0xc5:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e4604a6e expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.971528:0:57870:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839f8b lrc: 4/1,0 mode: CW/CW res: [0x200000405:0xc5:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4604a6e expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.971542:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839f8b lrc: 5/1,1 mode: CW/CW res: [0x200000405:0xc5:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e4604a6e expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.971551:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839f8b lrc: 5/1,1 mode: CW/CW res: [0x200000405:0xc5:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e4604a6e expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.971558:0:57870:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839f8b lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xc5:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e4604a6e expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.971570:0:57870:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x200002b, status=0 req@ffff936b453a8700 x1874004626648320/t8589936773(8589936773) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191338.971583:0:57870:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8700 x1874004626648320/t8589936773(8589936773) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191338.971597:0:57870:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839f8b lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xc5:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4604a6e expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.971726:0:57870:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 8 res 8589935621/197 (0 0) 00000080:00200000:1.0:1787191338.971733:0:57870:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xc5:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191338.971784:0:57870:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc5:0x0](ffff936b489a9988) for lock 0xe5129dc884839f8b 00000080:00010000:1.0:1787191338.971915:0:57870:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839f8b from it ffffa3fb421bbbf0 00010000:00010000:1.0:1787191338.971918:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839f8b lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xc5:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e4604a6e expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.971926:0:57870:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839f8b lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xc5:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e4604a6e expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.971947:0:57870:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000002:00100000:1.0:1787191338.971965:0:57870:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8700 x1874004626648320/t8589936773(8589936773) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191338.972131:0:57870:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988), inode mode 81a4 mask 4 00000080:00200000:1.0:1787191338.972140:0:57870:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988), xattr lov 00000080:00200008:1.0:1787191338.972165:0:57870:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc5:0x0](ffff936b489a9988), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191338.972172:0:57870:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988),name=f70.sanity-flr 00000002:00010000:1.0:1787191338.972184:0:57870:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc5:0x0]) in obj [0x200000405:0xc5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191338.972191:0:57870:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 30 res 8589935621/197 (0 0) 00010000:00010000:1.0:1787191338.972229:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839f92 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.972236:0:57870:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839f92 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.972430:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191338.972438:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839f8b lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xc5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4604a6e expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.972447:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b4150ac00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191338.972452:0:57627:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839f8b lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xc5:0x0].0x0 bits 0x5/0x5 rrc: 4 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4604a6e expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.972461:0:57627:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839f8b lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xc5:0x0].0x0 bits 0x5/0x5 rrc: 4 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4604a6e expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.972468:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839f8b lrc: 3/0,0 mode: CW/CW res: [0x200000405:0xc5:0x0].0x0 bits 0x5/0x5 rrc: 4 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x7130d520e4604a6e expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.972500:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839f8b lrc: 2/0,0 mode: --/CW res: [0x200000405:0xc5:0x0].0x0 bits 0x5/0x5 rrc: 4 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e4604a6e expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.972517:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191338.972545:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839f8b lrc: 1/0,0 mode: --/CW res: [0x200000405:0xc5:0x0].0x0 bits 0x5/0x5 rrc: 4 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e4604a6e expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.972552:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839f8b lrc: 0/0,0 mode: --/CW res: [0x200000405:0xc5:0x0].0x0 bits 0x5/0x5 rrc: 4 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e4604a6e expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.972565:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191338.972567:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191338.972568:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191338.972575:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626648832:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787191338.973520:0:57870:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839f92 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57870 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.973542:0:57870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57870:1874004626648704:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.973591:0:57870:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893780 going to sleep for 11 seconds 00000100:00100000:2.0:1787191338.979899:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626648832:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191338.980565:0:57871:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57871:1874004626648576:192.168.202.101@tcp:36:rm.0 00000100:00100000:1.0:1787191338.989041:0:57870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57870:1874004626648704:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191338.989082:0:57870:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839f92 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604a98 expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.989096:0:57870:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839f92 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604a98 expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.989110:0:57870:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839f92 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604a98 expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.989122:0:57870:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839f92 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604a98 expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.989134:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839f92 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604a98 expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.989144:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839f92 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604a98 expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.989153:0:57870:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839f92 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604a98 expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.989166:0:57870:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b453a8e00 x1874004626648704/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/976 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191338.989178:0:57870:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839f92 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604a98 expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191338.989191:0:57870:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839f92 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604a98 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.989202:0:57870:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/197 (0 0) 00000080:00200000:1.0:1787191338.989209:0:57870:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xc5:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787191338.989267:0:57870:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc5:0x0]: layout version change: 4294967294 -> 4 00000080:00010000:1.0:1787191338.989273:0:57870:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc5:0x0](ffff936b489a9988) for lock 0xe5129dc884839f92 00000080:00010000:1.0:1787191338.989278:0:57870:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc5:0x0](ffff936b489a9988) 00000080:00010000:1.0:1787191338.989280:0:57870:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839f92 from it ffffa3fb421bbcd8 00010000:00010000:1.0:1787191338.989283:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839f92 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604a98 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.989291:0:57870:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839f92 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604a98 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191338.989329:0:57870:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc5:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:1.0:1787191338.989340:0:57870:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc5:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191338.989343:0:57870:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191338.989347:0:57870:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc5:0x0] 00000008:00010000:1.0:1787191338.989364:0:57870:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191338.989367:0:57870:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b47d7dab0, osc lock ffff936b468365f0, flags 0x400000400001002 00010000:00010000:1.0:1787191338.989384:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191338.989398:0:57870:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:1.0:1787191338.989411:0:57870:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191338.989415:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191338.989423:0:57870:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000020:00200000:1.0:1787191338.989434:0:57870:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191338.989443:0:57870:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc5:0x0] updating i_size 5 i_blocks 0 00000020:00010000:1.0:1787191338.989449:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51657530 (ffff936b465cc488/0) at cl_lock_release():245 00000020:00010000:1.0:1787191338.989452:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51657530 (ffff936b465cc488/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191338.989455:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7dab0 (ffff936b465cce18/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191338.989458:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51657530 (ffff936b465cc488/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191338.989461:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7dab0 (ffff936b465cc488/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191338.989471:0:57870:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc5:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200080:1.0:1787191338.989537:0:57870:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988) cmd=c00c66f3 arg=ca42e0 00000002:00010000:1.0:1787191338.989560:0:57870:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc5:0x0]) in obj [0x200000405:0xc5:0x0], intent: open flags 05004040000002 00010000:00010000:1.0:1787191338.989602:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f99 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.989609:0:57870:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f99 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57870 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191338.989619:0:57870:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191338.989626:0:57870:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8e00 x1874004626649088/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191338.989635:0:57870:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f99 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x81000000000000 pid: 57870 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191338.989653:0:57870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57870:1874004626649088:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.989861:0:57870:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893780 going to sleep for 11 seconds 00000080:00200000:3.0:1787191338.994726:0:57872:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191338.994758:0:57872:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191338.994775:0:57872:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191338.994808:0:57872:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191338.994815:0:57872:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191338.994823:0:57872:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191338.994826:0:57872:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191338.994856:0:57872:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421cbb58 00010000:00010000:3.0:1787191338.994860:0:57872:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191338.994868:0:57872:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191338.994884:0:57872:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191338.994892:0:57872:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:3.0:1787191338.994898:0:57872:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191338.994910:0:57872:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:3.0:1787191338.994914:0:57872:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:3.0:1787191338.994927:0:57872:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1787191338.994976:0:57872:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839fa0 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.994984:0:57872:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839fa0 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191338.994994:0:57872:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839fa0 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191338.995026:0:57872:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57872:1874004626649216:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191338.995418:0:57870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57870:1874004626649088:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191338.995435:0:57870:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f99 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4604aa6 expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.995445:0:57870:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f99 lrc: 4/1,0 mode: --/PW res: [0x200000405:0xc5:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4604aa6 expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.995458:0:57870:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f99 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0xc5:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4604aa6 expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.995469:0:57870:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f99 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0xc5:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4604aa6 expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.995481:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f99 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0xc5:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4604aa6 expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.995490:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f99 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0xc5:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4604aa6 expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.995498:0:57870:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f99 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0xc5:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4604aa6 expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191338.995519:0:57870:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x600002b, status=0 req@ffff936b453a8e00 x1874004626649088/t8589936775(8589936775) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191338.995533:0:57870:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8e00 x1874004626649088/t8589936775(8589936775) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191338.995548:0:57870:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f99 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xc5:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4604aa6 expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.995558:0:57870:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 2 res 8589935621/197 (0 0) 00000080:00200000:1.0:1787191338.995563:0:57870:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xc5:0x0] suppgids 0 0: rc 0 00000002:00100000:1.0:1787191338.995577:0:57870:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8e00 x1874004626649088/t8589936775(8589936775) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191338.995586:0:57870:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc5:0x0](ffff936b489a9988) for lock 0xe5129dc884839f99 00000080:00010000:1.0:1787191338.995591:0:57870:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839f99 from it ffffa3fb421bbcc0 00010000:00010000:1.0:1787191338.995594:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f99 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xc5:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4604aa6 expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191338.995607:0:57870:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f99 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0xc5:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4604aa6 expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1787191338.995665:0:57870:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc5:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:1.0:1787191338.995678:0:57870:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc5:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191338.995681:0:57870:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191338.995687:0:57870:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191338.995697:0:57870:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000100:00100000:1.0:1787191338.995751:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787191338.995764:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626649344:192.168.202.101@tcp:1:lfs.0 00000100:00100000:3.0:1787191338.996276:0:57872:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c300 going to sleep for 11 seconds 00000100:00100000:2.0:1787191338.999561:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191338.999609:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634880000 00000100:00100000:3.0:1787191338.999628:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634880000 00000100:00100000:3.0:1787191338.999683:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1312 00000100:00100000:3.0:1787191338.999694:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30511:x1874004634880000:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191338.999714:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420080000000 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1787191338.999862:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191338.999870:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30511:x1874004634880000:12345-192.168.202.101@tcp:104: Request processed in 177us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191338.999878:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1312 00010000:00010000:1.0:1787191339.000521:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191339.000533:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420080000000 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1787191339.000543:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cafc00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191339.000549:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800428480000000 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000008:00010000:1.0:1787191339.000601:0:40930:0:(osc_cache.c:2029:try_to_add_extent_for_io()) ### extent: 00000000f286e072 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800429480000000 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000008:00010000:1.0:1787191339.000616:0:40930:0:(osc_cache.c:1183:osc_extent_make_ready()) ### extent: 00000000f286e072 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800429480000000 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1787191339.000799:0:40930:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800429480000000 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000008:00100000:1.0:1787191339.000968:0:40930:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff936b453aa300 - object 0x2c0000401:433 offset 0<>5 00000100:00100000:0.0:1787191339.001056:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787191339.001072:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626649472:192.168.202.101@tcp:4:bash.0 00000100:00100000:3.0:1787191339.005801:0:57872:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57872:1874004626649216:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191339.005825:0:57872:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839fa0 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.005870:0:57872:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839fa0 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.005876:0:57872:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839fa0 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.005883:0:57872:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839fa0 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.005891:0:57872:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839fa0 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.005897:0:57872:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9aa00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191339.005902:0:57872:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839fa0 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.005909:0:57872:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839fa0 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.005915:0:57872:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839fa0 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.005922:0:57872:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191339.005928:0:57872:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839fa0 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.005934:0:57872:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc884839fa0 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191339.005957:0:57872:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b51d1c700 x1874004626649216/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191339.005972:0:57872:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191339.006068:0:57872:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191339.006083:0:57872:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191339.006093:0:57872:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191339.006105:0:57872:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191339.006112:0:57872:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191339.006119:0:57872:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191339.006123:0:57872:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191339.006128:0:57872:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421cbbe8 00010000:00010000:3.0:1787191339.006131:0:57872:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191339.006139:0:57872:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191339.006152:0:57872:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191339.006159:0:57872:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000080:00200000:3.0:1787191339.006164:0:57872:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191339.006174:0:57872:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:3.0:1787191339.006178:0:57872:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:3.0:1787191339.006190:0:57872:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1787191339.006231:0:57872:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839fa7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.006237:0:57872:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839fa7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191339.007292:0:2389:0:(osc_cache.c:917:osc_extent_finish()) ### extent: 00000000f286e072 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800429480000000 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000008:00010000:0.0:1787191339.007347:0:2389:0:(osc_cache.c:497:__osc_extent_remove()) ### extent: 00000000f286e072 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800429480000000 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000100:00100000:0.0:1787191339.007373:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626649472:192.168.202.101@tcp:4:bash.0 00000080:00200000:1.0:1787191339.007578:0:40930:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1787191339.007614:0:40930:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1787191339.007656:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69480000020 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1787191339.007664:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191339.007692:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69480000020 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1787191339.007701:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000049b8e58a/0xe5129dc884839f76 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69480000020 nid: local remote: 0x7130d520e4604a36 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1787191339.007719:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191339.007721:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191339.007723:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191339.007961:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787191339.007975:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626649728:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787191339.008351:0:57872:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839fa7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191339.009174:0:57872:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57872:1874004626649600:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191339.009231:0:57872:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191339.017200:0:57872:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57872:1874004626649600:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191339.017223:0:57872:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839fa7 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.017236:0:57872:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839fa7 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.017242:0:57872:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839fa7 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.017250:0:57872:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839fa7 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.017258:0:57872:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839fa7 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.017265:0:57872:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9a800 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191339.017270:0:57872:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839fa7 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.017277:0:57872:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839fa7 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.017284:0:57872:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839fa7 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.017292:0:57872:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191339.017298:0:57872:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839fa7 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.017305:0:57872:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc884839fa7 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191339.017329:0:57872:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b51d1c700 x1874004626649600/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191339.017343:0:57872:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191339.017544:0:57872:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191339.017561:0:57872:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.017571:0:57872:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.017582:0:57872:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.017588:0:57872:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191339.017594:0:57872:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191339.017597:0:57872:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191339.017664:0:57872:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421cbb58 00010000:00010000:0.0:1787191339.017722:0:57872:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.017733:0:57872:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.017747:0:57872:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191339.017754:0:57872:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:0.0:1787191339.017763:0:57872:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1787191339.017768:0:57872:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:0.0:1787191339.017779:0:57872:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.017924:0:57872:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 78 lru_type: 1 00010000:00010000:0.0:1787191339.017935:0:57872:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 78 lru_type: 1 00000002:00010000:0.0:1787191339.017947:0:57872:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.017988:0:57872:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc884839fae lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.017996:0:57872:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc884839fae lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.018005:0:57872:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc884839fae lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191339.018025:0:57872:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57872:1874004626649856:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191339.018149:0:57872:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00000100:00100000:1.0:1787191339.025387:0:57872:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57872:1874004626649856:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191339.025422:0:57872:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc884839fae lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604aec expref: -99 pid: 57872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.025434:0:57872:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc884839fae lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604aec expref: -99 pid: 57872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.025445:0:57872:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc884839fae lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604aec expref: -99 pid: 57872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.025467:0:57872:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc884839fae lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604aec expref: -99 pid: 57872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.025479:0:57872:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc884839fae lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604aec expref: -99 pid: 57872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.025487:0:57872:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc884839fae lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604aec expref: -99 pid: 57872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.025494:0:57872:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc884839fae lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604aec expref: -99 pid: 57872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191339.025506:0:57872:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b6a477100 x1874004626649856/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191339.025519:0:57872:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc884839fae lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604aec expref: -99 pid: 57872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.025528:0:57872:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:1.0:1787191339.025535:0:57872:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc884839fae lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604aec expref: -99 pid: 57872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.025543:0:57872:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc884839fae lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604aec expref: -99 pid: 57872 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:1.0:1787191339.025570:0:57872:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.025581:0:57872:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 156 lru_type: 1 00010000:00010000:1.0:1787191339.025593:0:57872:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 156 lru_type: 1 00010000:00010000:1.0:1787191339.025601:0:57872:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 156 lru_type: 1 00010000:00010000:1.0:1787191339.025608:0:57872:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 157 lru_type: 1 00000080:00200000:1.0:1787191339.025620:0:57872:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191339.025630:0:57872:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:1.0:1787191339.025634:0:57872:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:1.0:1787191339.025641:0:57872:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb421cbcb8 00010000:00010000:1.0:1787191339.025644:0:57872:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 78 lru_type: 1 00010000:00010000:1.0:1787191339.025652:0:57872:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 79 lru_type: 1 00000002:00010000:1.0:1787191339.025668:0:57872:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.025674:0:57872:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc884839fae lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604aec expref: -99 pid: 57872 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.025683:0:57872:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc884839fae lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604aec expref: -99 pid: 57872 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.025690:0:57872:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc884839fae lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604aec expref: -99 pid: 57872 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.025698:0:57872:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc884839fae lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604aec expref: -99 pid: 57872 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:1.0:1787191339.025705:0:57872:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.025709:0:57872:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 157 lru_type: 1 00010000:00010000:1.0:1787191339.025716:0:57872:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 157 lru_type: 1 00010000:00010000:1.0:1787191339.025723:0:57872:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 157 lru_type: 1 00010000:00010000:1.0:1787191339.025730:0:57872:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 158 lru_type: 1 00000080:00200008:1.0:1787191339.026733:0:57872:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:1.0:1787191339.026742:0:57872:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191339.026759:0:57872:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.026769:0:57872:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.026780:0:57872:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.026798:0:57872:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191339.026804:0:57872:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191339.026807:0:57872:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191339.026812:0:57872:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421cbcb8 00010000:00010000:1.0:1787191339.026816:0:57872:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.026823:0:57872:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.026953:0:57872:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191339.026962:0:57872:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.026968:0:57872:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.026976:0:57872:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.026982:0:57872:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191339.026986:0:57872:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191339.026989:0:57872:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191339.026993:0:57872:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421cbb58 00010000:00010000:1.0:1787191339.026996:0:57872:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.027003:0:57872:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.027012:0:57872:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191339.027018:0:57872:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:1.0:1787191339.027023:0:57872:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191339.027033:0:57872:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:1.0:1787191339.027037:0:57872:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191339.027059:0:57872:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191339.027108:0:57872:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fb5 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.027115:0:57872:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fb5 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.027125:0:57872:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fb5 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191339.027146:0:57872:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57872:1874004626649984:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191339.027224:0:57872:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893780 going to sleep for 11 seconds 00000100:00100000:0.0:1787191339.028086:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626649344:192.168.202.101@tcp:1:lfs.0 00000100:00100000:0.0:1787191339.028118:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626649728:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787191339.028162:0:57870:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839f92 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4604a98 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191339.028182:0:57870:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc5:0x0]: losing layout lock 00010000:00010000:1.0:1787191339.028220:0:57870:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839f92 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604a98 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.028227:0:57870:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191339.028231:0:57870:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839f92 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604a98 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1787191339.028246:0:57870:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1787191339.028255:0:57870:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453ab800 x1874004626650240/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 472/440 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787191339.028272:0:57870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57870:1874004626650240:192.168.202.101@tcp:36:lfs.0 00000100:00100000:1.0:1787191339.028330:0:57870:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893480 going to sleep for 11 seconds 00000100:00100000:1.0:1787191339.037930:0:57872:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57872:1874004626649984:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191339.037954:0:57872:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fb5 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.037969:0:57872:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fb5 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.037977:0:57872:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fb5 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.037985:0:57872:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fb5 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.037994:0:57872:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fb5 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.038000:0:57872:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b4150bc00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191339.038005:0:57872:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fb5 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.038011:0:57872:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fb5 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.038019:0:57872:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fb5 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.038026:0:57872:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191339.038033:0:57872:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fb5 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.038053:0:57872:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fb5 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191339.038072:0:57872:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b453a8a80 x1874004626649984/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191339.038088:0:57872:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1787191339.038118:0:57872:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc884839fae lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604aec expref: -99 pid: 57872 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191339.038132:0:57872:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc884839fae lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604aec expref: -99 pid: 57872 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:1.0:1787191339.038141:0:57872:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839fae from it ffffa3fb421cb930 00010000:00010000:1.0:1787191339.038145:0:57872:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc884839fae lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604aec expref: -99 pid: 57872 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191339.038155:0:57872:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc884839fae lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604aec expref: -99 pid: 57872 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191339.038236:0:57872:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191339.038252:0:57872:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.038260:0:57872:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.038268:0:57872:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.038279:0:57872:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191339.038283:0:57872:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191339.038287:0:57872:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191339.038292:0:57872:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421cbbf8 00010000:00010000:1.0:1787191339.038295:0:57872:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.038303:0:57872:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.038311:0:57872:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191339.038319:0:57872:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191339.038324:0:57872:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191339.038330:0:57872:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:1.0:1787191339.038333:0:57872:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:1.0:1787191339.038338:0:57872:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b43c56000, open_flags a141, mode 81b6 opened 0 00000080:00200000:1.0:1787191339.038347:0:57872:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:1.0:1787191339.038367:0:57872:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xc6:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:1.0:1787191339.038377:0:57872:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc884839fae lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4604aec expref: -99 pid: 57872 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191339.038450:0:57872:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc884839fae lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4604aec expref: -99 pid: 57872 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191339.038458:0:57872:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191339.038460:0:57872:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc884839fae lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4604aec expref: -99 pid: 57872 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191339.038504:0:57872:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839fbc lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.038512:0:57872:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839fbc lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191339.038522:0:57872:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:1.0:1787191339.038529:0:57872:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8a80 x1874004626650496/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191339.038553:0:57872:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839fbc lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191339.038574:0:57872:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57872:1874004626650496:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191339.038704:0:57872:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893780 going to sleep for 11 seconds 00000100:00100000:1.0:1787191339.043039:0:57872:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589936776 gen 1 00000100:00100000:1.0:1787191339.043070:0:57872:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b453a8700 x1874004626648320/t8589936773(8589936773) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787191339.043093:0:57872:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b453a8e00 x1874004626649088/t8589936775(8589936775) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787191339.043101:0:57872:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff936b453a8a80 x1874004626650496/t8589936777(8589936777) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191355 ref 3 fl Rpc:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787191339.043112:0:57872:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57872:1874004626650496:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191339.043130:0:57872:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839fbc lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604b24 expref: -99 pid: 57872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.043163:0:57872:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839fbc lrc: 4/0,1 mode: --/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604b24 expref: -99 pid: 57872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.043172:0:57872:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839fbc lrc: 4/0,1 mode: --/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604b24 expref: -99 pid: 57872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.043183:0:57872:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839fbc lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604b24 expref: -99 pid: 57872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.043204:0:57872:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839fbc lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604b24 expref: -99 pid: 57872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.043218:0:57872:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839fbc lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604b24 expref: -99 pid: 57872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.043227:0:57872:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839fbc lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604b24 expref: -99 pid: 57872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.043234:0:57872:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839fbc lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604b24 expref: -99 pid: 57872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191339.043245:0:57872:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b453a8a80 x1874004626650496/t8589936777(8589936777) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191339.043257:0:57872:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8a80 x1874004626650496/t8589936777(8589936777) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191339.043269:0:57872:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839fbc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604b24 expref: -99 pid: 57872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.043280:0:57872:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/198 (0 0) 00000080:00200000:1.0:1787191339.043286:0:57872:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191339.043298:0:57872:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:1.0:1787191339.043330:0:57872:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xc6:0x0](ffff936b5395f448) 00000080:00200000:1.0:1787191339.043337:0:57872:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xc6:0x0], updating i_size 0 00000080:00200000:1.0:1787191339.043371:0:57872:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc6:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:1.0:1787191339.043376:0:57872:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xc6:0x0](ffff936b5395f448) 00000080:00010000:1.0:1787191339.043379:0:57872:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc6:0x0](ffff936b5395f448) for lock 0xe5129dc884839fbc 00000080:00010000:1.0:1787191339.043388:0:57872:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc6:0x0](ffff936b5395f448) 00000080:00200008:1.0:1787191339.043402:0:57872:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc6:0x0](ffff936b5395f448), flags 120501 00000002:00100000:1.0:1787191339.043424:0:57872:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8a80 x1874004626650496/t8589936777(8589936777) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191339.043456:0:57872:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839fbc from it ffff936b5339f480 00010000:00010000:1.0:1787191339.043460:0:57872:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839fbc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604b24 expref: -99 pid: 57872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.043470:0:57872:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839fbc lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604b24 expref: -99 pid: 57872 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191339.043491:0:57872:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc6:0x0](ffff936b5395f448), inode mode 81a4 mask 40 00000080:00200000:1.0:1787191339.043544:0:57872:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc6:0x0](ffff936b5395f448), inode mode 81a4 mask 2 00000080:00200000:1.0:1787191339.043553:0:57872:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xc6:0x0](ffff936b5395f448), xattr lov 00000002:00010000:1.0:1787191339.043570:0:57872:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc6:0x0]) in obj [0x200000405:0xc6:0x0], intent: open flags 040000002 00010000:00010000:1.0:1787191339.043611:0:57872:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc884839fc3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.043624:0:57872:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc884839fc3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191339.043635:0:57872:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:1.0:1787191339.043641:0:57872:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9500 x1874004626650752/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191339.043650:0:57872:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc884839fc3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191339.043668:0:57872:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57872:1874004626650752:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191339.043886:0:57872:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893780 going to sleep for 11 seconds 00000100:00100000:1.0:1787191339.048384:0:57870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57870:1874004626650240:192.168.202.101@tcp:36:lfs.0 00010000:00010000:1.0:1787191339.048435:0:57870:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/197 (0 0) 00000080:00010000:1.0:1787191339.048447:0:57870:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xc5:0x0](ffff936b489a9988) 00000002:00010000:1.0:1787191339.048459:0:57870:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc5:0x0]) in obj [0x200000405:0xc5:0x0], intent: layout flags 0 00010000:00010000:1.0:1787191339.048506:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839fca lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.048516:0:57870:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839fca lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.048526:0:57870:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839fca lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57870 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191339.048545:0:57870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57870:1874004626650880:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191339.048695:0:57870:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893480 going to sleep for 11 seconds 00000100:00100000:2.0:1787191339.049677:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191339.050105:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634880640 00000100:00100000:3.0:1787191339.050114:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634880640 00000100:00100000:3.0:1787191339.055541:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1313 00000100:00100000:3.0:1787191339.055558:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634880640:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191339.055578:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839fbc lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4604b24 expref: -99 pid: 57872 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191339.055667:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191339.055675:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634880640:12345-192.168.202.101@tcp:104: Request processed in 123us (6001us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191339.055682:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1313 00000100:00100000:1.0:1787191339.055977:0:57870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57870:1874004626650880:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191339.055999:0:57870:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839fca lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604b40 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.056013:0:57870:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839fca lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604b40 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191339.056027:0:57870:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b453ab800 x1874004626650880/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191339.056039:0:57870:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839fca lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604b40 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191339.056062:0:57870:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839fca lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604b40 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.056073:0:57870:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/197 (0 0) 00000080:00200000:1.0:1787191339.056080:0:57870:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xc5:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191339.056098:0:57870:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc5:0x0](ffff936b489a9988) for lock 0xe5129dc884839fca 00000080:00010000:1.0:1787191339.056107:0:57870:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839fca from it ffffa3fb421bbc70 00010000:00010000:1.0:1787191339.056111:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839fca lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604b40 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.056121:0:57870:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839fca lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604b40 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.056152:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839fca lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604b40 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.056165:0:57870:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839fca lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604b40 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:1.0:1787191339.056176:0:57870:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xc5:0x0](00000000fb2aac00) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839fca lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604b40 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.056230:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839fca lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604b40 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.056239:0:57870:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839fca lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604b40 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191339.056254:0:57870:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1787191339.056265:0:57870:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc5:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191339.056268:0:57870:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191339.056276:0:57870:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191339.056286:0:57870:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191339.056304:0:57870:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:1.0:1787191339.056317:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839fca lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604b40 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191339.056326:0:57870:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839fca lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604b40 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:1.0:1787191339.056333:0:57870:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xc5:0x0](00000000fb2aac00) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839fca lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604b40 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191339.056348:0:57870:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1787191339.056352:0:57870:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc5:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191339.056355:0:57870:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191339.056357:0:57870:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191339.056361:0:57870:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191339.056367:0:57870:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:1.0:1787191339.056391:0:57870:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191338 1787191338 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839f7d lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x1ae:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604a3d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191339.056456:0:57870:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc5:0x0]: layout version change: 4294967294 -> 5 00010000:00010000:1.0:1787191339.056461:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839fca lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604b40 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191339.056469:0:57870:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839fca lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604b40 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200080:1.0:1787191339.056491:0:57870:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988) cmd=66f4 arg=ca42e0 00000080:00200008:1.0:1787191339.056502:0:57870:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc5:0x0](ffff936b489a9988), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191339.056511:0:57870:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988),name=f70.sanity-flr 00000002:00010000:1.0:1787191339.056526:0:57870:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc5:0x0]) in obj [0x200000405:0xc5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.056532:0:57870:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 30 res 8589935621/197 (0 0) 00010000:00010000:1.0:1787191339.056572:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fd1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.056580:0:57870:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fd1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.056590:0:57870:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fd1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57870 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191339.056611:0:57870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57870:1874004626651008:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191339.056670:0:57870:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893480 going to sleep for 11 seconds 00010000:00010000:0.0:1787191339.057377:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191339.057385:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839fbc lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4604b24 expref: -99 pid: 57872 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.057394:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b4150b400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191339.057399:0:43384:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839fbc lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4604b24 expref: -99 pid: 57872 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.057413:0:43384:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839fbc lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4604b24 expref: -99 pid: 57872 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.057421:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839fbc lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4604b24 expref: -99 pid: 57872 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191339.057438:0:43384:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc6:0x0]: losing layout lock 00010000:00010000:0.0:1787191339.057475:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839fbc lrc: 2/0,0 mode: --/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4604b24 expref: -99 pid: 57872 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.057482:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191339.057512:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839fbc lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4604b24 expref: -99 pid: 57872 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.057520:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc884839fbc lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4604b24 expref: -99 pid: 57872 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.057533:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191339.057535:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191339.057536:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191339.057544:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787191339.057557:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626651136:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191339.060522:0:57870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57870:1874004626651008:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191339.060547:0:57870:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fd1 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604b4e expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.060560:0:57870:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fd1 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604b4e expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.060571:0:57870:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fd1 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604b4e expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.060581:0:57870:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fd1 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604b4e expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.060594:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fd1 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604b4e expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.060603:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fd1 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604b4e expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.060611:0:57870:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fd1 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604b4e expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191339.060622:0:57870:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b453ab800 x1874004626651008/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/976 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191339.060633:0:57870:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604b4e expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191339.060644:0:57870:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604b4e expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.060655:0:57870:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/197 (0 0) 00000080:00200000:1.0:1787191339.060661:0:57870:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xc5:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787191339.060721:0:57870:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc5:0x0]: layout version change: 5 -> 5 00000080:00010000:1.0:1787191339.060726:0:57870:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc5:0x0](ffff936b489a9988) for lock 0xe5129dc884839fd1 00000080:00010000:1.0:1787191339.060732:0:57870:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc5:0x0](ffff936b489a9988) 00000080:00010000:1.0:1787191339.060735:0:57870:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839fd1 from it ffffa3fb421bbcd8 00010000:00010000:1.0:1787191339.060738:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604b4e expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.060746:0:57870:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fd1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604b4e expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191339.060778:0:57870:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc5:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:1.0:1787191339.060803:0:57870:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc5:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191339.060807:0:57870:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191339.060810:0:57870:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc5:0x0] 00000008:00010000:1.0:1787191339.060828:0:57870:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191339.060855:0:57870:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b47d7d330, osc lock ffff936b468365f0, flags 0x400000400001002 00010000:00010000:1.0:1787191339.060905:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.060913:0:57870:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.060920:0:57870:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b453ab800 x1874004626651264/t0(0) o101->lustre-OST0001-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:1.0:1787191339.060945:0:57870:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:1.0:1787191339.060953:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787191339.060964:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626651264:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191339.061158:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626651136:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787191339.063760:0:2390:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.063805:0:2390:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.063819:0:2390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.063847:0:2390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191339.063862:0:2390:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 5, setting rss=5; kms=5, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 5/2,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1787191339.063872:0:2390:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1787191339.063891:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.063899:0:2390:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.063907:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.063916:0:2390:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1787191339.063939:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626651264:192.168.202.101@tcp:101:lfs.0 00000080:00200000:3.0:1787191339.064016:0:57870:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc5:0x0] updating i_size 5 i_blocks 8 00000020:00010000:3.0:1787191339.064023:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51657530 (ffff936b465cc488/0) at cl_lock_release():245 00000020:00010000:3.0:1787191339.064026:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51657530 (ffff936b465cc488/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191339.064031:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7d330 (ffff936b465cce18/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191339.064035:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51657530 (ffff936b465cc488/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191339.064037:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7d330 (ffff936b465cc488/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191339.064062:0:57870:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc5:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:1.0:1787191339.066828:0:57872:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57872:1874004626650752:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191339.066864:0:57872:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc884839fc3 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.066876:0:57872:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc884839fc3 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.066883:0:57872:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc884839fc3 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.066890:0:57872:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc884839fc3 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xc6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.066900:0:57872:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc884839fc3 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xc6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.066907:0:57872:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b4150b800 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191339.066911:0:57872:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc884839fc3 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xc6:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.066918:0:57872:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc884839fc3 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xc6:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.066925:0:57872:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc884839fc3 lrc: 5/0,0 mode: --/CR res: [0x200000405:0xc6:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.066937:0:57872:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191339.066942:0:57872:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc884839fc3 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xc6:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.066949:0:57872:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b800/0xe5129dc884839fc3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc6:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57872 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191339.066971:0:57872:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b453a9500 x1874004626650752/t8589936778(8589936778) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191339.066985:0:57872:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9500 x1874004626650752/t8589936778(8589936778) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191339.067002:0:57872:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xc6:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787191339.067096:0:57872:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1787191339.067104:0:57872:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191339.067164:0:57872:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xc6:0x0], updating i_size 0 00000002:00100000:1.0:1787191339.067183:0:57872:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9500 x1874004626650752/t8589936778(8589936778) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191339.067220:0:57872:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a9500 x1874004626650752/t8589936778(8589936778) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191339.067230:0:57872:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191339.067236:0:57872:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9180 x1874004626651520/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191339.067256:0:57872:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57872:1874004626651520:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191339.067346:0:57872:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893780 going to sleep for 11 seconds 00000100:00100000:1.0:1787191339.074497:0:57872:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57872:1874004626651520:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191339.074551:0:57872:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a9500 x1874004626650752/t8589936778(8589936778) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1787191339.075087:0:57872:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc6:0x0](ffff936b5395f448), flags 100001 00000002:00100000:1.0:1787191339.075157:0:57872:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a8a80 x1874004626650496/t8589936777(8589936777) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191355 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191339.075168:0:57872:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191339.075174:0:57872:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453ab800 x1874004626651776/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191339.075209:0:57872:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57872:1874004626651776:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191339.075817:0:57872:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893780 going to sleep for 11 seconds 00000100:00100000:1.0:1787191339.078083:0:57872:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57872:1874004626651776:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191339.078127:0:57872:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a8a80 x1874004626650496/t8589936777(8589936777) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191339.081574:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191339.081727:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.081745:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.081761:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.081770:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191339.081780:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191339.081784:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191339.081984:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:1.0:1787191339.081989:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.082078:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.082098:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191339.082107:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191339.082114:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191339.082192:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:1.0:1787191339.082198:0:57570:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b43c57800, open_flags 8241, mode 81b6 opened 0 00000080:00200000:1.0:1787191339.082208:0:57570:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:1.0:1787191339.082229:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xc7:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0101102 00010000:00010000:1.0:1787191339.082287:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839fdf lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.082295:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839fdf lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191339.082309:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191339.082324:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9c00 x1874004626652032/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191339.082335:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839fdf lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191339.082361:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626652032:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191339.082603:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893780 going to sleep for 11 seconds 00000100:00100000:1.0:1787191339.092724:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626652032:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191339.092753:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839fdf lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604b78 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.092783:0:57570:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839fdf lrc: 4/0,1 mode: --/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604b78 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.093086:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839fdf lrc: 4/0,1 mode: --/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604b78 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.093099:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839fdf lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604b78 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.093113:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839fdf lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604b78 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.093127:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839fdf lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604b78 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.093134:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839fdf lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604b78 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.093141:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839fdf lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604b78 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191339.093482:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x2b, status=0 req@ffff936b453a9c00 x1874004626652032/t8589936781(8589936781) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191339.093496:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9c00 x1874004626652032/t8589936781(8589936781) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191339.093511:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839fdf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604b78 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191339.093528:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839fdf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604b78 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.093538:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/198 (0 0) 00000080:00200000:1.0:1787191339.093544:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191339.093905:0:57570:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xc6:0x0](ffff936b5395f448): rc = 0 00000080:00200000:1.0:1787191339.093928:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc6:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:1.0:1787191339.093934:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc6:0x0](ffff936b5395f448) for lock 0xe5129dc884839fdf 00000080:00010000:1.0:1787191339.093946:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc6:0x0](ffff936b5395f448) 00000080:00200008:1.0:1787191339.093963:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc6:0x0](ffff936b5395f448), flags 101101 00000002:00100000:1.0:1787191339.093987:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9c00 x1874004626652032/t8589936781(8589936781) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191339.094367:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839fdf from it ffff936b5339fba0 00010000:00010000:1.0:1787191339.094373:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839fdf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604b78 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.094383:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839fdf lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604b78 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191339.094661:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc6:0x0](ffff936b5395f448), inode mode 81a4 mask 42 00000002:00010000:1.0:1787191339.094692:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xc6:0x0], intent: getxattr flags 0 00010000:00010000:1.0:1787191339.094732:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839fe6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.094745:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839fe6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.094755:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839fe6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191339.094775:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626652160:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191339.095496:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893780 going to sleep for 11 seconds 00000100:00100000:1.0:1787191339.101391:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626652160:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191339.101428:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839fe6 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604b8d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.101444:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839fe6 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604b8d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.101456:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839fe6 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604b8d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191339.101470:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b453abb80 x1874004626652160/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191339.101481:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604b8d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.101491:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/198 (0 0) 00000080:00200000:1.0:1787191339.101497:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xc6:0x0] suppgids 0 -1: rc 0 00000080:00010000:1.0:1787191339.101522:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc6:0x0](ffff936b5395f448) for lock 0xe5129dc884839fe6 00000080:00010000:1.0:1787191339.101531:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839fe6 from it ffffa3fb41caba38 00010000:00010000:1.0:1787191339.101536:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604b8d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.101544:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839fe6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604b8d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:1.0:1787191339.101580:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xc6:0x0](ffff936b5395f448) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191339.000000000, mtime 1787191339.000000000, ctime 1787191339.000000000 00010000:00010000:1.0:1787191339.101674:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839fdf lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4604b78 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191339.101694:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc6:0x0]: losing layout lock 00010000:00010000:1.0:1787191339.101732:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839fdf lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604b78 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.101738:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191339.101740:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bd400/0xe5129dc884839fdf lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604b78 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1787191339.101759:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1787191339.101765:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453abb80 x1874004626652416/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787191339.101906:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626652416:192.168.202.101@tcp:36:bash.0 00000100:00100000:1.0:1787191339.101975:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893780 going to sleep for 11 seconds 00000100:00100000:1.0:1787191339.113411:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626652416:192.168.202.101@tcp:36:bash.0 00000080:00200000:1.0:1787191339.113539:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:1.0:1787191339.113546:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc6:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00010000:00010000:1.0:1787191339.113562:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/198 (0 0) 00000080:00010000:1.0:1787191339.113571:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xc6:0x0](ffff936b5395f448) 00000002:00010000:1.0:1787191339.113580:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc6:0x0]) in obj [0x200000405:0xc6:0x0], intent: layout flags 0 00010000:00010000:1.0:1787191339.113618:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839fed lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.113624:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839fed lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.113631:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839fed lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191339.113645:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626652544:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191339.113719:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893780 going to sleep for 11 seconds 00000080:00200080:0.0:1787191339.115600:0:57870:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988) cmd=400866b1 arg=1 00000080:00200008:0.0:1787191339.115617:0:57870:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc5:0x0](ffff936b489a9988), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191339.115625:0:57870:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988),name=f70.sanity-flr 00000002:00010000:0.0:1787191339.115643:0:57870:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc5:0x0]) in obj [0x200000405:0xc5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.115660:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fd1 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604b4e expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.115674:0:57870:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fd1 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604b4e expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191339.115682:0:57870:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xc5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191339.115690:0:57870:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc5:0x0](ffff936b489a9988) 00000080:00010000:0.0:1787191339.115693:0:57870:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc5:0x0](ffff936b489a9988) for lock 0xe5129dc884839fd1 00000080:00010000:0.0:1787191339.115701:0:57870:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839fd1 from it ffffa3fb421bbcd8 00010000:00010000:0.0:1787191339.115705:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604b4e expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.115714:0:57870:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fd1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604b4e expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191339.115741:0:57870:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc5:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:0.0:1787191339.115752:0:57870:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc5:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191339.115755:0:57870:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191339.115759:0:57870:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc5:0x0] 00000008:00010000:0.0:1787191339.115782:0:57870:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191339.115785:0:57870:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b46b503b0, osc lock ffff936b50b63560, flags 0x400000400001002 00010000:00010000:0.0:1787191339.115800:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.115811:0:57870:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:0.0:1787191339.115822:0:57870:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191339.115826:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.115853:0:57870:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:0.0:1787191339.115863:0:57870:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191339.115874:0:57870:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc5:0x0] updating i_size 5 i_blocks 8 00000020:00010000:0.0:1787191339.115877:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c3a060 (ffff936b47a17ab8/0) at cl_lock_release():245 00000020:00010000:0.0:1787191339.115881:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c3a060 (ffff936b47a17ab8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191339.115884:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b46b503b0 (ffff936b47a17b48/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191339.115888:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c3a060 (ffff936b47a17ab8/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191339.115890:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b46b503b0 (ffff936b47a17ab8/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191339.115901:0:57870:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc5:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1787191339.115914:0:57870:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xc5:0x0], offset: 0, type: SEEK_DATA 00000080:00200000:0.0:1787191339.115919:0:57870:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc5:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:0.0:1787191339.115923:0:57870:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc5:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191339.115925:0:57870:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191339.115931:0:57870:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191339.115935:0:57870:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191339.115948:0:57870:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc5:0x0] updating i_size 5 i_blocks 8 00000080:00200000:0.0:1787191339.115955:0:57870:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc5:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191339.115960:0:57870:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000080:00200000:0.0:1787191339.115962:0:57870:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc5:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191339.115966:0:57870:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191339.115968:0:57870:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191339.115971:0:57870:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:0.0:1787191339.115976:0:57870:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:0.0:1787191339.115978:0:57870:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b46b503b0, osc lock ffff936b50b63560, flags 0x0 00010000:00010000:0.0:1787191339.115985:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191339.115993:0:57870:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191339.116002:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191339.116010:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191339.116016:0:57870:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191339.116024:0:57870:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc5:0x0] updating i_size 5 i_blocks 8 00000100:00100000:0.0:1787191339.116103:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787191339.116123:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626652672:192.168.202.101@tcp:23:lfs.0 00000100:00100000:1.0:1787191339.118365:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626652544:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191339.118392:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839fed lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xc6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604b9b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.118403:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839fed lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xc6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604b9b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191339.118637:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b453ab100 x1874004626652544/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191339.118648:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839fed lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604b9b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191339.118658:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839fed lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604b9b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.118665:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/198 (0 0) 00000080:00200000:1.0:1787191339.118670:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xc6:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191339.118685:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc6:0x0](ffff936b5395f448) for lock 0xe5129dc884839fed 00000080:00010000:1.0:1787191339.118690:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839fed from it ffffa3fb41cab8c8 00010000:00010000:1.0:1787191339.118693:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839fed lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604b9b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.118699:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839fed lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604b9b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.118716:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839fed lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604b9b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.118724:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839fed lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604b9b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:1.0:1787191339.118730:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xc6:0x0](00000000d13126ac) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839fed lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604b9b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191339.118762:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc6:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:1.0:1787191339.118765:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839fed lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604b9b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.118770:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839fed lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604b9b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:1.0:1787191339.118781:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xc6:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:1.0:1787191339.118787:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc6:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191339.118789:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xc6:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:1.0:1787191339.118795:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xc6:0x0](ffff936b5395f448) 00000002:00010000:1.0:1787191339.118801:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc6:0x0]) in obj [0x200000405:0xc6:0x0], intent: layout flags 02 00010000:00010000:1.0:1787191339.118811:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839fed lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4604b9b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191339.118819:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc6:0x0]: losing layout lock 00010000:00010000:1.0:1787191339.118978:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839fed lrc: 1/0,0 mode: --/CR res: [0x200000405:0xc6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604b9b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191339.118984:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191339.118986:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bcc00/0xe5129dc884839fed lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604b9b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191339.119003:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc884839ff4 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xc6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.119007:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc884839ff4 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xc6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191339.119014:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191339.119019:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453ab100 x1874004626652928/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191339.119025:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc884839ff4 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xc6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191339.119038:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626652928:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191339.119111:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893780 going to sleep for 11 seconds 00000100:00100000:0.0:1787191339.124206:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626652672:192.168.202.101@tcp:23:lfs.0 00000020:00010000:1.0:1787191339.124508:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b53cc58a8 (ffff936b47a17ab8/0) at cl_lock_release():245 00000020:00010000:1.0:1787191339.124513:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b53cc58a8 (ffff936b47a17ab8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191339.124519:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b46b503b0 (ffff936b47a17b48/1) at cl_lock_cancel():142 00010000:00010000:1.0:1787191339.124528:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191339.124544:0:57870:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00010000:1.0:1787191339.124559:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b53cc58a8 (ffff936b47a17ab8/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191339.124562:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b46b503b0 (ffff936b47a17ab8/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191339.124577:0:57870:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc5:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1787191339.124589:0:57870:0:(file.c:5244:ll_file_seek()) COMPLETED file f70.sanity-flr:[0x200000405:0xc5:0x0], offset: 0, type: SEEK_DATA, rc = 0 00000080:00200008:1.0:1787191339.124600:0:57870:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xc5:0x0], offset: 0, type: SEEK_HOLE 00000080:00200000:1.0:1787191339.124608:0:57870:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc5:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:1.0:1787191339.124615:0:57870:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc5:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191339.124618:0:57870:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191339.124623:0:57870:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191339.124631:0:57870:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191339.124647:0:57870:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc5:0x0] updating i_size 5 i_blocks 8 00000080:00200000:1.0:1787191339.124652:0:57870:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc5:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191339.124657:0:57870:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000080:00200000:1.0:1787191339.124660:0:57870:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc5:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:1.0:1787191339.124665:0:57870:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191339.124668:0:57870:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191339.124670:0:57870:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:1.0:1787191339.124681:0:57870:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:1.0:1787191339.124684:0:57870:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b47d7d1b0, osc lock ffff936b46836260, flags 0x0 00010000:00010000:1.0:1787191339.124703:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191339.124717:0:57870:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191339.124727:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191339.124736:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191339.124743:0:57870:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191339.124754:0:57870:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc5:0x0] updating i_size 5 i_blocks 8 00000100:00100000:0.0:1787191339.124829:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626653056:192.168.202.101@tcp:23:lfs.0 00000100:00100000:1.0:1787191339.127041:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626653056:192.168.202.101@tcp:23:lfs.0 00000020:00010000:2.0:1787191339.127320:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b53cc58a8 (ffff936b47a17ab8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191339.127325:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b53cc58a8 (ffff936b47a17ab8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191339.127330:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7d1b0 (ffff936b47a17b48/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191339.127341:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191339.127357:0:57870:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00010000:2.0:1787191339.127373:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b53cc58a8 (ffff936b47a17ab8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191339.127376:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7d1b0 (ffff936b47a17ab8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191339.127420:0:57870:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc5:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191339.127441:0:57870:0:(file.c:5244:ll_file_seek()) COMPLETED file f70.sanity-flr:[0x200000405:0xc5:0x0], offset: 0, type: SEEK_HOLE, rc = 5 00000080:00200080:2.0:1787191339.127458:0:57870:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988) cmd=400866b1 arg=0 00000080:00200080:2.0:1787191339.127469:0:57870:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988) cmd=400866b1 arg=1 00000080:00200008:2.0:1787191339.127477:0:57870:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc5:0x0](ffff936b489a9988), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191339.127486:0:57870:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988),name=f70.sanity-flr 00000002:00010000:2.0:1787191339.127512:0:57870:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc5:0x0]) in obj [0x200000405:0xc5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191339.127528:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fd1 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604b4e expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191339.127541:0:57870:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fd1 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604b4e expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191339.127548:0:57870:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xc5:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191339.127557:0:57870:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc5:0x0](ffff936b489a9988) 00000080:00010000:2.0:1787191339.127561:0:57870:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc5:0x0](ffff936b489a9988) for lock 0xe5129dc884839fd1 00000080:00010000:2.0:1787191339.127567:0:57870:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839fd1 from it ffffa3fb421bbcd8 00010000:00010000:2.0:1787191339.127570:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604b4e expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191339.127577:0:57870:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fd1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604b4e expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191339.127598:0:57870:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc5:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:2.0:1787191339.127609:0:57870:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc5:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191339.127613:0:57870:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191339.127616:0:57870:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc5:0x0] 00000008:00010000:2.0:1787191339.127635:0:57870:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191339.127638:0:57870:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1230, osc lock ffff936b44e62130, flags 0x400000400001002 00010000:00010000:2.0:1787191339.127653:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191339.127662:0:57870:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:2.0:1787191339.128605:0:57870:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191339.128610:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191339.128619:0:57870:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000020:00200000:2.0:1787191339.128632:0:57870:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191339.128643:0:57870:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc5:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191339.128648:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51656750 (ffff936b465ccbd8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191339.128651:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51656750 (ffff936b465ccbd8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191339.128654:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1230 (ffff936b465cc008/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191339.128657:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51656750 (ffff936b465ccbd8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191339.128660:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1230 (ffff936b465ccbd8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191339.128679:0:57870:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc5:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191339.128704:0:57870:0:(file.c:2483:do_file_read_iter()) START file f70.sanity-flr:[0x200000405:0xc5:0x0], ppos: 0, count: 4096 00000080:00200000:2.0:1787191339.128713:0:57870:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: read ppos: 0, bytes: 4096 00000080:00200000:2.0:1787191339.128722:0:57870:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000020:00200000:2.0:1787191339.128729:0:57870:0:(cl_io.c:214:cl_io_rw_init()) header@000000003dfeb733[0x110, 2, [0x200000405:0xc5:0x0] hash] 00000020:00200000:2.0:1787191339.128731:0:57870:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 4096) 2048 0 00000080:00200000:2.0:1787191339.128734:0:57870:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc5:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00000080:00200000:2.0:1787191339.128745:0:57870:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1787191339.128753:0:57870:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:2.0:1787191339.128756:0:57870:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1787191339.128769:0:57870:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:2.0:1787191339.128777:0:57870:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:2.0:1787191339.128780:0:57870:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1230, osc lock ffff936b44e62130, flags 0x40000 00000080:00200000:2.0:1787191339.129317:0:57870:0:(vvp_io.c:835:vvp_io_read_start()) f70.sanity-flr: read [0, 4096) 00000001:00010000:2.0:1787191339.129325:0:57870:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc5:0x0] 00000008:00010000:2.0:1787191339.129331:0:57870:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191339.129333:0:57870:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1db0, osc lock ffff936b44e62d10, flags 0x400001002 00010000:00010000:2.0:1787191339.129346:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1787191339.129359:0:57870:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000020:00200000:2.0:1787191339.129368:0:57870:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191339.129371:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1787191339.129380:0:57870:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00000020:00200000:2.0:1787191339.129390:0:57870:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191339.129393:0:57870:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc5:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191339.129396:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51656750 (ffff936b465ccbd8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191339.129398:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51656750 (ffff936b465ccbd8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191339.129400:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1db0 (ffff936b465cc008/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191339.129403:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51656750 (ffff936b465ccbd8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191339.129406:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1db0 (ffff936b465ccbd8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191339.129414:0:57870:0:(vvp_io.c:893:vvp_io_read_start()) count:4096 iocb pos:0 00000080:00200000:2.0:1787191339.129420:0:57870:0:(rw26.c:362:ll_direct_IO()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988), size=4096 (max 536870912), offset=0=0x0, pages 1 (max 131072), lockless, parallel 00000020:00200000:2.0:1787191339.129465:0:57870:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1787191339.129467:0:57870:0:(rw26.c:544:ll_direct_IO()) result 0 tot_bytes 5 count 5 file_offset 5 00000020:00010000:2.0:1787191339.129473:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b504217b8 (ffff936b465ccbd8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191339.129475:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b504217b8 (ffff936b465ccbd8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191339.129478:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1230 (ffff936b465cc008/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191339.129480:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b504217b8 (ffff936b465ccbd8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191339.129482:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1230 (ffff936b465ccbd8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191339.129487:0:57870:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000020:00200000:2.0:1787191339.129491:0:57870:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1787191339.129510:0:25580:0:(osc_cache.c:2029:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff936b46699300 00000008:00100000:2.0:1787191339.129551:0:25580:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff936b513b9880 - object 0x2c0000401:433 offset 0<>5 00000100:00100000:2.0:1787191339.129592:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626653184:192.168.202.101@tcp:3:lfs.0 00000100:00100000:1.0:1787191339.135114:0:57570:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589936784 gen 1 00000100:00100000:1.0:1787191339.135198:0:57570:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b453a9c00 x1874004626652032/t8589936781(8589936781) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191355 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787191339.135462:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626652928:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191339.135489:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc884839ff4 lrc: 4/0,1 mode: --/EX res: [0x200000405:0xc6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604ba9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.135503:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc884839ff4 lrc: 4/0,1 mode: --/CR res: [0x200000405:0xc6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604ba9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.135524:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc884839ff4 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xc6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604ba9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.135535:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc884839ff4 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xc6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604ba9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.135548:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc884839ff4 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xc6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604ba9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.135556:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc884839ff4 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xc6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604ba9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.135564:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc884839ff4 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xc6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604ba9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191339.135574:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b453ab100 x1874004626652928/t8589936784(8589936784) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191339.135592:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc884839ff4 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604ba9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191339.135604:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc884839ff4 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604ba9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.135614:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/198 (0 0) 00000080:00200000:1.0:1787191339.135620:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xc6:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191339.135630:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc6:0x0](ffff936b5395f448) for lock 0xe5129dc884839ff4 00000080:00010000:1.0:1787191339.135639:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839ff4 from it ffffa3fb41cab930 00010000:00010000:1.0:1787191339.135642:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc884839ff4 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604ba9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.135650:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc884839ff4 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604ba9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191339.135676:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:1.0:1787191339.135683:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc6:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:1.0:1787191339.135700:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc884839ff4 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604ba9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.135711:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc884839ff4 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604ba9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:1.0:1787191339.135719:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xc6:0x0](00000000d13126ac) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc884839ff4 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604ba9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.135760:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc884839ff4 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604ba9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.135768:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc884839ff4 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604ba9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191339.135783:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1787191339.135793:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc6:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191339.135797:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000008:00010000:3.0:1787191339.135882:0:2392:0:(osc_cache.c:917:osc_extent_finish()) ### no dlm lock: extent: ffff936b46699300 00000020:00200000:3.0:1787191339.135890:0:2392:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1787191339.135898:0:2392:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1787191339.135916:0:2392:0:(osc_cache.c:497:__osc_extent_remove()) ### no dlm lock: extent: ffff936b46699300 00000100:00100000:3.0:1787191339.135935:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626653184:192.168.202.101@tcp:3:lfs.0 00000080:00200000:2.0:1787191339.136066:0:57870:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1787191339.136077:0:57870:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc5:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191339.136082:0:57870:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 1 io complete with rc: 0, result: 5, restart: 0 00000020:00200000:2.0:1787191339.136086:0:57870:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191339.136093:0:57870:0:(file.c:2324:ll_file_io_generic()) iot: 1, result: 5 00000080:00200080:2.0:1787191339.136113:0:57870:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988) cmd=400866b1 arg=0 00000080:00200080:2.0:1787191339.136122:0:57870:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988) cmd=400866b1 arg=2 00000080:00200008:2.0:1787191339.136138:0:57870:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc5:0x0](ffff936b489a9988), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191339.136146:0:57870:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988),name=f70.sanity-flr 00000002:00010000:2.0:1787191339.136159:0:57870:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc5:0x0]) in obj [0x200000405:0xc5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191339.136169:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fd1 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604b4e expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191339.136180:0:57870:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fd1 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604b4e expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191339.136187:0:57870:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xc5:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191339.136193:0:57870:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc5:0x0](ffff936b489a9988) 00000080:00010000:2.0:1787191339.136196:0:57870:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc5:0x0](ffff936b489a9988) for lock 0xe5129dc884839fd1 00000080:00010000:2.0:1787191339.136201:0:57870:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839fd1 from it ffffa3fb421bbcd8 00010000:00010000:2.0:1787191339.136204:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604b4e expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191339.136212:0:57870:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fd1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604b4e expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:2.0:1787191339.136227:0:57870:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc5:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:2.0:1787191339.136237:0:57870:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc5:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191339.136345:0:57870:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191339.136349:0:57870:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc5:0x0] 00000008:00010000:2.0:1787191339.136368:0:57870:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191339.136371:0:57870:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1230, osc lock ffff936b44e62130, flags 0x400000400001002 00010000:00010000:2.0:1787191339.136386:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00010000:00010000:2.0:1787191339.136397:0:57870:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00000020:00200000:2.0:1787191339.136407:0:57870:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191339.136410:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00010000:00010000:2.0:1787191339.136418:0:57870:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 1 00000020:00200000:2.0:1787191339.136428:0:57870:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191339.136436:0:57870:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc5:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191339.136439:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51656750 (ffff936b465ccbd8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191339.136442:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51656750 (ffff936b465ccbd8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191339.136445:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1230 (ffff936b465cc008/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191339.136449:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51656750 (ffff936b465ccbd8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191339.136452:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1230 (ffff936b465ccbd8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191339.136460:0:57870:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc5:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191339.136479:0:57870:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xc5:0x0], ppos: 0, count: 4096 00000080:00200000:2.0:1787191339.136485:0:57870:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 4096 00000080:00200000:2.0:1787191339.136491:0:57870:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 2 00000020:00200000:2.0:1787191339.136497:0:57870:0:(cl_io.c:214:cl_io_rw_init()) header@000000003dfeb733[0x110, 2, [0x200000405:0xc5:0x0] hash] 00000020:00200000:2.0:1787191339.136499:0:57870:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 4096) 2048 0 00000080:00200000:2.0:1787191339.136502:0:57870:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc5:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00000080:00200000:2.0:1787191339.136511:0:57870:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1787191339.136517:0:57870:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:2.0:1787191339.136521:0:57870:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x11 00000080:00200000:2.0:1787191339.136533:0:57870:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:2.0:1787191339.136540:0:57870:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:2.0:1787191339.136543:0:57870:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1230, osc lock ffff936b44e62130, flags 0x40000 00000080:00200000:2.0:1787191339.136550:0:57870:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 4096) append 0 append lockpos 0 00000002:00010000:2.0:1787191339.136568:0:57870:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xc5:0x0], intent: getxattr flags 0 00010000:00010000:2.0:1787191339.136603:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc884839ffb lrc: 3/1,0 mode: --/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.136611:0:57870:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc884839ffb lrc: 3/1,0 mode: --/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.136621:0:57870:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc884839ffb lrc: 3/1,0 mode: --/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57870 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191339.136640:0:57870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57870:1874004626653312:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191339.136819:0:57870:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f9c0 going to sleep for 11 seconds 00020000:00200000:1.0:1787191339.138858:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:1.0:1787191339.138944:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:1.0:1787191339.138974:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc884839ff4 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604ba9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191339.138991:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc884839ff4 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604ba9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:1.0:1787191339.139002:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xc6:0x0](00000000d13126ac) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc884839ff4 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604ba9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191339.139040:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1787191339.139060:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc6:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191339.139064:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191339.139067:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:1.0:1787191339.139093:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191339.139171:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc6:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:1.0:1787191339.139177:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc884839ff4 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604ba9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191339.139187:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc884839ff4 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604ba9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00020000:00200000:1.0:1787191339.139204:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xc6:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:1.0:1787191339.139208:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc6:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191339.139211:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191339.139217:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191339.139226:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191339.139229:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:1.0:1787191339.139240:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:1.0:1787191339.139244:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b628937b0, osc lock ffff936b46837300, flags 0x80000000 00000008:00010000:1.0:1787191339.139248:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:1.0:1787191339.139250:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b628937f0, osc lock ffff936b46837c80, flags 0x80000000 00010000:00010000:1.0:1787191339.139294:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a002 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.139304:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a002 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.139314:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a002 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191339.139339:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626653440:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191339.139421:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893480 going to sleep for 11 seconds 00000100:00100000:1.0:1787191339.148371:0:57870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57870:1874004626653312:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191339.148398:0:57870:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc884839ffb lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604bbe expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.148415:0:57870:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc884839ffb lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604bbe expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.148425:0:57870:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc884839ffb lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604bbe expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191339.148438:0:57870:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b513b8e00 x1874004626653312/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1408 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191339.148455:0:57870:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc884839ffb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604bbe expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.148471:0:57870:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/197 (0 0) 00000080:00200000:1.0:1787191339.148478:0:57870:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xc5:0x0] suppgids 0 -1: rc 0 00000080:00010000:1.0:1787191339.148502:0:57870:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc5:0x0](ffff936b489a9988) for lock 0xe5129dc884839ffb 00000080:00010000:1.0:1787191339.148510:0:57870:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839ffb from it ffffa3fb421bb8e8 00010000:00010000:1.0:1787191339.148514:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc884839ffb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604bbe expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.148523:0:57870:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4a00/0xe5129dc884839ffb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604bbe expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191339.148561:0:57870:0:(rw26.c:362:ll_direct_IO()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988), size=4096 (max 536870912), offset=0=0x0, pages 1 (max 131072), lockless, parallel 00000020:00200000:1.0:1787191339.148625:0:57870:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:1.0:1787191339.148628:0:57870:0:(rw26.c:544:ll_direct_IO()) result 0 tot_bytes 4096 count 4096 file_offset 4096 00000080:00200000:1.0:1787191339.148644:0:57870:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc5:0x0] updating i_size 5 i_blocks 8 00000020:00010000:1.0:1787191339.148649:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b504217b8 (ffff936b465ccbd8/0) at cl_lock_release():245 00000020:00010000:1.0:1787191339.148653:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b504217b8 (ffff936b465ccbd8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191339.148657:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1230 (ffff936b465cc008/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191339.148660:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b504217b8 (ffff936b465ccbd8/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191339.148663:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1230 (ffff936b465ccbd8/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191339.148672:0:57870:0:(vvp_io.c:533:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:1.0:1787191339.148679:0:57870:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:1.0:1787191339.148697:0:40871:0:(osc_cache.c:2029:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff936b48690180 00000008:00100000:1.0:1787191339.148775:0:40871:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff936b453abb80 - object 0x280000401:431 offset 0<>4096 00000100:00100000:1.0:1787191339.148825:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626653568:192.168.202.101@tcp:4:lfs.0 00000100:00100000:0.0:1787191339.149896:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626653440:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191339.150020:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a002 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604bc5 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.150038:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a002 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4604bc5 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.150060:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a002 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4604bc5 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.150075:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a002 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4604bc5 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191339.150088:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a002 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4604bc5 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.150099:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a002 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4604bc5 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.150106:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a002 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4604bc5 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.150234:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc88483a009 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.150309:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc88483a009 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.150319:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc88483a009 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191339.150339:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626653696:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191339.150450:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191339.152115:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191339.152308:0:51131:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787191339.152325:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634881280 00000100:00100000:3.0:1787191339.152332:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634881280 00000100:00100000:3.0:1787191339.152420:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1314 00000100:00100000:3.0:1787191339.152431:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b50881c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30133:x1874004634881280:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191339.152448:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839f45 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46049aa expref: -99 pid: 57869 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191339.152520:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191339.152527:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b50881c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30133:x1874004634881280:12345-192.168.202.101@tcp:104: Request processed in 99us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191339.152534:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1314 00010000:00010000:1.0:1787191339.152603:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191339.152610:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839f45 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46049aa expref: -99 pid: 57869 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.152620:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cafe00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191339.152625:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839f45 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e46049aa expref: -99 pid: 57869 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.152664:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839f45 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46049aa expref: -99 pid: 57869 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.152671:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191339.152700:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839f45 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46049aa expref: -99 pid: 57869 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.152708:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc884839f45 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46049aa expref: -99 pid: 57869 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.152728:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191339.152730:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191339.152732:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191339.152744:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787191339.152756:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626653824:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787191339.154333:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191339.154629:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626653696:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191339.154649:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc88483a009 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604bd3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.154666:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc88483a009 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4604bd3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.154677:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc88483a009 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4604bd3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.154690:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc88483a009 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4604bd3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191339.154707:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc88483a009 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4604bd3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.154719:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc88483a009 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4604bd3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.154728:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc88483a009 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4604bd3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191339.154824:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787191339.154866:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626653952:192.168.202.101@tcp:10:bash.0 00000100:00100000:0.0:1787191339.154989:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626654080:192.168.202.101@tcp:10:bash.0 00000100:00100000:0.0:1787191339.157783:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626654080:192.168.202.101@tcp:10:bash.0 00000100:00100000:0.0:1787191339.157816:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626653952:192.168.202.101@tcp:10:bash.0 00000080:00200000:2.0:1787191339.157955:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc6:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191339.157963:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b497c9f38 (ffff936b465ccb48/0) at cl_lock_release():245 00000020:00010000:2.0:1787191339.157966:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b497c9f38 (ffff936b465ccb48/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191339.157971:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b628937b0 (ffff936b465cc6c8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191339.157981:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a002 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4604bc5 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.157998:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a002 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604bc5 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191339.158019:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b628937f0 (ffff936b465cccf8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191339.158024:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc88483a009 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4604bd3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.158032:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc88483a009 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604bd3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191339.158040:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b497c9f38 (ffff936b465ccb48/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191339.158054:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b628937b0 (ffff936b465ccb48/1) at cl_lock_fini():72 00000020:00010000:2.0:1787191339.158060:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b628937f0 (ffff936b465ccb48/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191339.158079:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc6:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191339.158118:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xc6:0x0](ffff936b5395f448) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191339.000000000, mtime 1787191339.000000000, ctime 1787191339.000000000, rc 0 00000080:00200008:2.0:1787191339.158222:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xc6:0x0], ppos: 0, count: 5 00000080:00200000:2.0:1787191339.158235:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191339.158250:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:2.0:1787191339.158255:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:2.0:1787191339.158261:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1787191339.158265:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@00000000c8a6ee3a[0x110, 1, [0x200000405:0xc6:0x0] hash] 00000020:00200000:2.0:1787191339.158267:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:2.0:1787191339.158270:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc6:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191339.158280:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xc6:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:2.0:1787191339.158283:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc6:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191339.158285:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1787191339.158288:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1787191339.158294:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:2.0:1787191339.158297:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1787191339.158310:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:2.0:1787191339.158321:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1787191339.158324:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1db0, osc lock ffff936b44e62d10, flags 0x0 00010000:00010000:2.0:1787191339.158340:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a002 lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604bc5 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191339.158352:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a002 lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604bc5 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191339.158364:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a002 lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4604bc5 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191339.158372:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a002 lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4604bc5 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191339.158378:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a002 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4604bc5 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191339.158390:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:2.0:1787191339.158398:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191339.158446:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:2.0:1787191339.158453:0:57570:0:(rw26.c:927:ll_write_end()) page@000000005c587978[3 000000002af24390 2 1 000000006265ac15 0 0 0] 00000080:00200000:2.0:1787191339.158457:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @000000003ffade7f 17ffffc0001001 3:0 ffff936b43a1e460 0 lru 00000080:00200000:2.0:1787191339.158465:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@000000007661070e 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000a2a44f55 000000006a0566da > 3< 0 0 > 4< 0 1 8 378519552 - | - - - - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1787191339.158467:0:57570:0:(rw26.c:927:ll_write_end()) end page@000000005c587978 00000080:00200000:2.0:1787191339.158468:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:2.0:1787191339.158472:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:2.0:1787191339.158489:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 00000000d5dd2c13 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a002 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604bc5 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191339.158514:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b5395f5f8, count 1, dirtied 1 00000080:00200000:2.0:1787191339.158518:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:2.0:1787191339.158520:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:2.0:1787191339.158534:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b497c97b8 (ffff936b465cccf8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191339.158536:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b497c97b8 (ffff936b465cccf8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191339.158539:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1db0 (ffff936b465cc6c8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191339.158543:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a002 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4604bc5 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191339.158552:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a002 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604bc5 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:2.0:1787191339.158561:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b497c97b8 (ffff936b465cccf8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191339.158563:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1db0 (ffff936b465cccf8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191339.158569:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:2.0:1787191339.158573:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1787191339.158579:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc6:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191339.158582:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:2.0:1787191339.158588:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc6:0x0] updating i_size 5 i_blocks 0 00000080:00200000:2.0:1787191339.158591:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:2.0:1787191339.158610:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc6:0x0](ffff936b5395f448), flags 100001 00000002:00100000:2.0:1787191339.158664:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a9c00 x1874004626652032/t8589936781(8589936781) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191355 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191339.158673:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191339.158678:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb480 x1874004626654336/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191339.158702:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626654336:192.168.202.101@tcp:35:bash.0 00000100:00100000:2.0:1787191339.158773:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787191339.160898:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626653824:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191339.160898:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626654336:192.168.202.101@tcp:35:bash.0 00000100:00100000:1.0:1787191339.160911:0:2390:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-ffff936b581fb000: committing for last_committed 21474837543 gen 2 00000008:00010000:1.0:1787191339.160978:0:2390:0:(osc_cache.c:917:osc_extent_finish()) ### no dlm lock: extent: ffff936b48690180 00000020:00200000:1.0:1787191339.160983:0:2390:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:1.0:1787191339.160990:0:2390:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:1.0:1787191339.161012:0:2390:0:(osc_cache.c:497:__osc_extent_remove()) ### no dlm lock: extent: ffff936b48690180 00000002:00100000:2.0:1787191339.161021:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a9c00 x1874004626652032/t8589936781(8589936781) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787191339.161030:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626653568:192.168.202.101@tcp:4:lfs.0 00000080:00200000:3.0:1787191339.161947:0:57870:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1787191339.161961:0:57870:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc5:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191339.161966:0:57870:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:3.0:1787191339.161977:0:57870:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc5:0x0] updating i_size 5 i_blocks 8 00000020:00200000:3.0:1787191339.161980:0:57870:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191339.161987:0:57870:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200080:3.0:1787191339.162004:0:57870:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988) cmd=400866b1 arg=0 00000080:00200080:3.0:1787191339.162011:0:57870:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988) cmd=400866b1 arg=1 00000080:00200008:3.0:1787191339.162019:0:57870:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc5:0x0](ffff936b489a9988), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191339.162026:0:57870:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988),name=f70.sanity-flr 00000002:00010000:3.0:1787191339.162040:0:57870:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc5:0x0]) in obj [0x200000405:0xc5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191339.162068:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fd1 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604b4e expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191339.162083:0:57870:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fd1 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604b4e expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:3.0:1787191339.162091:0:57870:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xc5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191339.162099:0:57870:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc5:0x0](ffff936b489a9988) 00000080:00010000:3.0:1787191339.162103:0:57870:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc5:0x0](ffff936b489a9988) for lock 0xe5129dc884839fd1 00000080:00010000:3.0:1787191339.162111:0:57870:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839fd1 from it ffffa3fb421bbcd8 00010000:00010000:3.0:1787191339.162116:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604b4e expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191339.162124:0:57870:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fd1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604b4e expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:3.0:1787191339.162148:0:57870:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc5:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:3.0:1787191339.162159:0:57870:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc5:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191339.162163:0:57870:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191339.162166:0:57870:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc5:0x0] 00000008:00010000:3.0:1787191339.162185:0:57870:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191339.162188:0:57870:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b506672b0, osc lock ffff936b44f65300, flags 0x400000400001002 00010000:00010000:3.0:1787191339.162203:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 1 00010000:00010000:3.0:1787191339.162215:0:57870:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 1 00000020:00200000:3.0:1787191339.162225:0:57870:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191339.162229:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 1 00010000:00010000:3.0:1787191339.162236:0:57870:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00000020:00200000:3.0:1787191339.162246:0:57870:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191339.162251:0:57870:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc5:0x0] updating i_size 5 i_blocks 8 00000020:00010000:3.0:1787191339.162254:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51656750 (ffff936b465ccbd8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191339.162257:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51656750 (ffff936b465ccbd8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191339.162260:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b506672b0 (ffff936b465cc008/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191339.162263:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51656750 (ffff936b465ccbd8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191339.162266:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b506672b0 (ffff936b465ccbd8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191339.162292:0:57870:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc5:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191339.162375:0:57870:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xc5:0x0], offset: 5, type: SEEK_DATA 00000080:00200000:3.0:1787191339.162381:0:57870:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc5:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:3.0:1787191339.162386:0:57870:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc5:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191339.162388:0:57870:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191339.162392:0:57870:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191339.162397:0:57870:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1787191339.162411:0:57870:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc5:0x0] updating i_size 5 i_blocks 8 00000080:00200000:3.0:1787191339.162418:0:57870:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc5:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191339.162423:0:57870:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000080:00200000:3.0:1787191339.162425:0:57870:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc5:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:3.0:1787191339.162429:0:57870:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191339.162432:0:57870:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1787191339.162435:0:57870:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:3.0:1787191339.162441:0:57870:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:3.0:1787191339.162443:0:57870:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b506672b0, osc lock ffff936b44f65300, flags 0x0 00010000:00010000:3.0:1787191339.162451:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:3.0:1787191339.162461:0:57870:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:3.0:1787191339.162470:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:3.0:1787191339.162478:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:3.0:1787191339.162485:0:57870:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00000080:00200000:3.0:1787191339.162494:0:57870:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc5:0x0] updating i_size 5 i_blocks 8 00000020:00010000:3.0:1787191339.162498:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b504217b8 (ffff936b465ccbd8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191339.162500:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b504217b8 (ffff936b465ccbd8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191339.162503:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b506672b0 (ffff936b465cc008/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191339.162507:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:3.0:1787191339.162515:0:57870:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00000020:00010000:3.0:1787191339.162524:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b504217b8 (ffff936b465ccbd8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191339.162526:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b506672b0 (ffff936b465ccbd8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191339.162532:0:57870:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc5:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191339.162538:0:57870:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xc5:0x0], offset: 0, type: (null) 00000080:00200000:3.0:1787191339.162542:0:57870:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc5:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:3.0:1787191339.162546:0:57870:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc5:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191339.162548:0:57870:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191339.162550:0:57870:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc5:0x0] 00000008:00010000:3.0:1787191339.162557:0:57870:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191339.162559:0:57870:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b506672b0, osc lock ffff936b44f65300, flags 0x400000400001002 00010000:00010000:3.0:1787191339.162567:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00010000:00010000:3.0:1787191339.162575:0:57870:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00000020:00200000:3.0:1787191339.162588:0:57870:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191339.162591:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00010000:00010000:3.0:1787191339.162597:0:57870:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00000020:00200000:3.0:1787191339.162606:0:57870:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191339.162610:0:57870:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc5:0x0] updating i_size 5 i_blocks 8 00000020:00010000:3.0:1787191339.162613:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51656750 (ffff936b465ccbd8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191339.162615:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51656750 (ffff936b465ccbd8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191339.162618:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b506672b0 (ffff936b465cc008/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191339.162621:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51656750 (ffff936b465ccbd8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191339.162623:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b506672b0 (ffff936b465ccbd8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191339.162629:0:57870:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc5:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191339.162635:0:57870:0:(file.c:5244:ll_file_seek()) COMPLETED file f70.sanity-flr:[0x200000405:0xc5:0x0], offset: 0, type: (null), rc = 5 00000080:00200080:3.0:1787191339.162640:0:57870:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988) cmd=400866b1 arg=0 00000080:00200000:0.0:1787191339.175228:0:57873:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191339.175324:0:57873:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.175340:0:57873:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.175354:0:57873:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.175362:0:57873:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191339.175370:0:57873:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191339.175374:0:57873:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191339.175382:0:57873:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421d3b58 00010000:00010000:0.0:1787191339.175386:0:57873:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.175396:0:57873:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.175412:0:57873:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191339.175420:0:57873:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:0.0:1787191339.175427:0:57873:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191339.175439:0:57873:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:0.0:1787191339.175443:0:57873:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:0.0:1787191339.175456:0:57873:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:0.0:1787191339.175510:0:57873:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a010 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57873 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.175518:0:57873:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a010 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57873 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.175527:0:57873:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a010 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57873 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191339.175552:0:57873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57873:1874004626654464:192.168.202.101@tcp:101:rm.0 00000100:00100000:0.0:1787191339.177264:0:57873:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000080:00200080:0.0:1787191339.177975:0:57870:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988) cmd=400866b1 arg=2 00000080:00200008:0.0:1787191339.177990:0:57870:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc5:0x0](ffff936b489a9988), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191339.177997:0:57870:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988),name=f70.sanity-flr 00000002:00010000:0.0:1787191339.178020:0:57870:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc5:0x0]) in obj [0x200000405:0xc5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.178038:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fd1 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604b4e expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1787191339.178064:0:57870:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fd1 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604b4e expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1787191339.178072:0:57870:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xc5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191339.178081:0:57870:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc5:0x0](ffff936b489a9988) 00000080:00010000:0.0:1787191339.178084:0:57870:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc5:0x0](ffff936b489a9988) for lock 0xe5129dc884839fd1 00000080:00010000:0.0:1787191339.178092:0:57870:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884839fd1 from it ffffa3fb421bbcd8 00010000:00010000:0.0:1787191339.178096:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604b4e expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1787191339.178104:0:57870:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fd1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604b4e expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00000080:00200000:0.0:1787191339.178187:0:57870:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc5:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00020000:00200000:0.0:1787191339.178200:0:57870:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc5:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191339.178203:0:57870:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191339.178207:0:57870:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc5:0x0] 00000008:00010000:0.0:1787191339.178226:0:57870:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191339.178229:0:57870:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b46b504b0, osc lock ffff936b50b62720, flags 0x400000400001002 00010000:00010000:0.0:1787191339.178633:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00010000:00010000:0.0:1787191339.178647:0:57870:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00000020:00200000:0.0:1787191339.178665:0:57870:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191339.178669:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00010000:00010000:0.0:1787191339.178677:0:57870:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00000020:00200000:0.0:1787191339.178689:0:57870:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191339.178698:0:57870:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc5:0x0] updating i_size 5 i_blocks 8 00000020:00010000:0.0:1787191339.178702:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c39bc0 (ffff936b47a17908/0) at cl_lock_release():245 00000020:00010000:0.0:1787191339.178705:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c39bc0 (ffff936b47a17908/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191339.178709:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b46b504b0 (ffff936b47a17488/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191339.178712:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c39bc0 (ffff936b47a17908/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191339.178715:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b46b504b0 (ffff936b47a17908/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191339.178726:0:57870:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc5:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1787191339.178755:0:57870:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xc5:0x0](ffff936b489a9988) current size 5, valid attrs 2068, mode 0, uid -1322410190, gid -1, new size 5, atime 1787191339.000000000, mtime 1787191339.000000000, ctime 1787191339.000000000 00010000:00010000:0.0:1787191339.178778:0:57870:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fd1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4604b4e expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00010000:00010000:0.0:1787191339.179067:0:57870:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839fca lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604b40 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191339.179112:0:57870:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fd1 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604b4e expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00010000:00010000:0.0:1787191339.179125:0:57870:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191339.179364:0:57870:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc884839fd1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604b4e expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00000020:00100000:0.0:1787191339.179395:0:57870:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1787191339.179408:0:57870:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474380 x1874004626654720/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787191339.179430:0:57870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57870:1874004626654720:192.168.202.101@tcp:36:lfs.0 00000100:00100000:0.0:1787191339.179547:0:57870:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00000100:00100000:1.0:1787191339.184411:0:57870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57870:1874004626654720:192.168.202.101@tcp:36:lfs.0 00000080:00200000:1.0:1787191339.184460:0:57870:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 2 00000080:00200000:1.0:1787191339.184468:0:57870:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc5:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:1.0:1787191339.184489:0:57870:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x11 00000080:00200000:1.0:1787191339.184510:0:57870:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:1.0:1787191339.184527:0:57870:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1787191339.184532:0:57870:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b628930f0, osc lock ffff936b46836130, flags 0x0 00000008:00010000:1.0:1787191339.184537:0:57870:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1787191339.184538:0:57870:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b62893130, osc lock ffff936b468378f0, flags 0x0 00010000:00010000:1.0:1787191339.184606:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000da911a26/0xe5129dc88483a017 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.184619:0:57870:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000da911a26/0xe5129dc88483a017 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.184629:0:57870:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000da911a26/0xe5129dc88483a017 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191339.184650:0:57870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57870:1874004626654848:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191339.184738:0:57870:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628939c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191339.184975:0:57873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57873:1874004626654464:192.168.202.101@tcp:101:rm.0 00010000:00010000:0.0:1787191339.184990:0:57873:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a010 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604bef expref: -99 pid: 57873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.185007:0:57873:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a010 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604bef expref: -99 pid: 57873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.185015:0:57873:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a010 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604bef expref: -99 pid: 57873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.185026:0:57873:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a010 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604bef expref: -99 pid: 57873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.185037:0:57873:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a010 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604bef expref: -99 pid: 57873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.185060:0:57873:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a010 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604bef expref: -99 pid: 57873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.185069:0:57873:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a010 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604bef expref: -99 pid: 57873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.185077:0:57873:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a010 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604bef expref: -99 pid: 57873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191339.185089:0:57873:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b6a475f80 x1874004626654464/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/976 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191339.185100:0:57873:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a010 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604bef expref: -99 pid: 57873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191339.185113:0:57873:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a010 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604bef expref: -99 pid: 57873 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.185121:0:57873:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/198 (0 0) 00000080:00200000:0.0:1787191339.185128:0:57873:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191339.185167:0:57873:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xc6:0x0](ffff936b5395f448): rc = 0 00000080:00200000:0.0:1787191339.185181:0:57873:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc6:0x0]: layout version change: 4 -> 4 00000080:00010000:0.0:1787191339.185186:0:57873:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc6:0x0](ffff936b5395f448) for lock 0xe5129dc88483a010 00000080:00010000:0.0:1787191339.185196:0:57873:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc6:0x0](ffff936b5395f448) 00000080:00010000:0.0:1787191339.185199:0:57873:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a010 from it ffffa3fb421d3b20 00010000:00010000:0.0:1787191339.185203:0:57873:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a010 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604bef expref: -99 pid: 57873 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.185211:0:57873:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a010 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604bef expref: -99 pid: 57873 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200008:0.0:1787191339.185249:0:57873:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc6:0x0](ffff936b5395f448), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191339.185427:0:57873:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc6:0x0](ffff936b5395f448),name=f70.sanity-flr 00000002:00010000:0.0:1787191339.185450:0:57873:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc6:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.185459:0:57873:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a010 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604bef expref: -99 pid: 57873 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.185469:0:57873:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a010 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604bef expref: -99 pid: 57873 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191339.185475:0:57873:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191339.185480:0:57873:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc6:0x0](ffff936b5395f448) 00000080:00010000:0.0:1787191339.185484:0:57873:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc6:0x0](ffff936b5395f448) for lock 0xe5129dc88483a010 00000080:00010000:0.0:1787191339.185487:0:57873:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a010 from it ffffa3fb421d3cb8 00010000:00010000:0.0:1787191339.185491:0:57873:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a010 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604bef expref: -99 pid: 57873 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.185498:0:57873:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a010 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604bef expref: -99 pid: 57873 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191339.185516:0:57873:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc6:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:0.0:1787191339.185524:0:57873:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc6:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191339.185527:0:57873:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191339.185530:0:57873:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc6:0x0] 00000008:00010000:0.0:1787191339.185543:0:57873:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191339.185545:0:57873:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b46b503b0, osc lock ffff936b50b62720, flags 0x400000400001002 00010000:00010000:0.0:1787191339.185558:0:57873:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a002 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604bc5 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191339.185569:0:57873:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a002 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604bc5 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:0.0:1787191339.185580:0:57873:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191339.185584:0:57873:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a002 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4604bc5 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191339.185591:0:57873:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a002 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604bc5 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:0.0:1787191339.185601:0:57873:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191339.185609:0:57873:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc6:0x0] updating i_size 5 i_blocks 0 00000020:00010000:0.0:1787191339.185614:0:57873:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c39bc0 (ffff936b47a17908/0) at cl_lock_release():245 00000020:00010000:0.0:1787191339.185618:0:57873:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c39bc0 (ffff936b47a17908/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191339.185621:0:57873:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b46b503b0 (ffff936b47a17488/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191339.185625:0:57873:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c39bc0 (ffff936b47a17908/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191339.185629:0:57873:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b46b503b0 (ffff936b47a17908/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191339.185638:0:57873:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc6:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191339.185688:0:57873:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191339.185698:0:57873:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.185705:0:57873:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.185713:0:57873:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.185725:0:57873:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191339.185729:0:57873:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191339.185731:0:57873:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191339.185735:0:57873:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421d3c10 00010000:00010000:0.0:1787191339.185739:0:57873:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.185746:0:57873:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.185755:0:57873:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191339.185763:0:57873:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:0.0:1787191339.185768:0:57873:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191339.185775:0:57873:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:0.0:1787191339.185778:0:57873:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:0.0:1787191339.185783:0:57873:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:0.0:1787191339.185804:0:57873:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc884839ff4 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4604ba9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191339.185819:0:57873:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc6:0x0]: losing layout lock 00010000:00010000:0.0:1787191339.187131:0:57873:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a010 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4604bef expref: -99 pid: 57873 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191339.187154:0:57873:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc6:0x0]: losing layout lock 00010000:00010000:1.0:1787191339.187742:0:57873:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839fe6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4604b8d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.188343:0:57873:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc884839ff4 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xc6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604ba9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191339.188360:0:57873:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a010 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604bef expref: -99 pid: 57873 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191339.188366:0:57873:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839fe6 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4604b8d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.188371:0:57873:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:1.0:1787191339.188374:0:57873:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc884839ff4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604ba9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191339.188387:0:57873:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a010 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604bef expref: -99 pid: 57873 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191339.188394:0:57873:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bde00/0xe5129dc884839fe6 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4604b8d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1787191339.188415:0:57873:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1787191339.188427:0:57873:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453ab800 x1874004626655104/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787191339.188452:0:57873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57873:1874004626655104:192.168.202.101@tcp:36:rm.0 00000100:00100000:1.0:1787191339.188599:0:57873:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787191339.191467:0:57870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57870:1874004626654848:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191339.191499:0:57870:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000da911a26/0xe5129dc88483a017 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604bfd expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.191524:0:57870:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000da911a26/0xe5129dc88483a017 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604bfd expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.191539:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000da911a26/0xe5129dc88483a017 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604bfd expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191339.191552:0:57870:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 4096, setting rss=4096; kms=4096, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000da911a26/0xe5129dc88483a017 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604bfd expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.191564:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000da911a26/0xe5129dc88483a017 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4604bfd expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.191574:0:57870:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000da911a26/0xe5129dc88483a017 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4604bfd expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.191605:0:57870:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b52373000 type 11 mode 2 res 11811161089/434 (0 18446744073709551615) 00010000:00010000:1.0:1787191339.191644:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a01e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.191653:0:57870:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a01e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.191663:0:57870:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a01e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191339.191688:0:57870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57870:1874004626655232:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191339.191760:0:57870:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628939c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191339.192259:0:57873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57873:1874004626655104:192.168.202.101@tcp:36:rm.0 00000080:00200000:1.0:1787191339.192306:0:57873:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc6:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00020000:00200000:1.0:1787191339.192316:0:57873:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc6:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191339.192319:0:57873:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191339.192324:0:57873:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191339.192360:0:57873:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000008:00010000:1.0:1787191339.192375:0:57873:0:(osc_cache.c:1183:osc_extent_make_ready()) ### extent: 00000000d5dd2c13 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a002 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604bc5 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1787191339.192398:0:57873:0:(osc_cache.c:917:osc_extent_finish()) ### extent: 00000000d5dd2c13 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a002 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604bc5 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1787191339.192417:0:57873:0:(osc_cache.c:497:__osc_extent_remove()) ### extent: 00000000d5dd2c13 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a002 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604bc5 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191339.192434:0:57873:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191339.192476:0:57873:0:(llite_lib.c:2066:ll_clear_inode()) VFS Op:inode=[0x200000405:0xc6:0x0](ffff936b5395f448) 00000008:00010000:1.0:1787191339.192502:0:57873:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 5 blocks 0 [cma]time 1787191339 1787191339 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a002 lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604bc5 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1787191339.192522:0:57873:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191339 1787191339 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc88483a009 lrc: 1/0,0 mode: PW/PW res: [0x2c0000401:0x1b3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604bd3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1787191339.198382:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191339.198437:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634881408 00000100:00100000:3.0:1787191339.198448:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634881408 00000100:00100000:3.0:1787191339.198500:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1315 00000100:00100000:3.0:1787191339.198510:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30353:x1874004634881408:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191339.198528:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc884839f4c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46049b1 expref: -99 pid: 57869 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191339.198611:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191339.198618:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30353:x1874004634881408:12345-192.168.202.101@tcp:104: Request processed in 110us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191339.198632:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1315 00010000:00010000:0.0:1787191339.198758:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191339.198765:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc884839f4c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46049b1 expref: -99 pid: 57869 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.198780:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44caf000 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191339.198796:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc884839f4c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e46049b1 expref: -99 pid: 57869 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.198862:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc884839f4c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46049b1 expref: -99 pid: 57869 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.198870:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191339.198891:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc884839f4c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46049b1 expref: -99 pid: 57869 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.198898:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc884839f4c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46049b1 expref: -99 pid: 57869 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.198915:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191339.198916:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191339.198918:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191339.198933:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626655360:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191339.202060:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191339.202348:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634881536 00000100:00100000:2.0:1787191339.202358:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634881536 00000100:00100000:2.0:1787191339.202413:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1316 00000100:00100000:2.0:1787191339.202423:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:37090:x1874004634881536:12345-192.168.202.101@tcp:105: 00010000:00010000:2.0:1787191339.202439:0:51131:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a01e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604c20 expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.202453:0:51131:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a01e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604c20 expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.202463:0:51131:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a01e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604c20 expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.202474:0:51131:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a01e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10080000000000 nid: local remote: 0x7130d520e4604c20 expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.202483:0:51131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a01e lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10080000000000 nid: local remote: 0x7130d520e4604c20 expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.202500:0:51131:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a01e lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x80000000000 nid: local remote: 0x7130d520e4604c20 expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.202518:0:51131:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b40030800) 00000100:00100000:2.0:1787191339.202574:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:37090:x1874004634881536:12345-192.168.202.101@tcp:105: Request processed in 152us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191339.202581:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1316 00000100:00100000:0.0:1787191339.203919:0:57870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57870:1874004626655232:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191339.203943:0:57870:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a01e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e4604c20 expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.203960:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a01e lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000020000 nid: local remote: 0x7130d520e4604c20 expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191339.203978:0:57870:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a01e lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000020000 nid: local remote: 0x7130d520e4604c20 expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.203991:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a01e lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4604c20 expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.203999:0:57870:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a01e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4604c20 expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191339.204111:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626655488:192.168.202.101@tcp:10:lfs.0 00000100:00100000:0.0:1787191339.204188:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787191339.204194:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626655616:192.168.202.101@tcp:10:lfs.0 00000100:00100000:0.0:1787191339.206931:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626655360:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191339.208036:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626655616:192.168.202.101@tcp:10:lfs.0 00000100:00100000:0.0:1787191339.208078:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626655488:192.168.202.101@tcp:10:lfs.0 00000080:00200000:2.0:1787191339.208353:0:57870:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc5:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191339.208360:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b497c9b78 (ffff936b465cc248/0) at cl_lock_release():245 00000020:00010000:2.0:1787191339.208364:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b497c9b78 (ffff936b465cc248/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191339.208368:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b628930f0 (ffff936b465ccc68/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191339.208379:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000da911a26/0xe5129dc88483a017 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4604bfd expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.208393:0:57870:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000da911a26/0xe5129dc88483a017 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604bfd expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191339.208409:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62893130 (ffff936b465ccd88/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191339.208414:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a01e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4604c20 expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.208422:0:57870:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a01e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4604c20 expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191339.208435:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b497c9b78 (ffff936b465cc248/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191339.208438:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b628930f0 (ffff936b465cc248/1) at cl_lock_fini():72 00000020:00010000:2.0:1787191339.208442:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62893130 (ffff936b465cc248/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191339.208494:0:57870:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc5:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191339.208516:0:57870:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xc5:0x0](ffff936b489a9988) current size 5, valid attrs 10002168, mode 0, uid -1322410190, gid -1, new size 5, atime 1787191339.000000000, mtime 1787191339.000000000, ctime 1787191339.000000000, rc 0 00000080:00200080:2.0:1787191339.208534:0:57870:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988) cmd=400866b1 arg=0 00000080:00200008:2.0:1787191339.208563:0:57870:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xc5:0x0](ffff936b489a9988) current size 5, valid attrs 101f0, mode a3fb, uid 1404174768, gid -27797, new size 18446624687721716104, atime 1787191338.000000000, mtime 1787191338.000000000, ctime 1787191339.000000000 00000020:00100000:2.0:1787191339.208618:0:57870:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1787191339.208637:0:57870:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb480 x1874004626655872/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787191339.208659:0:57870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57870:1874004626655872:192.168.202.101@tcp:36:lfs.0 00000100:00100000:2.0:1787191339.208746:0:57870:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787191339.213767:0:57870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57870:1874004626655872:192.168.202.101@tcp:36:lfs.0 00000080:00200000:0.0:1787191339.213820:0:57870:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc5:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191339.213859:0:57870:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc5:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191339.213863:0:57870:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191339.213869:0:57870:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191339.213883:0:57870:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191339.213887:0:57870:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:0.0:1787191339.213900:0:57870:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:0.0:1787191339.213904:0:57870:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b46b503b0, osc lock ffff936b50b62720, flags 0x0 00010000:00010000:0.0:1787191339.213919:0:57870:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b52373000 type 11 mode 2 res 11811161089/433 (0 1048575) 00010000:00010000:0.0:1787191339.213959:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a025 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.213970:0:57870:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a025 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.213980:0:57870:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a025 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191339.213998:0:57870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57870:1874004626656000:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191339.214086:0:57870:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000080:00200000:1.0:1787191339.216741:0:57874:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191339.216776:0:57874:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.216807:0:57874:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.216823:0:57874:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.216869:0:57874:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191339.216877:0:57874:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191339.216881:0:57874:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191339.216889:0:57874:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421cbb58 00010000:00010000:1.0:1787191339.216893:0:57874:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.216902:0:57874:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.216917:0:57874:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191339.216925:0:57874:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:1.0:1787191339.216931:0:57874:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191339.216942:0:57874:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:1.0:1787191339.216947:0:57874:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191339.216958:0:57874:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191339.217008:0:57874:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a02c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.217017:0:57874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a02c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.217027:0:57874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a02c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191339.217067:0:57874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57874:1874004626656128:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191339.217168:0:57874:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787191339.218684:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191339.218715:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634881664 00000100:00100000:3.0:1787191339.218722:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634881664 00000100:00100000:3.0:1787191339.218773:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1317 00000100:00100000:3.0:1787191339.218946:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30511:x1874004634881664:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191339.218963:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:3.0:1787191339.219021:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191339.219028:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30511:x1874004634881664:12345-192.168.202.101@tcp:104: Request processed in 247us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191339.219036:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1317 00010000:00010000:0.0:1787191339.220156:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191339.220167:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:0.0:1787191339.220180:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b587bd600 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191339.220187:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800428400000000 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00000080:00200000:0.0:1787191339.220251:0:43384:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1787191339.220265:0:43384:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:0.0:1787191339.220321:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400000020 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:0.0:1787191339.220335:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191339.220368:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400000020 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:0.0:1787191339.220377:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000082d98929/0xe5129dc884839fd8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400000020 nid: local remote: 0x7130d520e4604b5c expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:0.0:1787191339.220394:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191339.220396:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191339.220398:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191339.220407:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787191339.220425:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626656256:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191339.224460:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191339.224567:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634881792 00000100:00100000:3.0:1787191339.224575:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634881792 00000100:00100000:3.0:1787191339.224636:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1318 00000100:00100000:3.0:1787191339.224647:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:6491:x1874004634881792:12345-192.168.202.101@tcp:105: 00010000:00010000:3.0:1787191339.224662:0:40921:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a025 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604c2e expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.224675:0:40921:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a025 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604c2e expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.224685:0:40921:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a025 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604c2e expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.224695:0:40921:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a025 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080000000000 nid: local remote: 0x7130d520e4604c2e expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.224705:0:40921:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a025 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080000000000 nid: local remote: 0x7130d520e4604c2e expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.224716:0:40921:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a025 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000000000 nid: local remote: 0x7130d520e4604c2e expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.224735:0:40921:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b44caf000) 00000100:00100000:3.0:1787191339.224797:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:6491:x1874004634881792:12345-192.168.202.101@tcp:105: Request processed in 152us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191339.224804:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1318 00000100:00100000:0.0:1787191339.225689:0:57870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57870:1874004626656000:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191339.225710:0:57870:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a025 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e4604c2e expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.225728:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a025 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000020000 nid: local remote: 0x7130d520e4604c2e expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191339.225740:0:57870:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 5, setting rss=5; kms=5, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a025 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000020000 nid: local remote: 0x7130d520e4604c2e expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.225752:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a025 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4604c2e expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.225764:0:57870:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a025 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4604c2e expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191339.225872:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787191339.225887:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626656384:192.168.202.101@tcp:2:lfs.0 00000100:00100000:0.0:1787191339.227090:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626656256:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191339.228668:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626656384:192.168.202.101@tcp:2:lfs.0 00000020:00010000:2.0:1787191339.228723:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b53cc5e48 (ffff936b47a17488/0) at cl_lock_release():245 00000020:00010000:2.0:1787191339.228727:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b53cc5e48 (ffff936b47a17488/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191339.228732:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b46b503b0 (ffff936b47a17998/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191339.228743:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a025 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4604c2e expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.228760:0:57870:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a025 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4604c2e expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191339.228791:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b53cc5e48 (ffff936b47a17488/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191339.228796:0:57870:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b46b503b0 (ffff936b47a17488/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191339.228872:0:57870:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc5:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191339.228894:0:57870:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xc5:0x0](ffff936b489a9988) current size 5, valid attrs 100101f0, mode a3fb, uid 1404174768, gid -27797, new size 18446624687721716104, atime 1787191338.000000000, mtime 1787191338.000000000, ctime 1787191339.000000000, rc 0 00000080:00200080:2.0:1787191339.228915:0:57870:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988) cmd=c00c66f3 arg=ca42e0 00010000:00010000:2.0:1787191339.228968:0:57870:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f99 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0xc5:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81008000000000 nid: local remote: 0x7130d520e4604aa6 expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.228986:0:57870:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150a800/0xe5129dc884839f99 lrc: 0/0,0 mode: --/PW res: [0x200000405:0xc5:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x85809400000000 nid: local remote: 0x7130d520e4604aa6 expref: -99 pid: 57870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191339.229007:0:57870:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a8e00 x1874004626649088/t8589936775(8589936775) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191339.229017:0:57870:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191339.229023:0:57870:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8000 x1874004626656640/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191339.229055:0:57870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57870:1874004626656640:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191339.229139:0:57870:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f300 going to sleep for 11 seconds 00000100:00100000:1.0:1787191339.231060:0:57874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57874:1874004626656128:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191339.231080:0:57874:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a02c lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.231093:0:57874:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a02c lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.231099:0:57874:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a02c lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.231106:0:57874:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a02c lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.231113:0:57874:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a02c lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.231119:0:57874:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191339.231123:0:57874:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a02c lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.231193:0:57874:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a02c lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.231202:0:57874:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a02c lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.231209:0:57874:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191339.231215:0:57874:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a02c lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.231221:0:57874:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a02c lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191339.231771:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191339.231986:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634881920 00000100:00100000:3.0:1787191339.231993:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634881920 00000100:00100000:3.0:1787191339.232054:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1319 00000100:00100000:3.0:1787191339.232065:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6508:x1874004634881920:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191339.232079:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839fca lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4604b40 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191339.232328:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191339.232336:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6508:x1874004634881920:12345-192.168.202.101@tcp:104: Request processed in 273us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191339.232344:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1319 00000002:00100000:1.0:1787191339.232524:0:57874:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b453ab480 x1874004626656128/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191339.232540:0:57874:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191339.233290:0:57874:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191339.233310:0:57874:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.233322:0:57874:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.233335:0:57874:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.233342:0:57874:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191339.233347:0:57874:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191339.233350:0:57874:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191339.233357:0:57874:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421cbbe8 00010000:00010000:1.0:1787191339.233362:0:57874:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.233377:0:57874:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.233394:0:57874:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191339.233401:0:57874:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000080:00200000:1.0:1787191339.233406:0:57874:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191339.233417:0:57874:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:1.0:1787191339.233422:0:57874:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191339.233434:0:57874:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191339.233476:0:57874:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a033 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.233484:0:57874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a033 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.233494:0:57874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a033 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191339.233515:0:57874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57874:1874004626656768:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191339.233587:0:57874:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893d80 going to sleep for 11 seconds 00010000:00010000:0.0:1787191339.235369:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191339.235382:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839fca lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4604b40 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191339.235394:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b4150ac00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191339.235398:0:40929:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839fca lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4604b40 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191339.235408:0:40929:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839fca lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4604b40 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191339.235417:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839fca lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4604b40 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1787191339.235441:0:40929:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc5:0x0]: losing layout lock 00010000:00010000:0.0:1787191339.235491:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839fca lrc: 2/0,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4604b40 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191339.235503:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787191339.235568:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626656896:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787191339.235752:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839fca lrc: 1/0,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4604b40 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191339.235762:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150ac00/0xe5129dc884839fca lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4604b40 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191339.235778:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191339.235780:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191339.235782:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191339.240033:0:57874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57874:1874004626656768:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191339.240948:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626656896:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787191339.241117:0:57874:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a033 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.241184:0:57874:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a033 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.241193:0:57874:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a033 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.241200:0:57874:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a033 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.241209:0:57874:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a033 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.241214:0:57874:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030e00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191339.241218:0:57874:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a033 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.241225:0:57874:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a033 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.241231:0:57874:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a033 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.241297:0:57874:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191339.241305:0:57874:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a033 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.241313:0:57874:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a033 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191339.241336:0:57874:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b453ab480 x1874004626656768/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191339.241352:0:57874:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191339.241443:0:57874:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191339.241456:0:57874:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.241465:0:57874:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.241475:0:57874:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.241481:0:57874:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191339.241486:0:57874:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191339.241489:0:57874:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191339.241493:0:57874:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421cbb58 00010000:00010000:1.0:1787191339.241496:0:57874:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.241504:0:57874:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.241517:0:57874:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191339.241523:0:57874:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:1.0:1787191339.241531:0:57874:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:1.0:1787191339.241536:0:57874:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:1.0:1787191339.241546:0:57874:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.241552:0:57874:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 79 lru_type: 1 00010000:00010000:1.0:1787191339.241559:0:57874:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 79 lru_type: 1 00000002:00010000:1.0:1787191339.241571:0:57874:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.241607:0:57874:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a03a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.241613:0:57874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a03a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.241942:0:57874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a03a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191339.242555:0:57874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57874:1874004626657024:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191339.242745:0:57874:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191339.247210:0:57874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57874:1874004626657024:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191339.247236:0:57874:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a03a lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604c6d expref: -99 pid: 57874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.247259:0:57874:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a03a lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604c6d expref: -99 pid: 57874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.247270:0:57874:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a03a lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604c6d expref: -99 pid: 57874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.247281:0:57874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a03a lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604c6d expref: -99 pid: 57874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.247301:0:57874:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a03a lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604c6d expref: -99 pid: 57874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.247310:0:57874:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a03a lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604c6d expref: -99 pid: 57874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.247329:0:57874:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a03a lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604c6d expref: -99 pid: 57874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191339.247340:0:57874:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b453ab480 x1874004626657024/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191339.247354:0:57874:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a03a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604c6d expref: -99 pid: 57874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.247365:0:57874:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:0.0:1787191339.247374:0:57874:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a03a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604c6d expref: -99 pid: 57874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.247383:0:57874:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a03a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604c6d expref: -99 pid: 57874 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:0.0:1787191339.247413:0:57874:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.247424:0:57874:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 158 lru_type: 1 00010000:00010000:0.0:1787191339.247436:0:57874:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 158 lru_type: 1 00010000:00010000:0.0:1787191339.247444:0:57874:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 158 lru_type: 1 00010000:00010000:0.0:1787191339.247451:0:57874:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 159 lru_type: 1 00000080:00200000:0.0:1787191339.247463:0:57874:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191339.247472:0:57874:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:0.0:1787191339.247476:0:57874:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:0.0:1787191339.247483:0:57874:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb421cbcb8 00010000:00010000:0.0:1787191339.247487:0:57874:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 79 lru_type: 1 00010000:00010000:0.0:1787191339.247495:0:57874:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 80 lru_type: 1 00000002:00010000:0.0:1787191339.247512:0:57874:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.247518:0:57874:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a03a lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604c6d expref: -99 pid: 57874 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.247526:0:57874:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a03a lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604c6d expref: -99 pid: 57874 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.247534:0:57874:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a03a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604c6d expref: -99 pid: 57874 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.247542:0:57874:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a03a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604c6d expref: -99 pid: 57874 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:0.0:1787191339.247551:0:57874:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.247556:0:57874:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 159 lru_type: 1 00010000:00010000:0.0:1787191339.247565:0:57874:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 159 lru_type: 1 00010000:00010000:0.0:1787191339.247572:0:57874:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 159 lru_type: 1 00010000:00010000:0.0:1787191339.247579:0:57874:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 160 lru_type: 1 00000080:00200008:0.0:1787191339.249318:0:57874:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1787191339.249327:0:57874:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191339.249346:0:57874:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.249359:0:57874:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.249372:0:57874:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.249380:0:57874:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191339.249387:0:57874:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191339.249390:0:57874:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191339.249399:0:57874:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421cbcb8 00010000:00010000:0.0:1787191339.249402:0:57874:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.249411:0:57874:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.249545:0:57874:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191339.249552:0:57874:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.249558:0:57874:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.249566:0:57874:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.249572:0:57874:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191339.249576:0:57874:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191339.249578:0:57874:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191339.249581:0:57874:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421cbb58 00010000:00010000:0.0:1787191339.249584:0:57874:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.249592:0:57874:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.249600:0:57874:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191339.249606:0:57874:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:0.0:1787191339.249611:0:57874:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191339.249622:0:57874:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:0.0:1787191339.249627:0:57874:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:0.0:1787191339.249639:0:57874:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:0.0:1787191339.249681:0:57874:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a041 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.249688:0:57874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a041 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.249697:0:57874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a041 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191339.249720:0:57874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57874:1874004626657152:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191339.249813:0:57874:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191339.252028:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191339.252110:0:40922:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787191339.252129:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634882560 00000100:00100000:2.0:1787191339.252137:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634882560 00000100:00100000:2.0:1787191339.252194:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1320 00000100:00100000:2.0:1787191339.252205:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b4121d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8419:x1874004634882560:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191339.252221:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc88483a009 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4604bd3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191339.252302:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191339.252309:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b4121d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8419:x1874004634882560:12345-192.168.202.101@tcp:104: Request processed in 106us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191339.252316:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1320 00010000:00010000:1.0:1787191339.252481:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191339.252489:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc88483a009 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4604bd3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.252498:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cae600 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191339.252504:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc88483a009 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4604bd3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.252554:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc88483a009 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4604bd3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.252562:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191339.252586:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc88483a009 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4604bd3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.252595:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc88483a009 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4604bd3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.252621:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191339.252623:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191339.252625:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191339.252641:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626657280:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191339.255972:0:57870:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589936789 gen 1 00000100:00100000:0.0:1787191339.256013:0:57870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57870:1874004626656640:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191339.256053:0:57870:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a8e00 x1874004626649088/t8589936775(8589936775) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1787191339.256087:0:57870:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/197 (0 0) 00000080:00010000:0.0:1787191339.256103:0:57870:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xc5:0x0](ffff936b489a9988) 00000002:00010000:0.0:1787191339.256114:0:57870:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc5:0x0]) in obj [0x200000405:0xc5:0x0], intent: layout flags 0 00010000:00010000:0.0:1787191339.256162:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafc00/0xe5129dc88483a048 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.256171:0:57870:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafc00/0xe5129dc88483a048 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.256182:0:57870:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafc00/0xe5129dc88483a048 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57870 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191339.256203:0:57870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57870:1874004626657408:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191339.256305:0:57870:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191339.256744:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191339.256774:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634883200 00000100:00100000:3.0:1787191339.256781:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634883200 00000100:00100000:3.0:1787191339.256881:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1321 00000100:00100000:3.0:1787191339.256891:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8720:x1874004634883200:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191339.256904:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a002 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4604bc5 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191339.256953:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191339.256960:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8720:x1874004634883200:12345-192.168.202.101@tcp:104: Request processed in 71us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191339.256966:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1321 00010000:00010000:1.0:1787191339.257149:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191339.257157:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a002 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4604bc5 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191339.257165:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40031a00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191339.257171:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a002 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4604bc5 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191339.257211:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a002 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4604bc5 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191339.257219:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191339.257244:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a002 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4604bc5 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191339.257251:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a002 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4604bc5 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191339.257269:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191339.257271:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191339.257272:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191339.257284:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626657536:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191339.257753:0:57874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57874:1874004626657152:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191339.257767:0:57874:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a041 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.257775:0:57874:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a041 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.257792:0:57874:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a041 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.257799:0:57874:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a041 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.257806:0:57874:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a041 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.257811:0:57874:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cae200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191339.257815:0:57874:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a041 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.257821:0:57874:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a041 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.257826:0:57874:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a041 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.257938:0:57874:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191339.257944:0:57874:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a041 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.257953:0:57874:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a041 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191339.257970:0:57874:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b6a474e00 x1874004626657152/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191339.257986:0:57874:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1787191339.258013:0:57874:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a03a lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604c6d expref: -99 pid: 57874 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191339.258024:0:57874:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a03a lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604c6d expref: -99 pid: 57874 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:0.0:1787191339.258033:0:57874:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a03a from it ffffa3fb421cb930 00010000:00010000:0.0:1787191339.258036:0:57874:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a03a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604c6d expref: -99 pid: 57874 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191339.258053:0:57874:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a03a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604c6d expref: -99 pid: 57874 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191339.258134:0:57874:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191339.258148:0:57874:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.258157:0:57874:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.258165:0:57874:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.258176:0:57874:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191339.258180:0:57874:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191339.258183:0:57874:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191339.258188:0:57874:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421cbbf8 00010000:00010000:0.0:1787191339.258191:0:57874:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.258198:0:57874:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.258205:0:57874:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191339.258212:0:57874:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191339.258217:0:57874:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191339.258224:0:57874:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:0.0:1787191339.258226:0:57874:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:0.0:1787191339.258231:0:57874:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b484c5080, open_flags a141, mode 81b6 opened 0 00000080:00200000:0.0:1787191339.258348:0:57874:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:0.0:1787191339.258375:0:57874:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xc8:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:0.0:1787191339.258386:0:57874:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a03a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4604c6d expref: -99 pid: 57874 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191339.258425:0:57874:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a03a lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4604c6d expref: -99 pid: 57874 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191339.258432:0:57874:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191339.258434:0:57874:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a03a lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4604c6d expref: -99 pid: 57874 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191339.258463:0:57874:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a04f lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.258471:0:57874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a04f lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191339.258480:0:57874:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191339.258487:0:57874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474e00 x1874004626657792/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191339.258496:0:57874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a04f lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191339.258510:0:57874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57874:1874004626657792:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191339.258624:0:57874:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191339.262965:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626657280:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191339.264703:0:57870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57870:1874004626657408:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191339.264727:0:57870:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafc00/0xe5129dc88483a048 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604ca5 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.264739:0:57870:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafc00/0xe5129dc88483a048 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604ca5 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191339.264749:0:57870:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b6a474380 x1874004626657408/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191339.264758:0:57870:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafc00/0xe5129dc88483a048 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604ca5 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191339.264772:0:57870:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafc00/0xe5129dc88483a048 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604ca5 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.264779:0:57870:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/197 (0 0) 00000080:00200000:0.0:1787191339.264793:0:57870:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xc5:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191339.264806:0:57870:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc5:0x0](ffff936b489a9988) for lock 0xe5129dc88483a048 00000080:00010000:0.0:1787191339.264812:0:57870:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a048 from it ffffa3fb421bbbc8 00010000:00010000:0.0:1787191339.264815:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafc00/0xe5129dc88483a048 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604ca5 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.264821:0:57870:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafc00/0xe5129dc88483a048 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604ca5 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.264872:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafc00/0xe5129dc88483a048 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604ca5 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.264880:0:57870:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafc00/0xe5129dc88483a048 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604ca5 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1787191339.264886:0:57870:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xc5:0x0](00000000fb2aac00) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafc00/0xe5129dc88483a048 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604ca5 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.264917:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafc00/0xe5129dc88483a048 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604ca5 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.264921:0:57870:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafc00/0xe5129dc88483a048 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604ca5 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191339.264934:0:57870:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191339.264942:0:57870:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc5:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191339.264944:0:57870:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191339.264949:0:57870:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191339.264979:0:57870:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191339.264996:0:57870:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:0.0:1787191339.265004:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafc00/0xe5129dc88483a048 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604ca5 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191339.265010:0:57870:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafc00/0xe5129dc88483a048 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604ca5 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:0.0:1787191339.265015:0:57870:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xc5:0x0](00000000fb2aac00) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafc00/0xe5129dc88483a048 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604ca5 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191339.265028:0:57870:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191339.265032:0:57870:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc5:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191339.265034:0:57870:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191339.265036:0:57870:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191339.265062:0:57870:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191339.265068:0:57870:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:0.0:1787191339.265080:0:57870:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 5 blocks 8 [cma]time: 1787191338 1787191338 0 by oinfo size 5 blocks 8 [cma]time 1787191339 1787191338 1787191338 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a025 lrc: 1/0,0 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4604c2e expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000008:00010000:0.0:1787191339.265111:0:57870:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 4096 blocks 8 [cma]time: 1787191339 1787191339 0 by oinfo size 5 blocks 8 [cma]time 1787191339 1787191339 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000da911a26/0xe5129dc88483a017 lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x1af:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604bfd expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000008:00010000:0.0:1787191339.265142:0:57870:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191339 1787191339 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a01e lrc: 1/0,0 mode: PW/PW res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4604c20 expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191339.265195:0:57870:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc5:0x0]: layout version change: 4294967294 -> 6 00010000:00010000:0.0:1787191339.265200:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafc00/0xe5129dc88483a048 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604ca5 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191339.265208:0:57870:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafc00/0xe5129dc88483a048 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604ca5 expref: -99 pid: 57870 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200008:0.0:1787191339.265404:0:57870:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc5:0x0](ffff936b489a9988), flags 154002 00000002:00100000:0.0:1787191339.265448:0:57870:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a8700 x1874004626648320/t8589936773(8589936773) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191339.265459:0:57870:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:0.0:1787191339.265464:0:57870:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474380 x1874004626658048/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191339.265485:0:57870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57870:1874004626658048:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191339.265571:0:57870:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191339.269144:0:57874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57874:1874004626657792:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191339.269170:0:57874:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a04f lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604cc1 expref: -99 pid: 57874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.269198:0:57874:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a04f lrc: 4/0,1 mode: --/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604cc1 expref: -99 pid: 57874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.269207:0:57874:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a04f lrc: 4/0,1 mode: --/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604cc1 expref: -99 pid: 57874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.269218:0:57874:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a04f lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604cc1 expref: -99 pid: 57874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.269228:0:57874:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a04f lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604cc1 expref: -99 pid: 57874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.269375:0:57874:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a04f lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604cc1 expref: -99 pid: 57874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.269385:0:57874:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a04f lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604cc1 expref: -99 pid: 57874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.269402:0:57874:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a04f lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604cc1 expref: -99 pid: 57874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191339.269416:0:57874:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b6a474e00 x1874004626657792/t8589936790(8589936790) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191339.269430:0:57874:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474e00 x1874004626657792/t8589936790(8589936790) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191339.269443:0:57874:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a04f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604cc1 expref: -99 pid: 57874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.269452:0:57874:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/200 (0 0) 00000080:00200000:0.0:1787191339.269458:0:57874:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191339.269471:0:57874:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:0.0:1787191339.269498:0:57874:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xc8:0x0](ffff936b5396d348) 00000080:00200000:0.0:1787191339.269505:0:57874:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xc8:0x0], updating i_size 0 00000080:00200000:0.0:1787191339.269540:0:57874:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc8:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1787191339.269545:0:57874:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xc8:0x0](ffff936b5396d348) 00000080:00010000:0.0:1787191339.269549:0:57874:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc8:0x0](ffff936b5396d348) for lock 0xe5129dc88483a04f 00000080:00010000:0.0:1787191339.269560:0:57874:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc8:0x0](ffff936b5396d348) 00000080:00200008:0.0:1787191339.269575:0:57874:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc8:0x0](ffff936b5396d348), flags 120501 00000002:00100000:0.0:1787191339.269593:0:57874:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474e00 x1874004626657792/t8589936790(8589936790) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191339.269631:0:57874:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a04f from it ffff936b495dca80 00010000:00010000:0.0:1787191339.269635:0:57874:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a04f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604cc1 expref: -99 pid: 57874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.269645:0:57874:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a04f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604cc1 expref: -99 pid: 57874 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191339.269667:0:57874:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc8:0x0](ffff936b5396d348), inode mode 81a4 mask 40 00000080:00200000:0.0:1787191339.269725:0:57874:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc8:0x0](ffff936b5396d348), inode mode 81a4 mask 2 00000080:00200000:0.0:1787191339.269735:0:57874:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xc8:0x0](ffff936b5396d348), xattr lov 00000002:00010000:0.0:1787191339.269751:0:57874:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc8:0x0]) in obj [0x200000405:0xc8:0x0], intent: open flags 040000002 00010000:00010000:0.0:1787191339.269795:0:57874:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a056 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.269801:0:57874:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a056 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191339.269815:0:57874:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191339.269822:0:57874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475880 x1874004626658304/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191339.269857:0:57874:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a056 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191339.269877:0:57874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57874:1874004626658304:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191339.270058:0:57874:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191339.277111:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626657536:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191339.277425:0:57870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57870:1874004626658048:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191339.277457:0:57870:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a8700 x1874004626648320/t8589936773(8589936773) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191354 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191339.277510:0:57870:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191339.277522:0:57870:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc5:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191339.277525:0:57870:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191339.277532:0:57870:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:0.0:1787191339.277571:0:57870:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191339.277580:0:57870:0:(llite_lib.c:2066:ll_clear_inode()) VFS Op:inode=[0x200000405:0xc5:0x0](ffff936b489a9988) 00000080:00200000:0.0:1787191339.277731:0:57870:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191339.277748:0:57870:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.277764:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.277779:0:57870:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.277787:0:57870:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191339.277793:0:57870:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191339.277797:0:57870:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191339.277804:0:57870:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421bbbf8 00010000:00010000:0.0:1787191339.277808:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.277817:0:57870:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.277849:0:57870:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191339.277856:0:57870:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191339.277862:0:57870:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191339.277867:0:57870:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:0.0:1787191339.277871:0:57870:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc8:0x0](ffff936b5396d348), inode mode 81a4 mask 44 00000080:00200008:0.0:1787191339.277879:0:57870:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc8:0x0](ffff936b5396d348), flags 154400 00000002:00010000:0.0:1787191339.277892:0:57870:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc8:0x0]) in obj [0x200000405:0xc8:0x0], intent: open flags 0100240114401 00010000:00010000:0.0:1787191339.277931:0:57870:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a05d lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.277939:0:57870:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a05d lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57870 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191339.277950:0:57870:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:0.0:1787191339.277957:0:57870:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474380 x1874004626658560/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191339.277967:0:57870:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a05d lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57870 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191339.277998:0:57870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57870:1874004626658560:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191339.278189:0:57870:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191339.283311:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191339.283548:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634883328 00000100:00100000:2.0:1787191339.283557:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634883328 00000100:00100000:2.0:1787191339.283612:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1322 00000100:00100000:2.0:1787191339.283630:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634883328:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191339.283648:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a04f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4604cc1 expref: -99 pid: 57874 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191339.283727:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191339.283734:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634883328:12345-192.168.202.101@tcp:104: Request processed in 114us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191339.283740:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1322 00010000:00010000:0.0:1787191339.284203:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191339.284212:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a04f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4604cc1 expref: -99 pid: 57874 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.284221:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44caea00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191339.284226:0:43384:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a04f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4604cc1 expref: -99 pid: 57874 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.284236:0:43384:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a04f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4604cc1 expref: -99 pid: 57874 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.284255:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a04f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4604cc1 expref: -99 pid: 57874 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191339.284276:0:43384:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc8:0x0]: losing layout lock 00010000:00010000:0.0:1787191339.284322:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a04f lrc: 2/0,0 mode: --/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4604cc1 expref: -99 pid: 57874 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.284328:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191339.284347:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a04f lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4604cc1 expref: -99 pid: 57874 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.284354:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a04f lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4604cc1 expref: -99 pid: 57874 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.284369:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191339.284371:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191339.284373:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191339.284528:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626658688:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191339.286412:0:57870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57870:1874004626658560:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191339.286436:0:57870:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a05d lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.286450:0:57870:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a05d lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.286457:0:57870:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a05d lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.286463:0:57870:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a05d lrc: 3/0,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.286471:0:57870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a05d lrc: 4/0,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.286477:0:57870:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44caf200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191339.286480:0:57870:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a05d lrc: 4/0,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.286486:0:57870:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a05d lrc: 4/0,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.286493:0:57870:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a05d lrc: 5/0,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.286500:0:57870:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191339.286506:0:57870:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a05d lrc: 3/0,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57870 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.286512:0:57870:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a05d lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57870 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191339.286535:0:57870:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b6a474380 x1874004626658560/t8589936792(8589936792) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191339.286548:0:57870:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474380 x1874004626658560/t8589936792(8589936792) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191339.286559:0:57870:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xc8:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787191339.286579:0:57870:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xc8:0x0], updating i_size 0 00000002:00100000:0.0:1787191339.286598:0:57870:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474380 x1874004626658560/t8589936792(8589936792) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191339.286711:0:57870:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc8:0x0](ffff936b5396d348), inode mode 81a4 mask 4 00000080:00200000:0.0:1787191339.286720:0:57870:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xc8:0x0](ffff936b5396d348), xattr lov 00000080:00200008:0.0:1787191339.286763:0:57870:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc8:0x0](ffff936b5396d348), flags 154000 00000002:00100000:0.0:1787191339.286829:0:57870:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a474380 x1874004626658560/t8589936792(8589936792) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191355 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191339.287230:0:57870:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:0.0:1787191339.287236:0:57870:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474700 x1874004626658944/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191339.287326:0:57870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57870:1874004626658944:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191339.287408:0:57870:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191339.293814:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626658688:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191339.294160:0:57870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57870:1874004626658944:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191339.294191:0:57870:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a474380 x1874004626658560/t8589936792(8589936792) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787191339.294701:0:57874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57874:1874004626658304:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191339.294719:0:57874:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a056 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.294732:0:57874:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a056 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.294739:0:57874:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a056 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.294746:0:57874:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a056 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.294755:0:57874:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a056 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.294760:0:57874:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cae200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191339.294765:0:57874:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a056 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.294772:0:57874:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a056 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.294780:0:57874:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a056 lrc: 5/0,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.294795:0:57874:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191339.294800:0:57874:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a056 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.294807:0:57874:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a056 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57874 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191339.294857:0:57874:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b6a475880 x1874004626658304/t8589936794(8589936794) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191339.294870:0:57874:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475880 x1874004626658304/t8589936794(8589936794) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191339.294885:0:57874:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xc8:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787191339.294922:0:57874:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc8:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1787191339.294930:0:57874:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc8:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191339.294974:0:57874:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xc8:0x0], updating i_size 0 00000002:00100000:0.0:1787191339.295105:0:57874:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475880 x1874004626658304/t8589936794(8589936794) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191339.295149:0:57874:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a475880 x1874004626658304/t8589936794(8589936794) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191339.295159:0:57874:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191339.295164:0:57874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a476a00 x1874004626659200/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191339.295184:0:57874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57874:1874004626659200:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191339.295312:0:57874:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191339.300554:0:57874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57874:1874004626659200:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191339.300593:0:57874:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a475880 x1874004626658304/t8589936794(8589936794) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1787191339.300647:0:57874:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc8:0x0](ffff936b5396d348), flags 100001 00000002:00100000:0.0:1787191339.300694:0:57874:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a474e00 x1874004626657792/t8589936790(8589936790) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191355 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191339.300704:0:57874:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191339.300709:0:57874:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a476680 x1874004626659456/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191339.300730:0:57874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57874:1874004626659456:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191339.300815:0:57874:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191339.310223:0:57874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57874:1874004626659456:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191339.310323:0:57874:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a474e00 x1874004626657792/t8589936790(8589936790) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191339.313705:0:57875:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191339.313735:0:57875:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.313750:0:57875:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.313766:0:57875:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.313774:0:57875:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191339.313781:0:57875:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191339.313786:0:57875:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191339.313793:0:57875:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421dbbf8 00010000:00010000:1.0:1787191339.313797:0:57875:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.313807:0:57875:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.313825:0:57875:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191339.313854:0:57875:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191339.313860:0:57875:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191339.313872:0:57875:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b49567c80, open_flags d900, mode 0 opened 0 00000080:00200000:1.0:1787191339.313877:0:57875:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:1.0:1787191339.313890:0:57875:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:1.0:1787191339.313942:0:57875:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a064 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.313951:0:57875:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a064 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57875 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191339.313963:0:57875:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191339.313975:0:57875:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453aaa00 x1874004626659712/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191339.313998:0:57875:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a064 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191339.314019:0:57875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aaa00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57875:1874004626659712:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191339.314206:0:57875:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893d80 going to sleep for 11 seconds 00000080:00200000:2.0:1787191339.318136:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191339.318162:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191339.318178:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191339.318193:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191339.318207:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191339.318214:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191339.318218:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191339.318225:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:2.0:1787191339.318229:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000100:00100000:1.0:1787191339.318341:0:57875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aaa00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57875:1874004626659712:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191339.318360:0:57875:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a064 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604d15 expref: -99 pid: 57875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.318382:0:57875:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a064 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604d15 expref: -99 pid: 57875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.318389:0:57875:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a064 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604d15 expref: -99 pid: 57875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.318417:0:57875:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a064 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604d15 expref: -99 pid: 57875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.318427:0:57875:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a064 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604d15 expref: -99 pid: 57875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.318439:0:57875:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a064 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604d15 expref: -99 pid: 57875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.318446:0:57875:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a064 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604d15 expref: -99 pid: 57875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.318453:0:57875:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a064 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604d15 expref: -99 pid: 57875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191339.318464:0:57875:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b453aaa00 x1874004626659712/t8589936797(8589936797) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191339.318476:0:57875:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453aaa00 x1874004626659712/t8589936797(8589936797) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191339.318489:0:57875:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a064 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604d15 expref: -99 pid: 57875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191339.318502:0:57875:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a064 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604d15 expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.318510:0:57875:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/200 (0 0) 00000080:00200000:1.0:1787191339.318515:0:57875:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191339.318558:0:57875:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xc8:0x0](ffff936b5396d348): rc = 0 00000080:00200000:1.0:1787191339.318574:0:57875:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc8:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:1.0:1787191339.318579:0:57875:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc8:0x0](ffff936b5396d348) for lock 0xe5129dc88483a064 00000080:00010000:1.0:1787191339.318588:0:57875:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc8:0x0](ffff936b5396d348) 00000080:00200008:1.0:1787191339.318598:0:57875:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc8:0x0](ffff936b5396d348), flags 154400 00000002:00100000:1.0:1787191339.318615:0:57875:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453aaa00 x1874004626659712/t8589936797(8589936797) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1787191339.318737:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191339.318755:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191339.318763:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191339.318768:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00010000:1.0:1787191339.319058:0:57875:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a064 from it ffff936b5339fde0 00010000:00010000:1.0:1787191339.319063:0:57875:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a064 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604d15 expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.319072:0:57875:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a064 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604d15 expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191339.319088:0:57875:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc8:0x0](ffff936b5396d348), inode mode 81a4 mask 44 00000080:00200000:1.0:1787191339.319178:0:57875:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc8:0x0](ffff936b5396d348), inode mode 81a4 mask 4 00000080:00200000:1.0:1787191339.319185:0:57875:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xc8:0x0](ffff936b5396d348), xattr lov 00000080:00200008:1.0:1787191339.319211:0:57875:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc8:0x0](ffff936b5396d348), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191339.319216:0:57875:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc8:0x0](ffff936b5396d348),name=f70.sanity-flr 00000002:00010000:1.0:1787191339.319231:0:57875:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc8:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.319304:0:57875:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a064 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604d15 expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.319316:0:57875:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a064 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604d15 expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191339.319329:0:57875:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191339.319334:0:57875:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc8:0x0](ffff936b5396d348) 00000080:00010000:1.0:1787191339.319337:0:57875:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc8:0x0](ffff936b5396d348) for lock 0xe5129dc88483a064 00000080:00010000:1.0:1787191339.319341:0:57875:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a064 from it ffffa3fb421dbcd8 00010000:00010000:1.0:1787191339.319344:0:57875:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a064 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604d15 expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.319351:0:57875:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a064 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604d15 expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191339.319370:0:57875:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc8:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:1.0:1787191339.319381:0:57875:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc8:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191339.319383:0:57875:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191339.319387:0:57875:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc8:0x0] 00000008:00010000:1.0:1787191339.319417:0:57875:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191339.319421:0:57875:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b47d7d0b0, osc lock ffff936b468378f0, flags 0x400000400001002 00010000:00010000:1.0:1787191339.319470:0:57875:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a06b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57875 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.319479:0:57875:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a06b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57875 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.319490:0:57875:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b453a8380 x1874004626659840/t0(0) o101->lustre-OST0001-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:1.0:1787191339.319520:0:57875:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:1.0:1787191339.319538:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626659840:192.168.202.101@tcp:101:lfs.0 00000080:00200000:2.0:1787191339.319671:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:2.0:1787191339.319678:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc8:0x0](ffff936b5396d348), inode mode 81a4 mask 42 00000080:00200008:2.0:1787191339.319685:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc8:0x0](ffff936b5396d348), flags 101101 00000002:00010000:2.0:1787191339.319699:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc8:0x0]) in obj [0x200000405:0xc8:0x0], intent: open|creat flags 04240101102 00010000:00010000:2.0:1787191339.319710:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a064 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4604d15 expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191339.319724:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc8:0x0]: losing layout lock 00010000:00010000:2.0:1787191339.319750:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a064 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604d15 expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191339.319757:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191339.319760:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a064 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604d15 expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191339.319791:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a072 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xc8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.319798:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a072 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191339.319807:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191339.319813:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bad80 x1874004626660096/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191339.319822:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a072 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191339.319859:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626660096:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191339.319938:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f9c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787191339.324118:0:2389:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a06b lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57875 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.324145:0:2389:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a06b lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604d23 expref: -99 pid: 57875 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.324158:0:2389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a06b lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604d23 expref: -99 pid: 57875 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.324170:0:2389:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a06b lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604d23 expref: -99 pid: 57875 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191339.324185:0:2389:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a06b lrc: 5/2,0 mode: PR/PR res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604d23 expref: -99 pid: 57875 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1787191339.324197:0:2389:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1787191339.324222:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a06b lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4604d23 expref: -99 pid: 57875 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.324231:0:2389:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a06b lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4604d23 expref: -99 pid: 57875 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.324431:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a06b lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4604d23 expref: -99 pid: 57875 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.324441:0:2389:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a06b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604d23 expref: -99 pid: 57875 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1787191339.324463:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626659840:192.168.202.101@tcp:101:lfs.0 00000080:00200000:2.0:1787191339.324617:0:57875:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc8:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191339.324623:0:57875:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c39bc0 (ffff936b47a17908/0) at cl_lock_release():245 00000020:00010000:2.0:1787191339.324627:0:57875:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c39bc0 (ffff936b47a17908/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191339.324631:0:57875:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7d0b0 (ffff936b465cc758/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191339.324635:0:57875:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c39bc0 (ffff936b47a17908/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191339.324637:0:57875:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7d0b0 (ffff936b47a17908/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191339.324673:0:57875:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc8:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:2.0:1787191339.324691:0:57875:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/200 (0 0) 00000080:00010000:2.0:1787191339.324703:0:57875:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xc8:0x0](ffff936b5396d348) 00000002:00010000:2.0:1787191339.324712:0:57875:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc8:0x0]) in obj [0x200000405:0xc8:0x0], intent: layout flags 0 00010000:00010000:2.0:1787191339.324754:0:57875:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a079 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.324766:0:57875:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a079 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.324776:0:57875:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a079 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191339.324796:0:57875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57875:1874004626660224:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191339.325088:0:57875:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f300 going to sleep for 11 seconds 00000100:00100000:0.0:1787191339.325926:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626660096:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191339.325947:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a072 lrc: 4/0,1 mode: --/CW res: [0x200000405:0xc8:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604d31 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.325960:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a072 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xc8:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604d31 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.325969:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a072 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xc8:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604d31 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191339.325991:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x200002b, status=0 req@ffff936b513bad80 x1874004626660096/t8589936798(8589936798) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191339.326004:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bad80 x1874004626660096/t8589936798(8589936798) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191339.326017:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a072 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xc8:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604d31 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191339.326029:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a072 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xc8:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604d31 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.326039:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 8 res 8589935621/200 (0 0) 00000080:00200000:0.0:1787191339.326058:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000405:0xc8:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787191339.326120:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc8:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:0.0:1787191339.326126:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc8:0x0](ffff936b5396d348) for lock 0xe5129dc88483a072 00000080:00010000:0.0:1787191339.326132:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a072 from it ffffa3fb41cabbf0 00010000:00010000:0.0:1787191339.326136:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a072 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xc8:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604d31 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.326145:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a072 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xc8:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604d31 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000002:00100000:0.0:1787191339.326170:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bad80 x1874004626660096/t8589936798(8589936798) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191339.326236:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xc8:0x0], intent: getxattr flags 0 00010000:00010000:2.0:1787191339.328119:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a080 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.328136:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a080 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.328149:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a080 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191339.328173:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626660352:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191339.328464:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787191339.330176:0:57875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57875:1874004626660224:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191339.330202:0:57875:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a079 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604d3f expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.330227:0:57875:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a079 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604d3f expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191339.330365:0:57875:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b513baa00 x1874004626660224/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191339.330384:0:57875:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a079 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604d3f expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191339.330398:0:57875:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a079 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604d3f expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.330410:0:57875:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/200 (0 0) 00000080:00200000:2.0:1787191339.330416:0:57875:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xc8:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1787191339.330435:0:57875:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc8:0x0](ffff936b5396d348) for lock 0xe5129dc88483a079 00000080:00010000:2.0:1787191339.330443:0:57875:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a079 from it ffffa3fb421dbbc8 00010000:00010000:2.0:1787191339.330448:0:57875:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a079 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604d3f expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.330458:0:57875:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a079 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604d3f expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191339.330483:0:57875:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a072 lrc: 2/0,1 mode: CW/CW res: [0x200000405:0xc8:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604d31 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191339.330495:0:57875:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a072 lrc: 2/0,1 mode: CW/CW res: [0x200000405:0xc8:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604d31 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:2.0:1787191339.330503:0:57875:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xc8:0x0](000000002d349481) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a072 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xc8:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604d31 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191339.330513:0:57875:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a072 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xc8:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604d31 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191339.330530:0:57875:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a072 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xc8:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604d31 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000100:00100000:0.0:1787191339.330565:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626660352:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191339.330579:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a080 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604d4d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.330586:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a080 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604d4d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.330593:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a080 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604d4d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191339.330600:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b6a475500 x1874004626660352/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191339.330607:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a080 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604d4d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.330612:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/200 (0 0) 00000080:00200000:0.0:1787191339.330615:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xc8:0x0] suppgids 0 -1: rc 0 00000080:00010000:0.0:1787191339.330631:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc8:0x0](ffff936b5396d348) for lock 0xe5129dc88483a080 00000080:00200008:2.0:1787191339.330632:0:57875:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc8:0x0](ffff936b5396d348), flags 154000 00000080:00010000:0.0:1787191339.330634:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a080 from it ffffa3fb41caba38 00010000:00010000:0.0:1787191339.330640:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a080 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604d4d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.330645:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a080 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604d4d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:0.0:1787191339.330665:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xc8:0x0](ffff936b5396d348) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191339.000000000, mtime 1787191339.000000000, ctime 1787191339.000000000 00000002:00100000:2.0:1787191339.330680:0:57875:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453aaa00 x1874004626659712/t8589936797(8589936797) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191355 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1787191339.330686:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a072 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xc8:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4604d31 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000020:00100000:2.0:1787191339.330698:0:57875:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00010000:00010000:0.0:1787191339.330706:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a079 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604d3f expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000100:00100000:2.0:1787191339.330706:0:57875:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513baa00 x1874004626660608/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191339.330741:0:57875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57875:1874004626660608:192.168.202.101@tcp:35:lfs.0 00010000:00010000:0.0:1787191339.330743:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a072 lrc: 1/0,0 mode: --/CW res: [0x200000405:0xc8:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604d31 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191339.330756:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191339.330759:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a072 lrc: 0/0,0 mode: --/CW res: [0x200000405:0xc8:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604d31 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000020:00100000:0.0:1787191339.330776:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 36, max 7 00000100:00100000:0.0:1787191339.330783:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475500 x1874004626660864/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787191339.330797:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626660864:192.168.202.101@tcp:36:bash.0 00000100:00100000:2.0:1787191339.330814:0:57875:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f300 going to sleep for 11 seconds 00000100:00100000:0.0:1787191339.330829:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191339.336249:0:57875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57875:1874004626660608:192.168.202.101@tcp:35:lfs.0 00000002:00100000:2.0:1787191339.336278:0:57875:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453aaa00 x1874004626659712/t8589936797(8589936797) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787191339.336407:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626660864:192.168.202.101@tcp:36:bash.0 00000080:00200000:3.0:1787191339.336466:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:3.0:1787191339.336472:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc8:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:3.0:1787191339.336481:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xc8:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:3.0:1787191339.336486:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc8:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191339.336488:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xc8:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:3.0:1787191339.336495:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xc8:0x0](ffff936b5396d348) 00000002:00010000:3.0:1787191339.336512:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc8:0x0]) in obj [0x200000405:0xc8:0x0], intent: layout flags 02 00010000:00010000:3.0:1787191339.336528:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a079 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4604d3f expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191339.336542:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc8:0x0]: losing layout lock 00010000:00010000:3.0:1787191339.336578:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a079 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4604d3f expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191339.336586:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191339.336588:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a079 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4604d3f expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191339.336609:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc88483a087 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xc8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.336616:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc88483a087 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xc8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191339.336625:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191339.336629:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1ed80 x1874004626661120/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191339.336635:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc88483a087 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xc8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191339.336650:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ed80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626661120:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191339.336714:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c540 going to sleep for 11 seconds 00000080:00200000:3.0:1787191339.336783:0:57875:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191339.336792:0:57875:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191339.336798:0:57875:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191339.336806:0:57875:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191339.336811:0:57875:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191339.336816:0:57875:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191339.336819:0:57875:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191339.336824:0:57875:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421dbbf8 00010000:00010000:3.0:1787191339.336826:0:57875:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191339.336851:0:57875:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191339.336860:0:57875:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191339.336865:0:57875:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191339.336869:0:57875:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191339.336878:0:57875:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b62914000, open_flags d900, mode 0 opened 0 00000080:00200000:3.0:1787191339.337128:0:57875:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:3.0:1787191339.337143:0:57875:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:3.0:1787191339.337174:0:57875:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a08e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.337181:0:57875:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a08e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57875 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191339.337188:0:57875:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:3.0:1787191339.337194:0:57875:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1df80 x1874004626661376/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191339.337202:0:57875:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a08e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191339.337214:0:57875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57875:1874004626661376:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191339.337323:0:57875:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787191339.344733:0:57875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57875:1874004626661376:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191339.344756:0:57875:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a08e lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.344768:0:57875:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a08e lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.344774:0:57875:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a08e lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.344781:0:57875:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a08e lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.344789:0:57875:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a08e lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.344795:0:57875:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9ae00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191339.344800:0:57875:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a08e lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.344807:0:57875:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a08e lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.344814:0:57875:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a08e lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.344820:0:57875:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191339.344827:0:57875:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a08e lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.344870:0:57875:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a08e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57875 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191339.344896:0:57875:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b51d1df80 x1874004626661376/t8589936802(8589936802) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191339.344910:0:57875:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1df80 x1874004626661376/t8589936802(8589936802) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191339.344927:0:57875:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191339.345566:0:57875:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xc8:0x0](ffff936b5396d348): rc = 0 00000080:00010000:3.0:1787191339.345574:0:57875:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc8:0x0](ffff936b5396d348) for lock 0x0 00000080:00200008:3.0:1787191339.345595:0:57875:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc8:0x0](ffff936b5396d348), flags 154400 00000002:00100000:3.0:1787191339.345618:0:57875:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1df80 x1874004626661376/t8589936802(8589936802) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191339.345737:0:57875:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc8:0x0](ffff936b5396d348), inode mode 81a4 mask 44 00000080:00200000:3.0:1787191339.345803:0:57875:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc8:0x0](ffff936b5396d348), inode mode 81a4 mask 4 00000080:00200000:3.0:1787191339.345811:0:57875:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xc8:0x0](ffff936b5396d348), xattr lov 00000080:00200008:3.0:1787191339.347206:0:57875:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc8:0x0](ffff936b5396d348), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191339.347219:0:57875:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc8:0x0](ffff936b5396d348),name=f70.sanity-flr 00000002:00010000:3.0:1787191339.347238:0:57875:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc8:0x0]) in obj [0x200000405:0xc8:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191339.347250:0:57875:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 30 res 8589935621/200 (0 0) 00010000:00010000:3.0:1787191339.347298:0:57875:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a095 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.347306:0:57875:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a095 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.347320:0:57875:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a095 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191339.347343:0:57875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57875:1874004626661504:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191339.347418:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191339.347432:0:57875:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787191339.347455:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634884096 00000100:00100000:3.0:1787191339.347463:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634884096 00000100:00100000:3.0:1787191339.347519:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1323 00000100:00100000:3.0:1787191339.347531:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:37089:x1874004634884096:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191339.347545:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a025 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000030000 nid: local remote: 0x7130d520e4604c2e expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:2.0:1787191339.347555:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191339.347573:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634884224 00000100:00100000:2.0:1787191339.347576:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634884224 00000100:00100000:2.0:1787191339.347593:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1324 00000100:00100000:2.0:1787191339.347597:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+5:8422:x1874004634884224:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191339.347606:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a01e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000030000 nid: local remote: 0x7130d520e4604c20 expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191339.347659:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191339.347665:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+5:8422:x1874004634884224:12345-192.168.202.101@tcp:104: Request processed in 67us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191339.347672:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1324 00010000:00010000:0.0:1787191339.347769:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191339.347777:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a01e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000030000 nid: local remote: 0x7130d520e4604c20 expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.347786:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030800 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191339.347792:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a01e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400030000 nid: local remote: 0x7130d520e4604c20 expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.347982:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a01e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e4604c20 expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.347991:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191339.348018:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a01e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e4604c20 expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.348033:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a01e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e4604c20 expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.348062:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191339.348064:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191339.348066:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191339.348085:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626661632:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787191339.354875:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191339.354889:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:37089:x1874004634884096:12345-192.168.202.101@tcp:104: Request processed in 7354us (7465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191339.354901:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1323 00010000:00010000:0.0:1787191339.355166:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191339.355174:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a025 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000030000 nid: local remote: 0x7130d520e4604c2e expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.355186:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44caf000 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191339.355193:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a025 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428400030000 nid: local remote: 0x7130d520e4604c2e expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.355246:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a025 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e4604c2e expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.355253:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191339.355275:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a025 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e4604c2e expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.355283:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a025 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e4604c2e expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.355302:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191339.355304:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191339.355306:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191339.355427:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787191339.355442:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626661760:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191339.355781:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191339.355804:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634884992 00000100:00100000:2.0:1787191339.355811:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634884992 00000100:00100000:2.0:1787191339.355868:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1325 00000100:00100000:2.0:1787191339.355878:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:29543:x1874004634884992:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191339.355890:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839f7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4604a3d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191339.355941:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191339.355947:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:29543:x1874004634884992:12345-192.168.202.101@tcp:104: Request processed in 72us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191339.355954:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1325 00010000:00010000:1.0:1787191339.356111:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191339.356118:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839f7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4604a3d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.356136:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cae400 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191339.356141:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839f7d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4604a3d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.356195:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839f7d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4604a3d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.356202:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191339.356234:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839f7d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4604a3d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.356433:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc884839f7d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4604a3d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.356451:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191339.356453:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191339.356455:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191339.356463:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787191339.356473:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626661888:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191339.356578:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191339.356711:0:57875:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589936803 gen 1 00000100:00100000:2.0:1787191339.356785:0:57875:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b513bad80 x1874004626660096/t8589936798(8589936798) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191355 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787191339.356798:0:57875:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b51d1df80 x1874004626661376/t8589936802(8589936802) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191355 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787191339.356809:0:57875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57875:1874004626661504:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191339.356824:0:57875:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a095 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604daf expref: -99 pid: 57875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.356858:0:57875:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a095 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604daf expref: -99 pid: 57875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.356870:0:57875:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a095 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604daf expref: -99 pid: 57875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.356881:0:57875:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a095 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604daf expref: -99 pid: 57875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.356892:0:57875:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a095 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604daf expref: -99 pid: 57875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.356910:0:57875:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a095 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604daf expref: -99 pid: 57875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.356919:0:57875:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a095 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604daf expref: -99 pid: 57875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191339.356929:0:57875:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b51d1f800 x1874004626661504/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/976 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191339.356940:0:57875:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a095 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604daf expref: -99 pid: 57875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191339.356952:0:57875:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a095 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604daf expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.356969:0:57875:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/200 (0 0) 00000080:00200000:2.0:1787191339.356976:0:57875:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xc8:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1787191339.357028:0:57875:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc8:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191339.357037:0:57875:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc8:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191339.357040:0:57875:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191339.357054:0:57875:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191339.357066:0:57875:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191339.357087:0:57875:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc8:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:2.0:1787191339.357103:0:57875:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a06b lrc: 1/0,0 mode: PR/PR res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604d23 expref: -99 pid: 57875 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191339.357208:0:57875:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc8:0x0]: layout version change: 4294967294 -> 4 00000080:00010000:2.0:1787191339.357221:0:57875:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc8:0x0](ffff936b5396d348) for lock 0xe5129dc88483a095 00000080:00010000:2.0:1787191339.357227:0:57875:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc8:0x0](ffff936b5396d348) 00000080:00010000:2.0:1787191339.357230:0:57875:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a095 from it ffffa3fb421dbcd8 00010000:00010000:2.0:1787191339.357233:0:57875:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a095 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604daf expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.357250:0:57875:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a095 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604daf expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191339.357276:0:57875:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc8:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:2.0:1787191339.357282:0:57875:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc8:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191339.357285:0:57875:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191339.357288:0:57875:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc8:0x0] 00000008:00010000:2.0:1787191339.357299:0:57875:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191339.357303:0:57875:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d11b0, osc lock ffff936b44e62d10, flags 0x400000400001002 00010000:00010000:2.0:1787191339.357317:0:57875:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a06b lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604d23 expref: -99 pid: 57875 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1787191339.357367:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634884864 00000100:00100000:3.0:1787191339.357373:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634884864 00000100:00100000:3.0:1787191339.357423:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1326 00000100:00100000:3.0:1787191339.357434:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8419:x1874004634884864:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191339.357445:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000da911a26/0xe5129dc88483a017 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4604bfd expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1787191339.357450:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626661632:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787191339.357545:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191339.357612:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8419:x1874004634884864:12345-192.168.202.101@tcp:104: Request processed in 121us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191339.357623:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1326 00010000:00010000:2.0:1787191339.357718:0:57875:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a06b lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604d23 expref: -99 pid: 57875 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000008:00010000:2.0:1787191339.357735:0:57875:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a06b lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604d23 expref: -99 pid: 57875 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:2.0:1787191339.357744:0:57875:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191339.357748:0:57875:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a06b lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4604d23 expref: -99 pid: 57875 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191339.357756:0:57875:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a06b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604d23 expref: -99 pid: 57875 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:2.0:1787191339.357768:0:57875:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191339.357777:0:57875:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc8:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191339.357781:0:57875:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51656bf0 (ffff936b465cccf8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191339.357784:0:57875:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51656bf0 (ffff936b465cccf8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191339.357787:0:57875:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d11b0 (ffff936b465cc6c8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191339.357790:0:57875:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51656bf0 (ffff936b465cccf8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191339.357793:0:57875:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d11b0 (ffff936b465cccf8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191339.357800:0:57875:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc8:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191339.357863:0:57875:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc8:0x0](ffff936b5396d348), flags 154000 00000002:00100000:2.0:1787191339.357919:0:57875:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1df80 x1874004626661376/t8589936802(8589936802) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191355 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191339.357931:0:57875:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:2.0:1787191339.357936:0:57875:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9c00 x1874004626662144/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191339.357954:0:57875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57875:1874004626662144:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191339.358009:0:57875:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787191339.358548:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ed80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626661120:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191339.358563:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc88483a087 lrc: 4/0,1 mode: --/EX res: [0x200000405:0xc8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604d77 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.358573:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc88483a087 lrc: 4/0,1 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604d77 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.358584:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc88483a087 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xc8:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604d77 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.358593:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc88483a087 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xc8:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604d77 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.358604:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc88483a087 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xc8:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604d77 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.358611:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc88483a087 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xc8:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604d77 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.358617:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc88483a087 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xc8:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604d77 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191339.358683:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b51d1ed80 x1874004626661120/t8589936803(8589936803) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191339.358702:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc88483a087 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc8:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604d77 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191339.358718:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc88483a087 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc8:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604d77 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.358726:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/200 (0 0) 00000080:00200000:0.0:1787191339.358732:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xc8:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191339.358745:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc8:0x0](ffff936b5396d348) for lock 0xe5129dc88483a087 00000080:00010000:0.0:1787191339.358751:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a087 from it ffffa3fb41cab930 00010000:00010000:0.0:1787191339.358753:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc88483a087 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc8:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604d77 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.358761:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc88483a087 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc8:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604d77 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191339.358774:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:0.0:1787191339.358779:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc8:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00020000:00200000:0.0:1787191339.358787:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xc8:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:0.0:1787191339.358791:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc8:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191339.358794:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191339.358801:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191339.358817:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191339.358820:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:0.0:1787191339.358854:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:0.0:1787191339.358858:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f996f0, osc lock ffff936b50b62d10, flags 0x80000000 00000008:00010000:0.0:1787191339.358862:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:0.0:1787191339.358864:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f99730, osc lock ffff936b50b63db0, flags 0x80000000 00010000:00010000:0.0:1787191339.358873:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b52373000 type 11 mode 2 res 11811161089/437 (0 1048575) 00010000:00010000:0.0:1787191339.359078:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc88483a09c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.359089:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc88483a09c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.359100:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc88483a09c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191339.359118:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626662272:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191339.359406:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191339.365463:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:0.0:1787191339.365813:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626661760:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191339.365946:0:40921:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787191339.365965:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634885120 00000100:00100000:2.0:1787191339.365972:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634885120 00000100:00100000:2.0:1787191339.366034:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1327 00000100:00100000:2.0:1787191339.366060:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b50880850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30353:x1874004634885120:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191339.366085:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a06b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000010000 nid: local remote: 0x7130d520e4604d23 expref: -99 pid: 57875 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191339.366402:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787191339.366411:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000da911a26/0xe5129dc88483a017 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4604bfd expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.366420:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40031600 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191339.366425:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000da911a26/0xe5129dc88483a017 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e4604bfd expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.366470:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000da911a26/0xe5129dc88483a017 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4604bfd expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.366477:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191339.366507:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000da911a26/0xe5129dc88483a017 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4604bfd expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.366515:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000da911a26/0xe5129dc88483a017 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4604bfd expref: -99 pid: 57870 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.366534:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191339.366538:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a06b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000010000 nid: local remote: 0x7130d520e4604d23 expref: -99 pid: 57875 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191339.366549:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030e00 already unused, calling callback (ffffffffc1208790) 00000100:00100000:0.0:1787191339.366875:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626662400:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787191339.367821:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00010000:00010000:1.0:1787191339.367829:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a06b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800428400010000 nid: local remote: 0x7130d520e4604d23 expref: -99 pid: 57875 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000100:00100000:2.0:1787191339.367859:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b50880850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30353:x1874004634885120:12345-192.168.202.101@tcp:104: Request processed in 1791us (2381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191339.367870:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1327 00000080:00200000:1.0:1787191339.367900:0:43384:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc8:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1787191339.367914:0:43384:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc8:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1787191339.368710:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a06b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400010020 nid: local remote: 0x7130d520e4604d23 expref: -99 pid: 57875 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191339.368720:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191339.369536:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a06b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400010020 nid: local remote: 0x7130d520e4604d23 expref: -99 pid: 57875 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191339.369549:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a06b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400010020 nid: local remote: 0x7130d520e4604d23 expref: -99 pid: 57875 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191339.369580:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191339.369583:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191339.369585:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191339.369607:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626662528:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191339.369614:0:57875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57875:1874004626662144:192.168.202.101@tcp:35:lfs.0 00000002:00100000:2.0:1787191339.369646:0:57875:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1df80 x1874004626661376/t8589936802(8589936802) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191339.369761:0:57875:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191339.369779:0:57875:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191339.369807:0:57875:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191339.369825:0:57875:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191339.369859:0:57875:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191339.369865:0:57875:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191339.369868:0:57875:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191339.369875:0:57875:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421dbbf8 00010000:00010000:2.0:1787191339.369879:0:57875:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191339.369889:0:57875:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191339.369912:0:57875:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191339.369920:0:57875:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191339.369925:0:57875:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191339.369941:0:57875:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b604caf00, open_flags d902, mode 0 opened 0 00000080:00200000:2.0:1787191339.369948:0:57875:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:2.0:1787191339.369962:0:57875:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154403 00010000:00010000:2.0:1787191339.370013:0:57875:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a0a3 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57875 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.370021:0:57875:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a0a3 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57875 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191339.370031:0:57875:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191339.370038:0:57875:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9c00 x1874004626662784/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191339.370061:0:57875:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a0a3 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57875 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191339.370084:0:57875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57875:1874004626662784:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191339.370524:0:57875:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5ff00 going to sleep for 11 seconds 00010000:00010000:0.0:1787191339.371631:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191339.371675:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626661888:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191339.383708:0:57875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57875:1874004626662784:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191339.383737:0:57875:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a0a3 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604dd2 expref: -99 pid: 57875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.383757:0:57875:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a0a3 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604dd2 expref: -99 pid: 57875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.383763:0:57875:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a0a3 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604dd2 expref: -99 pid: 57875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.383771:0:57875:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a0a3 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604dd2 expref: -99 pid: 57875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.383779:0:57875:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a0a3 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604dd2 expref: -99 pid: 57875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.383788:0:57875:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a0a3 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604dd2 expref: -99 pid: 57875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.383793:0:57875:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a0a3 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604dd2 expref: -99 pid: 57875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.383801:0:57875:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a0a3 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604dd2 expref: -99 pid: 57875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191339.383809:0:57875:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b513b9c00 x1874004626662784/t8589936805(8589936805) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191339.383818:0:57875:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9c00 x1874004626662784/t8589936805(8589936805) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191339.383827:0:57875:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a0a3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604dd2 expref: -99 pid: 57875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191339.383875:0:57875:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a0a3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604dd2 expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.383883:0:57875:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a095 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604daf expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191339.383892:0:57875:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a095 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604daf expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191339.383898:0:57875:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a0a3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604dd2 expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.383905:0:57875:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a0a3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x7130d520e4604dd2 expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.383911:0:57875:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a0a3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x7130d520e4604dd2 expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.383983:0:57875:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000080:00200000:2.0:1787191339.383991:0:57875:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191339.384038:0:57875:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xc8:0x0](ffff936b5396d348): rc = 0 00000080:00200000:2.0:1787191339.384094:0:57875:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc8:0x0]: layout version change: 4 -> 4 00000080:00010000:2.0:1787191339.384100:0:57875:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc8:0x0](ffff936b5396d348) for lock 0xe5129dc88483a095 00000080:00010000:2.0:1787191339.384113:0:57875:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc8:0x0](ffff936b5396d348) 00000080:00200008:2.0:1787191339.384126:0:57875:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc8:0x0](ffff936b5396d348), flags 154402 00000002:00100000:2.0:1787191339.384151:0:57875:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9c00 x1874004626662784/t8589936805(8589936805) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191339.384180:0:57875:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513b9c00 x1874004626662784/t8589936805(8589936805) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191339.384186:0:57875:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191339.384190:0:57875:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513ba680 x1874004626663040/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191339.384205:0:57875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57875:1874004626663040:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191339.384277:0:57875:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f300 going to sleep for 11 seconds 00000100:00100000:3.0:1787191339.385164:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191339.385189:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634885248 00000100:00100000:3.0:1787191339.385195:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634885248 00000100:00100000:3.0:1787191339.385252:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1328 00000100:00100000:3.0:1787191339.385262:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:6491:x1874004634885248:12345-192.168.202.101@tcp:105: 00010000:00010000:3.0:1787191339.385275:0:51131:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc88483a09c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604db6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.385597:0:51131:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc88483a09c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604db6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.385608:0:51131:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc88483a09c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604db6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.385620:0:51131:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc88483a09c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080000000000 nid: local remote: 0x7130d520e4604db6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.385629:0:51131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc88483a09c lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080000000000 nid: local remote: 0x7130d520e4604db6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.385640:0:51131:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc88483a09c lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000000000 nid: local remote: 0x7130d520e4604db6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.385657:0:51131:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b44cae200) 00000100:00100000:3.0:1787191339.385698:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:6491:x1874004634885248:12345-192.168.202.101@tcp:105: Request processed in 437us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191339.385706:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1328 00000100:00100000:0.0:1787191339.385941:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626662400:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191339.385979:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626662272:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191339.385995:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc88483a09c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e4604db6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.386010:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc88483a09c lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000020000 nid: local remote: 0x7130d520e4604db6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191339.386024:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc88483a09c lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000020000 nid: local remote: 0x7130d520e4604db6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.386053:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc88483a09c lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4604db6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.386062:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc88483a09c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4604db6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.386119:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a0aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.386128:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a0aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.386137:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a0aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191339.386154:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626663168:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191339.386193:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787191339.387020:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191339.387031:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a0a3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x7130d520e4604dd2 expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.387053:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd5c00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191339.387059:0:57627:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a0a3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x7130d520e4604dd2 expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.387068:0:57627:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a0a3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x7130d520e4604dd2 expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.387129:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a0a3 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4604dd2 expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.387423:0:57627:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a095 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604daf expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.387466:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a0a3 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4604dd2 expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.387474:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787191339.387532:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626663296:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787191339.387623:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a0a3 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4604dd2 expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.387632:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a0a3 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4604dd2 expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.387648:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191339.387650:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191339.387652:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191339.387683:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626662528:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191339.387803:0:57875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57875:1874004626663040:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191339.387827:0:57875:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513b9c00 x1874004626662784/t8589936805(8589936805) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191339.387930:0:57875:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a095 from it ffff936b60dc4d20 00010000:00010000:1.0:1787191339.387935:0:57875:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a095 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604daf expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.387945:0:57875:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a095 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604daf expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191339.387964:0:57875:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc8:0x0](ffff936b5396d348), inode mode 81a4 mask 46 00000080:00200080:1.0:1787191339.388069:0:57875:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc8:0x0](ffff936b5396d348) cmd=800466af arg=7ffd7e96ac1c 00000080:00200080:1.0:1787191339.388097:0:57875:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc8:0x0](ffff936b5396d348) cmd=80086601 arg=7ffd7e96abb8 00000100:00100000:1.0:1787191339.388123:0:57875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57875:1874004626663424:192.168.202.101@tcp:33:lfs.0 00000100:00100000:0.0:1787191339.391344:0:57875:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787191339.392600:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626663168:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191339.392619:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a0aa lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604de0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.392634:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a0aa lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4604de0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.392644:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a0aa lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4604de0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.392654:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a0aa lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4604de0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191339.392662:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a0aa lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4604de0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.392672:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a0aa lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4604de0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.392680:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a0aa lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4604de0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191339.392776:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626663552:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191339.392994:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787191339.393003:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626663680:192.168.202.101@tcp:10:bash.0 00000100:00100000:0.0:1787191339.393323:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626663296:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191339.396364:0:57875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57875:1874004626663424:192.168.202.101@tcp:33:lfs.0 00000080:00200080:0.0:1787191339.396409:0:57875:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc8:0x0](ffff936b5396d348) cmd=c00c66f3 arg=7ffd7e96aba4 00000080:00200008:0.0:1787191339.396546:0:57875:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc8:0x0](ffff936b5396d348), flags 154002 00000100:00100000:1.0:1787191339.397276:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626663680:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191339.397311:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626663552:192.168.202.101@tcp:10:bash.0 00000080:00200000:2.0:1787191339.397409:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc8:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191339.397416:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b504217b8 (ffff936b465ccbd8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191339.397420:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b504217b8 (ffff936b465ccbd8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191339.397425:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f996f0 (ffff936b47a17128/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191339.397434:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc88483a09c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4604db6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.397460:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc88483a09c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4604db6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191339.397475:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99730 (ffff936b47a17248/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191339.397480:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a0aa lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4604de0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.397489:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a0aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604de0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191339.397498:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b504217b8 (ffff936b465ccbd8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191339.397501:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f996f0 (ffff936b465ccbd8/1) at cl_lock_fini():72 00000020:00010000:2.0:1787191339.397505:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99730 (ffff936b465ccbd8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191339.397550:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc8:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191339.397570:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xc8:0x0](ffff936b5396d348) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191339.000000000, mtime 1787191339.000000000, ctime 1787191339.000000000, rc 0 00000080:00200008:2.0:1787191339.397639:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xc8:0x0], ppos: 0, count: 5 00000080:00200000:2.0:1787191339.397651:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191339.397657:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:2.0:1787191339.397663:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:2.0:1787191339.397667:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1787191339.397685:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@00000000d34613dc[0x110, 1, [0x200000405:0xc8:0x0] hash] 00000020:00200000:2.0:1787191339.397687:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:2.0:1787191339.397691:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc8:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:2.0:1787191339.397705:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xc8:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:2.0:1787191339.397710:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc8:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191339.397713:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1787191339.397719:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1787191339.397725:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:2.0:1787191339.397730:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1787191339.397747:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:2.0:1787191339.397766:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1787191339.397770:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d11b0, osc lock ffff936b44e62d10, flags 0x0 00010000:00010000:2.0:1787191339.397787:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc88483a09c lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4604db6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191339.397801:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc88483a09c lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4604db6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191339.397818:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc88483a09c lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4604db6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191339.397826:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc88483a09c lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4604db6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191339.397862:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc88483a09c lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4604db6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191339.397874:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:2.0:1787191339.397883:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191339.397935:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:2.0:1787191339.397943:0:57570:0:(rw26.c:927:ll_write_end()) page@00000000f585c29d[3 000000004c8bcab1 2 1 000000006265ac15 0 0 0] 00000080:00200000:2.0:1787191339.397947:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @00000000240277a3 17ffffc0001001 3:0 ffff936b43a1ee00 0 lru 00000080:00200000:2.0:1787191339.397955:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@0000000003e8f154 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000ef00a996 000000009563084d > 3< 0 0 > 4< 0 0 8 461643776 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1787191339.397957:0:57570:0:(rw26.c:927:ll_write_end()) end page@00000000f585c29d 00000080:00200000:2.0:1787191339.397959:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:2.0:1787191339.397964:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:2.0:1787191339.397992:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 0000000085e76a85 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc88483a09c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4604db6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191339.398019:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b5396d4f8, count 1, dirtied 1 00000080:00200000:2.0:1787191339.398024:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:2.0:1787191339.398027:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:2.0:1787191339.398050:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b497c97b8 (ffff936b465cccf8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191339.398053:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b497c97b8 (ffff936b465cccf8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191339.398056:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d11b0 (ffff936b465cc6c8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191339.398061:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc88483a09c lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4604db6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191339.398070:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc88483a09c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4604db6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:2.0:1787191339.398086:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b497c97b8 (ffff936b465cccf8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191339.398089:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d11b0 (ffff936b465cccf8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191339.398096:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:2.0:1787191339.398100:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1787191339.398105:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc8:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191339.398108:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:2.0:1787191339.398113:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc8:0x0] updating i_size 5 i_blocks 0 00000080:00200000:2.0:1787191339.398117:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:2.0:1787191339.398130:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc8:0x0](ffff936b5396d348), flags 100001 00000002:00100000:2.0:1787191339.398181:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513bad80 x1874004626660096/t8589936798(8589936798) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191355 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191339.398189:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191339.398193:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513baa00 x1874004626663936/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191339.398213:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626663936:192.168.202.101@tcp:35:bash.0 00000100:00100000:2.0:1787191339.398306:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f300 going to sleep for 11 seconds 00000080:00200000:0.0:1787191339.404155:0:57876:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191339.404188:0:57876:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.404205:0:57876:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.404231:0:57876:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.405169:0:57876:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191339.405182:0:57876:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191339.405186:0:57876:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191339.405195:0:57876:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421e3bf8 00010000:00010000:0.0:1787191339.405200:0:57876:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.405303:0:57876:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.405321:0:57876:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191339.405330:0:57876:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191339.405338:0:57876:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191339.405343:0:57876:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:0.0:1787191339.405347:0:57876:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc8:0x0](ffff936b5396d348), inode mode 81a4 mask 44 00000080:00200008:0.0:1787191339.405354:0:57876:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc8:0x0](ffff936b5396d348), flags 154400 00000002:00010000:0.0:1787191339.405375:0:57876:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc8:0x0]) in obj [0x200000405:0xc8:0x0], intent: open flags 0104240114401 00010000:00010000:0.0:1787191339.405425:0:57876:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a0b1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.405431:0:57876:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a0b1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57876 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191339.405439:0:57876:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:0.0:1787191339.405450:0:57876:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477100 x1874004626664192/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191339.405461:0:57876:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a0b1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191339.405482:0:57876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57876:1874004626664192:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191339.405533:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626663936:192.168.202.101@tcp:35:bash.0 00000002:00100000:2.0:1787191339.405557:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513bad80 x1874004626660096/t8589936798(8589936798) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787191339.405693:0:57876:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000080:00200000:0.0:1787191339.409215:0:57877:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191339.409243:0:57877:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.409261:0:57877:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.409277:0:57877:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.409284:0:57877:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191339.409292:0:57877:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191339.409295:0:57877:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191339.409302:0:57877:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421ebb58 00010000:00010000:0.0:1787191339.409306:0:57877:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.409316:0:57877:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.409333:0:57877:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191339.409340:0:57877:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:0.0:1787191339.409347:0:57877:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191339.409352:0:57877:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=8 00000080:00200008:0.0:1787191339.409358:0:57877:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc8:0x0](ffff936b5396d348), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191339.409363:0:57877:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc8:0x0](ffff936b5396d348),name=f70.sanity-flr 00000002:00010000:0.0:1787191339.409376:0:57877:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc8:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.409382:0:57877:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a095 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604daf expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191339.409390:0:57877:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a095 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604daf expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191339.409396:0:57877:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191339.409400:0:57877:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc8:0x0](ffff936b5396d348) 00000080:00010000:0.0:1787191339.409403:0:57877:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc8:0x0](ffff936b5396d348) for lock 0xe5129dc88483a095 00000080:00010000:0.0:1787191339.409407:0:57877:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a095 from it ffffa3fb421ebcb8 00010000:00010000:0.0:1787191339.409410:0:57877:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a095 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604daf expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191339.409418:0:57877:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a095 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604daf expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191339.409441:0:57877:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc8:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1787191339.409452:0:57877:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc8:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191339.409456:0:57877:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191339.409459:0:57877:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc8:0x0] 00000008:00010000:0.0:1787191339.409479:0:57877:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191339.409483:0:57877:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b46b502b0, osc lock ffff936b50b631d0, flags 0x400000400001002 00010000:00010000:0.0:1787191339.409499:0:57877:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc88483a09c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4604db6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191339.409515:0:57877:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc88483a09c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4604db6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:0.0:1787191339.409527:0:57877:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191339.409531:0:57877:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc88483a09c lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4604db6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191339.409539:0:57877:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc88483a09c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4604db6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:0.0:1787191339.409547:0:57877:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191339.409554:0:57877:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc8:0x0] updating i_size 5 i_blocks 0 00000020:00010000:0.0:1787191339.409559:0:57877:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c3abf0 (ffff936b47a17f38/0) at cl_lock_release():245 00000020:00010000:0.0:1787191339.409561:0:57877:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c3abf0 (ffff936b47a17f38/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191339.409563:0:57877:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b46b502b0 (ffff936b47a17c68/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191339.409566:0:57877:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c3abf0 (ffff936b47a17f38/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191339.409568:0:57877:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b46b502b0 (ffff936b47a17f38/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191339.409577:0:57877:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc8:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191339.409594:0:57877:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191339.409599:0:57877:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.409603:0:57877:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.409609:0:57877:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.409617:0:57877:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191339.409619:0:57877:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191339.409621:0:57877:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191339.409624:0:57877:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421ebc10 00010000:00010000:0.0:1787191339.409626:0:57877:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.409630:0:57877:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.409635:0:57877:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191339.409637:0:57877:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:0.0:1787191339.409639:0:57877:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191339.409644:0:57877:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:0.0:1787191339.409647:0:57877:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:0.0:1787191339.409651:0:57877:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:0.0:1787191339.409670:0:57877:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc88483a087 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc8:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4604d77 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191339.409682:0:57877:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc8:0x0]: losing layout lock 00010000:00010000:0.0:1787191339.409694:0:57877:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a095 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4604daf expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191339.409699:0:57877:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc8:0x0]: losing layout lock 00010000:00010000:0.0:1787191339.409704:0:57877:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a080 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4604d4d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.409747:0:57877:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc88483a087 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4604d77 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.409752:0:57877:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a095 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604daf expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191339.409756:0:57877:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a080 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4604d4d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.409759:0:57877:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:0.0:1787191339.409761:0:57877:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc88483a087 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4604d77 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.409768:0:57877:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a095 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604daf expref: -99 pid: 57875 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191339.409773:0:57877:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a080 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4604d4d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1787191339.409784:0:57877:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1787191339.409794:0:57877:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475500 x1874004626664448/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787191339.409813:0:57877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57877:1874004626664448:192.168.202.101@tcp:36:rm.0 00000100:00100000:0.0:1787191339.410345:0:57877:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99840 going to sleep for 11 seconds 00000100:00100000:0.0:1787191339.419945:0:57876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57876:1874004626664192:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191339.419969:0:57876:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a0b1 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.419981:0:57876:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a0b1 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.419988:0:57876:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a0b1 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.419995:0:57876:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a0b1 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.420003:0:57876:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a0b1 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.420009:0:57876:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44caf200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191339.420014:0:57876:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a0b1 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.420025:0:57876:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a0b1 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.420033:0:57876:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a0b1 lrc: 5/0,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.420039:0:57876:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191339.420058:0:57876:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a0b1 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.420066:0:57876:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a0b1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc8:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57876 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191339.420105:0:57876:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x3, status=-2 req@ffff936b6a477100 x1874004626664192/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191339.420125:0:57876:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xc8:0x0] suppgids 0 0: rc -2 00000080:00200000:0.0:1787191339.420133:0:57876:0:(file.c:872:ll_intent_file_open()) lock enqueue: err: -2 00000080:00200000:0.0:1787191339.420221:0:57876:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191339.420254:0:57876:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.420268:0:57876:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.420280:0:57876:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.420288:0:57876:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191339.420293:0:57876:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191339.420296:0:57876:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191339.420302:0:57876:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421e3bf8 00010000:00010000:0.0:1787191339.420305:0:57876:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.420313:0:57876:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.421265:0:57876:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191339.421277:0:57876:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=57 00000080:00200000:0.0:1787191339.421286:0:57876:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:0.0:1787191339.421935:0:57877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57877:1874004626664448:192.168.202.101@tcp:36:rm.0 00000080:00200000:0.0:1787191339.422004:0:57877:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc8:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00020000:00200000:0.0:1787191339.422016:0:57877:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc8:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191339.422020:0:57877:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191339.422027:0:57877:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191339.422038:0:57877:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1787191339.422055:0:57876:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b43d42a80, open_flags d900, mode 0 opened 0 00000080:00200000:3.0:1787191339.422064:0:57876:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000008:00010000:0.0:1787191339.422068:0:57877:0:(osc_cache.c:1183:osc_extent_make_ready()) ### extent: 0000000085e76a85 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc88483a09c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4604db6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000002:00010000:3.0:1787191339.422092:0:57876:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00000008:00010000:0.0:1787191339.422104:0:57877:0:(osc_cache.c:917:osc_extent_finish()) ### extent: 0000000085e76a85 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc88483a09c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4604db6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1787191339.422134:0:57877:0:(osc_cache.c:497:__osc_extent_remove()) ### extent: 0000000085e76a85 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc88483a09c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4604db6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191339.422158:0:57877:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc8:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:3.0:1787191339.422170:0:57876:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a0b8 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.422180:0:57876:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a0b8 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57876 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191339.422192:0:57876:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191339.422202:0:57876:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1e300 x1874004626664704/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191339.422212:0:57876:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a0b8 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57876 initiator: MDT0 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1787191339.422216:0:57877:0:(llite_lib.c:2066:ll_clear_inode()) VFS Op:inode=[0x200000405:0xc8:0x0](ffff936b5396d348) 00000100:00100000:3.0:1787191339.422236:0:57876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57876:1874004626664704:192.168.202.101@tcp:101:lfs.0 00000008:00010000:0.0:1787191339.422257:0:57877:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 5 blocks 0 [cma]time 1787191339 1787191339 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc88483a09c lrc: 1/0,0 mode: PW/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4604db6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1787191339.422283:0:57877:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191339 1787191339 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a0aa lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x1b2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604de0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1787191339.422433:0:57876:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c840 going to sleep for 11 seconds 00000100:00100000:3.0:1787191339.428247:0:57876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57876:1874004626664704:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191339.428273:0:57876:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a0b8 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.428288:0:57876:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a0b8 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.428295:0:57876:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a0b8 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.428302:0:57876:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a0b8 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.428310:0:57876:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a0b8 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.428316:0:57876:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9ae00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191339.428320:0:57876:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a0b8 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.428327:0:57876:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a0b8 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.428334:0:57876:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a0b8 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.428341:0:57876:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191339.428348:0:57876:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a0b8 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.428355:0:57876:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a0b8 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57876 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191339.428382:0:57876:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x7, status=0 req@ffff936b51d1e300 x1874004626664704/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/608 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191339.429008:0:57876:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191339.429287:0:57876:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191339.429301:0:57876:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191339.429312:0:57876:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191339.429322:0:57876:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191339.429327:0:57876:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191339.429333:0:57876:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191339.429337:0:57876:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191339.429343:0:57876:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421e3b58 00010000:00010000:3.0:1787191339.429347:0:57876:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191339.429356:0:57876:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191339.429372:0:57876:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191339.429379:0:57876:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191339.429386:0:57876:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191339.429407:0:57876:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=9 00000080:00200000:3.0:1787191339.429412:0:57876:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:3.0:1787191339.429425:0:57876:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1787191339.429476:0:57876:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a0bf lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.429495:0:57876:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a0bf lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.429508:0:57876:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a0bf lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191339.429539:0:57876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57876:1874004626664832:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191339.429695:0:57876:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c840 going to sleep for 11 seconds 00000100:00100000:3.0:1787191339.432232:0:57876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57876:1874004626664832:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191339.432251:0:57876:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a0bf lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.432262:0:57876:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a0bf lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.432266:0:57876:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a0bf lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.432271:0:57876:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a0bf lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.432276:0:57876:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a0bf lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.432279:0:57876:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9a400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191339.432282:0:57876:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a0bf lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.432287:0:57876:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a0bf lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.432291:0:57876:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a0bf lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.432296:0:57876:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191339.432301:0:57876:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a0bf lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.432305:0:57876:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a0bf lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57876 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191339.432320:0:57876:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b51d1e300 x1874004626664832/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191339.432332:0:57876:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191339.435624:0:57878:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191339.435658:0:57878:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.435672:0:57878:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.435684:0:57878:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.435695:0:57878:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191339.435703:0:57878:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191339.435707:0:57878:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191339.435714:0:57878:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421f3b58 00010000:00010000:1.0:1787191339.435719:0:57878:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.435798:0:57878:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.435812:0:57878:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191339.435820:0:57878:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:1.0:1787191339.435826:0:57878:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191339.435860:0:57878:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:1.0:1787191339.435865:0:57878:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191339.435879:0:57878:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191339.435931:0:57878:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a0c6 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.435941:0:57878:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a0c6 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.435952:0:57878:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a0c6 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191339.435980:0:57878:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57878:1874004626664960:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191339.436299:0:57878:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:1.0:1787191339.439656:0:57878:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57878:1874004626664960:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191339.439688:0:57878:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a0c6 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.439703:0:57878:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a0c6 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.439709:0:57878:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a0c6 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.439716:0:57878:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a0c6 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.439725:0:57878:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a0c6 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.439731:0:57878:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030e00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191339.439736:0:57878:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a0c6 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.439744:0:57878:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a0c6 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.439751:0:57878:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a0c6 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.439759:0:57878:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191339.439765:0:57878:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a0c6 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.439771:0:57878:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a0c6 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191339.439799:0:57878:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b453a8a80 x1874004626664960/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191339.439812:0:57878:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191339.439952:0:57878:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191339.439965:0:57878:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.439973:0:57878:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.439990:0:57878:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.439997:0:57878:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191339.440003:0:57878:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191339.440007:0:57878:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191339.440012:0:57878:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421f3be8 00010000:00010000:1.0:1787191339.440016:0:57878:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.440025:0:57878:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.440040:0:57878:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191339.440061:0:57878:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000080:00200000:1.0:1787191339.440067:0:57878:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191339.440079:0:57878:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:1.0:1787191339.440084:0:57878:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191339.440097:0:57878:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191339.440140:0:57878:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a0cd lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.440153:0:57878:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a0cd lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.440161:0:57878:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a0cd lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191339.440180:0:57878:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57878:1874004626665088:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191339.440253:0:57878:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:1.0:1787191339.443754:0:57878:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57878:1874004626665088:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191339.443775:0:57878:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a0cd lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.443801:0:57878:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a0cd lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.443809:0:57878:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a0cd lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.443817:0:57878:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a0cd lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.443826:0:57878:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a0cd lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.443970:0:57878:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40031600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191339.443975:0:57878:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a0cd lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.443983:0:57878:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a0cd lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.443991:0:57878:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a0cd lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.443998:0:57878:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191339.444005:0:57878:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a0cd lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.444012:0:57878:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a0cd lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191339.444034:0:57878:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b453a8a80 x1874004626665088/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191339.444060:0:57878:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191339.444215:0:57878:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191339.444231:0:57878:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.444243:0:57878:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.444255:0:57878:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.444262:0:57878:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191339.444268:0:57878:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191339.444271:0:57878:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191339.444276:0:57878:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421f3b58 00010000:00010000:1.0:1787191339.444279:0:57878:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.444287:0:57878:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.444301:0:57878:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191339.444308:0:57878:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:1.0:1787191339.444315:0:57878:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:1.0:1787191339.444320:0:57878:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:1.0:1787191339.444331:0:57878:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.444339:0:57878:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 80 lru_type: 1 00010000:00010000:1.0:1787191339.444347:0:57878:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 80 lru_type: 1 00000002:00010000:1.0:1787191339.444356:0:57878:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.444569:0:57878:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0d4 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.444577:0:57878:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0d4 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.444586:0:57878:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0d4 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191339.444606:0:57878:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57878:1874004626665216:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191339.445019:0:57878:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000080:00200000:2.0:1787191339.446281:0:57879:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191339.446306:0:57879:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191339.446321:0:57879:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191339.446337:0:57879:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191339.446344:0:57879:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191339.446352:0:57879:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191339.446356:0:57879:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191339.446363:0:57879:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421fbbf8 00010000:00010000:2.0:1787191339.446366:0:57879:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191339.446375:0:57879:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191339.446389:0:57879:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191339.446396:0:57879:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191339.446402:0:57879:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191339.446413:0:57879:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b484de000, open_flags d900, mode 0 opened 0 00000080:00200000:2.0:1787191339.446419:0:57879:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:2.0:1787191339.446432:0:57879:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:2.0:1787191339.446475:0:57879:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a0db lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.446483:0:57879:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a0db lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57879 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191339.446493:0:57879:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191339.446504:0:57879:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513baa00 x1874004626665472/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191339.446513:0:57879:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a0db lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57879 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191339.446532:0:57879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57879:1874004626665472:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191339.446689:0:57879:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f300 going to sleep for 11 seconds 00000100:00100000:1.0:1787191339.448669:0:57878:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57878:1874004626665216:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191339.448689:0:57878:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0d4 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604e65 expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.448700:0:57878:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0d4 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604e65 expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.448712:0:57878:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0d4 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604e65 expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.448722:0:57878:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0d4 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604e65 expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.448733:0:57878:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0d4 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604e65 expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.448742:0:57878:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0d4 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604e65 expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.448748:0:57878:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0d4 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604e65 expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191339.448759:0:57878:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b453a8a80 x1874004626665216/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191339.448772:0:57878:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604e65 expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.448781:0:57878:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:1.0:1787191339.448788:0:57878:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604e65 expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.448797:0:57878:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0d4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604e65 expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:1.0:1787191339.448824:0:57878:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.449157:0:57878:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 160 lru_type: 1 00010000:00010000:1.0:1787191339.449388:0:57878:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 160 lru_type: 1 00010000:00010000:1.0:1787191339.449398:0:57878:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 160 lru_type: 1 00010000:00010000:1.0:1787191339.449414:0:57878:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 161 lru_type: 1 00000080:00200000:1.0:1787191339.449430:0:57878:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191339.449438:0:57878:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:1.0:1787191339.449441:0:57878:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:1.0:1787191339.449447:0:57878:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb421f3cb8 00010000:00010000:1.0:1787191339.449450:0:57878:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 80 lru_type: 1 00010000:00010000:1.0:1787191339.449458:0:57878:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 81 lru_type: 1 00000002:00010000:1.0:1787191339.449479:0:57878:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.449486:0:57878:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0d4 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604e65 expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.449494:0:57878:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0d4 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604e65 expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.449592:0:57878:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604e65 expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.449600:0:57878:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0d4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604e65 expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:1.0:1787191339.449609:0:57878:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.449615:0:57878:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 161 lru_type: 1 00010000:00010000:1.0:1787191339.449623:0:57878:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 161 lru_type: 1 00010000:00010000:1.0:1787191339.449630:0:57878:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 161 lru_type: 1 00010000:00010000:1.0:1787191339.449637:0:57878:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 162 lru_type: 1 00000080:00200008:1.0:1787191339.450480:0:57878:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:1.0:1787191339.450487:0:57878:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191339.450561:0:57878:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.450572:0:57878:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.450582:0:57878:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.450589:0:57878:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191339.450595:0:57878:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191339.450598:0:57878:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191339.450603:0:57878:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421f3cb8 00010000:00010000:1.0:1787191339.450607:0:57878:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.450615:0:57878:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.450740:0:57878:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191339.450748:0:57878:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.450755:0:57878:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.450763:0:57878:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.450769:0:57878:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191339.450773:0:57878:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191339.450776:0:57878:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191339.450779:0:57878:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421f3b58 00010000:00010000:1.0:1787191339.450782:0:57878:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.450788:0:57878:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.450797:0:57878:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191339.450803:0:57878:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:1.0:1787191339.450808:0:57878:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:2.0:1787191339.451269:0:57879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57879:1874004626665472:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191339.451285:0:57879:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a0db lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.451296:0:57879:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a0db lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.451303:0:57879:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a0db lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.451308:0:57879:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a0db lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.451325:0:57879:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a0db lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.451578:0:57879:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd5400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191339.451583:0:57879:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a0db lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.451590:0:57879:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a0db lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.451597:0:57879:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a0db lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.451660:0:57879:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191339.451667:0:57879:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a0db lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57879 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.451808:0:57879:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a0db lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57879 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191339.451828:0:57879:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x7, status=0 req@ffff936b513baa00 x1874004626665472/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/608 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191339.451861:0:57879:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1787191339.451890:0:57879:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0d4 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604e65 expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191339.451892:0:57878:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:1.0:1787191339.451899:0:57878:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00010000:00010000:2.0:1787191339.451905:0:57879:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0d4 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604e65 expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:2.0:1787191339.451918:0:57879:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a0d4 from it ffffa3fb421fb9a0 00010000:00010000:2.0:1787191339.451923:0:57879:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604e65 expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:1.0:1787191339.451927:0:57878:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191339.451931:0:57879:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0d4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604e65 expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191339.452090:0:57878:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a0e2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.452096:0:57878:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a0e2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.452103:0:57878:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a0e2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191339.452118:0:57878:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57878:1874004626665600:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191339.452249:0:57878:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000080:00200000:2.0:1787191339.452425:0:57879:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191339.452436:0:57879:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191339.452443:0:57879:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191339.452453:0:57879:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191339.452459:0:57879:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191339.452464:0:57879:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191339.452467:0:57879:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191339.452472:0:57879:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421fbb58 00010000:00010000:2.0:1787191339.452475:0:57879:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191339.452484:0:57879:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191339.452493:0:57879:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191339.452499:0:57879:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191339.452503:0:57879:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191339.452507:0:57879:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=9 00000100:00100000:1.0:1787191339.457983:0:57878:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57878:1874004626665600:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191339.458007:0:57878:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a0e2 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.458027:0:57878:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a0e2 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.458034:0:57878:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a0e2 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.458051:0:57878:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a0e2 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.458060:0:57878:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a0e2 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.458066:0:57878:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40031600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191339.458071:0:57878:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a0e2 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.458078:0:57878:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a0e2 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.458084:0:57878:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a0e2 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.458091:0:57878:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191339.458098:0:57878:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a0e2 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.458105:0:57878:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a0e2 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191339.458123:0:57878:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b453a8a80 x1874004626665600/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191339.458153:0:57878:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1787191339.458184:0:57878:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0d4 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604e65 expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191339.458198:0:57878:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0d4 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604e65 expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00010000:1.0:1787191339.458207:0:57878:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a0d4 from it ffffa3fb421f3930 00010000:00010000:1.0:1787191339.458211:0:57878:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604e65 expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191339.458220:0:57878:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0d4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604e65 expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1787191339.458287:0:57878:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191339.458302:0:57878:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.458310:0:57878:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.458318:0:57878:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.458325:0:57878:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191339.458331:0:57878:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191339.458334:0:57878:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191339.458340:0:57878:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421f3bf8 00010000:00010000:1.0:1787191339.458343:0:57878:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.458352:0:57878:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.458361:0:57878:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191339.458369:0:57878:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191339.458375:0:57878:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191339.458380:0:57878:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:1.0:1787191339.458385:0:57878:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:1.0:1787191339.458391:0:57878:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b42a0e480, open_flags a141, mode 81b6 opened 0 00000080:00200000:1.0:1787191339.458400:0:57878:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:1.0:1787191339.458421:0:57878:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xc9:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:1.0:1787191339.458431:0:57878:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0d4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4604e65 expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191339.458502:0:57878:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0d4 lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4604e65 expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191339.458510:0:57878:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191339.458512:0:57878:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0d4 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4604e65 expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191339.458548:0:57878:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a0e9 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.458555:0:57878:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a0e9 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191339.458570:0:57878:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191339.458577:0:57878:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8a80 x1874004626665856/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191339.458586:0:57878:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a0e9 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191339.458606:0:57878:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57878:1874004626665856:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191339.458890:0:57878:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000080:00200000:0.0:1787191339.462167:0:57880:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191339.462198:0:57880:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.462213:0:57880:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.462227:0:57880:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.462240:0:57880:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191339.462247:0:57880:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191339.462251:0:57880:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191339.462258:0:57880:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42183bf8 00010000:00010000:0.0:1787191339.462262:0:57880:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.462270:0:57880:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.462284:0:57880:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191339.462291:0:57880:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191339.462296:0:57880:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:1.0:1787191339.463284:0:57878:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57878:1874004626665856:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191339.463304:0:57878:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a0e9 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604eab expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.463326:0:57878:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a0e9 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604eab expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.463334:0:57878:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a0e9 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604eab expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.463345:0:57878:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a0e9 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604eab expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.463355:0:57878:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a0e9 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604eab expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.463366:0:57878:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a0e9 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604eab expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.463378:0:57878:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a0e9 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604eab expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.463385:0:57878:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a0e9 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604eab expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191339.463407:0:57878:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b453a8a80 x1874004626665856/t8589936809(8589936809) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191339.463420:0:57878:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8a80 x1874004626665856/t8589936809(8589936809) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191339.463431:0:57878:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a0e9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604eab expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.463439:0:57878:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/201 (0 0) 00000080:00200000:1.0:1787191339.463444:0:57878:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191339.463454:0:57878:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:1.0:1787191339.463478:0:57878:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448) 00000080:00200000:1.0:1787191339.463496:0:57878:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xc9:0x0], updating i_size 0 00000080:00200000:1.0:1787191339.463534:0:57878:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc9:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:1.0:1787191339.463538:0:57878:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) 00000080:00010000:1.0:1787191339.463541:0:57878:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) for lock 0xe5129dc88483a0e9 00000080:00010000:1.0:1787191339.463550:0:57878:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) 00000080:00200008:1.0:1787191339.463565:0:57878:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc9:0x0](ffff936b5395f448), flags 120501 00000002:00100000:1.0:1787191339.463586:0:57878:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8a80 x1874004626665856/t8589936809(8589936809) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191339.463633:0:57878:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a0e9 from it ffff936b5339f6c0 00010000:00010000:1.0:1787191339.463638:0:57878:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a0e9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604eab expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.463647:0:57878:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a0e9 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604eab expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191339.463666:0:57878:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448), inode mode 81a4 mask 40 00000080:00200000:1.0:1787191339.463727:0:57878:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448), inode mode 81a4 mask 2 00000080:00200000:1.0:1787191339.463737:0:57878:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448), xattr lov 00000002:00010000:1.0:1787191339.463753:0:57878:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc9:0x0]) in obj [0x200000405:0xc9:0x0], intent: open flags 040000002 00010000:00010000:1.0:1787191339.463809:0:57878:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a0f0 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.463817:0:57878:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a0f0 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191339.463826:0:57878:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191339.463874:0:57878:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9f80 x1874004626666112/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000080:00200000:0.0:1787191339.463880:0:57880:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00010000:00010000:1.0:1787191339.463886:0:57878:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a0f0 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1787191339.463888:0:57880:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448), inode mode 81a4 mask 44 00000080:00200008:0.0:1787191339.463895:0:57880:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc9:0x0](ffff936b5395f448), flags 154400 00000002:00010000:0.0:1787191339.463909:0:57880:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc9:0x0]) in obj [0x200000405:0xc9:0x0], intent: open flags 0100240114401 00000100:00100000:1.0:1787191339.463913:0:57878:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57878:1874004626666112:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191339.463936:0:57880:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a0f7 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.463944:0:57880:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a0f7 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57880 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191339.463952:0:57880:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:0.0:1787191339.463959:0:57880:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477100 x1874004626666368/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191339.463965:0:57880:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a0f7 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57880 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191339.463974:0:57880:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57880:1874004626666368:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191339.464076:0:57878:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:0.0:1787191339.464094:0:57880:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99840 going to sleep for 11 seconds 00000100:00100000:3.0:1787191339.467687:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:0.0:1787191339.467899:0:57880:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57880:1874004626666368:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191339.467917:0:57880:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a0f7 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.467941:0:57880:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a0f7 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 57880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.467949:0:57880:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a0f7 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 57880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.467956:0:57880:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a0f7 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 57880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.467963:0:57880:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a0f7 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 57880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.467967:0:57880:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44caf200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191339.467970:0:57880:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a0f7 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x206400000000 pid: 57880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.467974:0:57880:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a0f7 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x206400000000 pid: 57880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.467980:0:57880:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a0f7 lrc: 5/0,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x20e400000000 pid: 57880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.467987:0:57880:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191339.467995:0:57880:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a0f7 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 57880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.468002:0:57880:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a0f7 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x4a0f400000000 pid: 57880 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191339.468022:0:57880:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b6a477100 x1874004626666368/t8589936810(8589936810) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191339.468033:0:57880:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477100 x1874004626666368/t8589936810(8589936810) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191339.468057:0:57880:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xc9:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787191339.468080:0:57880:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xc9:0x0], updating i_size 0 00000002:00100000:0.0:1787191339.468100:0:57880:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477100 x1874004626666368/t8589936810(8589936810) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191339.468257:0:57880:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448), inode mode 81a4 mask 4 00000080:00200000:0.0:1787191339.468264:0:57880:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448), xattr lov 00000080:00200008:0.0:1787191339.468300:0:57880:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc9:0x0](ffff936b5395f448), flags 154000 00000100:00100000:2.0:1787191339.468337:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634885376 00000100:00100000:2.0:1787191339.468345:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634885376 00000002:00100000:0.0:1787191339.468353:0:57880:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a477100 x1874004626666368/t8589936810(8589936810) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191355 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191339.468362:0:57880:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:0.0:1787191339.468365:0:57880:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a476680 x1874004626666624/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191339.468380:0:57880:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57880:1874004626666624:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191339.468394:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1329 00000100:00100000:2.0:1787191339.468406:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634885376:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191339.468421:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a0e9 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4604eab expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1787191339.468440:0:57880:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99840 going to sleep for 11 seconds 00010000:00010000:2.0:1787191339.468472:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191339.468479:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634885376:12345-192.168.202.101@tcp:104: Request processed in 76us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191339.468495:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1329 00010000:00010000:1.0:1787191339.468943:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191339.468952:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a0e9 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4604eab expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.468961:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030e00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191339.468965:0:40930:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a0e9 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4604eab expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.468972:0:40930:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a0e9 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4604eab expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.468980:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a0e9 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4604eab expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191339.468997:0:40930:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc9:0x0]: losing layout lock 00010000:00010000:0.0:1787191339.469274:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a0e9 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4604eab expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.469284:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191339.469308:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a0e9 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4604eab expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.469313:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a0e9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4604eab expref: -99 pid: 57878 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.469321:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191339.469322:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191339.469323:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191339.469380:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787191339.469390:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626666752:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191339.475745:0:57878:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57878:1874004626666112:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191339.475769:0:57878:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a0f0 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.475782:0:57878:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a0f0 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.475799:0:57878:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a0f0 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.475806:0:57878:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a0f0 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.475814:0:57878:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a0f0 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.475821:0:57878:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030000 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191339.475826:0:57878:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a0f0 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.475869:0:57878:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a0f0 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.475877:0:57878:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a0f0 lrc: 5/0,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.475883:0:57878:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191339.475890:0:57878:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a0f0 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.475896:0:57878:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a0f0 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57878 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191339.475920:0:57878:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b453a9f80 x1874004626666112/t8589936811(8589936811) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191339.475934:0:57878:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9f80 x1874004626666112/t8589936811(8589936811) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191339.475950:0:57878:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xc9:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787191339.476039:0:57878:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc9:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1787191339.476060:0:57878:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc9:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191339.476109:0:57878:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xc9:0x0], updating i_size 0 00000002:00100000:1.0:1787191339.476287:0:57878:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9f80 x1874004626666112/t8589936811(8589936811) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191339.476326:0:57878:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a9f80 x1874004626666112/t8589936811(8589936811) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191339.476336:0:57878:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191339.476342:0:57878:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9180 x1874004626667008/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191339.476363:0:57878:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57878:1874004626667008:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191339.476471:0:57878:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:0.0:1787191339.483759:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626666752:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191339.483759:0:57880:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57880:1874004626666624:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191339.483802:0:57880:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a477100 x1874004626666368/t8589936810(8589936810) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191339.484266:0:57880:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191339.484289:0:57880:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.484307:0:57880:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.484321:0:57880:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.484338:0:57880:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191339.484344:0:57880:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191339.484348:0:57880:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191339.484355:0:57880:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42183bf8 00010000:00010000:1.0:1787191339.484359:0:57880:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.484369:0:57880:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.484385:0:57880:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191339.484392:0:57880:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191339.484400:0:57880:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191339.484413:0:57880:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b42a0ef00, open_flags d900, mode 0 opened 0 00000080:00200000:1.0:1787191339.484420:0:57880:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:1.0:1787191339.484433:0:57880:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:1.0:1787191339.484493:0:57880:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0fe lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.484502:0:57880:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0fe lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57880 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191339.484512:0:57880:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:1.0:1787191339.484519:0:57880:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9500 x1874004626667264/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191339.484528:0:57880:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0fe lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57880 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191339.484548:0:57880:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57880:1874004626667264:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191339.484994:0:57880:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893180 going to sleep for 11 seconds 00000100:00100000:1.0:1787191339.485881:0:57878:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57878:1874004626667008:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191339.485909:0:57878:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a9f80 x1874004626666112/t8589936811(8589936811) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1787191339.485963:0:57878:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc9:0x0](ffff936b5395f448), flags 100001 00000002:00100000:1.0:1787191339.485999:0:57878:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a8a80 x1874004626665856/t8589936809(8589936809) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191355 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191339.486008:0:57878:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191339.486012:0:57878:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453aa680 x1874004626667520/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191339.486028:0:57878:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57878:1874004626667520:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191339.486303:0:57878:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:1.0:1787191339.489397:0:57880:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57880:1874004626667264:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191339.489424:0:57880:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0fe lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604ef8 expref: -99 pid: 57880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.489455:0:57880:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0fe lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604ef8 expref: -99 pid: 57880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.489465:0:57880:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0fe lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604ef8 expref: -99 pid: 57880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.489477:0:57880:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0fe lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604ef8 expref: -99 pid: 57880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.489640:0:57880:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0fe lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604ef8 expref: -99 pid: 57880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.489654:0:57880:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0fe lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604ef8 expref: -99 pid: 57880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.489663:0:57880:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0fe lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604ef8 expref: -99 pid: 57880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.489670:0:57880:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0fe lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604ef8 expref: -99 pid: 57880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191339.489688:0:57880:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b453a9500 x1874004626667264/t8589936814(8589936814) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191339.489701:0:57880:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9500 x1874004626667264/t8589936814(8589936814) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191339.489713:0:57880:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0fe lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604ef8 expref: -99 pid: 57880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191339.489727:0:57880:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0fe lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604ef8 expref: -99 pid: 57880 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.489737:0:57880:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/201 (0 0) 00000080:00200000:1.0:1787191339.489743:0:57880:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191339.489792:0:57880:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xc9:0x0](ffff936b5395f448): rc = 0 00000080:00200000:1.0:1787191339.489807:0:57880:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc9:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:1.0:1787191339.489812:0:57880:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) for lock 0xe5129dc88483a0fe 00000080:00010000:1.0:1787191339.489827:0:57880:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) 00000080:00200008:1.0:1787191339.489859:0:57880:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc9:0x0](ffff936b5395f448), flags 154400 00000002:00100000:1.0:1787191339.489880:0:57880:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9500 x1874004626667264/t8589936814(8589936814) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191339.489931:0:57880:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a0fe from it ffff936b5339f360 00010000:00010000:1.0:1787191339.489936:0:57880:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0fe lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604ef8 expref: -99 pid: 57880 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.489945:0:57880:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0fe lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604ef8 expref: -99 pid: 57880 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191339.489975:0:57880:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448), inode mode 81a4 mask 44 00000080:00200000:1.0:1787191339.490037:0:57880:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448), inode mode 81a4 mask 4 00000080:00200000:1.0:1787191339.490053:0:57880:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448), xattr lov 00000080:00200008:1.0:1787191339.490120:0:57880:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc9:0x0](ffff936b5395f448), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191339.490126:0:57880:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448),name=f70.sanity-flr 00000002:00010000:1.0:1787191339.490210:0:57880:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc9:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.490220:0:57880:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0fe lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604ef8 expref: -99 pid: 57880 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.490231:0:57880:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0fe lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604ef8 expref: -99 pid: 57880 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191339.490237:0:57880:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191339.490243:0:57880:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) 00000080:00010000:1.0:1787191339.490246:0:57880:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) for lock 0xe5129dc88483a0fe 00000080:00010000:1.0:1787191339.490249:0:57880:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a0fe from it ffffa3fb42183cd8 00010000:00010000:1.0:1787191339.490252:0:57880:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0fe lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604ef8 expref: -99 pid: 57880 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.490260:0:57880:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0fe lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604ef8 expref: -99 pid: 57880 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191339.490276:0:57880:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc9:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:1.0:1787191339.490284:0:57880:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc9:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191339.490288:0:57880:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191339.490291:0:57880:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc9:0x0] 00000008:00010000:1.0:1787191339.490306:0:57880:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191339.490309:0:57880:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b628931b0, osc lock ffff936b46836130, flags 0x400000400001002 00000008:00010000:1.0:1787191339.490315:0:57880:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191339.490316:0:57880:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b628931f0, osc lock ffff936b46837c80, flags 0x400000400001002 00010000:00010000:1.0:1787191339.490460:0:57880:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483a105 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57880 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.490471:0:57880:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483a105 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57880 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.490547:0:57880:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b453a8380 x1874004626667648/t0(0) o101->lustre-OST0001-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191339.490611:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626667648:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191339.490891:0:57880:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000da911a26/0xe5129dc88483a10c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57880 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.490901:0:57880:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000da911a26/0xe5129dc88483a10c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57880 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.490910:0:57880:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b453aaa00 x1874004626667776/t0(0) o101->lustre-OST0000-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191339.491508:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787191339.491519:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626667776:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191339.492773:0:57878:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57878:1874004626667520:192.168.202.101@tcp:35:lfs.0 00000002:00100000:2.0:1787191339.492804:0:57878:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a8a80 x1874004626665856/t8589936809(8589936809) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191339.494226:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191339.494251:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.494267:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.494282:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.494291:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191339.494299:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191339.494302:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191339.494310:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:0.0:1787191339.494314:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.494323:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.494338:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191339.494346:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191339.494352:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191339.494359:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:0.0:1787191339.494364:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448), inode mode 81a4 mask 42 00000080:00200008:0.0:1787191339.494372:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc9:0x0](ffff936b5395f448), flags 101101 00000002:00010000:0.0:1787191339.494387:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc9:0x0]) in obj [0x200000405:0xc9:0x0], intent: open|creat flags 04240101102 00010000:00010000:0.0:1787191339.494400:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0fe lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4604ef8 expref: -99 pid: 57880 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191339.494417:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc9:0x0]: losing layout lock 00010000:00010000:0.0:1787191339.494459:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0fe lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604ef8 expref: -99 pid: 57880 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191339.494466:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191339.494469:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a0fe lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604ef8 expref: -99 pid: 57880 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191339.494632:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a113 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.494645:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a113 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191339.494656:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191339.494667:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a476a00 x1874004626668032/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191339.494676:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a113 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191339.494697:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626668032:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191339.494875:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000020:00200000:1.0:1787191339.495062:0:57880:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 2 items remaining. 00010000:00010000:0.0:1787191339.502916:0:2389:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483a105 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57880 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.502945:0:2389:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483a105 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604f06 expref: -99 pid: 57880 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.502960:0:2389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483a105 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604f06 expref: -99 pid: 57880 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.502973:0:2389:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483a105 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604f06 expref: -99 pid: 57880 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191339.502987:0:2389:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483a105 lrc: 5/2,0 mode: PR/PR res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604f06 expref: -99 pid: 57880 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1787191339.503006:0:2389:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191339.503010:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483a105 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4604f06 expref: -99 pid: 57880 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.503019:0:2389:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483a105 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4604f06 expref: -99 pid: 57880 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.503028:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483a105 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4604f06 expref: -99 pid: 57880 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.503037:0:2389:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483a105 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604f06 expref: -99 pid: 57880 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1787191339.503069:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626667648:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191339.505209:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626668032:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191339.505236:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a113 lrc: 4/0,1 mode: --/CW res: [0x200000405:0xc9:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604f14 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.505250:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a113 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xc9:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604f14 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.505260:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a113 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xc9:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604f14 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191339.505278:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x200002b, status=0 req@ffff936b6a476a00 x1874004626668032/t8589936816(8589936816) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191339.505292:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a476a00 x1874004626668032/t8589936816(8589936816) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191339.505304:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a113 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xc9:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604f14 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191339.505318:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a113 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xc9:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604f14 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.505328:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 8 res 8589935621/201 (0 0) 00000080:00200000:0.0:1787191339.505335:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000405:0xc9:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787191339.505405:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc9:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:0.0:1787191339.505411:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) for lock 0xe5129dc88483a113 00000080:00010000:0.0:1787191339.505418:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a113 from it ffffa3fb41cabbf0 00010000:00010000:0.0:1787191339.505422:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a113 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xc9:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604f14 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.505431:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a113 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xc9:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604f14 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000002:00100000:0.0:1787191339.505460:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a476a00 x1874004626668032/t8589936816(8589936816) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191339.505533:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xc9:0x0], intent: getxattr flags 0 00010000:00010000:0.0:1787191339.505574:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a11a lrc: 3/1,0 mode: --/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.505583:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a11a lrc: 3/1,0 mode: --/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.505592:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a11a lrc: 3/1,0 mode: --/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191339.505611:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626668160:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191339.505699:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787191339.507673:0:2389:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000da911a26/0xe5129dc88483a10c lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57880 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.507696:0:2389:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000da911a26/0xe5129dc88483a10c lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604f22 expref: -99 pid: 57880 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.507710:0:2389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000da911a26/0xe5129dc88483a10c lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604f22 expref: -99 pid: 57880 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.507721:0:2389:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000da911a26/0xe5129dc88483a10c lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604f22 expref: -99 pid: 57880 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191339.507734:0:2389:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000da911a26/0xe5129dc88483a10c lrc: 5/2,0 mode: PR/PR res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604f22 expref: -99 pid: 57880 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1787191339.507745:0:2389:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1787191339.507764:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000da911a26/0xe5129dc88483a10c lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4604f22 expref: -99 pid: 57880 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.507780:0:2389:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000da911a26/0xe5129dc88483a10c lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4604f22 expref: -99 pid: 57880 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.507788:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000da911a26/0xe5129dc88483a10c lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4604f22 expref: -99 pid: 57880 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.507801:0:2389:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000da911a26/0xe5129dc88483a10c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604f22 expref: -99 pid: 57880 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1787191339.507822:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626667776:192.168.202.101@tcp:101:lfs.0 00000080:00200000:1.0:1787191339.507942:0:57880:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc9:0x0] updating i_size 0 i_blocks 0 00000020:00010000:1.0:1787191339.507948:0:57880:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b516579d0 (ffff936b465cc3f8/0) at cl_lock_release():245 00000020:00010000:1.0:1787191339.507952:0:57880:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b516579d0 (ffff936b465cc3f8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191339.507957:0:57880:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b628931b0 (ffff936b465cc7e8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191339.507962:0:57880:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b628931f0 (ffff936b465cc998/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191339.507964:0:57880:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b516579d0 (ffff936b465cc3f8/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191339.507967:0:57880:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b628931b0 (ffff936b465cc3f8/1) at cl_lock_fini():72 00000020:00010000:1.0:1787191339.507971:0:57880:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b628931f0 (ffff936b465cc3f8/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191339.507983:0:57880:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc9:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1787191339.508036:0:57880:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc9:0x0](ffff936b5395f448), flags 154000 00000002:00100000:1.0:1787191339.508103:0:57880:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a9500 x1874004626667264/t8589936814(8589936814) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191355 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191339.508114:0:57880:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191339.508119:0:57880:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8700 x1874004626668416/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191339.508139:0:57880:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57880:1874004626668416:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191339.508195:0:57880:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893180 going to sleep for 11 seconds 00000100:00100000:0.0:1787191339.509020:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626668160:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191339.509035:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a11a lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604f30 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.509059:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a11a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604f30 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.509067:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a11a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604f30 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191339.509079:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b6a475880 x1874004626668160/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191339.509090:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a11a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604f30 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.509099:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/201 (0 0) 00000080:00200000:0.0:1787191339.509104:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xc9:0x0] suppgids 0 -1: rc 0 00000080:00010000:0.0:1787191339.509124:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) for lock 0xe5129dc88483a11a 00000080:00010000:0.0:1787191339.509131:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a11a from it ffffa3fb41caba38 00010000:00010000:0.0:1787191339.509135:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a11a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604f30 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.509143:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a11a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604f30 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:0.0:1787191339.509171:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xc9:0x0](ffff936b5395f448) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191339.000000000, mtime 1787191339.000000000, ctime 1787191339.000000000 00010000:00010000:0.0:1787191339.509193:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a113 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xc9:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4604f14 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191339.509210:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc9:0x0]: losing layout lock 00010000:00010000:0.0:1787191339.509238:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a113 lrc: 1/0,0 mode: --/CW res: [0x200000405:0xc9:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604f14 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.509244:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191339.509247:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a113 lrc: 0/0,0 mode: --/CW res: [0x200000405:0xc9:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604f14 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1787191339.509263:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 36, max 7 00000100:00100000:0.0:1787191339.509269:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475880 x1874004626668672/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787191339.509285:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626668672:192.168.202.101@tcp:36:bash.0 00000100:00100000:0.0:1787191339.509333:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191339.511625:0:57880:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57880:1874004626668416:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191339.511660:0:57880:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a9500 x1874004626667264/t8589936814(8589936814) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191339.511739:0:57880:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191339.511760:0:57880:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.511774:0:57880:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.511788:0:57880:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.511797:0:57880:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191339.511803:0:57880:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191339.511807:0:57880:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191339.511814:0:57880:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42183bf8 00010000:00010000:1.0:1787191339.511818:0:57880:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.511828:0:57880:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.511872:0:57880:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191339.511881:0:57880:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191339.511887:0:57880:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191339.511900:0:57880:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b42a0e300, open_flags d902, mode 0 opened 0 00000080:00200000:1.0:1787191339.511908:0:57880:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:1.0:1787191339.511923:0:57880:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154403 00010000:00010000:1.0:1787191339.511972:0:57880:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a121 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57880 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.511981:0:57880:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a121 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57880 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191339.511992:0:57880:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191339.512000:0:57880:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8700 x1874004626668928/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191339.512010:0:57880:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a121 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57880 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191339.512029:0:57880:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57880:1874004626668928:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191339.512217:0:57880:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893180 going to sleep for 11 seconds 00000100:00100000:0.0:1787191339.512304:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626668672:192.168.202.101@tcp:36:bash.0 00000080:00200000:0.0:1787191339.512335:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:0.0:1787191339.512342:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc9:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00010000:00010000:0.0:1787191339.512353:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/201 (0 0) 00000080:00010000:0.0:1787191339.512361:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xc9:0x0](ffff936b5395f448) 00000002:00010000:0.0:1787191339.512366:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc9:0x0]) in obj [0x200000405:0xc9:0x0], intent: layout flags 0 00010000:00010000:0.0:1787191339.512386:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a128 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.512394:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a128 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.512401:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a128 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191339.512413:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626669056:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191339.512444:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191339.515895:0:57880:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57880:1874004626668928:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191339.515919:0:57880:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a121 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604f5a expref: -99 pid: 57880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.515940:0:57880:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a121 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604f5a expref: -99 pid: 57880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.515949:0:57880:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a121 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604f5a expref: -99 pid: 57880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.515960:0:57880:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a121 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604f5a expref: -99 pid: 57880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.515973:0:57880:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a121 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604f5a expref: -99 pid: 57880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.515986:0:57880:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a121 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604f5a expref: -99 pid: 57880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.515994:0:57880:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a121 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604f5a expref: -99 pid: 57880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.516001:0:57880:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a121 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604f5a expref: -99 pid: 57880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191339.516013:0:57880:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b453a8700 x1874004626668928/t8589936820(8589936820) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191339.516026:0:57880:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8700 x1874004626668928/t8589936820(8589936820) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191339.516051:0:57880:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a121 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604f5a expref: -99 pid: 57880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191339.516066:0:57880:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a121 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604f5a expref: -99 pid: 57880 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.516076:0:57880:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/201 (0 0) 00000080:00200000:1.0:1787191339.516081:0:57880:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191339.516136:0:57880:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xc9:0x0](ffff936b5395f448): rc = 0 00000080:00200000:1.0:1787191339.516153:0:57880:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc9:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:1.0:1787191339.516158:0:57880:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) for lock 0xe5129dc88483a121 00000080:00010000:1.0:1787191339.516171:0:57880:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) 00000080:00200008:1.0:1787191339.516186:0:57880:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc9:0x0](ffff936b5395f448), flags 154402 00000002:00100000:1.0:1787191339.516209:0:57880:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8700 x1874004626668928/t8589936820(8589936820) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191339.516245:0:57880:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a8700 x1874004626668928/t8589936820(8589936820) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191339.516254:0:57880:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191339.516260:0:57880:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9500 x1874004626669312/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191339.516278:0:57880:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57880:1874004626669312:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191339.516341:0:57880:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893180 going to sleep for 11 seconds 00000100:00100000:0.0:1787191339.517544:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626669056:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191339.517566:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a128 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604f3e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.517580:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a128 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604f3e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191339.517593:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b6a474700 x1874004626669056/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191339.517608:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a128 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604f3e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191339.517621:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a128 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604f3e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.517631:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/201 (0 0) 00000080:00200000:0.0:1787191339.517636:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xc9:0x0] suppgids 0 0: rc 0 00000100:00100000:1.0:1787191339.518580:0:57880:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57880:1874004626669312:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191339.518604:0:57880:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a8700 x1874004626668928/t8589936820(8589936820) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191339.518666:0:57880:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a121 from it ffff936b5339f360 00010000:00010000:1.0:1787191339.518673:0:57880:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a121 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604f5a expref: -99 pid: 57880 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.518684:0:57880:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a121 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604f5a expref: -99 pid: 57880 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191339.518706:0:57880:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448), inode mode 81a4 mask 46 00000080:00200080:1.0:1787191339.518790:0:57880:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448) cmd=800466af arg=7ffe12aec38c 00000080:00200080:1.0:1787191339.518805:0:57880:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448) cmd=80086601 arg=7ffe12aec328 00000100:00100000:1.0:1787191339.518861:0:57880:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57880:1874004626669440:192.168.202.101@tcp:33:lfs.0 00000100:00100000:1.0:1787191339.518929:0:57880:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893180 going to sleep for 11 seconds 00000080:00010000:0.0:1787191339.520649:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) for lock 0xe5129dc88483a128 00000080:00010000:0.0:1787191339.520664:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a128 from it ffffa3fb41cab8c8 00010000:00010000:0.0:1787191339.520670:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a128 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604f3e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.520683:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a128 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604f3e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.520709:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a121 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604f5a expref: -99 pid: 57880 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.520722:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a121 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604f5a expref: -99 pid: 57880 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1787191339.520731:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xc9:0x0](00000000d13126ac) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a121 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604f5a expref: -99 pid: 57880 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.520740:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a121 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604f5a expref: -99 pid: 57880 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.520753:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a121 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604f5a expref: -99 pid: 57880 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:0.0:1787191339.520773:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xc9:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:0.0:1787191339.520780:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc9:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191339.520783:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xc9:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:0.0:1787191339.520793:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xc9:0x0](ffff936b5395f448) 00000002:00010000:0.0:1787191339.520802:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc9:0x0]) in obj [0x200000405:0xc9:0x0], intent: layout flags 02 00010000:00010000:0.0:1787191339.520816:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a128 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4604f3e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1787191339.521258:0:57880:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57880:1874004626669440:192.168.202.101@tcp:33:lfs.0 00000080:00200080:3.0:1787191339.521293:0:57880:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448) cmd=c00c66f3 arg=7ffe12aec314 00000080:00200008:3.0:1787191339.521461:0:57880:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc9:0x0](ffff936b5395f448), flags 154002 00000080:00200000:0.0:1787191339.522714:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc9:0x0]: losing layout lock 00010000:00010000:0.0:1787191339.522739:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a121 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4604f5a expref: -99 pid: 57880 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191339.522754:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc9:0x0]: losing layout lock 00010000:00010000:0.0:1787191339.522787:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a128 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4604f3e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.522795:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a121 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604f5a expref: -99 pid: 57880 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191339.522800:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1787191339.522803:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a128 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4604f3e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.522814:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a121 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4604f5a expref: -99 pid: 57880 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191339.522862:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a12f lrc: 3/0,1 mode: --/EX res: [0x200000405:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.522870:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a12f lrc: 3/0,1 mode: --/EX res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191339.522881:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191339.522892:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474700 x1874004626669696/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 384/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191339.522902:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a12f lrc: 3/0,1 mode: --/EX res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191339.522924:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626669696:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191339.523010:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000080:00200000:0.0:1787191339.536283:0:57881:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191339.536313:0:57881:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.536330:0:57881:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.536346:0:57881:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.536355:0:57881:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191339.536364:0:57881:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191339.536367:0:57881:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191339.536374:0:57881:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421fbbf8 00010000:00010000:0.0:1787191339.536378:0:57881:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.536388:0:57881:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.536404:0:57881:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191339.536412:0:57881:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191339.536417:0:57881:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191339.536430:0:57881:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b45036600, open_flags d900, mode 0 opened 0 00000080:00200000:0.0:1787191339.536437:0:57881:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:0.0:1787191339.536451:0:57881:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:0.0:1787191339.536518:0:57881:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57881 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.536526:0:57881:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57881 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191339.536538:0:57881:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:0.0:1787191339.536550:0:57881:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474380 x1874004626669952/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191339.536560:0:57881:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57881 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191339.536582:0:57881:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57881:1874004626669952:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191339.536777:0:57881:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00000100:00100000:3.0:1787191339.543062:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191339.543095:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634886016 00000100:00100000:3.0:1787191339.543104:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634886016 00000100:00100000:3.0:1787191339.543165:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1330 00000100:00100000:3.0:1787191339.543176:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:37089:x1874004634886016:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191339.543194:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a0aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4604de0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191339.543259:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191339.543266:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:37089:x1874004634886016:12345-192.168.202.101@tcp:104: Request processed in 93us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191339.543273:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1330 00010000:00010000:3.0:1787191339.543297:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191339.543303:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a0aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4604de0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191339.543316:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44caf000 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191339.543321:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a0aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4604de0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191339.543364:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a0aa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4604de0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191339.543372:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191339.543393:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a0aa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4604de0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191339.543401:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a0aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4604de0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191339.543422:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191339.543424:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191339.543426:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191339.543440:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626670080:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191339.543528:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191339.543547:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634886656 00000100:00100000:3.0:1787191339.543550:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634886656 00000100:00100000:3.0:1787191339.543571:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1331 00000100:00100000:3.0:1787191339.543578:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8420:x1874004634886656:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191339.543586:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc88483a09c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000030000 nid: local remote: 0x7130d520e4604db6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191339.543619:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191339.543625:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8420:x1874004634886656:12345-192.168.202.101@tcp:104: Request processed in 48us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191339.543631:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1331 00000100:00100000:0.0:1787191339.543860:0:57881:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589936822 gen 1 00000100:00100000:0.0:1787191339.543941:0:57881:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b6a476a00 x1874004626668032/t8589936816(8589936816) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191355 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787191339.543962:0:57881:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff936b6a474380 x1874004626669952/t8589936823(8589936823) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191355 ref 3 fl Rpc:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787191339.543973:0:57881:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57881:1874004626669952:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191339.543987:0:57881:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604fa7 expref: -99 pid: 57881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.544003:0:57881:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604fa7 expref: -99 pid: 57881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.544011:0:57881:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604fa7 expref: -99 pid: 57881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.544022:0:57881:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604fa7 expref: -99 pid: 57881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.544032:0:57881:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604fa7 expref: -99 pid: 57881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.544053:0:57881:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604fa7 expref: -99 pid: 57881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.544062:0:57881:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604fa7 expref: -99 pid: 57881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.544069:0:57881:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604fa7 expref: -99 pid: 57881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191339.544084:0:57881:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b6a474380 x1874004626669952/t8589936823(8589936823) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191339.544095:0:57881:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474380 x1874004626669952/t8589936823(8589936823) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191339.544106:0:57881:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604fa7 expref: -99 pid: 57881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191339.544119:0:57881:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604fa7 expref: -99 pid: 57881 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.544127:0:57881:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/201 (0 0) 00000080:00200000:0.0:1787191339.544133:0:57881:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191339.544200:0:57881:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc9:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191339.544208:0:57881:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc9:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191339.544212:0:57881:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191339.544217:0:57881:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:0.0:1787191339.544268:0:57881:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc9:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:0.0:1787191339.544296:0:57881:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483a105 lrc: 1/0,0 mode: PR/PR res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604f06 expref: -99 pid: 57880 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000008:00010000:0.0:1787191339.544312:0:57881:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000da911a26/0xe5129dc88483a10c lrc: 1/0,0 mode: PR/PR res: [0x280000401:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604f22 expref: -99 pid: 57880 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191339.544368:0:57881:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xc9:0x0](ffff936b5395f448): rc = 0 00000080:00200000:0.0:1787191339.544388:0:57881:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc9:0x0]: layout version change: 4294967294 -> 4 00000080:00010000:0.0:1787191339.544394:0:57881:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) for lock 0xe5129dc88483a136 00000080:00010000:0.0:1787191339.544410:0:57881:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) 00000080:00200008:0.0:1787191339.544424:0:57881:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc9:0x0](ffff936b5395f448), flags 154400 00000002:00100000:0.0:1787191339.544447:0:57881:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474380 x1874004626669952/t8589936823(8589936823) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191339.544485:0:57881:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a136 from it ffff936b495dca80 00010000:00010000:0.0:1787191339.544490:0:57881:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604fa7 expref: -99 pid: 57881 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.544500:0:57881:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604fa7 expref: -99 pid: 57881 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191339.544520:0:57881:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448), inode mode 81a4 mask 44 00000080:00200000:0.0:1787191339.544626:0:57881:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448), inode mode 81a4 mask 4 00000080:00200000:0.0:1787191339.544634:0:57881:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448), xattr lov 00000080:00200008:0.0:1787191339.544662:0:57881:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc9:0x0](ffff936b5395f448), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191339.544668:0:57881:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448),name=f70.sanity-flr 00000002:00010000:0.0:1787191339.544685:0:57881:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc9:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.544693:0:57881:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604fa7 expref: -99 pid: 57881 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.544703:0:57881:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604fa7 expref: -99 pid: 57881 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191339.544711:0:57881:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191339.544716:0:57881:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) 00000080:00010000:0.0:1787191339.544720:0:57881:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) for lock 0xe5129dc88483a136 00000080:00010000:0.0:1787191339.544724:0:57881:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a136 from it ffffa3fb421fbcd8 00010000:00010000:0.0:1787191339.544727:0:57881:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604fa7 expref: -99 pid: 57881 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.544735:0:57881:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604fa7 expref: -99 pid: 57881 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191339.544752:0:57881:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc9:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1787191339.544758:0:57881:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc9:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191339.544761:0:57881:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191339.544763:0:57881:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc9:0x0] 00000008:00010000:0.0:1787191339.544777:0:57881:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191339.544780:0:57881:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b46b503b0, osc lock ffff936b50b631d0, flags 0x400000400001002 00010000:00010000:0.0:1787191339.544815:0:57881:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc88483a13d lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57881 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.544825:0:57881:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc88483a13d lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57881 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.544868:0:57881:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b6a475880 x1874004626670208/t0(0) o101->lustre-OST0000-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:0.0:1787191339.544897:0:57881:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:0.0:1787191339.544916:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626670208:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191339.545191:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626669696:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191339.545205:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a12f lrc: 4/0,1 mode: --/EX res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604f6f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.545213:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a12f lrc: 4/0,1 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604f6f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.545221:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a12f lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604f6f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.545230:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a12f lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604f6f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.545239:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a12f lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604f6f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.545246:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a12f lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604f6f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.545253:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a12f lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604f6f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191339.545261:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b6a474700 x1874004626669696/t8589936822(8589936822) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 384/736 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191339.545275:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a12f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604f6f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191339.545284:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a12f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604f6f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.545292:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/201 (0 0) 00000080:00200000:1.0:1787191339.545296:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xc9:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191339.545305:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) for lock 0xe5129dc88483a12f 00000080:00010000:1.0:1787191339.545309:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a12f from it ffffa3fb41cab930 00010000:00010000:1.0:1787191339.545312:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a12f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604f6f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.545320:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a12f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604f6f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191339.545332:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:1.0:1787191339.545335:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc9:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00020000:00200000:1.0:1787191339.545344:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xc9:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:1.0:1787191339.545347:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc9:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191339.545350:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191339.545356:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191339.545368:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191339.545371:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:1.0:1787191339.545379:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:1.0:1787191339.545382:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b628931b0, osc lock ffff936b46837c80, flags 0x80000000 00000008:00010000:1.0:1787191339.545385:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:1.0:1787191339.545387:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b628931f0, osc lock ffff936b46836130, flags 0x80000000 00010000:00010000:1.0:1787191339.545393:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b52377800 type 11 mode 2 res 10737419265/436 (0 1048575) 00010000:00010000:1.0:1787191339.545412:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.545421:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.545430:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191339.545444:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626670336:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191339.545471:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00010000:00010000:1.0:1787191339.545496:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191339.545502:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc88483a09c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000030000 nid: local remote: 0x7130d520e4604db6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191339.545511:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cae200 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191339.545517:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc88483a09c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428400030000 nid: local remote: 0x7130d520e4604db6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191339.545548:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc88483a09c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e4604db6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191339.545556:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191339.545569:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc88483a09c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e4604db6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191339.545577:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000000dfb27c0/0xe5129dc88483a09c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e4604db6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191339.545592:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191339.545594:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191339.545595:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191339.545604:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626670464:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191339.549099:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626670080:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787191339.549491:0:2389:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc88483a13d lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57881 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.549512:0:2389:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc88483a13d lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604fb5 expref: -99 pid: 57881 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.549526:0:2389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc88483a13d lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604fb5 expref: -99 pid: 57881 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.549538:0:2389:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc88483a13d lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604fb5 expref: -99 pid: 57881 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191339.549559:0:2389:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc88483a13d lrc: 5/2,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604fb5 expref: -99 pid: 57881 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1787191339.549570:0:2389:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1787191339.549587:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc88483a13d lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4604fb5 expref: -99 pid: 57881 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.549595:0:2389:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc88483a13d lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4604fb5 expref: -99 pid: 57881 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.549603:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc88483a13d lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4604fb5 expref: -99 pid: 57881 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.549611:0:2389:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc88483a13d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4604fb5 expref: -99 pid: 57881 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1787191339.549627:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626670208:192.168.202.101@tcp:101:lfs.0 00000080:00200000:0.0:1787191339.549693:0:57881:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc9:0x0] updating i_size 0 i_blocks 0 00000020:00010000:0.0:1787191339.549699:0:57881:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c3abf0 (ffff936b47a17f38/0) at cl_lock_release():245 00000020:00010000:0.0:1787191339.549702:0:57881:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c3abf0 (ffff936b47a17f38/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191339.549708:0:57881:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b46b503b0 (ffff936b47a17c68/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191339.549712:0:57881:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c3abf0 (ffff936b47a17f38/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191339.549715:0:57881:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b46b503b0 (ffff936b47a17f38/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191339.549729:0:57881:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc9:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1787191339.549792:0:57881:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc9:0x0](ffff936b5395f448), flags 154000 00000002:00100000:0.0:1787191339.549906:0:57881:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a474380 x1874004626669952/t8589936823(8589936823) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191355 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191339.549918:0:57881:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191339.549924:0:57881:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a476680 x1874004626670720/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191339.549945:0:57881:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57881:1874004626670720:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191339.550027:0:57881:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00000100:00100000:2.0:1787191339.551019:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191339.551147:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634886784 00000100:00100000:3.0:1787191339.551156:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634886784 00000100:00100000:3.0:1787191339.551212:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1332 00000100:00100000:3.0:1787191339.551224:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8422:x1874004634886784:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191339.551242:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc88483a13d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000010000 nid: local remote: 0x7130d520e4604fb5 expref: -99 pid: 57881 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191339.551310:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191339.551316:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8422:x1874004634886784:12345-192.168.202.101@tcp:104: Request processed in 94us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191339.551323:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1332 00010000:00010000:1.0:1787191339.551469:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191339.551476:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc88483a13d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000010000 nid: local remote: 0x7130d520e4604fb5 expref: -99 pid: 57881 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.551493:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cae800 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191339.551499:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc88483a13d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800428400010000 nid: local remote: 0x7130d520e4604fb5 expref: -99 pid: 57881 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191339.551548:0:57627:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc9:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1787191339.551558:0:57627:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc9:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1787191339.551597:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc88483a13d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400010020 nid: local remote: 0x7130d520e4604fb5 expref: -99 pid: 57881 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.551604:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191339.551628:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc88483a13d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400010020 nid: local remote: 0x7130d520e4604fb5 expref: -99 pid: 57881 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.551636:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e47c8f59/0xe5129dc88483a13d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400010020 nid: local remote: 0x7130d520e4604fb5 expref: -99 pid: 57881 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.551652:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191339.551654:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191339.551656:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191339.551667:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787191339.551678:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626670848:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191339.552515:0:57881:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57881:1874004626670720:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191339.552543:0:57881:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a474380 x1874004626669952/t8589936823(8589936823) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191339.552806:0:57881:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191339.552824:0:57881:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.552871:0:57881:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.552884:0:57881:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.552893:0:57881:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191339.552899:0:57881:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191339.552903:0:57881:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191339.552911:0:57881:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421fbb58 00010000:00010000:0.0:1787191339.552915:0:57881:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.552924:0:57881:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.552937:0:57881:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191339.552943:0:57881:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191339.552949:0:57881:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191339.552952:0:57881:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=9 00000080:00200008:0.0:1787191339.552959:0:57881:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc9:0x0](ffff936b5395f448), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191339.552965:0:57881:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448),name=f70.sanity-flr 00000002:00010000:0.0:1787191339.552978:0:57881:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc9:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.552984:0:57881:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604fa7 expref: -99 pid: 57881 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191339.552993:0:57881:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604fa7 expref: -99 pid: 57881 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191339.552999:0:57881:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191339.553003:0:57881:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) 00000080:00010000:0.0:1787191339.553006:0:57881:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) for lock 0xe5129dc88483a136 00000080:00010000:0.0:1787191339.553010:0:57881:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a136 from it ffffa3fb421fbcb8 00010000:00010000:0.0:1787191339.553013:0:57881:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604fa7 expref: -99 pid: 57881 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191339.553021:0:57881:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604fa7 expref: -99 pid: 57881 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191339.553052:0:57881:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc9:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:0.0:1787191339.553063:0:57881:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc9:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191339.553066:0:57881:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191339.553069:0:57881:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc9:0x0] 00000008:00010000:0.0:1787191339.553090:0:57881:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191339.553093:0:57881:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b46b503b0, osc lock ffff936b50b631d0, flags 0x400000400001002 00010000:00010000:0.0:1787191339.553106:0:57881:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b52377800 type 11 mode 6 res 10737419265/436 (0 1048575) 00010000:00010000:0.0:1787191339.553136:0:57881:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a14b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57881 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.553146:0:57881:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a14b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57881 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.553156:0:57881:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b6a476680 x1874004626670976/t0(0) o101->lustre-OST0000-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:0.0:1787191339.553188:0:57881:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:0.0:1787191339.553202:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787191339.553215:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626670976:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191339.554979:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191339.555014:0:40922:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787191339.555028:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634886912 00000100:00100000:2.0:1787191339.555035:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634886912 00000100:00100000:2.0:1787191339.555095:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1333 00000100:00100000:2.0:1787191339.555105:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b50882850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:6489:x1874004634886912:12345-192.168.202.101@tcp:105: 00010000:00010000:2.0:1787191339.555119:0:40922:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.555138:0:40922:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.555148:0:40922:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.555159:0:40922:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080000000000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.555168:0:40922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080000000000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.555177:0:40922:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000000000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.555192:0:40922:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b40030600) 00000100:00100000:2.0:1787191339.555231:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b50882850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:6489:x1874004634886912:12345-192.168.202.101@tcp:105: Request processed in 128us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191339.555239:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1333 00000100:00100000:0.0:1787191339.555973:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626670336:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191339.555992:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.556008:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191339.556026:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.556037:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.556055:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.556122:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc88483a152 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.556138:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc88483a152 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.556148:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc88483a152 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191339.556168:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626671104:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191339.556230:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00000100:00100000:3.0:1787191339.556968:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191339.557026:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634887040 00000100:00100000:2.0:1787191339.557032:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634887040 00000100:00100000:2.0:1787191339.557086:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1334 00000100:00100000:2.0:1787191339.557094:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30510:x1874004634887040:12345-192.168.202.101@tcp:106: 00010000:00010000:2.0:1787191339.557103:0:51131:0:(ldlm_lockd.c:2541:ldlm_callback_handler()) ### glimpse ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.557113:0:51131:0:(ldlm_lockd.c:2123:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00010000:2.0:1787191339.557148:0:51131:0:(cl_object.c:322:cl_object_glimpse()) header@00000000c8a6ee3a[0x110, 1, [0x200000405:0xc9:0x0] hash] 00000020:00010000:2.0:1787191339.557150:0:51131:0:(cl_object.c:322:cl_object_glimpse()) size: 0 mtime: 1787191339 atime: 1787191339 ctime: 1787191339 blocks: 0 00000020:00010000:2.0:1787191339.557154:0:51131:0:(cl_object.c:322:cl_object_glimpse()) header@00000000d34613dc[0x110, 2, [0x280000401:0x1b4:0x0] hash] 00000020:00010000:2.0:1787191339.557156:0:51131:0:(cl_object.c:322:cl_object_glimpse()) size: 0 mtime: 1787191339 atime: 1787191339 ctime: 1787191339 blocks: 0 00000100:00100000:2.0:1787191339.557189:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30510:x1874004634887040:12345-192.168.202.101@tcp:106: Request processed in 96us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191339.557196:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1334 00000100:00100000:1.0:1787191339.557596:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626670464:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787191339.561647:0:2389:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a14b lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57881 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.561670:0:2389:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a14b lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57881 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.561685:0:2389:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a14b lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 57881 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.561695:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a14b lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 57881 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.561704:0:2389:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a14b lrc: 5/1,0 mode: --/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 57881 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191339.561718:0:2389:0:(osc_lock.c:187:osc_lock_lvb_update()) ### no dlm lock: acquired size 0, setting rss=0; leaving kms=0, end=18446744073709551615 00000020:00200000:1.0:1787191339.561725:0:2389:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1787191339.561746:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a14b lrc: 4/1,0 mode: --/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 57881 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.561754:0:2389:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a14b lrc: 3/0,0 mode: --/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 57881 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.561762:0:2389:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a14b lrc: 4/0,0 mode: --/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 57881 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.561769:0:2389:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cae400 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191339.561775:0:2389:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a14b lrc: 5/0,0 mode: --/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 57881 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.561786:0:2389:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191339.561794:0:2389:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a14b lrc: 3/0,0 mode: --/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 57881 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.561802:0:2389:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a14b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 57881 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191339.561825:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626670976:192.168.202.101@tcp:101:lfs.0 00000080:00200000:3.0:1787191339.562030:0:57881:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc9:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1787191339.562037:0:57881:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c3abf0 (ffff936b47a17f38/0) at cl_lock_release():245 00000020:00010000:3.0:1787191339.562053:0:57881:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c3abf0 (ffff936b47a17f38/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191339.562058:0:57881:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b46b503b0 (ffff936b47a17c68/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191339.562063:0:57881:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c3abf0 (ffff936b47a17f38/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191339.562065:0:57881:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b46b503b0 (ffff936b47a17f38/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191339.562079:0:57881:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc9:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191339.562130:0:57881:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191339.562154:0:57881:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191339.562169:0:57881:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191339.562182:0:57881:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191339.562190:0:57881:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191339.562198:0:57881:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191339.562201:0:57881:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191339.562208:0:57881:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421fbbf8 00010000:00010000:3.0:1787191339.562211:0:57881:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191339.562219:0:57881:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191339.562234:0:57881:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191339.562241:0:57881:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191339.562247:0:57881:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191339.562251:0:57881:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:3.0:1787191339.562255:0:57881:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448), inode mode 81a4 mask 46 00000080:00200008:3.0:1787191339.562264:0:57881:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc9:0x0](ffff936b5395f448), flags 154402 00000080:00200000:3.0:1787191339.562364:0:57881:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448), inode mode 81a4 mask 4 00000080:00200000:3.0:1787191339.562371:0:57881:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448), xattr lov 00000080:00200008:3.0:1787191339.562396:0:57881:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc9:0x0](ffff936b5395f448), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191339.562402:0:57881:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448),name=f70.sanity-flr 00000002:00010000:3.0:1787191339.562416:0:57881:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc9:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191339.562424:0:57881:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604fa7 expref: -99 pid: 57881 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191339.562433:0:57881:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604fa7 expref: -99 pid: 57881 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787191339.562439:0:57881:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191339.562444:0:57881:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) 00000080:00010000:3.0:1787191339.562447:0:57881:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) for lock 0xe5129dc88483a136 00000080:00010000:3.0:1787191339.562451:0:57881:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a136 from it ffffa3fb421fbcd8 00010000:00010000:3.0:1787191339.562454:0:57881:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604fa7 expref: -99 pid: 57881 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191339.562461:0:57881:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604fa7 expref: -99 pid: 57881 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:3.0:1787191339.562475:0:57881:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc9:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:3.0:1787191339.562499:0:57881:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc9:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191339.562503:0:57881:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191339.562506:0:57881:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc9:0x0] 00000008:00010000:3.0:1787191339.562524:0:57881:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191339.562528:0:57881:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667b30, osc lock ffff936b44f65300, flags 0x400000400001002 00010000:00010000:3.0:1787191339.562543:0:57881:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.562553:0:57881:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1787191339.562563:0:57881:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191339.562566:0:57881:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 7/0,2 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.562574:0:57881:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1787191339.562582:0:57881:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191339.562588:0:57881:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc9:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1787191339.562591:0:57881:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c3abf0 (ffff936b47a17f38/0) at cl_lock_release():245 00000020:00010000:3.0:1787191339.562593:0:57881:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c3abf0 (ffff936b47a17f38/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191339.562596:0:57881:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667b30 (ffff936b47a17c68/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191339.562599:0:57881:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c3abf0 (ffff936b47a17f38/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191339.562602:0:57881:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667b30 (ffff936b47a17f38/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191339.562608:0:57881:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc9:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200080:3.0:1787191339.562687:0:57881:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448) cmd=c00c66f3 arg=24ce2e0 00000080:00200008:3.0:1787191339.562798:0:57881:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc9:0x0](ffff936b5395f448), flags 154002 00000100:00100000:1.0:1787191339.566781:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626670848:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191339.566990:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626671104:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191339.567010:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc88483a152 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604fca expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.567034:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc88483a152 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4604fca expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.567058:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc88483a152 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4604fca expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.567072:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc88483a152 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4604fca expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191339.567084:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc88483a152 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4604fca expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.567097:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc88483a152 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4604fca expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.567105:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc88483a152 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4604fca expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191339.569955:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787191339.569979:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626671232:192.168.202.101@tcp:10:bash.0 00000100:00100000:2.0:1787191339.570156:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626671360:192.168.202.101@tcp:10:bash.0 00000100:00100000:2.0:1787191339.574356:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626671360:192.168.202.101@tcp:10:bash.0 00000100:00100000:2.0:1787191339.574430:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626671232:192.168.202.101@tcp:10:bash.0 00000080:00200000:1.0:1787191339.574581:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc9:0x0] updating i_size 0 i_blocks 0 00000020:00010000:1.0:1787191339.574589:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b497c9e48 (ffff936b465cc368/0) at cl_lock_release():245 00000020:00010000:1.0:1787191339.574593:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b497c9e48 (ffff936b465cc368/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191339.574598:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b628931b0 (ffff936b465cc3f8/1) at cl_lock_cancel():142 00010000:00010000:1.0:1787191339.574608:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.574692:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1787191339.574710:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b628931f0 (ffff936b465cc998/1) at cl_lock_cancel():142 00010000:00010000:1.0:1787191339.574716:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc88483a152 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4604fca expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.574724:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc88483a152 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604fca expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1787191339.574734:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b497c9e48 (ffff936b465cc368/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191339.574737:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b628931b0 (ffff936b465cc368/1) at cl_lock_fini():72 00000020:00010000:1.0:1787191339.574741:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b628931f0 (ffff936b465cc368/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191339.574760:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc9:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1787191339.574773:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xc9:0x0](ffff936b5395f448) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191339.000000000, mtime 1787191339.000000000, ctime 1787191339.000000000, rc 0 00000080:00200000:3.0:1787191339.575213:0:57882:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191339.575235:0:57882:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191339.575248:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191339.575261:0:57882:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191339.575268:0:57882:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191339.575274:0:57882:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191339.575277:0:57882:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191339.575283:0:57882:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42163bf8 00010000:00010000:3.0:1787191339.575287:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191339.575295:0:57882:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191339.575305:0:57882:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191339.575311:0:57882:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191339.575317:0:57882:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191339.575320:0:57882:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:3.0:1787191339.575323:0:57882:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448), inode mode 81a4 mask 44 00000080:00200008:3.0:1787191339.575796:0:57882:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc9:0x0](ffff936b5395f448), flags 154400 00000002:00010000:3.0:1787191339.575815:0:57882:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc9:0x0]) in obj [0x200000405:0xc9:0x0], intent: open flags 0104240114401 00010000:00010000:3.0:1787191339.577163:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a159 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.577177:0:57882:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a159 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57882 initiator: MDT0 lru_score: 0 lru_type: 0 00000080:00200008:1.0:1787191339.577188:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xc9:0x0], ppos: 0, count: 5 00000020:00100000:3.0:1787191339.577190:0:57882:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191339.577201:0:57882:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1dc00 x1874004626671616/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000080:00200000:1.0:1787191339.577202:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:1.0:1787191339.577207:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00010000:00010000:3.0:1787191339.577211:0:57882:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a159 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57882 initiator: MDT0 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1787191339.577214:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:1.0:1787191339.577219:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:1.0:1787191339.577226:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@00000000c8a6ee3a[0x110, 1, [0x200000405:0xc9:0x0] hash] 00000020:00200000:1.0:1787191339.577228:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000100:00100000:3.0:1787191339.577230:0:57882:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57882:1874004626671616:192.168.202.101@tcp:101:lfs.0 00000080:00200000:1.0:1787191339.577234:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc9:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:1.0:1787191339.577246:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xc9:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:1.0:1787191339.577250:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc9:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191339.577254:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:1.0:1787191339.577259:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:1.0:1787191339.577267:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:1.0:1787191339.577271:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1787191339.577292:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:1.0:1787191339.577310:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1787191339.577315:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b47d7d0b0, osc lock ffff936b46836130, flags 0x0 00010000:00010000:1.0:1787191339.577332:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.577344:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.577356:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.577364:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.577377:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191339.577388:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000100:00100000:3.0:1787191339.577487:0:57882:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cf00 going to sleep for 11 seconds 00000080:00200000:1.0:1787191339.578676:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:1.0:1787191339.578720:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:1.0:1787191339.578729:0:57570:0:(rw26.c:927:ll_write_end()) page@00000000de419574[3 000000002af24390 2 1 00000000fd37f800 0 0 0] 00000080:00200000:1.0:1787191339.578733:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @0000000004e64928 17ffffc0001001 3:0 ffff936b432590e0 0 lru 00000080:00200000:1.0:1787191339.578741:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@000000003b89a1eb 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000a2a44f55 00000000a9621480 > 3< 0 0 > 4< 0 0 8 386928640 - | - - - - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1787191339.578743:0:57570:0:(rw26.c:927:ll_write_end()) end page@00000000de419574 00000080:00200000:1.0:1787191339.578744:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:1.0:1787191339.578748:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:1.0:1787191339.578767:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 0000000056c7e072 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191339.578788:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b5395f5f8, count 1, dirtied 1 00000080:00200000:1.0:1787191339.578792:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:1.0:1787191339.578794:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:1.0:1787191339.578811:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b497c9e48 (ffff936b465cc368/0) at cl_lock_release():245 00000020:00010000:1.0:1787191339.578814:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b497c9e48 (ffff936b465cc368/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191339.578816:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7d0b0 (ffff936b465cc998/1) at cl_lock_cancel():142 00010000:00010000:1.0:1787191339.578821:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.578828:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:1.0:1787191339.578871:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b497c9e48 (ffff936b465cc368/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191339.578873:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7d0b0 (ffff936b465cc368/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191339.578880:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:1.0:1787191339.578885:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:1.0:1787191339.578890:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc9:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191339.578893:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:1.0:1787191339.578900:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc9:0x0] updating i_size 5 i_blocks 0 00000080:00200000:1.0:1787191339.578904:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:1.0:1787191339.578929:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc9:0x0](ffff936b5395f448), flags 100001 00000002:00100000:1.0:1787191339.578981:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a476a00 x1874004626668032/t8589936816(8589936816) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191355 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191339.578992:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:1.0:1787191339.578997:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453ab800 x1874004626671872/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191339.579015:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626671872:192.168.202.101@tcp:35:bash.0 00000100:00100000:1.0:1787191339.579078:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893180 going to sleep for 11 seconds 00000100:00100000:1.0:1787191339.581632:0:57882:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57882:1874004626671616:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191339.581653:0:57882:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a159 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604fd8 expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.581665:0:57882:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a159 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4604fd8 expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.581673:0:57882:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a159 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604fd8 expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191339.581686:0:57882:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x200002b, status=0 req@ffff936b51d1dc00 x1874004626671616/t8589936825(8589936825) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191339.581695:0:57882:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1dc00 x1874004626671616/t8589936825(8589936825) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191339.581704:0:57882:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a159 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604fd8 expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191339.581713:0:57882:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a159 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604fd8 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.581721:0:57882:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/201 (0 0) 00000080:00200000:1.0:1787191339.581725:0:57882:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xc9:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787191339.581776:0:57882:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc9:0x0]: layout version change: 4 -> 4 00000080:00010000:1.0:1787191339.581780:0:57882:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) for lock 0xe5129dc88483a159 00000080:00010000:1.0:1787191339.581784:0:57882:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a159 from it ffffa3fb42163bf0 00010000:00010000:1.0:1787191339.581787:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a159 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604fd8 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.581794:0:57882:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a159 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604fd8 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000002:00100000:1.0:1787191339.581814:0:57882:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1dc00 x1874004626671616/t8589936825(8589936825) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191339.581950:0:57882:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448), inode mode 81a4 mask 4 00000080:00200000:1.0:1787191339.581958:0:57882:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448), xattr lov 00000080:00200008:1.0:1787191339.581986:0:57882:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc9:0x0](ffff936b5395f448), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191339.581993:0:57882:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448),name=f70.sanity-flr 00000002:00010000:1.0:1787191339.582014:0:57882:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc9:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.582022:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604fa7 expref: -99 pid: 57881 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191339.582031:0:57882:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604fa7 expref: -99 pid: 57881 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1787191339.582036:0:57882:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191339.582050:0:57882:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) 00000080:00010000:1.0:1787191339.582054:0:57882:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) for lock 0xe5129dc88483a136 00000080:00010000:1.0:1787191339.582058:0:57882:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a136 from it ffffa3fb42163cd8 00010000:00010000:1.0:1787191339.582061:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604fa7 expref: -99 pid: 57881 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191339.582069:0:57882:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604fa7 expref: -99 pid: 57881 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1787191339.582090:0:57882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc9:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:1.0:1787191339.582103:0:57882:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc9:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191339.582106:0:57882:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191339.582110:0:57882:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc9:0x0] 00000008:00010000:1.0:1787191339.582240:0:57882:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191339.582244:0:57882:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b47d7d0b0, osc lock ffff936b46836130, flags 0x400000400001002 00010000:00010000:1.0:1787191339.582261:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191339.582276:0:57882:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1787191339.582285:0:57882:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191339.582287:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191339.582292:0:57882:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:1.0:1787191339.582299:0:57882:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191339.582307:0:57882:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc9:0x0] updating i_size 5 i_blocks 0 00000020:00010000:1.0:1787191339.582312:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b516572e0 (ffff936b465cc368/0) at cl_lock_release():245 00000020:00010000:1.0:1787191339.582314:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b516572e0 (ffff936b465cc368/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191339.582316:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7d0b0 (ffff936b465cc998/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191339.582319:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b516572e0 (ffff936b465cc368/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191339.582321:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7d0b0 (ffff936b465cc368/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191339.582328:0:57882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc9:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1787191339.582363:0:57882:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc9:0x0](ffff936b5395f448), flags 154000 00010000:00010000:1.0:1787191339.582376:0:57882:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a159 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604fd8 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191339.582556:0:57882:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191339.582567:0:57882:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.582575:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.582585:0:57882:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.582592:0:57882:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191339.582596:0:57882:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191339.582598:0:57882:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191339.582601:0:57882:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42163b58 00010000:00010000:1.0:1787191339.582603:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.582608:0:57882:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.582658:0:57882:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191339.582664:0:57882:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191339.582668:0:57882:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191339.582670:0:57882:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=9 00000080:00200008:1.0:1787191339.582673:0:57882:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc9:0x0](ffff936b5395f448), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191339.582676:0:57882:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448),name=f70.sanity-flr 00000002:00010000:1.0:1787191339.582682:0:57882:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc9:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.582687:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604fa7 expref: -99 pid: 57881 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1787191339.582692:0:57882:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604fa7 expref: -99 pid: 57881 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:1.0:1787191339.582700:0:57882:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191339.582703:0:57882:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) 00000080:00010000:1.0:1787191339.582704:0:57882:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) for lock 0xe5129dc88483a136 00000080:00010000:1.0:1787191339.582706:0:57882:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a136 from it ffffa3fb42163cb8 00010000:00010000:1.0:1787191339.582708:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4604fa7 expref: -99 pid: 57881 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1787191339.582713:0:57882:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604fa7 expref: -99 pid: 57881 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00000080:00200000:1.0:1787191339.582720:0:57882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc9:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:1.0:1787191339.582724:0:57882:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc9:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191339.582726:0:57882:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191339.582727:0:57882:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc9:0x0] 00000008:00010000:1.0:1787191339.582733:0:57882:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191339.582734:0:57882:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b47d7d0b0, osc lock ffff936b46836130, flags 0x400000400001002 00010000:00010000:1.0:1787191339.582739:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191339.582745:0:57882:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:1.0:1787191339.582750:0:57882:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191339.582752:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191339.582761:0:57882:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:1.0:1787191339.582766:0:57882:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191339.582769:0:57882:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc9:0x0] updating i_size 5 i_blocks 0 00000020:00010000:1.0:1787191339.582771:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b516572e0 (ffff936b465cc368/0) at cl_lock_release():245 00000020:00010000:1.0:1787191339.582772:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b516572e0 (ffff936b465cc368/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191339.582773:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7d0b0 (ffff936b465cc998/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191339.582775:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b516572e0 (ffff936b465cc368/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191339.582777:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7d0b0 (ffff936b465cc368/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191339.582781:0:57882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc9:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191339.582798:0:57882:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191339.582802:0:57882:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.582806:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.582811:0:57882:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.582815:0:57882:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191339.582817:0:57882:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191339.582819:0:57882:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191339.582821:0:57882:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42163bf8 00010000:00010000:1.0:1787191339.582823:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.582900:0:57882:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.582908:0:57882:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191339.582911:0:57882:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191339.582913:0:57882:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191339.582916:0:57882:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:1.0:1787191339.582918:0:57882:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448), inode mode 81a4 mask 46 00000080:00200008:1.0:1787191339.582924:0:57882:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xc9:0x0](ffff936b5395f448), flags 154402 00000002:00010000:1.0:1787191339.582935:0:57882:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc9:0x0]) in obj [0x200000405:0xc9:0x0], intent: open flags 0104240114403 00010000:00010000:1.0:1787191339.582973:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a160 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x10000000000000 pid: 57882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.582979:0:57882:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a160 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x0 pid: 57882 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191339.582990:0:57882:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191339.583000:0:57882:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8e00 x1874004626672128/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191339.583010:0:57882:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a160 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x0 pid: 57882 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191339.583027:0:57882:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57882:1874004626672128:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191339.583231:0:57882:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787191339.583324:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626671872:192.168.202.101@tcp:35:bash.0 00000002:00100000:0.0:1787191339.583345:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a476a00 x1874004626668032/t8589936816(8589936816) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787191339.587061:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191339.587101:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634887168 00000100:00100000:2.0:1787191339.587109:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634887168 00000100:00100000:2.0:1787191339.587168:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1335 00000100:00100000:2.0:1787191339.587178:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634887168:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191339.587196:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4604fa7 expref: -99 pid: 57881 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00010000:00010000:2.0:1787191339.587271:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191339.587277:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634887168:12345-192.168.202.101@tcp:104: Request processed in 101us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191339.587288:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1335 00010000:00010000:0.0:1787191339.587295:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191339.587302:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4604fa7 expref: -99 pid: 57881 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00010000:00010000:0.0:1787191339.587315:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cafa00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191339.587320:0:40930:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4604fa7 expref: -99 pid: 57881 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00010000:00010000:0.0:1787191339.587439:0:40930:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4604fa7 expref: -99 pid: 57881 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00010000:00010000:0.0:1787191339.587450:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4604fa7 expref: -99 pid: 57881 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00010000:00010000:1.0:1787191339.589249:0:40930:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a159 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604fd8 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191339.589282:0:40930:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a12f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604f6f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191339.589581:0:57883:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191339.589603:0:57883:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191339.589669:0:57883:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.589670:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4604fa7 expref: -99 pid: 57881 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00010000:00010000:1.0:1787191339.589679:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191339.589681:0:57883:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191339.589688:0:57883:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191339.589696:0:57883:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191339.589699:0:57883:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191339.589706:0:57883:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421cbb58 00010000:00010000:2.0:1787191339.589710:0:57883:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.589715:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4604fa7 expref: -99 pid: 57881 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00010000:00010000:2.0:1787191339.589718:0:57883:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.589723:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a136 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4604fa7 expref: -99 pid: 57881 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00000080:00200000:2.0:1787191339.589731:0:57883:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00010000:00010000:1.0:1787191339.589738:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:2.0:1787191339.589738:0:57883:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00010000:00010000:1.0:1787191339.589740:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191339.589743:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:2.0:1787191339.589745:0:57883:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:1.0:1787191339.589754:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000080:00200000:2.0:1787191339.589756:0:57883:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:2.0:1787191339.589760:0:57883:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191339.589774:0:57883:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00000100:00100000:1.0:1787191339.589778:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626672256:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787191339.589812:0:57883:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc88483a167 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57883 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.589822:0:57883:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc88483a167 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57883 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.589852:0:57883:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc88483a167 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57883 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191339.589868:0:57883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8a80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57883:1874004626672384:192.168.202.101@tcp:101:rm.0 00000100:00100000:2.0:1787191339.590600:0:57883:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787191339.593012:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626672256:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191339.593199:0:57882:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57882:1874004626672128:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191339.593220:0:57882:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CW ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a160 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604fed expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.593232:0:57882:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a160 lrc: 4/1,0 mode: --/CW res: [0x200000405:0xc9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604fed expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.593244:0:57882:0:(ldlm_request.c:795:ldlm_cli_enqueue_fini()) ### enqueue reply includes blocking AST ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a160 lrc: 4/1,0 mode: --/CW res: [0x200000405:0xc9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4604fed expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.593255:0:57882:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a160 lrc: 4/1,0 mode: CW/CW res: [0x200000405:0xc9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e4604fed expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.593266:0:57882:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a160 lrc: 4/1,0 mode: CW/CW res: [0x200000405:0xc9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4604fed expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.593278:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a160 lrc: 5/1,1 mode: CW/CW res: [0x200000405:0xc9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e4604fed expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.593287:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a160 lrc: 5/1,1 mode: CW/CW res: [0x200000405:0xc9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e4604fed expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.593294:0:57882:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a160 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xc9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e4604fed expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191339.593305:0:57882:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x200002b, status=0 req@ffff936b453a8e00 x1874004626672128/t8589936827(8589936827) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191339.593318:0:57882:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8e00 x1874004626672128/t8589936827(8589936827) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191339.593438:0:57882:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a160 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xc9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4604fed expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.593449:0:57882:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 8 res 8589935621/201 (0 0) 00000080:00200000:1.0:1787191339.593454:0:57882:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xc9:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191339.593580:0:57882:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) for lock 0xe5129dc88483a160 00000080:00010000:1.0:1787191339.593585:0:57882:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a160 from it ffffa3fb42163bf0 00010000:00010000:1.0:1787191339.593588:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a160 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xc9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e4604fed expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.593593:0:57882:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a160 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xc9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e4604fed expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.593608:0:57882:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000002:00100000:1.0:1787191339.593626:0:57882:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8e00 x1874004626672128/t8589936827(8589936827) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1787191339.593640:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191339.593647:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a160 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xc9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4604fed expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.593654:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40031800 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191339.593659:0:40929:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a160 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xc9:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4604fed expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.593667:0:40929:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a160 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xc9:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4604fed expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.593676:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a160 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0xc9:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x7130d520e4604fed expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.593699:0:40929:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a159 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4604fd8 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191339.593734:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a160 lrc: 2/0,0 mode: --/CW res: [0x200000405:0xc9:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e4604fed expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.593740:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000080:00200000:1.0:1787191339.593792:0:57882:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448), inode mode 81a4 mask 4 00000100:00100000:2.0:1787191339.593798:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626672512:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00200000:1.0:1787191339.593800:0:57882:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448), xattr lov 00000080:00200008:1.0:1787191339.593824:0:57882:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc9:0x0](ffff936b5395f448), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191339.593850:0:57882:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448),name=f70.sanity-flr 00000002:00010000:1.0:1787191339.593864:0:57882:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc9:0x0]) in obj [0x200000405:0xc9:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.593870:0:57882:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 30 res 8589935621/201 (0 0) 00010000:00010000:1.0:1787191339.593895:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a16e lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x10000000000000 pid: 57882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.593902:0:57882:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a16e lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x0 pid: 57882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.593910:0:57882:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a16e lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x0 pid: 57882 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191339.593923:0:57882:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57882:1874004626672640:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191339.593946:0:57882:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00010000:00010000:3.0:1787191339.593968:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a160 lrc: 1/0,0 mode: --/CW res: [0x200000405:0xc9:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e4604fed expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.593976:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a160 lrc: 0/0,0 mode: --/CW res: [0x200000405:0xc9:0x0].0x0 bits 0x5/0x5 rrc: 6 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e4604fed expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.593989:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191339.593991:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191339.593993:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191339.597326:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626672512:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191339.597357:0:57882:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57882:1874004626672640:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191339.597376:0:57882:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a16e lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460501e expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.597387:0:57882:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a16e lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460501e expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.597411:0:57882:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a16e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460501e expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.597422:0:57882:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a16e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460501e expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.597434:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a16e lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460501e expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.597442:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a16e lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460501e expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.597450:0:57882:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a16e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460501e expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191339.597457:0:57883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8a80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57883:1874004626672384:192.168.202.101@tcp:101:rm.0 00000002:00100000:1.0:1787191339.597460:0:57882:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b453ab480 x1874004626672640/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/976 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1787191339.597467:0:57883:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc88483a167 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605009 expref: -99 pid: 57883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191339.597471:0:57882:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a16e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460501e expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.597485:0:57883:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc88483a167 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605009 expref: -99 pid: 57883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.597492:0:57883:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc88483a167 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605009 expref: -99 pid: 57883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.597500:0:57883:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc88483a167 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605009 expref: -99 pid: 57883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.597508:0:57883:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc88483a167 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605009 expref: -99 pid: 57883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.597521:0:57883:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc88483a167 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605009 expref: -99 pid: 57883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.597528:0:57883:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc88483a167 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605009 expref: -99 pid: 57883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.597535:0:57883:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc88483a167 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605009 expref: -99 pid: 57883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191339.597544:0:57883:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b513b8a80 x1874004626672384/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/976 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191339.597552:0:57883:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc88483a167 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605009 expref: -99 pid: 57883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191339.597564:0:57883:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc88483a167 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605009 expref: -99 pid: 57883 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.597574:0:57883:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a16e lrc: 4/2,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460501e expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.597584:0:57883:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a16e lrc: 4/2,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460501e expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.597592:0:57883:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc88483a167 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605009 expref: -99 pid: 57883 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.597599:0:57883:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc88483a167 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x7130d520e4605009 expref: -99 pid: 57883 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.597606:0:57883:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc88483a167 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x7130d520e4605009 expref: -99 pid: 57883 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191339.597659:0:57882:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a16e lrc: 4/2,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460501e expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.597668:0:57882:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/201 (0 0) 00000080:00200000:1.0:1787191339.597675:0:57882:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xc9:0x0] suppgids 0 0: rc 0 00010000:00010000:0.0:1787191339.597684:0:57883:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000080:00200000:0.0:1787191339.597688:0:57883:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191339.597718:0:57883:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xc9:0x0](ffff936b5395f448): rc = 0 00000080:00200000:0.0:1787191339.597730:0:57883:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc9:0x0]: layout version change: 4 -> 4 00000080:00200000:1.0:1787191339.597730:0:57882:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc9:0x0]: layout version change: 4 -> 4 00000080:00010000:0.0:1787191339.597735:0:57883:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) for lock 0xe5129dc88483a16e 00000080:00010000:1.0:1787191339.597735:0:57882:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) for lock 0xe5129dc88483a16e 00000080:00010000:1.0:1787191339.597741:0:57882:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) 00000080:00010000:1.0:1787191339.597744:0:57882:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a16e from it ffffa3fb42163cd8 00000080:00010000:0.0:1787191339.597746:0:57883:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) 00010000:00010000:1.0:1787191339.597747:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a16e lrc: 4/2,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460501e expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000080:00010000:0.0:1787191339.597749:0:57883:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a16e from it ffffa3fb421cbb20 00010000:00010000:1.0:1787191339.597755:0:57882:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a16e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460501e expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1787191339.597775:0:57882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc9:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00010000:00010000:2.0:1787191339.597780:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00020000:00200000:1.0:1787191339.597785:0:57882:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc9:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00010000:00010000:2.0:1787191339.597786:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc88483a167 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x7130d520e4605009 expref: -99 pid: 57883 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00020000:00200000:1.0:1787191339.597789:0:57882:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191339.597792:0:57882:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc9:0x0] 00000008:00010000:1.0:1787191339.597810:0:57882:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00010000:00010000:0.0:1787191339.597811:0:57883:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a16e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460501e expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191339.597813:0:57882:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b47d7d0b0, osc lock ffff936b46836130, flags 0x400000400001002 00010000:00010000:0.0:1787191339.597820:0:57883:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a16e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460501e expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.597830:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191339.597869:0:57882:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000080:00200008:0.0:1787191339.597874:0:57883:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc9:0x0](ffff936b5395f448), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191339.597880:0:57883:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448),name=f70.sanity-flr 00000020:00200000:1.0:1787191339.597885:0:57882:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191339.597889:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191339.597896:0:57882:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000002:00010000:0.0:1787191339.597898:0:57883:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc9:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.597905:0:57883:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a16e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460501e expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1787191339.597906:0:57882:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1787191339.597912:0:57883:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a16e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460501e expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191339.597914:0:57882:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc9:0x0] updating i_size 5 i_blocks 0 00000080:00200000:0.0:1787191339.597919:0:57883:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000020:00010000:1.0:1787191339.597919:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b516572e0 (ffff936b465cc368/0) at cl_lock_release():245 00000020:00010000:1.0:1787191339.597922:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b516572e0 (ffff936b465cc368/0) at cl_lock_cancel():142 00000080:00010000:0.0:1787191339.597923:0:57883:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) 00000020:00010000:1.0:1787191339.597925:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7d0b0 (ffff936b465cc998/1) at cl_lock_cancel():142 00000080:00010000:0.0:1787191339.597926:0:57883:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) for lock 0xe5129dc88483a16e 00000020:00010000:1.0:1787191339.597929:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b516572e0 (ffff936b465cc368/0) at cl_lock_fini():72 00000080:00010000:0.0:1787191339.597930:0:57883:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a16e from it ffffa3fb421cbcb8 00000020:00010000:1.0:1787191339.597932:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7d0b0 (ffff936b465cc368/1) at cl_lock_fini():72 00010000:00010000:0.0:1787191339.597933:0:57883:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a16e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460501e expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.597939:0:57883:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a16e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460501e expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191339.597940:0:57882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc9:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191339.597951:0:57883:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc9:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1787191339.597956:0:57883:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc9:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191339.597959:0:57883:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191339.597962:0:57883:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc9:0x0] 00000008:00010000:0.0:1787191339.597970:0:57883:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191339.597972:0:57883:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b46b503b0, osc lock ffff936b50b62ab0, flags 0x400000400001002 00010000:00010000:0.0:1787191339.597980:0:57883:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1787191339.597988:0:57883:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000020:00200000:0.0:1787191339.597995:0:57883:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191339.597998:0:57883:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1787191339.598005:0:57883:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00000020:00200000:0.0:1787191339.598017:0:57883:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191339.598021:0:57883:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc9:0x0] updating i_size 5 i_blocks 0 00000020:00010000:0.0:1787191339.598024:0:57883:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c38250 (ffff936b47a17cf8/0) at cl_lock_release():245 00000020:00010000:0.0:1787191339.598026:0:57883:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c38250 (ffff936b47a17cf8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191339.598029:0:57883:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b46b503b0 (ffff936b47a17bd8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191339.598031:0:57883:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c38250 (ffff936b47a17cf8/0) at cl_lock_fini():72 00000080:00200080:1.0:1787191339.598032:0:57882:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448) cmd=c00c66f3 arg=18472e0 00000020:00010000:0.0:1787191339.598033:0:57883:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b46b503b0 (ffff936b47a17cf8/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191339.598039:0:57883:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc9:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000002:00010000:1.0:1787191339.598060:0:57882:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc9:0x0]) in obj [0x200000405:0xc9:0x0], intent: open flags 05004040000002 00010000:00010000:1.0:1787191339.598071:0:57882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a159 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4604fd8 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1787191339.598083:0:57883:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00010000:00010000:1.0:1787191339.598085:0:57882:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a12f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4604f6f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000002:00010000:0.0:1787191339.598090:0:57883:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.598096:0:57883:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.598103:0:57883:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.598109:0:57883:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191339.598112:0:57883:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191339.598115:0:57883:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000002:00100000:1.0:1787191339.598116:0:57882:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1dc00 x1874004626671616/t8589936825(8589936825) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191355 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191339.598118:0:57883:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421cbc10 00010000:00010000:0.0:1787191339.598122:0:57883:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.598129:0:57883:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.598142:0:57883:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191339.598147:0:57883:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:0.0:1787191339.598151:0:57883:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191339.598157:0:57883:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:0.0:1787191339.598161:0:57883:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:0.0:1787191339.598165:0:57883:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:0.0:1787191339.598184:0:57883:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a12f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4604f6f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191339.598194:0:57883:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc9:0x0]: losing layout lock 00010000:00010000:0.0:1787191339.598204:0:57883:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc88483a167 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4605009 expref: -99 pid: 57883 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1787191339.598212:0:57883:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc9:0x0]: losing layout lock 00010000:00010000:0.0:1787191339.598219:0:57883:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a16e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e460501e expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191339.598225:0:57883:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc9:0x0]: losing layout lock 00010000:00010000:0.0:1787191339.598230:0:57883:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a11a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4604f30 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.598259:0:57883:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a12f lrc: 1/0,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4604f6f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191339.598267:0:57883:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc88483a167 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4605009 expref: -99 pid: 57883 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.598274:0:57883:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a16e lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460501e expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000020:00100000:1.0:1787191339.598278:0:57882:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00010000:00010000:0.0:1787191339.598281:0:57883:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a11a lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4604f30 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1787191339.598284:0:57882:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453ab480 x1874004626673024/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191339.598287:0:57883:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 4 locks packed 00010000:00010000:0.0:1787191339.598290:0:57883:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a12f lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4604f6f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191339.598300:0:57883:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a16e lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460501e expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000100:00100000:1.0:1787191339.598304:0:57882:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57882:1874004626673024:192.168.202.101@tcp:35:lfs.0 00010000:00010000:0.0:1787191339.598309:0:57883:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a11a lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4604f30 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1787191339.598320:0:57883:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 36, max 7 00000100:00100000:0.0:1787191339.598325:0:57883:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a476a00 x1874004626673152/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 512/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787191339.598335:0:57883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57883:1874004626673152:192.168.202.101@tcp:36:rm.0 00000100:00100000:1.0:1787191339.598416:0:57882:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00010000:00010000:2.0:1787191339.598440:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd5a00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191339.598445:0:43384:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc88483a167 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4605009 expref: -99 pid: 57883 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.598454:0:43384:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc88483a167 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4605009 expref: -99 pid: 57883 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.598461:0:43384:0:(ldlm_request.c:1774:ldlm_cli_cancel()) ### lock is already being destroyed 00010000:00010000:2.0:1787191339.598464:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc88483a167 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4605009 expref: -99 pid: 57883 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.598471:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc88483a167 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4605009 expref: -99 pid: 57883 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.598484:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191339.598486:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191339.598488:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191339.598514:0:57883:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99000 going to sleep for 11 seconds 00000100:00100000:3.0:1787191339.600906:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191339.601057:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634887296 00000100:00100000:2.0:1787191339.601066:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634887296 00000100:00100000:2.0:1787191339.601111:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1336 00000100:00100000:2.0:1787191339.601121:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634887296:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191339.601146:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a159 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x429400000000 nid: local remote: 0x7130d520e4604fd8 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191339.601213:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191339.601220:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634887296:12345-192.168.202.101@tcp:104: Request processed in 101us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191339.601227:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1336 00010000:00010000:0.0:1787191339.602080:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191339.602091:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a159 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x429400000000 nid: local remote: 0x7130d520e4604fd8 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191339.602101:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9a400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191339.602105:0:57627:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a159 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0xd/0xd rrc: 3 type: IBT gid 0 flags: 0x429400000000 nid: local remote: 0x7130d520e4604fd8 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191339.602118:0:57627:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a159 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0xd/0xd rrc: 3 type: IBT gid 0 flags: 0x429400000000 nid: local remote: 0x7130d520e4604fd8 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191339.602137:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a159 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0xd/0xd rrc: 3 type: IBT gid 0 flags: 0x429400000000 nid: local remote: 0x7130d520e4604fd8 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000100:00100000:1.0:1787191339.602515:0:57882:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57882:1874004626673024:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191339.602548:0:57882:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1dc00 x1874004626671616/t8589936825(8589936825) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1787191339.602605:0:57882:0:(ldlm_request.c:1873:ldlm_cli_cancel_list_local()) ### Cancel lock separately ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a159 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0xd/0xd rrc: 3 type: IBT gid 0 flags: 0x4c29400000000 nid: local remote: 0x7130d520e4604fd8 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191339.602644:0:57882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a159 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0xd/0xd rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4604fd8 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191339.602651:0:57882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787191339.602665:0:57882:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57882:1874004626673280:192.168.202.101@tcp:103:lfs.0 00000100:00100000:1.0:1787191339.602737:0:57882:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00010000:00010000:2.0:1787191339.603054:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a159 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0xd/0xd rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4604fd8 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191339.603062:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191339.603088:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a159 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0xd/0xd rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4604fd8 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191339.603098:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191339.603100:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191339.603102:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191339.603109:0:2392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787191339.603120:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626673408:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191339.605327:0:57882:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57882:1874004626673280:192.168.202.101@tcp:103:lfs.0 00010000:00010000:1.0:1787191339.605352:0:57882:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a159 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0xd/0xd rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4604fd8 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191339.605428:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a175 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.605436:0:57882:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a175 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57882 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191339.605447:0:57882:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191339.605456:0:57882:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453ab480 x1874004626673664/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191339.605466:0:57882:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a175 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x81000000000000 pid: 57882 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191339.605491:0:57882:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57882:1874004626673664:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191339.605651:0:57882:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191339.607084:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626673408:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191339.613213:0:57883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57883:1874004626673152:192.168.202.101@tcp:36:rm.0 00000100:00100000:1.0:1787191339.614049:0:57882:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57882:1874004626673664:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191339.614072:0:57882:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a175 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4605041 expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.614085:0:57882:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a175 lrc: 4/1,0 mode: --/PW res: [0x200000405:0xc9:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4605041 expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.614097:0:57882:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a175 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0xc9:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4605041 expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.614108:0:57882:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a175 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0xc9:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4605041 expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.614121:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a175 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0xc9:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4605041 expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.614139:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a175 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0xc9:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4605041 expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.614152:0:57882:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a175 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0xc9:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4605041 expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191339.614163:0:57882:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x600002b, status=0 req@ffff936b453ab480 x1874004626673664/t8589936830(8589936830) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191339.614176:0:57882:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453ab480 x1874004626673664/t8589936830(8589936830) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191339.614193:0:57882:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a175 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xc9:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4605041 expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.614205:0:57882:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 2 res 8589935621/201 (0 0) 00000080:00200000:1.0:1787191339.614211:0:57882:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xc9:0x0] suppgids 0 0: rc 0 00000002:00100000:1.0:1787191339.614231:0:57882:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453ab480 x1874004626673664/t8589936830(8589936830) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191339.614239:0:57882:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) for lock 0xe5129dc88483a175 00000080:00010000:1.0:1787191339.614244:0:57882:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a175 from it ffffa3fb42163cc0 00010000:00010000:1.0:1787191339.614248:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a175 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xc9:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4605041 expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.614254:0:57882:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a175 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0xc9:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4605041 expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1787191339.614305:0:57882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc9:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00010000:00010000:1.0:1787191339.614317:0:57882:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/201 (0 0) 00000080:00010000:1.0:1787191339.614323:0:57882:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xc9:0x0](ffff936b5395f448) 00000002:00010000:1.0:1787191339.614333:0:57882:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc9:0x0]) in obj [0x200000405:0xc9:0x0], intent: layout flags 0 00010000:00010000:1.0:1787191339.614369:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a17c lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.614376:0:57882:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a17c lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.614383:0:57882:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a17c lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57882 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191339.614400:0:57882:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57882:1874004626673792:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191339.614473:0:57882:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191339.616240:0:57882:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57882:1874004626673792:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191339.616267:0:57882:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a17c lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460504f expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.616280:0:57882:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a17c lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460504f expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191339.616292:0:57882:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b453abb80 x1874004626673792/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191339.616301:0:57882:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a17c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460504f expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191339.616312:0:57882:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a17c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460504f expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.616325:0:57882:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/201 (0 0) 00000080:00200000:1.0:1787191339.616331:0:57882:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xc9:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191339.616345:0:57882:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) for lock 0xe5129dc88483a17c 00000080:00010000:1.0:1787191339.616353:0:57882:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a17c from it ffffa3fb42163b70 00010000:00010000:1.0:1787191339.616357:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a17c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460504f expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.616366:0:57882:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a17c lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460504f expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.616388:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a17c lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460504f expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.616398:0:57882:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a17c lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460504f expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:1.0:1787191339.616406:0:57882:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xc9:0x0](00000000d13126ac) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a17c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460504f expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191339.616447:0:57882:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc9:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:1.0:1787191339.616453:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a17c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460504f expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.616461:0:57882:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a17c lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460504f expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:1.0:1787191339.616476:0:57882:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc9:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191339.616490:0:57882:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191339.616497:0:57882:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191339.616509:0:57882:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000100:00100000:0.0:1787191339.616658:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626673920:192.168.202.101@tcp:1:lfs.0 00000100:00100000:3.0:1787191339.623142:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191339.623178:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634887424 00000100:00100000:3.0:1787191339.623188:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634887424 00000100:00100000:3.0:1787191339.623237:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1337 00000100:00100000:3.0:1787191339.623248:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8720:x1874004634887424:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191339.623268:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00010000:00010000:3.0:1787191339.623353:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191339.623360:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8720:x1874004634887424:12345-192.168.202.101@tcp:104: Request processed in 114us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191339.623368:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1337 00010000:00010000:1.0:1787191339.623480:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191339.623500:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00010000:00010000:1.0:1787191339.623510:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030600 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191339.623517:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800428400020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00000008:00010000:1.0:1787191339.623541:0:40930:0:(osc_cache.c:2029:try_to_add_extent_for_io()) ### extent: 0000000056c7e072 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800429400020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00000008:00010000:1.0:1787191339.623555:0:40930:0:(osc_cache.c:1183:osc_extent_make_ready()) ### extent: 0000000056c7e072 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800429400020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00010000:00010000:1.0:1787191339.623609:0:40930:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800429400020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00000008:00100000:1.0:1787191339.623684:0:40930:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff936b453a9c00 - object 0x280000401:436 offset 0<>5 00000100:00100000:1.0:1787191339.623728:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626674048:192.168.202.101@tcp:4:bash.0 00000008:00010000:1.0:1787191339.638123:0:2389:0:(osc_cache.c:917:osc_extent_finish()) ### extent: 0000000056c7e072 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800429400020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00000008:00010000:1.0:1787191339.638183:0:2389:0:(osc_cache.c:497:__osc_extent_remove()) ### extent: 0000000056c7e072 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800429400020000 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00000100:00100000:1.0:1787191339.638217:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626674048:192.168.202.101@tcp:4:bash.0 00000080:00200000:2.0:1787191339.638313:0:40930:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc9:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1787191339.638360:0:40930:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc9:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:2.0:1787191339.638444:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400020020 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00010000:00010000:2.0:1787191339.638452:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191339.638484:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400020020 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00010000:00010000:2.0:1787191339.638493:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a144 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400020020 nid: local remote: 0x7130d520e4604fbc expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00010000:00010000:2.0:1787191339.638514:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191339.638517:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191339.638519:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191339.638907:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787191339.638924:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626674176:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191339.641826:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626673920:192.168.202.101@tcp:1:lfs.0 00000100:00100000:2.0:1787191339.641951:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626674176:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787191339.642160:0:57882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a17c lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e460504f expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191339.642184:0:57882:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc9:0x0]: losing layout lock 00010000:00010000:3.0:1787191339.642230:0:57882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a17c lrc: 1/0,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460504f expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191339.642238:0:57882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191339.642241:0:57882:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a17c lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460504f expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000020:00100000:3.0:1787191339.642262:0:57882:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1787191339.642270:0:57882:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1fb80 x1874004626674432/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 472/440 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191339.642299:0:57882:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57882:1874004626674432:192.168.202.101@tcp:36:lfs.0 00000100:00100000:3.0:1787191339.642372:0:57882:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cb40 going to sleep for 11 seconds 00000080:00200000:0.0:1787191339.644173:0:57884:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191339.644205:0:57884:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.644219:0:57884:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.644233:0:57884:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.644240:0:57884:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191339.644248:0:57884:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191339.644252:0:57884:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191339.644259:0:57884:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421f3b58 00010000:00010000:0.0:1787191339.644263:0:57884:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.644271:0:57884:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.644292:0:57884:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191339.644301:0:57884:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:0.0:1787191339.644307:0:57884:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191339.644320:0:57884:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:0.0:1787191339.644324:0:57884:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:0.0:1787191339.644694:0:57884:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:0.0:1787191339.644743:0:57884:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a183 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.644751:0:57884:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a183 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.644761:0:57884:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a183 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191339.644784:0:57884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57884:1874004626674560:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191339.644883:0:57884:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99000 going to sleep for 11 seconds 00000100:00100000:3.0:1787191339.650089:0:57882:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589936831 gen 1 00000100:00100000:3.0:1787191339.650108:0:57882:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b453a8e00 x1874004626672128/t8589936827(8589936827) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191355 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787191339.650143:0:57882:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b453ab480 x1874004626673664/t8589936830(8589936830) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191355 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787191339.650155:0:57882:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57882:1874004626674432:192.168.202.101@tcp:36:lfs.0 00010000:00010000:3.0:1787191339.650190:0:57882:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/201 (0 0) 00000080:00010000:3.0:1787191339.650200:0:57882:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xc9:0x0](ffff936b5395f448) 00000002:00010000:3.0:1787191339.650209:0:57882:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc9:0x0]) in obj [0x200000405:0xc9:0x0], intent: layout flags 0 00010000:00010000:3.0:1787191339.650250:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a18a lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.650258:0:57882:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a18a lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.650267:0:57882:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a18a lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57882 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191339.650284:0:57882:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57882:1874004626674688:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191339.650360:0:57882:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787191339.652511:0:57884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57884:1874004626674560:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191339.652531:0:57884:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a183 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.652543:0:57884:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a183 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.652550:0:57884:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a183 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.652557:0:57884:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a183 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.652567:0:57884:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a183 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.652573:0:57884:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44caea00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191339.652578:0:57884:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a183 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.652584:0:57884:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a183 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.652591:0:57884:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a183 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.652597:0:57884:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191339.652604:0:57884:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a183 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.652610:0:57884:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a183 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191339.652642:0:57884:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b6a474380 x1874004626674560/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191339.652657:0:57884:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191339.652735:0:57884:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191339.652747:0:57884:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.652756:0:57884:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.652767:0:57884:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.652774:0:57884:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191339.652779:0:57884:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191339.652782:0:57884:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191339.652787:0:57884:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421f3be8 00010000:00010000:0.0:1787191339.652790:0:57884:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.652798:0:57884:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.652812:0:57884:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191339.652818:0:57884:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000080:00200000:0.0:1787191339.652823:0:57884:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191339.652876:0:57884:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:0.0:1787191339.652881:0:57884:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:0.0:1787191339.652891:0:57884:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:0.0:1787191339.652926:0:57884:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a191 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.652934:0:57884:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a191 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.652943:0:57884:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a191 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191339.652960:0:57884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57884:1874004626674816:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191339.653028:0:57884:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99000 going to sleep for 11 seconds 00000100:00100000:3.0:1787191339.655320:0:57882:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57882:1874004626674688:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191339.655349:0:57882:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a18a lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605079 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.655368:0:57882:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a18a lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605079 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191339.655382:0:57882:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b51d1fb80 x1874004626674688/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191339.655402:0:57882:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a18a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605079 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191339.655414:0:57882:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a18a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605079 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.655423:0:57882:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/201 (0 0) 00000080:00200000:3.0:1787191339.655428:0:57882:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xc9:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1787191339.655444:0:57882:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) for lock 0xe5129dc88483a18a 00000080:00010000:3.0:1787191339.655451:0:57882:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a18a from it ffffa3fb42163c70 00010000:00010000:3.0:1787191339.655455:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a18a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605079 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.655464:0:57882:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a18a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605079 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191339.655485:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a18a lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605079 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191339.655496:0:57882:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a18a lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605079 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:3.0:1787191339.655508:0:57882:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xc9:0x0](00000000d13126ac) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a18a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605079 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191339.655551:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a18a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605079 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191339.655559:0:57882:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a18a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605079 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191339.655573:0:57882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc9:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00020000:00200000:3.0:1787191339.655582:0:57882:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc9:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191339.655586:0:57882:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191339.655592:0:57882:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191339.655602:0:57882:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1787191339.655680:0:57882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc9:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:3.0:1787191339.655692:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a18a lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605079 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191339.655700:0:57882:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a18a lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605079 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:3.0:1787191339.655708:0:57882:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xc9:0x0](00000000d13126ac) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a18a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605079 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191339.655724:0:57882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc9:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1787191339.655728:0:57882:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc9:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191339.655730:0:57882:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191339.655733:0:57882:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191339.655737:0:57882:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1787191339.655743:0:57882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc9:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:3.0:1787191339.655768:0:57882:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191339 1787191339 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc88483a152 lrc: 1/0,0 mode: PW/PW res: [0x2c0000401:0x1b7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4604fca expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191339.655827:0:57882:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc9:0x0]: layout version change: 4294967294 -> 5 00010000:00010000:3.0:1787191339.655876:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a18a lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605079 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191339.655885:0:57882:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a18a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605079 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200080:3.0:1787191339.655908:0:57882:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448) cmd=66f4 arg=18472e0 00000080:00200008:3.0:1787191339.655921:0:57882:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc9:0x0](ffff936b5395f448), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191339.655929:0:57882:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448),name=f70.sanity-flr 00000002:00010000:3.0:1787191339.655943:0:57882:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc9:0x0]) in obj [0x200000405:0xc9:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191339.655950:0:57882:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 30 res 8589935621/201 (0 0) 00010000:00010000:3.0:1787191339.655983:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a198 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.655990:0:57882:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a198 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.655999:0:57882:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a198 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57882 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191339.656018:0:57882:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57882:1874004626674944:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191339.656106:0:57882:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787191339.658745:0:57884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57884:1874004626674816:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191339.658767:0:57884:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a191 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.658779:0:57884:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a191 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.658785:0:57884:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a191 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.658792:0:57884:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a191 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.658800:0:57884:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a191 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.658806:0:57884:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44caf200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191339.658811:0:57884:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a191 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.658818:0:57884:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a191 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.658825:0:57884:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a191 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.658856:0:57884:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191339.658862:0:57884:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a191 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.658870:0:57884:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a191 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191339.658895:0:57884:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b6a474380 x1874004626674816/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191339.658909:0:57884:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191339.658999:0:57884:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191339.659013:0:57884:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.659023:0:57884:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.659034:0:57884:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.659052:0:57884:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191339.659057:0:57884:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191339.659060:0:57884:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191339.659065:0:57884:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421f3b58 00010000:00010000:0.0:1787191339.659068:0:57884:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.659075:0:57884:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.659089:0:57884:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191339.659096:0:57884:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:0.0:1787191339.659104:0:57884:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1787191339.659109:0:57884:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:0.0:1787191339.659119:0:57884:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.659135:0:57884:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 81 lru_type: 1 00010000:00010000:0.0:1787191339.659142:0:57884:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 81 lru_type: 1 00000002:00010000:0.0:1787191339.659150:0:57884:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.659183:0:57884:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a19f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.659189:0:57884:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a19f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.659198:0:57884:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a19f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191339.659216:0:57884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57884:1874004626675072:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191339.659286:0:57884:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99000 going to sleep for 11 seconds 00000100:00100000:3.0:1787191339.661021:0:57882:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57882:1874004626674944:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191339.661052:0:57882:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a198 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460509c expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.661063:0:57882:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a198 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460509c expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.661075:0:57882:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a198 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460509c expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.661086:0:57882:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a198 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460509c expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.661096:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a198 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460509c expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.661105:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a198 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460509c expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.661112:0:57882:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a198 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460509c expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191339.661130:0:57882:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b51d1fb80 x1874004626674944/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/976 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191339.661141:0:57882:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a198 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460509c expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191339.661152:0:57882:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a198 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460509c expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.661162:0:57882:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/201 (0 0) 00000080:00200000:3.0:1787191339.661168:0:57882:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xc9:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1787191339.661222:0:57882:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc9:0x0]: layout version change: 5 -> 5 00000080:00010000:3.0:1787191339.661226:0:57882:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) for lock 0xe5129dc88483a198 00000080:00010000:3.0:1787191339.661231:0:57882:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) 00000080:00010000:3.0:1787191339.661234:0:57882:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a198 from it ffffa3fb42163cd8 00010000:00010000:3.0:1787191339.661238:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a198 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460509c expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.661246:0:57882:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a198 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460509c expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191339.661273:0:57882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc9:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:3.0:1787191339.661282:0:57882:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc9:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191339.661286:0:57882:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191339.661289:0:57882:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc9:0x0] 00000008:00010000:3.0:1787191339.661304:0:57882:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191339.661307:0:57882:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b506679b0, osc lock ffff936b44f65300, flags 0x400000400001002 00010000:00010000:3.0:1787191339.661345:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.661356:0:57882:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.661366:0:57882:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b51d1fb80 x1874004626675200/t0(0) o101->lustre-OST0000-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:3.0:1787191339.661414:0:57882:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:3.0:1787191339.661425:0:2392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787191339.661440:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626675200:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191339.669051:0:57884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57884:1874004626675072:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191339.669080:0:57884:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a19f lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46050aa expref: -99 pid: 57884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.669093:0:57884:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a19f lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46050aa expref: -99 pid: 57884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.669105:0:57884:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a19f lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46050aa expref: -99 pid: 57884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.669115:0:57884:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a19f lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46050aa expref: -99 pid: 57884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.669138:0:57884:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a19f lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46050aa expref: -99 pid: 57884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.669147:0:57884:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a19f lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46050aa expref: -99 pid: 57884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.669155:0:57884:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a19f lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46050aa expref: -99 pid: 57884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191339.669168:0:57884:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b6a474380 x1874004626675072/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191339.669184:0:57884:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a19f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46050aa expref: -99 pid: 57884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.669195:0:57884:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:0.0:1787191339.669203:0:57884:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a19f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46050aa expref: -99 pid: 57884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.669212:0:57884:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a19f lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46050aa expref: -99 pid: 57884 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:0.0:1787191339.669242:0:57884:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.669254:0:57884:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 162 lru_type: 1 00010000:00010000:0.0:1787191339.669267:0:57884:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 162 lru_type: 1 00010000:00010000:0.0:1787191339.669276:0:57884:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 162 lru_type: 1 00010000:00010000:0.0:1787191339.669283:0:57884:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 163 lru_type: 1 00000080:00200000:0.0:1787191339.669295:0:57884:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191339.669304:0:57884:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:0.0:1787191339.669308:0:57884:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:0.0:1787191339.669315:0:57884:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb421f3cb8 00010000:00010000:0.0:1787191339.669318:0:57884:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 81 lru_type: 1 00010000:00010000:0.0:1787191339.669325:0:57884:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 82 lru_type: 1 00000002:00010000:0.0:1787191339.669340:0:57884:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.669346:0:57884:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a19f lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46050aa expref: -99 pid: 57884 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.669354:0:57884:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a19f lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46050aa expref: -99 pid: 57884 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.669360:0:57884:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a19f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46050aa expref: -99 pid: 57884 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.669368:0:57884:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a19f lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46050aa expref: -99 pid: 57884 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:0.0:1787191339.669375:0:57884:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.669380:0:57884:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 163 lru_type: 1 00010000:00010000:0.0:1787191339.669388:0:57884:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 163 lru_type: 1 00010000:00010000:0.0:1787191339.669404:0:57884:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 163 lru_type: 1 00010000:00010000:0.0:1787191339.669411:0:57884:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 164 lru_type: 1 00000080:00200008:0.0:1787191339.670015:0:57884:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1787191339.670023:0:57884:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191339.670037:0:57884:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.670059:0:57884:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.670068:0:57884:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.670075:0:57884:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191339.670080:0:57884:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191339.670082:0:57884:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191339.670086:0:57884:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421f3cb8 00010000:00010000:0.0:1787191339.670092:0:57884:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.670100:0:57884:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191339.670370:0:2392:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.670387:0:2392:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.670410:0:2392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.670421:0:2392:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191339.670437:0:2392:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 5, setting rss=5; kms=5, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 5/2,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1787191339.670448:0:2392:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1787191339.670465:0:2392:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.670473:0:2392:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.670481:0:2392:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.670490:0:2392:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1787191339.670504:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626675200:192.168.202.101@tcp:101:lfs.0 00000080:00200000:1.0:1787191339.670510:0:57882:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc9:0x0] updating i_size 5 i_blocks 8 00000020:00010000:1.0:1787191339.670516:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51656e40 (ffff936b465cc998/0) at cl_lock_release():245 00000020:00010000:1.0:1787191339.670519:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51656e40 (ffff936b465cc998/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191339.670524:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b506679b0 (ffff936b47a17f38/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191339.670528:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51656e40 (ffff936b465cc998/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191339.670531:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b506679b0 (ffff936b465cc998/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191339.670544:0:57882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc9:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191339.670925:0:57884:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191339.670939:0:57884:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191339.670949:0:57884:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191339.670959:0:57884:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191339.670966:0:57884:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191339.670972:0:57884:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191339.670975:0:57884:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191339.670981:0:57884:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421f3b58 00010000:00010000:2.0:1787191339.670984:0:57884:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191339.670992:0:57884:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191339.671002:0:57884:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191339.671007:0:57884:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191339.671013:0:57884:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191339.671024:0:57884:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:2.0:1787191339.671029:0:57884:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191339.671053:0:57884:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191339.671093:0:57884:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a1ad lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.671100:0:57884:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a1ad lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.671111:0:57884:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a1ad lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191339.671143:0:57884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57884:1874004626675328:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191339.671235:0:57884:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787191339.676826:0:57884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57884:1874004626675328:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191339.676870:0:57884:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a1ad lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.676885:0:57884:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a1ad lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.676892:0:57884:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a1ad lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.676899:0:57884:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a1ad lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.676907:0:57884:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a1ad lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.676913:0:57884:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd5e00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191339.676918:0:57884:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a1ad lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.676925:0:57884:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a1ad lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.676937:0:57884:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a1ad lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.676944:0:57884:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191339.676950:0:57884:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a1ad lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.676956:0:57884:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a1ad lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191339.676975:0:57884:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513b8e00 x1874004626675328/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191339.676991:0:57884:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1787191339.677019:0:57884:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a19f lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46050aa expref: -99 pid: 57884 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191339.677031:0:57884:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a19f lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46050aa expref: -99 pid: 57884 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:3.0:1787191339.677051:0:57884:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a19f from it ffffa3fb421f3930 00010000:00010000:3.0:1787191339.677056:0:57884:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a19f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46050aa expref: -99 pid: 57884 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191339.677065:0:57884:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a19f lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46050aa expref: -99 pid: 57884 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787191339.677152:0:57884:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191339.677166:0:57884:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191339.677174:0:57884:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191339.677181:0:57884:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191339.677188:0:57884:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191339.677193:0:57884:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191339.677196:0:57884:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191339.677200:0:57884:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421f3bf8 00010000:00010000:3.0:1787191339.677203:0:57884:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191339.677209:0:57884:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191339.677217:0:57884:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191339.677224:0:57884:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191339.677229:0:57884:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191339.677236:0:57884:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:3.0:1787191339.677239:0:57884:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:3.0:1787191339.677243:0:57884:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b46085200, open_flags a141, mode 81b6 opened 0 00000080:00200000:3.0:1787191339.677252:0:57884:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:3.0:1787191339.677270:0:57884:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xca:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:3.0:1787191339.677280:0:57884:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a19f lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e46050aa expref: -99 pid: 57884 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191339.677324:0:57884:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a19f lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46050aa expref: -99 pid: 57884 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191339.677331:0:57884:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191339.677334:0:57884:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a19f lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46050aa expref: -99 pid: 57884 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191339.677366:0:57884:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc88483a1b4 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.677373:0:57884:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc88483a1b4 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191339.677383:0:57884:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191339.677390:0:57884:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1fb80 x1874004626675584/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191339.677399:0:57884:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc88483a1b4 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191339.677417:0:57884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57884:1874004626675584:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191339.677545:0:57884:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191339.685612:0:57884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57884:1874004626675584:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191339.685649:0:57884:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc88483a1b4 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46050e2 expref: -99 pid: 57884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.685678:0:57884:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc88483a1b4 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46050e2 expref: -99 pid: 57884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.685688:0:57884:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc88483a1b4 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46050e2 expref: -99 pid: 57884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.685705:0:57884:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc88483a1b4 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46050e2 expref: -99 pid: 57884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.685717:0:57884:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc88483a1b4 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46050e2 expref: -99 pid: 57884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.685731:0:57884:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc88483a1b4 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46050e2 expref: -99 pid: 57884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.685740:0:57884:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc88483a1b4 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46050e2 expref: -99 pid: 57884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.685747:0:57884:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc88483a1b4 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46050e2 expref: -99 pid: 57884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191339.685760:0:57884:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b51d1fb80 x1874004626675584/t8589936832(8589936832) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191339.685773:0:57884:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1fb80 x1874004626675584/t8589936832(8589936832) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191339.685786:0:57884:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc88483a1b4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46050e2 expref: -99 pid: 57884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.685796:0:57884:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/202 (0 0) 00000080:00200000:3.0:1787191339.685804:0:57884:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191339.685818:0:57884:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:3.0:1787191339.685872:0:57884:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xca:0x0](ffff936b489aec08) 00000080:00200000:3.0:1787191339.685880:0:57884:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xca:0x0], updating i_size 0 00000080:00200000:3.0:1787191339.685917:0:57884:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xca:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:3.0:1787191339.685921:0:57884:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xca:0x0](ffff936b489aec08) 00000080:00010000:3.0:1787191339.685924:0:57884:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xca:0x0](ffff936b489aec08) for lock 0xe5129dc88483a1b4 00000080:00010000:3.0:1787191339.685934:0:57884:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xca:0x0](ffff936b489aec08) 00000080:00200008:3.0:1787191339.685948:0:57884:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xca:0x0](ffff936b489aec08), flags 120501 00000002:00100000:3.0:1787191339.685967:0:57884:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1fb80 x1874004626675584/t8589936832(8589936832) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1787191339.685997:0:57884:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a1b4 from it ffff936b46033d80 00010000:00010000:3.0:1787191339.686002:0:57884:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc88483a1b4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46050e2 expref: -99 pid: 57884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.686011:0:57884:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc88483a1b4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46050e2 expref: -99 pid: 57884 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191339.686031:0:57884:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xca:0x0](ffff936b489aec08), inode mode 81a4 mask 40 00000080:00200000:3.0:1787191339.686119:0:57884:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xca:0x0](ffff936b489aec08), inode mode 81a4 mask 2 00000080:00200000:3.0:1787191339.686260:0:57884:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xca:0x0](ffff936b489aec08), xattr lov 00000002:00010000:3.0:1787191339.686279:0:57884:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xca:0x0]) in obj [0x200000405:0xca:0x0], intent: open flags 040000002 00010000:00010000:3.0:1787191339.686323:0:57884:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a1bb lrc: 3/1,0 mode: --/CR res: [0x200000405:0xca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.686330:0:57884:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a1bb lrc: 3/1,0 mode: --/CR res: [0x200000405:0xca:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191339.686341:0:57884:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191339.686348:0:57884:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1c000 x1874004626675840/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191339.686362:0:57884:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a1bb lrc: 3/1,0 mode: --/CR res: [0x200000405:0xca:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191339.686380:0:57884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57884:1874004626675840:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191339.686576:0:57884:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787191339.696775:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191339.696869:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634888064 00000100:00100000:3.0:1787191339.696879:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634888064 00000100:00100000:3.0:1787191339.696927:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1338 00000100:00100000:3.0:1787191339.696935:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634888064:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191339.696953:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc88483a1b4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46050e2 expref: -99 pid: 57884 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191339.697030:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191339.697036:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634888064:12345-192.168.202.101@tcp:104: Request processed in 102us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191339.697053:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1338 00010000:00010000:0.0:1787191339.697060:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191339.697067:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc88483a1b4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46050e2 expref: -99 pid: 57884 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.697076:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9aa00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191339.697082:0:40929:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc88483a1b4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46050e2 expref: -99 pid: 57884 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.697090:0:40929:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc88483a1b4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46050e2 expref: -99 pid: 57884 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.697100:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc88483a1b4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e46050e2 expref: -99 pid: 57884 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191339.697123:0:40929:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xca:0x0]: losing layout lock 00010000:00010000:0.0:1787191339.697169:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc88483a1b4 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46050e2 expref: -99 pid: 57884 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.697176:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191339.697198:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc88483a1b4 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46050e2 expref: -99 pid: 57884 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.697206:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc88483a1b4 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46050e2 expref: -99 pid: 57884 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.697225:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191339.697227:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191339.697229:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191339.697245:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626675968:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191339.701858:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626675968:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191339.702000:0:57884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57884:1874004626675840:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191339.702023:0:57884:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a1bb lrc: 4/1,0 mode: --/CR res: [0x200000405:0xca:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.702037:0:57884:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a1bb lrc: 4/1,0 mode: --/CR res: [0x200000405:0xca:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.702053:0:57884:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a1bb lrc: 4/1,0 mode: --/CR res: [0x200000405:0xca:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.702061:0:57884:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a1bb lrc: 3/0,0 mode: --/CR res: [0x200000405:0xca:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.702072:0:57884:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a1bb lrc: 4/0,0 mode: --/CR res: [0x200000405:0xca:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.702080:0:57884:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9a600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191339.702085:0:57884:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a1bb lrc: 4/0,0 mode: --/CR res: [0x200000405:0xca:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.702092:0:57884:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a1bb lrc: 4/0,0 mode: --/CR res: [0x200000405:0xca:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.702100:0:57884:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a1bb lrc: 5/0,0 mode: --/CR res: [0x200000405:0xca:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.702108:0:57884:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191339.702114:0:57884:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a1bb lrc: 3/0,0 mode: --/CR res: [0x200000405:0xca:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.702121:0:57884:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a1bb lrc: 0/0,0 mode: --/CR res: [0x200000405:0xca:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57884 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191339.702158:0:57884:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b51d1c000 x1874004626675840/t8589936833(8589936833) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191339.702171:0:57884:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1c000 x1874004626675840/t8589936833(8589936833) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191339.702189:0:57884:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xca:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1787191339.702237:0:57884:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xca:0x0] ignore/verify layout 1/0, layout version 5 restore needed 0 00000080:00200000:3.0:1787191339.702245:0:57884:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xca:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191339.702303:0:57884:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xca:0x0], updating i_size 0 00000002:00100000:3.0:1787191339.702323:0:57884:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1c000 x1874004626675840/t8589936833(8589936833) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191339.702360:0:57884:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1c000 x1874004626675840/t8589936833(8589936833) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191339.702369:0:57884:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191339.702374:0:57884:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1df80 x1874004626676224/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191339.702392:0:57884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57884:1874004626676224:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191339.702505:0:57884:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191339.711214:0:57884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57884:1874004626676224:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191339.711261:0:57884:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1c000 x1874004626675840/t8589936833(8589936833) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:3.0:1787191339.711336:0:57884:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xca:0x0](ffff936b489aec08), flags 100001 00000002:00100000:3.0:1787191339.711395:0:57884:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1fb80 x1874004626675584/t8589936832(8589936832) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191355 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191339.711406:0:57884:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191339.711412:0:57884:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1d500 x1874004626676480/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191339.711436:0:57884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57884:1874004626676480:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191339.711520:0:57884:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191339.714159:0:57884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57884:1874004626676480:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191339.714193:0:57884:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1fb80 x1874004626675584/t8589936832(8589936832) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191339.723475:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191339.723716:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191339.723733:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191339.723749:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191339.723758:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191339.723767:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191339.723771:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191339.723778:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:3.0:1787191339.723783:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191339.723791:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191339.723807:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191339.723815:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191339.723822:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191339.723887:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:3.0:1787191339.723892:0:57570:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b46084d80, open_flags 8241, mode 81b6 opened 0 00000080:00200000:3.0:1787191339.723901:0:57570:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:3.0:1787191339.723921:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xcb:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0101102 00010000:00010000:3.0:1787191339.723980:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483a1c2 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.723989:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483a1c2 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191339.724002:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191339.724015:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1d880 x1874004626676736/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191339.724024:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483a1c2 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191339.724056:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626676736:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191339.724388:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191339.728513:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626676736:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191339.728552:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483a1c2 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460511a expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.728591:0:57570:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483a1c2 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xca:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460511a expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.728599:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483a1c2 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460511a expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.728613:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483a1c2 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460511a expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.728626:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483a1c2 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460511a expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.728648:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483a1c2 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460511a expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.728656:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483a1c2 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460511a expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.728664:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483a1c2 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460511a expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191339.728676:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x2b, status=0 req@ffff936b51d1d880 x1874004626676736/t8589936836(8589936836) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191339.728688:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1d880 x1874004626676736/t8589936836(8589936836) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191339.728702:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483a1c2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460511a expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191339.728716:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483a1c2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460511a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.728727:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/202 (0 0) 00000080:00200000:3.0:1787191339.728735:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191339.728812:0:57570:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xca:0x0](ffff936b489aec08): rc = 0 00000080:00200000:3.0:1787191339.728872:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xca:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:3.0:1787191339.728880:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xca:0x0](ffff936b489aec08) for lock 0xe5129dc88483a1c2 00000080:00010000:3.0:1787191339.728893:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xca:0x0](ffff936b489aec08) 00000080:00200008:3.0:1787191339.728913:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xca:0x0](ffff936b489aec08), flags 101101 00000002:00100000:3.0:1787191339.728944:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1d880 x1874004626676736/t8589936836(8589936836) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1787191339.728990:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a1c2 from it ffff936b46033f60 00010000:00010000:3.0:1787191339.728995:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483a1c2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460511a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.729005:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483a1c2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460511a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191339.729036:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xca:0x0](ffff936b489aec08), inode mode 81a4 mask 42 00000002:00010000:3.0:1787191339.729080:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xca:0x0], intent: getxattr flags 0 00010000:00010000:3.0:1787191339.729225:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a1c9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.729235:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a1c9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xca:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.729245:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a1c9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xca:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191339.729265:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ed80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626676864:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191339.729384:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cb40 going to sleep for 11 seconds 00000080:00200080:1.0:1787191339.729892:0:57882:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448) cmd=400866b1 arg=1 00000080:00200008:1.0:1787191339.729904:0:57882:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc9:0x0](ffff936b5395f448), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191339.729911:0:57882:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448),name=f70.sanity-flr 00000002:00010000:1.0:1787191339.729922:0:57882:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc9:0x0]) in obj [0x200000405:0xc9:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.729934:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a198 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460509c expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.729945:0:57882:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a198 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460509c expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191339.729952:0:57882:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xc9:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191339.729958:0:57882:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) 00000080:00010000:1.0:1787191339.729961:0:57882:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) for lock 0xe5129dc88483a198 00000080:00010000:1.0:1787191339.729967:0:57882:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a198 from it ffffa3fb42163cd8 00010000:00010000:1.0:1787191339.729970:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a198 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460509c expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.729978:0:57882:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a198 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460509c expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191339.729999:0:57882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc9:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:1.0:1787191339.730009:0:57882:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc9:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191339.730012:0:57882:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191339.730016:0:57882:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc9:0x0] 00000008:00010000:1.0:1787191339.730034:0:57882:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191339.730037:0:57882:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b47d7df30, osc lock ffff936b46836130, flags 0x400000400001002 00010000:00010000:1.0:1787191339.730066:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.730077:0:57882:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1787191339.730089:0:57882:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191339.730093:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.730101:0:57882:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1787191339.730111:0:57882:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191339.730120:0:57882:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc9:0x0] updating i_size 5 i_blocks 8 00000020:00010000:1.0:1787191339.730124:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51656e40 (ffff936b465cc998/0) at cl_lock_release():245 00000020:00010000:1.0:1787191339.730127:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51656e40 (ffff936b465cc998/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191339.730130:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7df30 (ffff936b47a17f38/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191339.730134:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51656e40 (ffff936b465cc998/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191339.730136:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7df30 (ffff936b465cc998/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191339.730148:0:57882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc9:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1787191339.730162:0:57882:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xc9:0x0], offset: 0, type: SEEK_DATA 00000080:00200000:1.0:1787191339.730167:0:57882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc9:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:1.0:1787191339.730171:0:57882:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc9:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191339.730174:0:57882:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191339.730178:0:57882:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191339.730183:0:57882:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191339.730197:0:57882:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc9:0x0] updating i_size 5 i_blocks 8 00000080:00200000:1.0:1787191339.730204:0:57882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc9:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191339.730209:0:57882:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000080:00200000:1.0:1787191339.730211:0:57882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc9:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:1.0:1787191339.730215:0:57882:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191339.730219:0:57882:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191339.730221:0:57882:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:1.0:1787191339.730227:0:57882:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:1.0:1787191339.730229:0:57882:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b47d7df30, osc lock ffff936b46836130, flags 0x0 00010000:00010000:1.0:1787191339.730237:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191339.730247:0:57882:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191339.730255:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191339.730262:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191339.730270:0:57882:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191339.730281:0:57882:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc9:0x0] updating i_size 5 i_blocks 8 00000100:00100000:0.0:1787191339.730339:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626676992:192.168.202.101@tcp:23:lfs.0 00000100:00100000:0.0:1787191339.733826:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626676992:192.168.202.101@tcp:23:lfs.0 00000020:00010000:1.0:1787191339.734987:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b497c9a88 (ffff936b465cc998/0) at cl_lock_release():245 00000020:00010000:1.0:1787191339.734993:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b497c9a88 (ffff936b465cc998/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191339.734998:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7df30 (ffff936b47a17f38/1) at cl_lock_cancel():142 00010000:00010000:1.0:1787191339.735009:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191339.735025:0:57882:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00010000:1.0:1787191339.735051:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b497c9a88 (ffff936b465cc998/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191339.735055:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7df30 (ffff936b465cc998/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191339.735071:0:57882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc9:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1787191339.735084:0:57882:0:(file.c:5244:ll_file_seek()) COMPLETED file f70.sanity-flr:[0x200000405:0xc9:0x0], offset: 0, type: SEEK_DATA, rc = 0 00000080:00200008:1.0:1787191339.735094:0:57882:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xc9:0x0], offset: 0, type: SEEK_HOLE 00000080:00200000:1.0:1787191339.735103:0:57882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc9:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:1.0:1787191339.735113:0:57882:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc9:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191339.735116:0:57882:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191339.735122:0:57882:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191339.735131:0:57882:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191339.735153:0:57882:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc9:0x0] updating i_size 5 i_blocks 8 00000080:00200000:1.0:1787191339.735159:0:57882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc9:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191339.735166:0:57882:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000080:00200000:1.0:1787191339.735168:0:57882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc9:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:1.0:1787191339.735174:0:57882:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191339.735177:0:57882:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191339.735180:0:57882:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:1.0:1787191339.735193:0:57882:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:1.0:1787191339.735198:0:57882:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b47d7df30, osc lock ffff936b46836130, flags 0x0 00010000:00010000:1.0:1787191339.735219:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191339.735234:0:57882:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191339.735246:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191339.735254:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191339.735261:0:57882:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191339.735271:0:57882:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc9:0x0] updating i_size 5 i_blocks 8 00000100:00100000:0.0:1787191339.735371:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787191339.735390:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626677120:192.168.202.101@tcp:23:lfs.0 00000100:00100000:0.0:1787191339.736499:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ed80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626676864:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191339.736520:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a1c9 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xca:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460512f expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.736534:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a1c9 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460512f expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.736545:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a1c9 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460512f expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191339.736557:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b51d1ed80 x1874004626676864/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191339.736568:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a1c9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460512f expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.736579:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/202 (0 0) 00000080:00200000:0.0:1787191339.736585:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xca:0x0] suppgids 0 -1: rc 0 00000080:00010000:0.0:1787191339.736614:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xca:0x0](ffff936b489aec08) for lock 0xe5129dc88483a1c9 00000080:00010000:0.0:1787191339.736623:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a1c9 from it ffffa3fb41caba38 00010000:00010000:0.0:1787191339.736628:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a1c9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460512f expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.736636:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a1c9 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460512f expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:0.0:1787191339.736668:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xca:0x0](ffff936b489aec08) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191339.000000000, mtime 1787191339.000000000, ctime 1787191339.000000000 00010000:00010000:0.0:1787191339.736693:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483a1c2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e460511a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191339.736710:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xca:0x0]: losing layout lock 00010000:00010000:0.0:1787191339.736745:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483a1c2 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460511a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.736752:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191339.736756:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483a1c2 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460511a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1787191339.736775:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1787191339.736781:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474380 x1874004626677376/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787191339.736803:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626677376:192.168.202.101@tcp:36:bash.0 00000100:00100000:0.0:1787191339.736889:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99000 going to sleep for 11 seconds 00000100:00100000:0.0:1787191339.738026:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626677120:192.168.202.101@tcp:23:lfs.0 00000100:00100000:3.0:1787191339.739286:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626677376:192.168.202.101@tcp:36:bash.0 00000080:00200000:3.0:1787191339.739325:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:3.0:1787191339.739332:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xca:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00010000:00010000:3.0:1787191339.739348:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/202 (0 0) 00000080:00010000:3.0:1787191339.739358:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xca:0x0](ffff936b489aec08) 00000002:00010000:3.0:1787191339.739368:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xca:0x0]) in obj [0x200000405:0xca:0x0], intent: layout flags 0 00010000:00010000:3.0:1787191339.739407:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a1d0 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.739416:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a1d0 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.739426:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a1d0 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191339.739444:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f800 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626677504:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191339.739516:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c300 going to sleep for 11 seconds 00000020:00010000:1.0:1787191339.746396:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b497c9a88 (ffff936b465cc998/0) at cl_lock_release():245 00000020:00010000:1.0:1787191339.746410:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b497c9a88 (ffff936b465cc998/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191339.746416:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7df30 (ffff936b47a17f38/1) at cl_lock_cancel():142 00010000:00010000:1.0:1787191339.746427:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191339.746450:0:57882:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00010000:1.0:1787191339.746469:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b497c9a88 (ffff936b465cc998/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191339.746472:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7df30 (ffff936b465cc998/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191339.746560:0:57882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc9:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191339.746636:0:57882:0:(file.c:5244:ll_file_seek()) COMPLETED file f70.sanity-flr:[0x200000405:0xc9:0x0], offset: 0, type: SEEK_HOLE, rc = 5 00000080:00200080:2.0:1787191339.746654:0:57882:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448) cmd=400866b1 arg=0 00000080:00200080:2.0:1787191339.746664:0:57882:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448) cmd=400866b1 arg=1 00000080:00200008:2.0:1787191339.746671:0:57882:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc9:0x0](ffff936b5395f448), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191339.746679:0:57882:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448),name=f70.sanity-flr 00000002:00010000:2.0:1787191339.746704:0:57882:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc9:0x0]) in obj [0x200000405:0xc9:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191339.746719:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a198 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460509c expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191339.746733:0:57882:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a198 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460509c expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191339.746741:0:57882:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xc9:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191339.746749:0:57882:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) 00000080:00010000:2.0:1787191339.746752:0:57882:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) for lock 0xe5129dc88483a198 00000080:00010000:2.0:1787191339.746758:0:57882:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a198 from it ffffa3fb42163cd8 00010000:00010000:2.0:1787191339.746761:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a198 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460509c expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191339.746768:0:57882:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a198 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460509c expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191339.746791:0:57882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc9:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:2.0:1787191339.746801:0:57882:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc9:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191339.746804:0:57882:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191339.746808:0:57882:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc9:0x0] 00000008:00010000:2.0:1787191339.746825:0:57882:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191339.746828:0:57882:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d12b0, osc lock ffff936b44e62d10, flags 0x400000400001002 00010000:00010000:2.0:1787191339.746875:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191339.746885:0:57882:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:2.0:1787191339.746896:0:57882:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191339.746900:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191339.746908:0:57882:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000020:00200000:2.0:1787191339.746918:0:57882:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191339.746927:0:57882:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc9:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191339.746930:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51656bf0 (ffff936b465cccf8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191339.746932:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51656bf0 (ffff936b465cccf8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191339.746935:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d12b0 (ffff936b465cc6c8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191339.746938:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51656bf0 (ffff936b465cccf8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191339.746940:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d12b0 (ffff936b465cccf8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191339.746948:0:57882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc9:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191339.746970:0:57882:0:(file.c:2483:do_file_read_iter()) START file f70.sanity-flr:[0x200000405:0xc9:0x0], ppos: 0, count: 4096 00000080:00200000:2.0:1787191339.746979:0:57882:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: read ppos: 0, bytes: 4096 00000080:00200000:2.0:1787191339.746987:0:57882:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000020:00200000:2.0:1787191339.746992:0:57882:0:(cl_io.c:214:cl_io_rw_init()) header@00000000c8a6ee3a[0x110, 2, [0x200000405:0xc9:0x0] hash] 00000020:00200000:2.0:1787191339.746994:0:57882:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 4096) 2048 0 00000080:00200000:2.0:1787191339.746997:0:57882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc9:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00000080:00200000:2.0:1787191339.747005:0:57882:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1787191339.747012:0:57882:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:2.0:1787191339.747016:0:57882:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1787191339.747028:0:57882:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:2.0:1787191339.747035:0:57882:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:2.0:1787191339.747050:0:57882:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d12b0, osc lock ffff936b44e62d10, flags 0x40000 00000080:00200000:2.0:1787191339.747056:0:57882:0:(vvp_io.c:835:vvp_io_read_start()) f70.sanity-flr: read [0, 4096) 00000001:00010000:2.0:1787191339.747063:0:57882:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc9:0x0] 00000008:00010000:2.0:1787191339.747071:0:57882:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191339.747073:0:57882:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d11b0, osc lock ffff936b44e625f0, flags 0x400001002 00010000:00010000:2.0:1787191339.747080:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1787191339.747090:0:57882:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000020:00200000:2.0:1787191339.747098:0:57882:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191339.747101:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1787191339.747109:0:57882:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00000020:00200000:2.0:1787191339.747118:0:57882:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191339.747121:0:57882:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc9:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191339.747136:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51656bf0 (ffff936b465cccf8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191339.747139:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51656bf0 (ffff936b465cccf8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191339.747142:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d11b0 (ffff936b465cc6c8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191339.747145:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51656bf0 (ffff936b465cccf8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191339.747147:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d11b0 (ffff936b465cccf8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191339.747154:0:57882:0:(vvp_io.c:893:vvp_io_read_start()) count:4096 iocb pos:0 00000080:00200000:2.0:1787191339.747160:0:57882:0:(rw26.c:362:ll_direct_IO()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448), size=4096 (max 536870912), offset=0=0x0, pages 1 (max 131072), lockless, parallel 00000020:00200000:2.0:1787191339.747216:0:57882:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1787191339.747219:0:57882:0:(rw26.c:544:ll_direct_IO()) result 0 tot_bytes 5 count 5 file_offset 5 00000020:00010000:2.0:1787191339.747225:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b497c97b8 (ffff936b465cccf8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191339.747227:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b497c97b8 (ffff936b465cccf8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191339.747230:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d12b0 (ffff936b465cc6c8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191339.747233:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b497c97b8 (ffff936b465cccf8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191339.747236:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d12b0 (ffff936b465cccf8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191339.747240:0:57882:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000020:00200000:2.0:1787191339.747245:0:57882:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1787191339.747264:0:25580:0:(osc_cache.c:2029:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff936b46699c00 00000008:00100000:2.0:1787191339.747313:0:25580:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff936b513b8700 - object 0x280000401:436 offset 0<>5 00000100:00100000:2.0:1787191339.747353:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787191339.747376:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626677632:192.168.202.101@tcp:3:lfs.0 00000100:00100000:3.0:1787191339.750363:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f800 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626677504:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191339.750396:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a1d0 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460513d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.750412:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a1d0 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460513d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191339.750427:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b51d1f800 x1874004626677504/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191339.750439:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a1d0 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460513d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191339.750451:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a1d0 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460513d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.750461:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/202 (0 0) 00000080:00200000:3.0:1787191339.750467:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xca:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1787191339.750484:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xca:0x0](ffff936b489aec08) for lock 0xe5129dc88483a1d0 00000080:00010000:3.0:1787191339.750492:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a1d0 from it ffffa3fb41cab8c8 00010000:00010000:3.0:1787191339.750495:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a1d0 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460513d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.750504:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a1d0 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460513d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191339.750530:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a1d0 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xca:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460513d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191339.750542:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a1d0 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460513d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:3.0:1787191339.750550:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xca:0x0](0000000089b06177) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a1d0 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460513d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191339.750602:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xca:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:3.0:1787191339.750607:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a1d0 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460513d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191339.750627:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a1d0 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460513d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:3.0:1787191339.750645:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xca:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:3.0:1787191339.750652:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xca:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191339.750656:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xca:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:3.0:1787191339.750665:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xca:0x0](ffff936b489aec08) 00000002:00010000:3.0:1787191339.750675:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xca:0x0]) in obj [0x200000405:0xca:0x0], intent: layout flags 02 00010000:00010000:3.0:1787191339.750688:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a1d0 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xca:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e460513d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191339.750702:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xca:0x0]: losing layout lock 00010000:00010000:3.0:1787191339.750732:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a1d0 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460513d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191339.750740:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191339.750743:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a1d0 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460513d expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191339.750768:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a1d7 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xca:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.750775:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a1d7 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191339.750786:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191339.750792:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1f800 x1874004626677888/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191339.750802:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a1d7 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191339.750821:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f800 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626677888:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191339.750933:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c300 going to sleep for 11 seconds 00000008:00010000:3.0:1787191339.752414:0:2391:0:(osc_cache.c:917:osc_extent_finish()) ### no dlm lock: extent: ffff936b46699c00 00000020:00200000:3.0:1787191339.752424:0:2391:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1787191339.752432:0:2391:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1787191339.752482:0:2391:0:(osc_cache.c:497:__osc_extent_remove()) ### no dlm lock: extent: ffff936b46699c00 00000100:00100000:3.0:1787191339.752507:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626677632:192.168.202.101@tcp:3:lfs.0 00000080:00200000:2.0:1787191339.752564:0:57882:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1787191339.752577:0:57882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc9:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191339.752582:0:57882:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 1 io complete with rc: 0, result: 5, restart: 0 00000020:00200000:2.0:1787191339.752585:0:57882:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191339.752593:0:57882:0:(file.c:2324:ll_file_io_generic()) iot: 1, result: 5 00000080:00200080:2.0:1787191339.752609:0:57882:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448) cmd=400866b1 arg=0 00000080:00200080:2.0:1787191339.752682:0:57882:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448) cmd=400866b1 arg=2 00000080:00200008:2.0:1787191339.752690:0:57882:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc9:0x0](ffff936b5395f448), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191339.752697:0:57882:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448),name=f70.sanity-flr 00000002:00010000:2.0:1787191339.752714:0:57882:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc9:0x0]) in obj [0x200000405:0xc9:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191339.752728:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a198 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460509c expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191339.752740:0:57882:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a198 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460509c expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191339.752747:0:57882:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xc9:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191339.752754:0:57882:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) 00000080:00010000:2.0:1787191339.752758:0:57882:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) for lock 0xe5129dc88483a198 00000080:00010000:2.0:1787191339.752765:0:57882:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a198 from it ffffa3fb42163cd8 00010000:00010000:2.0:1787191339.752769:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a198 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460509c expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191339.752779:0:57882:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a198 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460509c expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:2.0:1787191339.752802:0:57882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc9:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:2.0:1787191339.752814:0:57882:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc9:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191339.752817:0:57882:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191339.752821:0:57882:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc9:0x0] 00000008:00010000:2.0:1787191339.752912:0:57882:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191339.752917:0:57882:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d12b0, osc lock ffff936b44e62d10, flags 0x400000400001002 00010000:00010000:2.0:1787191339.752935:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00010000:00010000:2.0:1787191339.752946:0:57882:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00000020:00200000:2.0:1787191339.752957:0:57882:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191339.752960:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00010000:00010000:2.0:1787191339.752968:0:57882:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 1 00000020:00200000:2.0:1787191339.752976:0:57882:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191339.752984:0:57882:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc9:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191339.752989:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51656bf0 (ffff936b465cccf8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191339.752991:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51656bf0 (ffff936b465cccf8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191339.752994:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d12b0 (ffff936b465cc6c8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191339.752997:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51656bf0 (ffff936b465cccf8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191339.752999:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d12b0 (ffff936b465cccf8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191339.753007:0:57882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc9:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191339.753028:0:57882:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xc9:0x0], ppos: 0, count: 4096 00000080:00200000:2.0:1787191339.753035:0:57882:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 4096 00000080:00200000:2.0:1787191339.753054:0:57882:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 2 00000020:00200000:2.0:1787191339.753059:0:57882:0:(cl_io.c:214:cl_io_rw_init()) header@00000000c8a6ee3a[0x110, 2, [0x200000405:0xc9:0x0] hash] 00000020:00200000:2.0:1787191339.753061:0:57882:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 4096) 2048 0 00000080:00200000:2.0:1787191339.753064:0:57882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc9:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00000080:00200000:2.0:1787191339.753073:0:57882:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1787191339.753079:0:57882:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:2.0:1787191339.753082:0:57882:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x11 00000080:00200000:2.0:1787191339.753096:0:57882:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:2.0:1787191339.753103:0:57882:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:2.0:1787191339.753106:0:57882:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d12b0, osc lock ffff936b44e62d10, flags 0x40000 00000080:00200000:2.0:1787191339.753112:0:57882:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 4096) append 0 append lockpos 0 00000002:00010000:2.0:1787191339.753194:0:57882:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xc9:0x0], intent: getxattr flags 0 00010000:00010000:2.0:1787191339.753231:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc88483a1de lrc: 3/1,0 mode: --/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.753238:0:57882:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc88483a1de lrc: 3/1,0 mode: --/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.753249:0:57882:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc88483a1de lrc: 3/1,0 mode: --/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57882 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191339.753267:0:57882:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57882:1874004626678016:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191339.753598:0:57882:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787191339.757652:0:57882:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589936839 gen 1 00000100:00100000:0.0:1787191339.757728:0:57882:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b51d1d880 x1874004626676736/t8589936836(8589936836) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191355 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787191339.757745:0:57882:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57882:1874004626678016:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191339.757767:0:57882:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc88483a1de lrc: 4/1,0 mode: --/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605160 expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.757783:0:57882:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc88483a1de lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605160 expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.757795:0:57882:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc88483a1de lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605160 expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191339.757806:0:57882:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b513b9180 x1874004626678016/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1408 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191339.757816:0:57882:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc88483a1de lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605160 expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.757828:0:57882:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/201 (0 0) 00000080:00200000:0.0:1787191339.757869:0:57882:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xc9:0x0] suppgids 0 -1: rc 0 00000080:00010000:0.0:1787191339.757897:0:57882:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) for lock 0xe5129dc88483a1de 00000080:00010000:0.0:1787191339.757905:0:57882:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a1de from it ffffa3fb421638e8 00010000:00010000:0.0:1787191339.757910:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc88483a1de lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605160 expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.757921:0:57882:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5a00/0xe5129dc88483a1de lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605160 expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191339.757953:0:57882:0:(rw26.c:362:ll_direct_IO()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448), size=4096 (max 536870912), offset=0=0x0, pages 1 (max 131072), lockless, parallel 00000020:00200000:0.0:1787191339.758013:0:57882:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:0.0:1787191339.758017:0:57882:0:(rw26.c:544:ll_direct_IO()) result 0 tot_bytes 4096 count 4096 file_offset 4096 00000080:00200000:0.0:1787191339.758031:0:57882:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc9:0x0] updating i_size 5 i_blocks 8 00000020:00010000:0.0:1787191339.758036:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b497c97b8 (ffff936b465cccf8/0) at cl_lock_release():245 00000020:00010000:0.0:1787191339.758051:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b497c97b8 (ffff936b465cccf8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191339.758055:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d12b0 (ffff936b465cc6c8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191339.758058:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b497c97b8 (ffff936b465cccf8/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191339.758061:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d12b0 (ffff936b465cccf8/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191339.758069:0:57882:0:(vvp_io.c:533:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:0.0:1787191339.758075:0:57882:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:0.0:1787191339.758094:0:31426:0:(osc_cache.c:2029:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff936b61fcf3c0 00000008:00100000:0.0:1787191339.758193:0:31426:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff936b6a474380 - object 0x2c0000401:440 offset 0<>4096 00000100:00100000:0.0:1787191339.758232:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626678144:192.168.202.101@tcp:4:lfs.0 00000100:00100000:1.0:1787191339.759215:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f800 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626677888:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191339.759233:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a1d7 lrc: 4/0,1 mode: --/EX res: [0x200000405:0xca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605152 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.759242:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a1d7 lrc: 4/0,1 mode: --/CR res: [0x200000405:0xca:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605152 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.759253:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a1d7 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xca:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605152 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.759261:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a1d7 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xca:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605152 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.759272:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a1d7 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xca:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605152 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.759279:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a1d7 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xca:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605152 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.759290:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a1d7 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xca:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605152 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191339.759302:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b51d1f800 x1874004626677888/t8589936839(8589936839) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191339.759320:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a1d7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xca:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605152 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191339.759332:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a1d7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xca:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605152 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.759343:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/202 (0 0) 00000080:00200000:1.0:1787191339.759348:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xca:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191339.759359:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xca:0x0](ffff936b489aec08) for lock 0xe5129dc88483a1d7 00000080:00010000:1.0:1787191339.759366:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a1d7 from it ffffa3fb41cab930 00010000:00010000:1.0:1787191339.759369:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a1d7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xca:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605152 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.759377:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a1d7 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xca:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605152 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191339.759436:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:1.0:1787191339.759443:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xca:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:1.0:1787191339.759458:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a1d7 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xca:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605152 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.759473:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a1d7 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xca:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605152 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:1.0:1787191339.759480:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xca:0x0](0000000089b06177) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a1d7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xca:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605152 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.759517:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a1d7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xca:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605152 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.759526:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a1d7 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xca:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605152 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191339.759538:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xca:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1787191339.759546:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xca:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191339.759550:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191339.759555:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:1.0:1787191339.759607:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xca:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:2.0:1787191339.760561:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191339.760639:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634888704 00000100:00100000:3.0:1787191339.760646:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634888704 00000100:00100000:3.0:1787191339.760698:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1339 00000100:00100000:3.0:1787191339.760707:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8425:x1874004634888704:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191339.760722:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483a105 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4604f06 expref: -99 pid: 57880 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191339.760793:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191339.760800:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8425:x1874004634888704:12345-192.168.202.101@tcp:104: Request processed in 95us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191339.760807:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1339 00010000:00010000:0.0:1787191339.761004:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191339.761011:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483a105 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4604f06 expref: -99 pid: 57880 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.761020:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030000 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191339.761026:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483a105 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4604f06 expref: -99 pid: 57880 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.761082:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483a105 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4604f06 expref: -99 pid: 57880 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.761089:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191339.761109:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483a105 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4604f06 expref: -99 pid: 57880 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.761117:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483a105 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4604f06 expref: -99 pid: 57880 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.761148:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191339.761150:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191339.761151:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191339.761167:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626678272:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787191339.762402:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a1d7 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xca:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605152 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191339.762420:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a1d7 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xca:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605152 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:0.0:1787191339.762431:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xca:0x0](0000000089b06177) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a1d7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xca:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605152 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191339.762469:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xca:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191339.762479:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xca:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191339.762483:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191339.762488:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:0.0:1787191339.762555:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xca:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:1.0:1787191339.763013:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626678272:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00200000:0.0:1787191339.763600:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xca:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:0.0:1787191339.763611:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a1d7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xca:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605152 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191339.763680:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a1d7 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xca:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605152 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00020000:00200000:0.0:1787191339.763700:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xca:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:0.0:1787191339.763704:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xca:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191339.763707:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191339.763715:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191339.763731:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191339.763735:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:0.0:1787191339.763747:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:0.0:1787191339.763752:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f99db0, osc lock ffff936b50b62ab0, flags 0x80000000 00000008:00010000:0.0:1787191339.763756:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:0.0:1787191339.763757:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f99df0, osc lock ffff936b50b63430, flags 0x80000000 00010000:00010000:0.0:1787191339.763805:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a1e5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.763816:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a1e5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.763826:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a1e5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191339.765122:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626678400:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191339.765881:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191339.770678:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626678400:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191339.770711:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a1e5 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e460516e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.770731:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a1e5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e460516e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.770743:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a1e5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e460516e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.770761:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a1e5 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e460516e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191339.770778:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a1e5 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e460516e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.770791:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a1e5 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460516e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.770799:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a1e5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460516e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.770996:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a1ec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.771007:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a1ec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.771019:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a1ec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191339.771055:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626678528:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191339.771149:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191339.775429:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626678528:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191339.775458:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a1ec lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605175 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.775482:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a1ec lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4605175 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.775495:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a1ec lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4605175 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.775510:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a1ec lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4605175 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191339.775524:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a1ec lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4605175 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.775535:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a1ec lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4605175 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.775542:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a1ec lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4605175 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191339.775808:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626678656:192.168.202.101@tcp:10:bash.0 00000100:00100000:2.0:1787191339.776225:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787191339.776233:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626678784:192.168.202.101@tcp:10:bash.0 00000100:00100000:0.0:1787191339.780720:0:2389:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-ffff936b581fb000: committing for last_committed 17179870336 gen 1 00000008:00010000:0.0:1787191339.780810:0:2389:0:(osc_cache.c:917:osc_extent_finish()) ### no dlm lock: extent: ffff936b61fcf3c0 00000020:00200000:0.0:1787191339.780817:0:2389:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:0.0:1787191339.780825:0:2389:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:0.0:1787191339.780865:0:2389:0:(osc_cache.c:497:__osc_extent_remove()) ### no dlm lock: extent: ffff936b61fcf3c0 00000100:00100000:0.0:1787191339.780892:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626678144:192.168.202.101@tcp:4:lfs.0 00000080:00200000:2.0:1787191339.780995:0:57882:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1787191339.781008:0:57882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc9:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191339.781013:0:57882:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:2.0:1787191339.781024:0:57882:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc9:0x0] updating i_size 5 i_blocks 8 00000020:00200000:2.0:1787191339.781027:0:57882:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191339.781035:0:57882:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200080:2.0:1787191339.781064:0:57882:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448) cmd=400866b1 arg=0 00000080:00200080:2.0:1787191339.781073:0:57882:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448) cmd=400866b1 arg=1 00000080:00200008:2.0:1787191339.781079:0:57882:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc9:0x0](ffff936b5395f448), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191339.781087:0:57882:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448),name=f70.sanity-flr 00000002:00010000:2.0:1787191339.781109:0:57882:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc9:0x0]) in obj [0x200000405:0xc9:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191339.781304:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a198 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460509c expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191339.781320:0:57882:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a198 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460509c expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:2.0:1787191339.781329:0:57882:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xc9:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191339.781337:0:57882:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) 00000080:00010000:2.0:1787191339.781341:0:57882:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) for lock 0xe5129dc88483a198 00000080:00010000:2.0:1787191339.781348:0:57882:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a198 from it ffffa3fb42163cd8 00010000:00010000:2.0:1787191339.781353:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a198 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460509c expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191339.781367:0:57882:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a198 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460509c expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:2.0:1787191339.781389:0:57882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc9:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:2.0:1787191339.781408:0:57882:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc9:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191339.781413:0:57882:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191339.781416:0:57882:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc9:0x0] 00000008:00010000:2.0:1787191339.781434:0:57882:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191339.781438:0:57882:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d11b0, osc lock ffff936b44e625f0, flags 0x400000400001002 00010000:00010000:2.0:1787191339.781454:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 1 00010000:00010000:2.0:1787191339.781464:0:57882:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 1 00000020:00200000:2.0:1787191339.781474:0:57882:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191339.781477:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 1 00010000:00010000:2.0:1787191339.781485:0:57882:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00000020:00200000:2.0:1787191339.781495:0:57882:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191339.781500:0:57882:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc9:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191339.781503:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51656bf0 (ffff936b465cccf8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191339.781506:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51656bf0 (ffff936b465cccf8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191339.781509:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d11b0 (ffff936b465cc6c8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191339.781513:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51656bf0 (ffff936b465cccf8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191339.781515:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d11b0 (ffff936b465cccf8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191339.781524:0:57882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc9:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191339.781537:0:57882:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xc9:0x0], offset: 5, type: SEEK_DATA 00000080:00200000:2.0:1787191339.781542:0:57882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc9:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:2.0:1787191339.781546:0:57882:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc9:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191339.781548:0:57882:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191339.781553:0:57882:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191339.781558:0:57882:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191339.781570:0:57882:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc9:0x0] updating i_size 5 i_blocks 8 00000080:00200000:2.0:1787191339.781578:0:57882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc9:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191339.781582:0:57882:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000080:00200000:2.0:1787191339.781584:0:57882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc9:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191339.781589:0:57882:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191339.781592:0:57882:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191339.781595:0:57882:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:2.0:1787191339.781602:0:57882:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:2.0:1787191339.781604:0:57882:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d11b0, osc lock ffff936b44e625f0, flags 0x0 00010000:00010000:2.0:1787191339.781612:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:2.0:1787191339.782102:0:57882:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:2.0:1787191339.782112:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:2.0:1787191339.782120:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:2.0:1787191339.782137:0:57882:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00000080:00200000:2.0:1787191339.782151:0:57882:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc9:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191339.782155:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b497c97b8 (ffff936b465cccf8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191339.782158:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b497c97b8 (ffff936b465cccf8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191339.782161:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d11b0 (ffff936b465cc6c8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191339.782165:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:2.0:1787191339.782172:0:57882:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00000020:00010000:2.0:1787191339.782182:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b497c97b8 (ffff936b465cccf8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191339.782185:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d11b0 (ffff936b465cccf8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191339.782194:0:57882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc9:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191339.782201:0:57882:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xc9:0x0], offset: 0, type: (null) 00000080:00200000:2.0:1787191339.782207:0:57882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc9:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:2.0:1787191339.782211:0:57882:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc9:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191339.782213:0:57882:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191339.782215:0:57882:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc9:0x0] 00000008:00010000:2.0:1787191339.782224:0:57882:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191339.782225:0:57882:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d11b0, osc lock ffff936b44e625f0, flags 0x400000400001002 00010000:00010000:2.0:1787191339.782234:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00010000:00010000:2.0:1787191339.782247:0:57882:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00000020:00200000:2.0:1787191339.782256:0:57882:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191339.782259:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00010000:00010000:2.0:1787191339.782266:0:57882:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00000020:00200000:2.0:1787191339.782275:0:57882:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191339.782280:0:57882:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc9:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191339.782283:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51656bf0 (ffff936b465cccf8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191339.782285:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51656bf0 (ffff936b465cccf8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191339.782288:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d11b0 (ffff936b465cc6c8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191339.782290:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51656bf0 (ffff936b465cccf8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191339.782292:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d11b0 (ffff936b465cccf8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191339.782298:0:57882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc9:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191339.782306:0:57882:0:(file.c:5244:ll_file_seek()) COMPLETED file f70.sanity-flr:[0x200000405:0xc9:0x0], offset: 0, type: (null), rc = 5 00000080:00200080:2.0:1787191339.782312:0:57882:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448) cmd=400866b1 arg=0 00000100:00100000:3.0:1787191339.786556:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626678784:192.168.202.101@tcp:10:bash.0 00000100:00100000:3.0:1787191339.786590:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626678656:192.168.202.101@tcp:10:bash.0 00000080:00200000:0.0:1787191339.786782:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xca:0x0] updating i_size 0 i_blocks 0 00000020:00010000:0.0:1787191339.786789:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b53cc5d58 (ffff936b47a17c68/0) at cl_lock_release():245 00000020:00010000:0.0:1787191339.786792:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b53cc5d58 (ffff936b47a17c68/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191339.786797:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99db0 (ffff936b47a17cf8/1) at cl_lock_cancel():142 00010000:00010000:0.0:1787191339.786806:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a1e5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460516e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.786820:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a1e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460516e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:0.0:1787191339.786857:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99df0 (ffff936b47a17bd8/1) at cl_lock_cancel():142 00010000:00010000:0.0:1787191339.786863:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a1ec lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4605175 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.786872:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a1ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4605175 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:0.0:1787191339.786881:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b53cc5d58 (ffff936b47a17c68/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191339.786883:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99db0 (ffff936b47a17c68/1) at cl_lock_fini():72 00000020:00010000:0.0:1787191339.786888:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99df0 (ffff936b47a17c68/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191339.786905:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xca:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1787191339.786916:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xca:0x0](ffff936b489aec08) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191339.000000000, mtime 1787191339.000000000, ctime 1787191339.000000000, rc 0 00000080:00200008:0.0:1787191339.787004:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xca:0x0], ppos: 0, count: 5 00000080:00200000:0.0:1787191339.787016:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:0.0:1787191339.787022:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:0.0:1787191339.787026:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:0.0:1787191339.787030:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:0.0:1787191339.787035:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@00000000605e95f1[0x110, 1, [0x200000405:0xca:0x0] hash] 00000020:00200000:0.0:1787191339.787049:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:0.0:1787191339.787054:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xca:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:0.0:1787191339.787067:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xca:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:0.0:1787191339.787071:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xca:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191339.787074:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:0.0:1787191339.787078:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:0.0:1787191339.787084:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:0.0:1787191339.787087:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1787191339.787101:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:0.0:1787191339.787117:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:0.0:1787191339.787122:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b46b502b0, osc lock ffff936b50b63430, flags 0x0 00010000:00010000:0.0:1787191339.787139:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a1e5 lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460516e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.787152:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a1e5 lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460516e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.787163:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a1e5 lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460516e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.787177:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a1e5 lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460516e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.787184:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a1e5 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460516e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191339.787195:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:0.0:1787191339.787204:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:0.0:1787191339.787242:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:0.0:1787191339.787249:0:57570:0:(rw26.c:927:ll_write_end()) page@00000000b2903f9c[3 0000000084a986f8 2 1 00000000f4d347a7 0 0 0] 00000080:00200000:0.0:1787191339.787253:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @0000000093c55d4d 17ffffc0001001 3:0 ffff936b522c4000 0 lru 00000080:00200000:0.0:1787191339.787260:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@00000000efdfe8b8 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000ef00a996 00000000a48fd6f2 > 3< 0 0 > 4< 0 0 8 470024192 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1787191339.787262:0:57570:0:(rw26.c:927:ll_write_end()) end page@00000000b2903f9c 00000080:00200000:0.0:1787191339.787263:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:0.0:1787191339.787266:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:0.0:1787191339.787282:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 00000000725432b4 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a1e5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460516e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191339.787297:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b489aedb8, count 1, dirtied 1 00000080:00200000:0.0:1787191339.787301:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:0.0:1787191339.787303:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:0.0:1787191339.787314:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b53cc5d58 (ffff936b47a17c68/0) at cl_lock_release():245 00000020:00010000:0.0:1787191339.787317:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b53cc5d58 (ffff936b47a17c68/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191339.787319:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b46b502b0 (ffff936b47a17bd8/1) at cl_lock_cancel():142 00010000:00010000:0.0:1787191339.787323:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a1e5 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460516e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.787349:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a1e5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460516e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:0.0:1787191339.787358:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b53cc5d58 (ffff936b47a17c68/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191339.787361:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b46b502b0 (ffff936b47a17c68/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191339.787366:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:0.0:1787191339.787370:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:0.0:1787191339.787375:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xca:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191339.787378:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:0.0:1787191339.787383:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xca:0x0] updating i_size 5 i_blocks 0 00000080:00200000:0.0:1787191339.787387:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:0.0:1787191339.787404:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xca:0x0](ffff936b489aec08), flags 100001 00000002:00100000:0.0:1787191339.787459:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1d880 x1874004626676736/t8589936836(8589936836) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191355 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191339.787471:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191339.787477:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474380 x1874004626679040/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191339.787507:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626679040:192.168.202.101@tcp:35:bash.0 00000100:00100000:0.0:1787191339.787596:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00000080:00200080:2.0:1787191339.789472:0:57882:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448) cmd=400866b1 arg=2 00000080:00200008:2.0:1787191339.789489:0:57882:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xc9:0x0](ffff936b5395f448), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191339.789497:0:57882:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448),name=f70.sanity-flr 00000002:00010000:2.0:1787191339.789517:0:57882:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc9:0x0]) in obj [0x200000405:0xc9:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191339.789532:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a198 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460509c expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1787191339.789547:0:57882:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a198 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460509c expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:2.0:1787191339.789556:0:57882:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xc9:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191339.789565:0:57882:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) 00000080:00010000:2.0:1787191339.789569:0:57882:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) for lock 0xe5129dc88483a198 00000080:00010000:2.0:1787191339.789579:0:57882:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a198 from it ffffa3fb42163cd8 00010000:00010000:2.0:1787191339.789583:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a198 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460509c expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1787191339.789592:0:57882:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a198 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460509c expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 0 00000080:00200000:2.0:1787191339.789681:0:57882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc9:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:2.0:1787191339.789695:0:57882:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc9:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191339.789698:0:57882:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191339.789702:0:57882:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xc9:0x0] 00000008:00010000:2.0:1787191339.789721:0:57882:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191339.789725:0:57882:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d11b0, osc lock ffff936b44e625f0, flags 0x400000400001002 00010000:00010000:2.0:1787191339.789742:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00010000:00010000:2.0:1787191339.789753:0:57882:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00000020:00200000:2.0:1787191339.789765:0:57882:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191339.789769:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00010000:00010000:2.0:1787191339.789777:0:57882:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00000020:00200000:2.0:1787191339.789787:0:57882:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191339.789796:0:57882:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc9:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191339.789800:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51656bf0 (ffff936b465cccf8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191339.789803:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51656bf0 (ffff936b465cccf8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191339.789806:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d11b0 (ffff936b465cc6c8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191339.789810:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51656bf0 (ffff936b465cccf8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191339.789812:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d11b0 (ffff936b465cccf8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191339.789825:0:57882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc9:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191339.789890:0:57882:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xc9:0x0](ffff936b5395f448) current size 5, valid attrs 2068, mode 0, uid -1322410190, gid -1, new size 5, atime 1787191339.000000000, mtime 1787191339.000000000, ctime 1787191339.000000000 00010000:00010000:2.0:1787191339.789910:0:57882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a198 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e460509c expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 0 00010000:00010000:2.0:1787191339.789925:0:57882:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a18a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605079 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191339.789969:0:57882:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a198 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460509c expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 0 00010000:00010000:2.0:1787191339.789977:0:57882:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191339.789979:0:57882:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a198 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xc9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460509c expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 0 00000020:00100000:2.0:1787191339.790004:0:57882:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 36, max 7 00000100:00100000:2.0:1787191339.790019:0:57882:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9f80 x1874004626679296/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787191339.790054:0:57882:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57882:1874004626679296:192.168.202.101@tcp:36:lfs.0 00000100:00100000:2.0:1787191339.790222:0:57882:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f300 going to sleep for 11 seconds 00000100:00100000:0.0:1787191339.796618:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626679040:192.168.202.101@tcp:35:bash.0 00000100:00100000:2.0:1787191339.796624:0:57882:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57882:1874004626679296:192.168.202.101@tcp:36:lfs.0 00000002:00100000:0.0:1787191339.796651:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1d880 x1874004626676736/t8589936836(8589936836) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191339.796661:0:57882:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 2 00000080:00200000:2.0:1787191339.796667:0:57882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc9:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:2.0:1787191339.796689:0:57882:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x11 00000080:00200000:2.0:1787191339.796713:0:57882:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:2.0:1787191339.796729:0:57882:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1787191339.796733:0:57882:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b62b5f330, osc lock ffff936b44e625f0, flags 0x0 00000008:00010000:2.0:1787191339.796736:0:57882:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1787191339.796737:0:57882:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b62b5f370, osc lock ffff936b44e62d10, flags 0x0 00010000:00010000:2.0:1787191339.796792:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc88483a1f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.796805:0:57882:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc88483a1f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.796816:0:57882:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc88483a1f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191339.796853:0:57882:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57882:1874004626679424:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191339.796929:0:57882:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5ff00 going to sleep for 11 seconds 00000080:00200000:3.0:1787191339.803265:0:57885:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191339.803299:0:57885:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191339.803315:0:57885:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191339.803331:0:57885:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191339.803340:0:57885:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191339.803350:0:57885:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191339.803354:0:57885:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191339.803361:0:57885:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421cbb58 00010000:00010000:3.0:1787191339.803365:0:57885:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191339.803374:0:57885:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191339.803389:0:57885:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191339.803934:0:57885:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:3.0:1787191339.803942:0:57885:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191339.803955:0:57885:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:3.0:1787191339.803960:0:57885:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:3.0:1787191339.803975:0:57885:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1787191339.804026:0:57885:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a1fa lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.804034:0:57885:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a1fa lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.804055:0:57885:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a1fa lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57885 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191339.804086:0:57885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ce00 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57885:1874004626679552:192.168.202.101@tcp:101:rm.0 00000100:00100000:3.0:1787191339.804184:0:57885:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191339.806714:0:57882:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57882:1874004626679424:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191339.806742:0:57882:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc88483a1f3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605183 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.806759:0:57882:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc88483a1f3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605183 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.806772:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc88483a1f3 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605183 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1787191339.806785:0:57882:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 4096, setting rss=4096; kms=4096, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc88483a1f3 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605183 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.806798:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc88483a1f3 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605183 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.806806:0:57882:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc88483a1f3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605183 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.806867:0:57882:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b52377800 type 11 mode 2 res 10737419265/437 (0 18446744073709551615) 00010000:00010000:2.0:1787191339.806902:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc88483a201 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.806910:0:57882:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc88483a201 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.806925:0:57882:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc88483a201 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191339.806944:0:57882:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57882:1874004626679680:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191339.807006:0:57882:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787191339.810150:0:57885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ce00 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57885:1874004626679552:192.168.202.101@tcp:101:rm.0 00010000:00010000:0.0:1787191339.810176:0:57885:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a1fa lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460519f expref: -99 pid: 57885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.810197:0:57885:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a1fa lrc: 4/1,0 mode: --/PR res: [0x200000405:0xca:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460519f expref: -99 pid: 57885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.810204:0:57885:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a1fa lrc: 4/1,0 mode: --/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460519f expref: -99 pid: 57885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.810215:0:57885:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a1fa lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460519f expref: -99 pid: 57885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.810227:0:57885:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a1fa lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460519f expref: -99 pid: 57885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.810241:0:57885:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a1fa lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460519f expref: -99 pid: 57885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.810248:0:57885:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a1fa lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460519f expref: -99 pid: 57885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.810257:0:57885:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a1fa lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460519f expref: -99 pid: 57885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191339.810269:0:57885:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b51d1ce00 x1874004626679552/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/976 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191339.810280:0:57885:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a1fa lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460519f expref: -99 pid: 57885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191339.810298:0:57885:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a1fa lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460519f expref: -99 pid: 57885 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.810306:0:57885:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/202 (0 0) 00000080:00200000:0.0:1787191339.810312:0:57885:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191339.810369:0:57885:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xca:0x0](ffff936b489aec08): rc = 0 00000080:00200000:0.0:1787191339.810385:0:57885:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xca:0x0]: layout version change: 4 -> 4 00000080:00010000:0.0:1787191339.810390:0:57885:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xca:0x0](ffff936b489aec08) for lock 0xe5129dc88483a1fa 00000080:00010000:0.0:1787191339.810401:0:57885:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xca:0x0](ffff936b489aec08) 00000080:00010000:0.0:1787191339.810405:0:57885:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a1fa from it ffffa3fb421cbb20 00010000:00010000:0.0:1787191339.810408:0:57885:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a1fa lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460519f expref: -99 pid: 57885 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.810416:0:57885:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a1fa lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460519f expref: -99 pid: 57885 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200008:0.0:1787191339.810453:0:57885:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xca:0x0](ffff936b489aec08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191339.810460:0:57885:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xca:0x0](ffff936b489aec08),name=f70.sanity-flr 00000002:00010000:0.0:1787191339.810484:0:57885:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xca:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.810491:0:57885:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a1fa lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460519f expref: -99 pid: 57885 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.810502:0:57885:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a1fa lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460519f expref: -99 pid: 57885 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191339.810509:0:57885:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191339.810514:0:57885:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xca:0x0](ffff936b489aec08) 00000080:00010000:0.0:1787191339.810517:0:57885:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xca:0x0](ffff936b489aec08) for lock 0xe5129dc88483a1fa 00000080:00010000:0.0:1787191339.810521:0:57885:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a1fa from it ffffa3fb421cbcb8 00010000:00010000:0.0:1787191339.810525:0:57885:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a1fa lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460519f expref: -99 pid: 57885 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.810532:0:57885:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a1fa lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460519f expref: -99 pid: 57885 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191339.810550:0:57885:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xca:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:0.0:1787191339.810560:0:57885:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xca:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191339.810564:0:57885:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191339.810568:0:57885:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xca:0x0] 00000008:00010000:0.0:1787191339.810586:0:57885:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191339.810589:0:57885:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b46b502b0, osc lock ffff936b50b63430, flags 0x400000400001002 00010000:00010000:0.0:1787191339.810605:0:57885:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a1e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460516e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191339.810618:0:57885:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a1e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460516e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:0.0:1787191339.810629:0:57885:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191339.810632:0:57885:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a1e5 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460516e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191339.810640:0:57885:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a1e5 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460516e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:0.0:1787191339.810655:0:57885:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191339.810664:0:57885:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xca:0x0] updating i_size 5 i_blocks 0 00000020:00010000:0.0:1787191339.810671:0:57885:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c39030 (ffff936b47a17c68/0) at cl_lock_release():245 00000020:00010000:0.0:1787191339.810673:0:57885:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c39030 (ffff936b47a17c68/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191339.810676:0:57885:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b46b502b0 (ffff936b47a17bd8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191339.810681:0:57885:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c39030 (ffff936b47a17c68/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191339.810683:0:57885:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b46b502b0 (ffff936b47a17c68/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191339.810693:0:57885:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xca:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191339.810749:0:57885:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191339.810758:0:57885:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.810766:0:57885:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.810774:0:57885:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.810779:0:57885:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191339.810783:0:57885:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191339.810785:0:57885:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191339.810789:0:57885:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421cbc10 00010000:00010000:0.0:1787191339.810792:0:57885:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.810798:0:57885:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.810810:0:57885:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191339.810816:0:57885:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:0.0:1787191339.810821:0:57885:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191339.810826:0:57885:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:0.0:1787191339.810867:0:57885:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:0.0:1787191339.810873:0:57885:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:0.0:1787191339.810894:0:57885:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a1d7 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xca:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4605152 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191339.810907:0:57885:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xca:0x0]: losing layout lock 00010000:00010000:0.0:1787191339.810918:0:57885:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a1fa lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e460519f expref: -99 pid: 57885 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191339.810925:0:57885:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xca:0x0]: losing layout lock 00010000:00010000:1.0:1787191339.810993:0:57885:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a1c9 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xca:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e460512f expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.811036:0:57885:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a1d7 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xca:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605152 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191339.811054:0:57885:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a1fa lrc: 1/0,0 mode: --/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460519f expref: -99 pid: 57885 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191339.811063:0:57885:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a1c9 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xca:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e460512f expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.811069:0:57885:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:1.0:1787191339.811072:0:57885:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a1d7 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xca:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605152 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191339.811084:0:57885:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a1fa lrc: 0/0,0 mode: --/PR res: [0x200000405:0xca:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460519f expref: -99 pid: 57885 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191339.811092:0:57885:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a1c9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xca:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e460512f expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1787191339.811110:0:57885:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1787191339.811117:0:57885:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453aa300 x1874004626679936/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787191339.811149:0:57885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57885:1874004626679936:192.168.202.101@tcp:36:rm.0 00000100:00100000:1.0:1787191339.811267:0:57885:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191339.814502:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191339.814662:0:51131:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787191339.814682:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634888832 00000100:00100000:2.0:1787191339.814691:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634888832 00000100:00100000:2.0:1787191339.814749:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1340 00000100:00100000:2.0:1787191339.814759:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b50881c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:37089:x1874004634888832:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191339.814777:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000da911a26/0xe5129dc88483a10c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4604f22 expref: -99 pid: 57880 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191339.814873:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191339.814880:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b50881c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:37089:x1874004634888832:12345-192.168.202.101@tcp:104: Request processed in 123us (387us total) trans 0 rc 0/0 00010000:00010000:0.0:1787191339.814883:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1787191339.814887:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1340 00010000:00010000:0.0:1787191339.814891:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000da911a26/0xe5129dc88483a10c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4604f22 expref: -99 pid: 57880 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.814899:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40031600 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191339.814904:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000da911a26/0xe5129dc88483a10c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4604f22 expref: -99 pid: 57880 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.814947:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000da911a26/0xe5129dc88483a10c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4604f22 expref: -99 pid: 57880 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.814954:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191339.814978:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000da911a26/0xe5129dc88483a10c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4604f22 expref: -99 pid: 57880 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.814986:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000da911a26/0xe5129dc88483a10c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4604f22 expref: -99 pid: 57880 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.815001:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191339.815003:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191339.815005:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191339.815012:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787191339.815026:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626680064:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191339.818858:0:57882:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57882:1874004626679680:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191339.818894:0:57882:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc88483a201 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000020000 nid: local remote: 0x7130d520e46051a6 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.818907:0:57882:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc88483a201 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e46051a6 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.818921:0:57882:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc88483a201 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e46051a6 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191339.819480:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191339.819515:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634888960 00000100:00100000:2.0:1787191339.819522:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634888960 00000100:00100000:2.0:1787191339.819565:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1341 00000100:00100000:2.0:1787191339.819574:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30131:x1874004634888960:12345-192.168.202.101@tcp:105: 00010000:00010000:2.0:1787191339.819586:0:40921:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc88483a201 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e46051a6 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.819595:0:40921:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc88483a201 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e46051a6 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.819604:0:40921:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc88483a201 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000020000 nid: local remote: 0x7130d520e46051a6 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.819614:0:40921:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc88483a201 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10080000020000 nid: local remote: 0x7130d520e46051a6 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.819636:0:40921:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc88483a201 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10080000020000 nid: local remote: 0x7130d520e46051a6 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.819644:0:40921:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc88483a201 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x80000020000 nid: local remote: 0x7130d520e46051a6 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.819661:0:40921:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b51dd5c00) 00000100:00100000:2.0:1787191339.819712:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30131:x1874004634888960:12345-192.168.202.101@tcp:105: Request processed in 138us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191339.819719:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1341 00010000:00010000:3.0:1787191339.820688:0:57882:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc88483a201 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e46051a6 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.820702:0:57882:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc88483a201 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e46051a6 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.820716:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc88483a201 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000020000 nid: local remote: 0x7130d520e46051a6 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191339.820730:0:57882:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc88483a201 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000020000 nid: local remote: 0x7130d520e46051a6 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.820742:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc88483a201 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e46051a6 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.820749:0:57882:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc88483a201 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e46051a6 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191339.820854:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626680192:192.168.202.101@tcp:10:lfs.0 00000100:00100000:3.0:1787191339.820952:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626680320:192.168.202.101@tcp:10:lfs.0 00000100:00100000:1.0:1787191339.822403:0:57885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57885:1874004626679936:192.168.202.101@tcp:36:rm.0 00000080:00200000:1.0:1787191339.822463:0:57885:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xca:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00020000:00200000:1.0:1787191339.822475:0:57885:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xca:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191339.822490:0:57885:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191339.822496:0:57885:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191339.822507:0:57885:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000008:00010000:1.0:1787191339.822525:0:57885:0:(osc_cache.c:1183:osc_extent_make_ready()) ### extent: 00000000725432b4 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a1e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460516e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1787191339.822558:0:57885:0:(osc_cache.c:917:osc_extent_finish()) ### extent: 00000000725432b4 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a1e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460516e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1787191339.822581:0:57885:0:(osc_cache.c:497:__osc_extent_remove()) ### extent: 00000000725432b4 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a1e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460516e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191339.822603:0:57885:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xca:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191339.822656:0:57885:0:(llite_lib.c:2066:ll_clear_inode()) VFS Op:inode=[0x200000405:0xca:0x0](ffff936b489aec08) 00000008:00010000:1.0:1787191339.822686:0:57885:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 5 blocks 0 [cma]time 1787191339 1787191339 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a1e5 lrc: 1/0,0 mode: PW/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460516e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1787191339.822704:0:57885:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191339 1787191339 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a1ec lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x1b6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4605175 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1787191339.825868:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626680064:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191339.826184:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626680192:192.168.202.101@tcp:10:lfs.0 00000100:00100000:3.0:1787191339.826873:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626680320:192.168.202.101@tcp:10:lfs.0 00000080:00200000:0.0:1787191339.826914:0:57882:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xc9:0x0] updating i_size 5 i_blocks 8 00000020:00010000:0.0:1787191339.826921:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b497c97b8 (ffff936b465cccf8/0) at cl_lock_release():245 00000020:00010000:0.0:1787191339.826925:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b497c97b8 (ffff936b465cccf8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191339.826929:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62b5f330 (ffff936b465cc6c8/1) at cl_lock_cancel():142 00010000:00010000:0.0:1787191339.826938:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc88483a1f3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605183 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.826952:0:57882:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc88483a1f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605183 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:0.0:1787191339.826967:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62b5f370 (ffff936b47a17a28/1) at cl_lock_cancel():142 00010000:00010000:0.0:1787191339.826972:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc88483a201 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e46051a6 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.826980:0:57882:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc88483a201 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e46051a6 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:0.0:1787191339.826993:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b497c97b8 (ffff936b465cccf8/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191339.826995:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62b5f330 (ffff936b465cccf8/1) at cl_lock_fini():72 00000020:00010000:0.0:1787191339.826999:0:57882:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62b5f370 (ffff936b465cccf8/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191339.827015:0:57882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc9:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1787191339.827028:0:57882:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xc9:0x0](ffff936b5395f448) current size 5, valid attrs 10002168, mode 0, uid -1322410190, gid -1, new size 5, atime 1787191339.000000000, mtime 1787191339.000000000, ctime 1787191339.000000000, rc 0 00000080:00200080:0.0:1787191339.827056:0:57882:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448) cmd=400866b1 arg=0 00000080:00200008:0.0:1787191339.827084:0:57882:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xc9:0x0](ffff936b5395f448) current size 5, valid attrs 101f0, mode a3fb, uid 1108044320, gid -27797, new size 18446624687905961032, atime 1787191339.000000000, mtime 1787191339.000000000, ctime 1787191339.000000000 00000020:00100000:0.0:1787191339.827135:0:57882:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1787191339.827145:0:57882:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477b80 x1874004626680576/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787191339.827167:0:57882:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57882:1874004626680576:192.168.202.101@tcp:36:lfs.0 00000100:00100000:0.0:1787191339.827250:0:57882:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787191339.829602:0:57882:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57882:1874004626680576:192.168.202.101@tcp:36:lfs.0 00000080:00200000:0.0:1787191339.829645:0:57882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc9:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:0.0:1787191339.829657:0:57882:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc9:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191339.829661:0:57882:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191339.829668:0:57882:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191339.829681:0:57882:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000100:00100000:0.0:1787191339.829743:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626680704:192.168.202.101@tcp:2:lfs.0 00000100:00100000:0.0:1787191339.831983:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626680704:192.168.202.101@tcp:2:lfs.0 00000080:00200000:3.0:1787191339.832010:0:57882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc9:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191339.832026:0:57882:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xc9:0x0](ffff936b5395f448) current size 5, valid attrs 100101f0, mode a3fb, uid 1108044320, gid -27797, new size 18446624687905961032, atime 1787191339.000000000, mtime 1787191339.000000000, ctime 1787191339.000000000, rc 0 00000080:00200080:3.0:1787191339.832059:0:57882:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448) cmd=c00c66f3 arg=18472e0 00010000:00010000:3.0:1787191339.832120:0:57882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a175 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0xc9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81008000000000 nid: local remote: 0x7130d520e4605041 expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.832204:0:57882:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a175 lrc: 0/0,0 mode: --/PW res: [0x200000405:0xc9:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x85809400000000 nid: local remote: 0x7130d520e4605041 expref: -99 pid: 57882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191339.832226:0:57882:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453ab480 x1874004626673664/t8589936830(8589936830) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191355 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191339.832237:0:57882:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191339.832243:0:57882:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1ea00 x1874004626680960/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191339.832262:0:57882:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57882:1874004626680960:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191339.832373:0:57882:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191339.834475:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191339.834564:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634889088 00000100:00100000:3.0:1787191339.834571:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634889088 00000100:00100000:3.0:1787191339.834704:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1342 00000100:00100000:3.0:1787191339.834715:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6508:x1874004634889088:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191339.834731:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a18a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4605079 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191339.834813:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191339.834820:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6508:x1874004634889088:12345-192.168.202.101@tcp:104: Request processed in 107us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191339.834826:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1342 00010000:00010000:0.0:1787191339.835676:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191339.835685:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a18a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4605079 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191339.835695:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9b400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191339.835699:0:40930:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a18a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4605079 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191339.835708:0:40930:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a18a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4605079 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191339.835716:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a18a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4605079 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1787191339.835738:0:40930:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xc9:0x0]: losing layout lock 00010000:00010000:0.0:1787191339.835781:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a18a lrc: 2/0,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4605079 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191339.835788:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191339.835811:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a18a lrc: 1/0,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4605079 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191339.835818:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a18a lrc: 0/0,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4605079 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191339.835861:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191339.835863:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191339.835865:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191339.835882:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626681088:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191339.843000:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191339.843282:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634889728 00000100:00100000:3.0:1787191339.843291:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634889728 00000100:00100000:3.0:1787191339.843332:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1343 00000100:00100000:3.0:1787191339.843342:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8420:x1874004634889728:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191339.843360:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a1ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4605175 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191339.843446:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191339.843453:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8420:x1874004634889728:12345-192.168.202.101@tcp:104: Request processed in 113us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191339.843459:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1343 00000080:00200000:1.0:1787191339.846232:0:57886:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191339.846267:0:57886:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.846285:0:57886:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.846301:0:57886:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.846308:0:57886:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191339.846317:0:57886:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191339.846321:0:57886:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191339.846328:0:57886:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421e3b58 00010000:00010000:1.0:1787191339.846332:0:57886:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.846341:0:57886:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.846357:0:57886:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191339.846366:0:57886:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:1.0:1787191339.846372:0:57886:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191339.846383:0:57886:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:1.0:1787191339.846388:0:57886:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191339.846400:0:57886:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191339.846454:0:57886:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a208 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.846461:0:57886:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a208 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.846471:0:57886:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a208 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191339.846494:0:57886:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57886:1874004626681216:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191339.846575:0:57886:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191339.847207:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191339.847316:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634890368 00000100:00100000:3.0:1787191339.847323:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634890368 00000100:00100000:3.0:1787191339.847369:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1344 00000100:00100000:3.0:1787191339.847378:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30353:x1874004634890368:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191339.847391:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a1e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e460516e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191339.847448:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787191339.847455:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30353:x1874004634890368:12345-192.168.202.101@tcp:104: Request processed in 79us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191339.847463:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1344 00010000:00010000:0.0:1787191339.849499:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787191339.849513:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a1ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4605175 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.849528:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9bc00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191339.849534:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a1ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4605175 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.849588:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a1ec lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4605175 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.849595:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191339.849618:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a1ec lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4605175 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.849626:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a1ec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4605175 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.849646:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191339.849650:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a1e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e460516e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191339.849657:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44caf200 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191339.849661:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a1e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e460516e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191339.849683:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a1e5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e460516e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191339.849695:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191339.849701:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a1e5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e460516e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191339.849708:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a1e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e460516e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191339.849722:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191339.849723:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191339.849726:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191339.849747:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626681472:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191339.849875:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626681088:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191339.849897:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787191339.849902:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626681344:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787191339.850230:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191339.852513:0:57886:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589936844 gen 1 00000100:00100000:1.0:1787191339.852548:0:57886:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57886:1874004626681216:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191339.852565:0:57886:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a208 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.852580:0:57886:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a208 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.852587:0:57886:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a208 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.852594:0:57886:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a208 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.852603:0:57886:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a208 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.852610:0:57886:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030800 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191339.852614:0:57886:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a208 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.852621:0:57886:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a208 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.852628:0:57886:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a208 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.852635:0:57886:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191339.852641:0:57886:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a208 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.852647:0:57886:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a208 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191339.852671:0:57886:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b453aad80 x1874004626681216/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191339.852687:0:57886:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000100:00100000:3.0:1787191339.852735:0:57882:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57882:1874004626680960:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191339.852755:0:57882:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453ab480 x1874004626673664/t8589936830(8589936830) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191339.852773:0:57886:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00010000:00010000:3.0:1787191339.852778:0:57882:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/201 (0 0) 00000080:00010000:3.0:1787191339.852784:0:57882:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xc9:0x0](ffff936b5395f448) 00000002:00010000:1.0:1787191339.852786:0:57886:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00000002:00010000:3.0:1787191339.852789:0:57882:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xc9:0x0]) in obj [0x200000405:0xc9:0x0], intent: layout flags 0 00010000:00010000:1.0:1787191339.852794:0:57886:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.852805:0:57886:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.852811:0:57886:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191339.852815:0:57886:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191339.852818:0:57886:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191339.852823:0:57886:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421e3be8 00010000:00010000:3.0:1787191339.852824:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc88483a20f lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.852826:0:57886:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191339.852856:0:57882:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc88483a20f lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.852861:0:57886:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191339.852866:0:57882:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc88483a20f lrc: 3/1,0 mode: --/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57882 initiator: MDT0 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1787191339.852872:0:57886:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191339.852880:0:57886:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000100:00100000:3.0:1787191339.852885:0:57882:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57882:1874004626681600:192.168.202.101@tcp:101:lfs.0 00000080:00200000:1.0:1787191339.852886:0:57886:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191339.852898:0:57886:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:1.0:1787191339.852902:0:57886:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191339.852913:0:57886:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191339.852936:0:57886:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a216 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.852942:0:57886:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a216 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191339.852946:0:57882:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ccc0 going to sleep for 11 seconds 00010000:00010000:1.0:1787191339.852948:0:57886:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a216 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191339.852959:0:57886:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57886:1874004626681728:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191339.852983:0:57886:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191339.857066:0:57882:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57882:1874004626681600:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191339.857089:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626681344:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787191339.857096:0:57882:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc88483a20f lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605208 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191339.857101:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626681472:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787191339.857110:0:57882:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc88483a20f lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605208 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191339.857124:0:57882:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b51d1ea00 x1874004626681600/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191339.857149:0:57882:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc88483a20f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605208 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191339.857162:0:57882:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc88483a20f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605208 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.857172:0:57882:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/201 (0 0) 00000100:00100000:1.0:1787191339.857174:0:57886:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57886:1874004626681728:192.168.202.101@tcp:101:lfs.0 00000080:00200000:3.0:1787191339.857178:0:57882:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xc9:0x0] suppgids 0 0: rc 0 00010000:00010000:1.0:1787191339.857183:0:57886:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a216 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00000080:00010000:3.0:1787191339.857189:0:57882:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xc9:0x0](ffff936b5395f448) for lock 0xe5129dc88483a20f 00010000:00010000:1.0:1787191339.857190:0:57886:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a216 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.857196:0:57886:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a216 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00000080:00010000:3.0:1787191339.857196:0:57882:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a20f from it ffffa3fb42163bc8 00010000:00010000:3.0:1787191339.857200:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc88483a20f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605208 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.857208:0:57882:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc88483a20f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605208 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191339.857233:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc88483a20f lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605208 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191339.857244:0:57882:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc88483a20f lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605208 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:3.0:1787191339.857251:0:57882:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xc9:0x0](00000000d13126ac) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc88483a20f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605208 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191339.857292:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc88483a20f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605208 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191339.857304:0:57882:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc88483a20f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605208 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191339.857318:0:57882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc9:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1787191339.857328:0:57882:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc9:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191339.857331:0:57882:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191339.857337:0:57882:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191339.857346:0:57882:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1787191339.857367:0:57882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc9:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:3.0:1787191339.857379:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc88483a20f lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605208 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191339.857388:0:57882:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc88483a20f lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605208 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:3.0:1787191339.857396:0:57882:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xc9:0x0](00000000d13126ac) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc88483a20f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605208 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191339.857413:0:57882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc9:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00020000:00200000:3.0:1787191339.857418:0:57882:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc9:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191339.857421:0:57882:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191339.857423:0:57882:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191339.857427:0:57882:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1787191339.857433:0:57882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc9:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:3.0:1787191339.857445:0:57882:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 5 blocks 8 [cma]time: 1787191339 1787191339 1787191339 by oinfo size 5 blocks 8 [cma]time 1787191339 1787191339 1787191339 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 1/0,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00000008:00010000:3.0:1787191339.857480:0:57882:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 4096 blocks 8 [cma]time: 1787191339 1787191339 0 by oinfo size 5 blocks 8 [cma]time 1787191339 1787191339 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc88483a1f3 lrc: 1/0,0 mode: PW/PW res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605183 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000008:00010000:3.0:1787191339.857495:0:57882:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191339 1787191339 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc88483a201 lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x1b5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e46051a6 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.857513:0:57886:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a216 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.857520:0:57886:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a216 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.857526:0:57886:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40031a00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191339.857531:0:57886:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a216 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.857539:0:57886:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a216 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1787191339.857542:0:57882:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xc9:0x0]: layout version change: 4294967294 -> 6 00010000:00010000:1.0:1787191339.857546:0:57886:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a216 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.857547:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc88483a20f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605208 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191339.857554:0:57886:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191339.857554:0:57882:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a200/0xe5129dc88483a20f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605208 expref: -99 pid: 57882 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191339.857559:0:57886:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a216 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.857565:0:57886:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a216 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191339.857582:0:57886:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b453aad80 x1874004626681728/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:3.0:1787191339.857589:0:57882:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xc9:0x0](ffff936b5395f448), flags 154002 00000080:00200000:1.0:1787191339.857593:0:57886:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000002:00100000:3.0:1787191339.857625:0:57882:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a8e00 x1874004626672128/t8589936827(8589936827) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191355 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191339.857634:0:57882:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191339.857639:0:57882:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1ea00 x1874004626681984/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191339.857658:0:57882:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57882:1874004626681984:192.168.202.101@tcp:35:lfs.0 00000080:00200000:1.0:1787191339.857665:0:57886:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191339.857676:0:57886:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.857683:0:57886:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.857690:0:57886:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.857695:0:57886:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191339.857700:0:57886:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191339.857703:0:57886:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191339.857707:0:57886:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421e3b58 00010000:00010000:1.0:1787191339.857710:0:57886:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.857716:0:57886:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000100:00100000:3.0:1787191339.857721:0:57882:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ccc0 going to sleep for 11 seconds 00000080:00200000:1.0:1787191339.857725:0:57886:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191339.857731:0:57886:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:1.0:1787191339.857739:0:57886:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:1.0:1787191339.857744:0:57886:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:1.0:1787191339.857756:0:57886:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.857763:0:57886:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 82 lru_type: 1 00010000:00010000:1.0:1787191339.857771:0:57886:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 82 lru_type: 1 00000002:00010000:1.0:1787191339.857779:0:57886:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.857807:0:57886:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a21d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.857814:0:57886:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a21d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.857822:0:57886:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a21d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191339.861193:0:57886:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57886:1874004626682112:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191339.861309:0:57886:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191339.862236:0:57882:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57882:1874004626681984:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191339.862268:0:57882:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a8e00 x1874004626672128/t8589936827(8589936827) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191339.862322:0:57882:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xc9:0x0] ignore/verify layout 1/0, layout version 5 restore needed 0 00020000:00200000:3.0:1787191339.862333:0:57882:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xc9:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191339.862337:0:57882:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191339.862343:0:57882:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:3.0:1787191339.862378:0:57882:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xc9:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191339.862385:0:57882:0:(llite_lib.c:2066:ll_clear_inode()) VFS Op:inode=[0x200000405:0xc9:0x0](ffff936b5395f448) 00000080:00200000:3.0:1787191339.862520:0:57882:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191339.862537:0:57882:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191339.862550:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191339.862561:0:57882:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191339.862568:0:57882:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191339.862573:0:57882:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191339.862576:0:57882:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191339.862583:0:57882:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42163bf8 00010000:00010000:3.0:1787191339.862587:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191339.862594:0:57882:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191339.862609:0:57882:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191339.862627:0:57882:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191339.862633:0:57882:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191339.862644:0:57882:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b49716300, open_flags d900, mode 0 opened 0 00000080:00200000:3.0:1787191339.862650:0:57882:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:3.0:1787191339.862665:0:57882:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:3.0:1787191339.862710:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a224 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.862718:0:57882:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a224 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57882 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191339.862729:0:57882:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191339.862736:0:57882:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1ea00 x1874004626682368/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191339.862745:0:57882:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a224 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57882 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191339.862762:0:57882:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57882:1874004626682368:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191339.862936:0:57882:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191339.866250:0:57886:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57886:1874004626682112:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191339.866261:0:57882:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57882:1874004626682368:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191339.866272:0:57882:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a224 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.866273:0:57886:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a21d lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605232 expref: -99 pid: 57886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.866282:0:57882:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a224 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.866283:0:57886:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a21d lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605232 expref: -99 pid: 57886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.866290:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a224 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 57882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.866300:0:57882:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a224 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.866308:0:57882:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a224 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.866312:0:57886:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a21d lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605232 expref: -99 pid: 57886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.866320:0:57882:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9a600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191339.866322:0:57886:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a21d lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605232 expref: -99 pid: 57886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.866325:0:57882:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a224 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x206400000000 pid: 57882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.866332:0:57882:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a224 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.866339:0:57882:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a224 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.866343:0:57886:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a21d lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605232 expref: -99 pid: 57886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.866352:0:57886:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a21d lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605232 expref: -99 pid: 57886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.866359:0:57886:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a21d lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605232 expref: -99 pid: 57886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.866365:0:57882:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000002:00100000:1.0:1787191339.866369:0:57886:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b453aad80 x1874004626682112/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1787191339.866370:0:57882:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a224 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57882 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.866377:0:57882:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a224 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57882 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191339.866382:0:57886:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a21d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605232 expref: -99 pid: 57886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191339.866389:0:57882:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x7, status=0 req@ffff936b51d1ea00 x1874004626682368/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/608 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1787191339.866391:0:57886:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:1.0:1787191339.866399:0:57886:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a21d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605232 expref: -99 pid: 57886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.866407:0:57886:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a21d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605232 expref: -99 pid: 57886 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191339.866410:0:57882:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1787191339.866431:0:57882:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a21d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605232 expref: -99 pid: 57886 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:1.0:1787191339.866432:0:57886:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.866440:0:57886:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 164 lru_type: 1 00010000:00010000:3.0:1787191339.866442:0:57882:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a21d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605232 expref: -99 pid: 57886 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.866449:0:57886:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 164 lru_type: 1 00000080:00010000:3.0:1787191339.866449:0:57882:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a21d from it ffffa3fb421639a0 00010000:00010000:3.0:1787191339.866453:0:57882:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a21d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605232 expref: -99 pid: 57886 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.866457:0:57886:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 164 lru_type: 1 00010000:00010000:3.0:1787191339.866460:0:57882:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a21d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605232 expref: -99 pid: 57886 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191339.866465:0:57886:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 165 lru_type: 1 00000080:00200000:1.0:1787191339.866474:0:57886:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191339.866478:0:57886:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:1.0:1787191339.866481:0:57886:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:1.0:1787191339.866486:0:57886:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb421e3cb8 00010000:00010000:1.0:1787191339.866488:0:57886:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 82 lru_type: 1 00010000:00010000:1.0:1787191339.866495:0:57886:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 83 lru_type: 1 00000002:00010000:1.0:1787191339.866512:0:57886:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.866517:0:57886:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a21d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605232 expref: -99 pid: 57886 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191339.866525:0:57886:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a21d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605232 expref: -99 pid: 57886 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191339.866532:0:57886:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a21d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605232 expref: -99 pid: 57886 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191339.866537:0:57886:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a21d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605232 expref: -99 pid: 57886 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000002:00010000:1.0:1787191339.866545:0:57886:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.866549:0:57886:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 165 lru_type: 1 00010000:00010000:1.0:1787191339.866556:0:57886:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 165 lru_type: 1 00010000:00010000:1.0:1787191339.866561:0:57886:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 165 lru_type: 1 00010000:00010000:1.0:1787191339.866567:0:57886:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 166 lru_type: 1 00000080:00200008:0.0:1787191339.869365:0:57886:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1787191339.869376:0:57886:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191339.869416:0:57886:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.869432:0:57886:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.869445:0:57886:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.869453:0:57886:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191339.869461:0:57886:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191339.869464:0:57886:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191339.869471:0:57886:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421e3cb8 00010000:00010000:0.0:1787191339.869475:0:57886:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.869484:0:57886:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.869611:0:57886:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191339.869631:0:57886:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.869638:0:57886:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.869647:0:57886:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.869653:0:57886:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191339.869658:0:57886:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191339.869661:0:57886:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191339.869665:0:57886:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421e3b58 00010000:00010000:0.0:1787191339.869668:0:57886:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.869676:0:57886:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.869685:0:57886:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191339.869691:0:57886:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:0.0:1787191339.869696:0:57886:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191339.869700:0:57886:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=8 00000080:00200000:0.0:1787191339.869719:0:57886:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191339.869725:0:57886:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.869730:0:57886:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.869739:0:57886:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.869745:0:57886:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191339.869749:0:57886:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191339.869752:0:57886:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191339.869755:0:57886:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421e3bf8 00010000:00010000:0.0:1787191339.869758:0:57886:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.869766:0:57886:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.869773:0:57886:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191339.869777:0:57886:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191339.869780:0:57886:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191339.869785:0:57886:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:0.0:1787191339.869789:0:57886:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:0.0:1787191339.869794:0:57886:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b604ca000, open_flags a141, mode 81b6 opened 0 00000080:00200000:0.0:1787191339.869804:0:57886:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:0.0:1787191339.869824:0:57886:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xcc:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:0.0:1787191339.869855:0:57886:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a21d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4605232 expref: -99 pid: 57886 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191339.869910:0:57886:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a21d lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4605232 expref: -99 pid: 57886 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191339.869917:0:57886:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191339.869920:0:57886:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a21d lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4605232 expref: -99 pid: 57886 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191339.869956:0:57886:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a22b lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.869963:0:57886:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a22b lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191339.869976:0:57886:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191339.869989:0:57886:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a476d80 x1874004626682624/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191339.869997:0:57886:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a22b lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191339.870019:0:57886:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57886:1874004626682624:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191339.870161:0:57886:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787191339.874994:0:57886:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57886:1874004626682624:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191339.875022:0:57886:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a22b lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605263 expref: -99 pid: 57886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.875063:0:57886:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a22b lrc: 4/0,1 mode: --/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605263 expref: -99 pid: 57886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.875071:0:57886:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a22b lrc: 4/0,1 mode: --/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605263 expref: -99 pid: 57886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.875082:0:57886:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a22b lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605263 expref: -99 pid: 57886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.875093:0:57886:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a22b lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605263 expref: -99 pid: 57886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.875107:0:57886:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a22b lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605263 expref: -99 pid: 57886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.875115:0:57886:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a22b lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605263 expref: -99 pid: 57886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.875134:0:57886:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a22b lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605263 expref: -99 pid: 57886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191339.875145:0:57886:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b6a476d80 x1874004626682624/t8589936846(8589936846) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191339.875159:0:57886:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a476d80 x1874004626682624/t8589936846(8589936846) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191339.875171:0:57886:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a22b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605263 expref: -99 pid: 57886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.875181:0:57886:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/204 (0 0) 00000080:00200000:0.0:1787191339.875187:0:57886:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191339.875199:0:57886:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:0.0:1787191339.875228:0:57886:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xcc:0x0](ffff936b5396d348) 00000080:00200000:0.0:1787191339.875235:0:57886:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xcc:0x0], updating i_size 0 00000080:00200000:0.0:1787191339.875268:0:57886:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xcc:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1787191339.875272:0:57886:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xcc:0x0](ffff936b5396d348) 00000080:00010000:0.0:1787191339.875275:0:57886:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xcc:0x0](ffff936b5396d348) for lock 0xe5129dc88483a22b 00000080:00010000:0.0:1787191339.875284:0:57886:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xcc:0x0](ffff936b5396d348) 00000080:00200008:0.0:1787191339.875298:0:57886:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xcc:0x0](ffff936b5396d348), flags 120501 00000002:00100000:0.0:1787191339.875317:0:57886:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a476d80 x1874004626682624/t8589936846(8589936846) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191339.875347:0:57886:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a22b from it ffff936b495dc540 00010000:00010000:0.0:1787191339.875352:0:57886:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a22b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605263 expref: -99 pid: 57886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.875361:0:57886:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a22b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605263 expref: -99 pid: 57886 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191339.875381:0:57886:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xcc:0x0](ffff936b5396d348), inode mode 81a4 mask 40 00000080:00200000:0.0:1787191339.875941:0:57886:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xcc:0x0](ffff936b5396d348), inode mode 81a4 mask 2 00000080:00200000:0.0:1787191339.875953:0:57886:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xcc:0x0](ffff936b5396d348), xattr lov 00000002:00010000:0.0:1787191339.875971:0:57886:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xcc:0x0]) in obj [0x200000405:0xcc:0x0], intent: open flags 040000002 00010000:00010000:0.0:1787191339.876017:0:57886:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a232 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.876025:0:57886:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a232 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191339.876034:0:57886:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191339.876052:0:57886:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475180 x1874004626682880/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191339.876061:0:57886:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a232 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191339.876079:0:57886:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57886:1874004626682880:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191339.876309:0:57886:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787191339.879210:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191339.879356:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634890496 00000100:00100000:2.0:1787191339.879367:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634890496 00000100:00100000:2.0:1787191339.879429:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1345 00000100:00100000:2.0:1787191339.879439:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634890496:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191339.879456:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a22b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4605263 expref: -99 pid: 57886 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191339.879531:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191339.879538:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634890496:12345-192.168.202.101@tcp:104: Request processed in 100us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191339.879544:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1345 00010000:00010000:0.0:1787191339.879552:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191339.879560:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a22b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4605263 expref: -99 pid: 57886 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.879568:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44caf200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191339.879574:0:57627:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a22b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4605263 expref: -99 pid: 57886 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.879581:0:57627:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a22b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4605263 expref: -99 pid: 57886 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.879589:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a22b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4605263 expref: -99 pid: 57886 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191339.879608:0:57627:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xcc:0x0]: losing layout lock 00010000:00010000:0.0:1787191339.879662:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a22b lrc: 2/0,0 mode: --/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4605263 expref: -99 pid: 57886 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.879668:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191339.879700:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a22b lrc: 1/0,0 mode: --/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4605263 expref: -99 pid: 57886 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.879707:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a22b lrc: 0/0,0 mode: --/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4605263 expref: -99 pid: 57886 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.879718:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191339.879720:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191339.879722:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191339.879729:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787191339.879743:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626683008:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191339.881917:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626683008:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191339.883912:0:57886:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57886:1874004626682880:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191339.883935:0:57886:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a232 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.883947:0:57886:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a232 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.884017:0:57886:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a232 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.884025:0:57886:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a232 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.884034:0:57886:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a232 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.884053:0:57886:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44caea00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191339.884059:0:57886:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a232 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xcc:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.884065:0:57886:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a232 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xcc:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.884072:0:57886:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a232 lrc: 5/0,0 mode: --/CR res: [0x200000405:0xcc:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.884079:0:57886:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191339.884085:0:57886:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a232 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xcc:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.884091:0:57886:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a232 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xcc:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57886 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191339.884116:0:57886:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b6a475180 x1874004626682880/t8589936847(8589936847) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191339.884130:0:57886:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475180 x1874004626682880/t8589936847(8589936847) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191339.884147:0:57886:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xcc:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787191339.884196:0:57886:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xcc:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00000080:00200000:0.0:1787191339.884205:0:57886:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xcc:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191339.884250:0:57886:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xcc:0x0], updating i_size 0 00000002:00100000:0.0:1787191339.884267:0:57886:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475180 x1874004626682880/t8589936847(8589936847) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191339.884310:0:57886:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a475180 x1874004626682880/t8589936847(8589936847) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191339.884319:0:57886:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191339.884325:0:57886:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475c00 x1874004626683264/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191339.885219:0:57886:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57886:1874004626683264:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191339.885302:0:57886:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00000080:00200000:2.0:1787191339.887577:0:57887:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191339.887607:0:57887:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191339.887622:0:57887:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191339.887639:0:57887:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191339.887648:0:57887:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191339.887655:0:57887:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191339.887659:0:57887:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191339.887666:0:57887:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421cbbf8 00010000:00010000:2.0:1787191339.887669:0:57887:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191339.887678:0:57887:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191339.887695:0:57887:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191339.887702:0:57887:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191339.887709:0:57887:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191339.887725:0:57887:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b46081980, open_flags d900, mode 0 opened 0 00000080:00200000:2.0:1787191339.887731:0:57887:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:2.0:1787191339.887746:0:57887:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:2.0:1787191339.887805:0:57887:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a239 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.887813:0:57887:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a239 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57887 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191339.887824:0:57887:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:2.0:1787191339.888242:0:57887:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9f80 x1874004626683520/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191339.888252:0:57887:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a239 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191339.888274:0:57887:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57887:1874004626683520:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191339.888419:0:57886:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57886:1874004626683264:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191339.888438:0:57887:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5ff00 going to sleep for 11 seconds 00000002:00100000:0.0:1787191339.888443:0:57886:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a475180 x1874004626682880/t8589936847(8589936847) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1787191339.888491:0:57886:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xcc:0x0](ffff936b5396d348), flags 100001 00000002:00100000:0.0:1787191339.888526:0:57886:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a476d80 x1874004626682624/t8589936846(8589936846) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191355 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191339.888535:0:57886:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191339.888539:0:57886:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477800 x1874004626683776/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191339.888550:0:57886:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57886:1874004626683776:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191339.888589:0:57886:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787191339.891362:0:57887:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57887:1874004626683520:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191339.891387:0:57887:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a239 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460529b expref: -99 pid: 57887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.891413:0:57887:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a239 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460529b expref: -99 pid: 57887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.891422:0:57887:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a239 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460529b expref: -99 pid: 57887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.891433:0:57887:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a239 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460529b expref: -99 pid: 57887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.891443:0:57887:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a239 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460529b expref: -99 pid: 57887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.891455:0:57887:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a239 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460529b expref: -99 pid: 57887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.891464:0:57887:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a239 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460529b expref: -99 pid: 57887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.891471:0:57887:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a239 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460529b expref: -99 pid: 57887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191339.891488:0:57887:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b513b9f80 x1874004626683520/t8589936849(8589936849) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191339.891502:0:57887:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9f80 x1874004626683520/t8589936849(8589936849) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191339.891514:0:57887:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a239 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460529b expref: -99 pid: 57887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191339.891525:0:57887:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a239 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460529b expref: -99 pid: 57887 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.891535:0:57887:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/204 (0 0) 00000080:00200000:2.0:1787191339.891540:0:57887:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191339.891585:0:57887:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xcc:0x0](ffff936b5396d348): rc = 0 00000080:00200000:2.0:1787191339.891599:0:57887:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xcc:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:2.0:1787191339.891604:0:57887:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xcc:0x0](ffff936b5396d348) for lock 0xe5129dc88483a239 00000080:00010000:2.0:1787191339.891615:0:57887:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xcc:0x0](ffff936b5396d348) 00000080:00200008:2.0:1787191339.891628:0:57887:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xcc:0x0](ffff936b5396d348), flags 154400 00000002:00100000:2.0:1787191339.891650:0:57887:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9f80 x1874004626683520/t8589936849(8589936849) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1787191339.891702:0:57887:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a239 from it ffff936b60dc46c0 00010000:00010000:2.0:1787191339.891707:0:57887:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a239 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460529b expref: -99 pid: 57887 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.891716:0:57887:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a239 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460529b expref: -99 pid: 57887 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191339.891744:0:57887:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xcc:0x0](ffff936b5396d348), inode mode 81a4 mask 44 00000080:00200000:2.0:1787191339.891877:0:57887:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xcc:0x0](ffff936b5396d348), inode mode 81a4 mask 4 00000080:00200000:2.0:1787191339.891884:0:57887:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xcc:0x0](ffff936b5396d348), xattr lov 00000080:00200008:2.0:1787191339.891910:0:57887:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xcc:0x0](ffff936b5396d348), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191339.891916:0:57887:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xcc:0x0](ffff936b5396d348),name=f70.sanity-flr 00000002:00010000:2.0:1787191339.891934:0:57887:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xcc:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191339.891943:0:57887:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a239 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460529b expref: -99 pid: 57887 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191339.892066:0:57887:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a239 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460529b expref: -99 pid: 57887 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191339.892074:0:57887:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191339.892080:0:57887:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xcc:0x0](ffff936b5396d348) 00000080:00010000:2.0:1787191339.892083:0:57887:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xcc:0x0](ffff936b5396d348) for lock 0xe5129dc88483a239 00000080:00010000:2.0:1787191339.892087:0:57887:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a239 from it ffffa3fb421cbcd8 00010000:00010000:2.0:1787191339.892090:0:57887:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a239 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460529b expref: -99 pid: 57887 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191339.892098:0:57887:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a239 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460529b expref: -99 pid: 57887 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191339.892114:0:57887:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xcc:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:2.0:1787191339.892123:0:57887:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xcc:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191339.892126:0:57887:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191339.892130:0:57887:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xcc:0x0] 00000008:00010000:2.0:1787191339.892146:0:57887:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191339.892149:0:57887:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d11b0, osc lock ffff936b44e62130, flags 0x400000400001002 00010000:00010000:2.0:1787191339.892188:0:57887:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc88483a240 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.892199:0:57887:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc88483a240 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.892209:0:57887:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b513b8380 x1874004626683904/t0(0) o101->lustre-OST0000-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:2.0:1787191339.892239:0:57887:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:3.0:1787191339.892544:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626683904:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191339.895617:0:2391:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc88483a240 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.895643:0:2391:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc88483a240 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46052a9 expref: -99 pid: 57887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.895659:0:2391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc88483a240 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46052a9 expref: -99 pid: 57887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.895670:0:2391:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc88483a240 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46052a9 expref: -99 pid: 57887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191339.895686:0:2391:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc88483a240 lrc: 5/2,0 mode: PR/PR res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46052a9 expref: -99 pid: 57887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1787191339.895698:0:2391:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1787191339.895715:0:2391:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc88483a240 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46052a9 expref: -99 pid: 57887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.895724:0:2391:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc88483a240 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46052a9 expref: -99 pid: 57887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.895731:0:2391:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc88483a240 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46052a9 expref: -99 pid: 57887 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.895740:0:2391:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc88483a240 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46052a9 expref: -99 pid: 57887 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1787191339.895760:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626683904:192.168.202.101@tcp:101:lfs.0 00000080:00200000:2.0:1787191339.896198:0:57887:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xcc:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191339.896206:0:57887:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51655e10 (ffff936b465ccf38/0) at cl_lock_release():245 00000020:00010000:2.0:1787191339.896209:0:57887:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51655e10 (ffff936b465ccf38/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191339.896214:0:57887:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d11b0 (ffff936b465cc518/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191339.896218:0:57887:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51655e10 (ffff936b465ccf38/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191339.896220:0:57887:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d11b0 (ffff936b465ccf38/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191339.896235:0:57887:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xcc:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:0.0:1787191339.896277:0:57886:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57886:1874004626683776:192.168.202.101@tcp:35:lfs.0 00000080:00200008:2.0:1787191339.896294:0:57887:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xcc:0x0](ffff936b5396d348), flags 154000 00000002:00100000:0.0:1787191339.896308:0:57886:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a476d80 x1874004626682624/t8589936846(8589936846) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191339.896730:0:57887:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513b9f80 x1874004626683520/t8589936849(8589936849) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191355 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191339.896740:0:57887:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191339.896745:0:57887:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bad80 x1874004626684160/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191339.896767:0:57887:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57887:1874004626684160:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191339.898138:0:57887:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5ff00 going to sleep for 11 seconds 00000080:00200000:3.0:1787191339.898278:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191339.898299:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191339.898314:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191339.898329:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191339.898338:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191339.898346:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191339.898350:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191339.898356:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:3.0:1787191339.898361:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191339.898376:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191339.898392:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191339.898399:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191339.898404:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191339.898408:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:3.0:1787191339.898413:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xcc:0x0](ffff936b5396d348), inode mode 81a4 mask 42 00000080:00200008:3.0:1787191339.898419:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xcc:0x0](ffff936b5396d348), flags 101101 00000002:00010000:3.0:1787191339.898431:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xcc:0x0]) in obj [0x200000405:0xcc:0x0], intent: open|creat flags 04240101102 00010000:00010000:3.0:1787191339.898440:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a239 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e460529b expref: -99 pid: 57887 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191339.898455:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xcc:0x0]: losing layout lock 00010000:00010000:3.0:1787191339.898485:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a239 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460529b expref: -99 pid: 57887 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191339.898490:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191339.898492:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a239 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460529b expref: -99 pid: 57887 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191339.898515:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a247 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.898519:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a247 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191339.898526:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:3.0:1787191339.898533:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1e680 x1874004626684416/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191339.898539:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a247 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191339.898551:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1e680 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626684416:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191339.898649:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191339.902469:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1e680 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626684416:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191339.902499:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a247 lrc: 4/0,1 mode: --/CW res: [0x200000405:0xcc:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46052b7 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.902514:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a247 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xcc:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46052b7 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.902526:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a247 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xcc:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46052b7 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191339.902540:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x200002b, status=0 req@ffff936b51d1e680 x1874004626684416/t8589936851(8589936851) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191339.902553:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1e680 x1874004626684416/t8589936851(8589936851) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191339.902566:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a247 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xcc:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46052b7 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191339.902579:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a247 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xcc:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46052b7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.902590:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 8 res 8589935621/204 (0 0) 00000080:00200000:0.0:1787191339.902597:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000405:0xcc:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787191339.902672:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xcc:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:0.0:1787191339.902678:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xcc:0x0](ffff936b5396d348) for lock 0xe5129dc88483a247 00000080:00010000:0.0:1787191339.902685:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a247 from it ffffa3fb41cabbf0 00010000:00010000:0.0:1787191339.902689:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a247 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xcc:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46052b7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.902703:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a247 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xcc:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46052b7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000002:00100000:0.0:1787191339.902731:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1e680 x1874004626684416/t8589936851(8589936851) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191339.902788:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xcc:0x0], intent: getxattr flags 0 00010000:00010000:0.0:1787191339.902828:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a24e lrc: 3/1,0 mode: --/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.902867:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a24e lrc: 3/1,0 mode: --/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.902877:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a24e lrc: 3/1,0 mode: --/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191339.902896:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626684544:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191339.902971:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787191339.905170:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626684544:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191339.905192:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a24e lrc: 4/1,0 mode: --/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46052cc expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.905206:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a24e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46052cc expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.905216:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a24e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46052cc expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191339.905235:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b6a474e00 x1874004626684544/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191339.905245:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a24e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46052cc expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.905254:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/204 (0 0) 00000080:00200000:0.0:1787191339.905260:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xcc:0x0] suppgids 0 -1: rc 0 00000080:00010000:0.0:1787191339.905287:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xcc:0x0](ffff936b5396d348) for lock 0xe5129dc88483a24e 00000080:00010000:0.0:1787191339.905295:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a24e from it ffffa3fb41caba38 00010000:00010000:0.0:1787191339.905299:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a24e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46052cc expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.905307:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a24e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46052cc expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:0.0:1787191339.905341:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xcc:0x0](ffff936b5396d348) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191339.000000000, mtime 1787191339.000000000, ctime 1787191339.000000000 00010000:00010000:0.0:1787191339.905371:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a247 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xcc:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46052b7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191339.905402:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xcc:0x0]: losing layout lock 00010000:00010000:0.0:1787191339.905440:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a247 lrc: 1/0,0 mode: --/CW res: [0x200000405:0xcc:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46052b7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.905447:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191339.905450:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a247 lrc: 0/0,0 mode: --/CW res: [0x200000405:0xcc:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46052b7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1787191339.905473:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 36, max 7 00000100:00100000:0.0:1787191339.905480:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474e00 x1874004626684800/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787191339.905500:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626684800:192.168.202.101@tcp:36:bash.0 00000100:00100000:0.0:1787191339.905569:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787191339.906555:0:57887:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57887:1874004626684160:192.168.202.101@tcp:35:lfs.0 00000002:00100000:2.0:1787191339.906578:0:57887:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513b9f80 x1874004626683520/t8589936849(8589936849) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191339.906751:0:57887:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191339.906770:0:57887:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191339.906783:0:57887:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191339.906795:0:57887:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191339.906802:0:57887:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191339.906807:0:57887:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191339.906810:0:57887:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191339.906815:0:57887:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421cbbf8 00010000:00010000:2.0:1787191339.906818:0:57887:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191339.906825:0:57887:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191339.906945:0:57887:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191339.907015:0:57887:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191339.907022:0:57887:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191339.907034:0:57887:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b46081080, open_flags d900, mode 0 opened 0 00000080:00200000:2.0:1787191339.907053:0:57887:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:2.0:1787191339.907069:0:57887:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:2.0:1787191339.907115:0:57887:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a255 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.907122:0:57887:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a255 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57887 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191339.907132:0:57887:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191339.907138:0:57887:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bad80 x1874004626685056/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191339.907147:0:57887:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a255 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191339.907162:0:57887:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57887:1874004626685056:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191339.907344:0:57887:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787191339.913934:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626684800:192.168.202.101@tcp:36:bash.0 00000080:00200000:0.0:1787191339.913983:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:0.0:1787191339.913990:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xcc:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00010000:00010000:0.0:1787191339.914007:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/204 (0 0) 00000080:00010000:0.0:1787191339.914020:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xcc:0x0](ffff936b5396d348) 00000002:00010000:0.0:1787191339.914029:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xcc:0x0]) in obj [0x200000405:0xcc:0x0], intent: layout flags 0 00010000:00010000:0.0:1787191339.914086:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a25c lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.914096:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a25c lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.914106:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a25c lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191339.914126:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626685184:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191339.914201:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787191339.916788:0:57887:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57887:1874004626685056:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191339.916812:0:57887:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a255 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46052ef expref: -99 pid: 57887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.916862:0:57887:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a255 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46052ef expref: -99 pid: 57887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.916871:0:57887:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a255 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46052ef expref: -99 pid: 57887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.916883:0:57887:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a255 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46052ef expref: -99 pid: 57887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.916895:0:57887:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a255 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46052ef expref: -99 pid: 57887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.916909:0:57887:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a255 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46052ef expref: -99 pid: 57887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.916917:0:57887:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a255 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46052ef expref: -99 pid: 57887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.916924:0:57887:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a255 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46052ef expref: -99 pid: 57887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191339.916937:0:57887:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b513bad80 x1874004626685056/t8589936855(8589936855) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191339.917082:0:57887:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bad80 x1874004626685056/t8589936855(8589936855) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191339.917097:0:57887:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a255 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46052ef expref: -99 pid: 57887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191339.917112:0:57887:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a255 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46052ef expref: -99 pid: 57887 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.917183:0:57887:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/204 (0 0) 00000080:00200000:2.0:1787191339.917191:0:57887:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191339.917239:0:57887:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xcc:0x0](ffff936b5396d348): rc = 0 00000080:00200000:2.0:1787191339.917257:0:57887:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xcc:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:2.0:1787191339.917262:0:57887:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xcc:0x0](ffff936b5396d348) for lock 0xe5129dc88483a255 00000080:00010000:2.0:1787191339.917276:0:57887:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xcc:0x0](ffff936b5396d348) 00000080:00200008:2.0:1787191339.917290:0:57887:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xcc:0x0](ffff936b5396d348), flags 154400 00000002:00100000:2.0:1787191339.917314:0:57887:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bad80 x1874004626685056/t8589936855(8589936855) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1787191339.917370:0:57887:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a255 from it ffff936b60dc46c0 00010000:00010000:2.0:1787191339.917375:0:57887:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a255 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46052ef expref: -99 pid: 57887 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.917384:0:57887:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a255 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46052ef expref: -99 pid: 57887 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191339.917533:0:57887:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xcc:0x0](ffff936b5396d348), inode mode 81a4 mask 44 00000080:00200000:2.0:1787191339.917593:0:57887:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xcc:0x0](ffff936b5396d348), inode mode 81a4 mask 4 00000080:00200000:2.0:1787191339.917600:0:57887:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xcc:0x0](ffff936b5396d348), xattr lov 00000080:00200008:2.0:1787191339.917689:0:57887:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xcc:0x0](ffff936b5396d348), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191339.917696:0:57887:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xcc:0x0](ffff936b5396d348),name=f70.sanity-flr 00000002:00010000:2.0:1787191339.917715:0:57887:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xcc:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191339.917725:0:57887:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a255 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46052ef expref: -99 pid: 57887 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191339.917736:0:57887:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a255 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46052ef expref: -99 pid: 57887 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191339.917743:0:57887:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191339.917747:0:57887:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xcc:0x0](ffff936b5396d348) 00000080:00010000:2.0:1787191339.917750:0:57887:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xcc:0x0](ffff936b5396d348) for lock 0xe5129dc88483a255 00000080:00010000:2.0:1787191339.917754:0:57887:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a255 from it ffffa3fb421cbcd8 00010000:00010000:2.0:1787191339.917757:0:57887:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a255 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46052ef expref: -99 pid: 57887 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191339.917765:0:57887:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a255 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46052ef expref: -99 pid: 57887 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191339.917784:0:57887:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xcc:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00020000:00200000:2.0:1787191339.917794:0:57887:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xcc:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191339.917797:0:57887:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191339.917800:0:57887:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xcc:0x0] 00000008:00010000:2.0:1787191339.917818:0:57887:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191339.917821:0:57887:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d11b0, osc lock ffff936b44e62130, flags 0x400000400001002 00010000:00010000:2.0:1787191339.918017:0:57887:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc88483a240 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46052a9 expref: -99 pid: 57887 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191339.918029:0:57887:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc88483a240 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46052a9 expref: -99 pid: 57887 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:2.0:1787191339.918051:0:57887:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191339.918055:0:57887:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc88483a240 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46052a9 expref: -99 pid: 57887 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191339.918062:0:57887:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc88483a240 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46052a9 expref: -99 pid: 57887 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:2.0:1787191339.918072:0:57887:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191339.918083:0:57887:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xcc:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191339.918087:0:57887:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51655e10 (ffff936b465ccf38/0) at cl_lock_release():245 00000020:00010000:2.0:1787191339.918090:0:57887:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51655e10 (ffff936b465ccf38/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191339.918094:0:57887:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d11b0 (ffff936b465cc518/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191339.918098:0:57887:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51655e10 (ffff936b465ccf38/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191339.918101:0:57887:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d11b0 (ffff936b465ccf38/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191339.918112:0:57887:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xcc:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:0.0:1787191339.918177:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626685184:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191339.918192:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a25c lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xcc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46052fd expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.918207:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a25c lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xcc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46052fd expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191339.918218:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b6a477480 x1874004626685184/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191339.918227:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a25c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46052fd expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191339.918237:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a25c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46052fd expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000080:00200008:2.0:1787191339.918241:0:57887:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xcc:0x0](ffff936b5396d348), flags 154000 00010000:00010000:0.0:1787191339.918244:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/204 (0 0) 00000080:00200000:0.0:1787191339.918248:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xcc:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191339.918262:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xcc:0x0](ffff936b5396d348) for lock 0xe5129dc88483a25c 00000080:00010000:0.0:1787191339.918266:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a25c from it ffffa3fb41cab8c8 00010000:00010000:0.0:1787191339.918268:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a25c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46052fd expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.918275:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a25c lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xcc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46052fd expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000002:00100000:2.0:1787191339.918279:0:57887:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513bad80 x1874004626685056/t8589936855(8589936855) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191355 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1787191339.918288:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a255 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46052ef expref: -99 pid: 57887 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000020:00100000:2.0:1787191339.918289:0:57887:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191339.918294:0:57887:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9f80 x1874004626685440/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191339.918297:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a255 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46052ef expref: -99 pid: 57887 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:0.0:1787191339.918310:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xcc:0x0](000000002d349481) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a255 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46052ef expref: -99 pid: 57887 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000100:00100000:2.0:1787191339.918315:0:57887:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57887:1874004626685440:192.168.202.101@tcp:35:lfs.0 00010000:00010000:0.0:1787191339.918319:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a255 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46052ef expref: -99 pid: 57887 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191339.918326:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a255 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46052ef expref: -99 pid: 57887 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00020000:00200000:0.0:1787191339.918348:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xcc:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:0.0:1787191339.918353:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xcc:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191339.918356:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xcc:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:0.0:1787191339.918362:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xcc:0x0](ffff936b5396d348) 00000002:00010000:0.0:1787191339.918368:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xcc:0x0]) in obj [0x200000405:0xcc:0x0], intent: layout flags 02 00010000:00010000:0.0:1787191339.918380:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a25c lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xcc:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e46052fd expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191339.918395:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xcc:0x0]: losing layout lock 00010000:00010000:0.0:1787191339.918408:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a255 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46052ef expref: -99 pid: 57887 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191339.918415:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xcc:0x0]: losing layout lock 00010000:00010000:0.0:1787191339.918434:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a25c lrc: 1/0,0 mode: --/CR res: [0x200000405:0xcc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46052fd expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.918442:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a255 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46052ef expref: -99 pid: 57887 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191339.918452:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1787191339.918455:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a25c lrc: 0/0,0 mode: --/CR res: [0x200000405:0xcc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46052fd expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.918466:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a255 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46052ef expref: -99 pid: 57887 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191339.918484:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a263 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191339.918489:0:57887:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5ff00 going to sleep for 11 seconds 00010000:00010000:0.0:1787191339.918490:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a263 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xcc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191339.918498:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:0.0:1787191339.918503:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477480 x1874004626685696/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 384/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191339.918511:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a263 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xcc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191339.918522:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626685696:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191339.918546:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787191339.923426:0:57887:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57887:1874004626685440:192.168.202.101@tcp:35:lfs.0 00000002:00100000:2.0:1787191339.923463:0:57887:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513bad80 x1874004626685056/t8589936855(8589936855) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191339.923542:0:57887:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191339.923561:0:57887:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191339.923576:0:57887:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191339.923590:0:57887:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191339.923597:0:57887:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191339.923602:0:57887:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191339.923606:0:57887:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191339.923613:0:57887:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421cbbf8 00010000:00010000:2.0:1787191339.923630:0:57887:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191339.923639:0:57887:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191339.923654:0:57887:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191339.923661:0:57887:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191339.923668:0:57887:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191339.923682:0:57887:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b46081980, open_flags d902, mode 0 opened 0 00000080:00200000:2.0:1787191339.923689:0:57887:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:2.0:1787191339.923704:0:57887:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154403 00010000:00010000:2.0:1787191339.923755:0:57887:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a26a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.923762:0:57887:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a26a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57887 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191339.923773:0:57887:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191339.923779:0:57887:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9f80 x1874004626685952/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191339.923788:0:57887:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a26a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191339.923808:0:57887:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57887:1874004626685952:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191339.924026:0:57887:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787191339.929118:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191339.929166:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191339.929222:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191339.929256:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:1.0:1787191339.929292:0:40919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634891904 00000100:00100000:3.0:1787191339.929297:0:40921:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787191339.929302:0:40919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634891904 00000100:00100000:3.0:1787191339.929314:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634891136 00000100:00100000:3.0:1787191339.929319:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634891136 00000100:00100000:3.0:1787191339.929356:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634891264 00000100:00100000:3.0:1787191339.929360:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634891264 00000100:00100000:1.0:1787191339.929361:0:40919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634892032 00000100:00100000:1.0:1787191339.929367:0:40919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634892032 00000100:00100000:3.0:1787191339.929381:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1346 00000100:00100000:1.0:1787191339.929389:0:40919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 36 00000100:00100000:3.0:1787191339.929395:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+5:29543:x1874004634891136:12345-192.168.202.101@tcp:104: 00000100:00100000:1.0:1787191339.929403:0:40919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+5:8420:x1874004634891904:12345-192.168.202.101@tcp:104: 00010000:00010000:1.0:1787191339.929419:0:40919:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc88483a201 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000030000 nid: local remote: 0x7130d520e46051a6 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191339.929419:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc88483a152 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4604fca expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:2.0:1787191339.929538:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1347 00000100:00100000:0.0:1787191339.929541:0:57570:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589936857 gen 1 00000100:00100000:2.0:1787191339.929546:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b50881050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+5:30353:x1874004634891264:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191339.929554:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc88483a1f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4605183 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191339.929597:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191339.929604:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+5:29543:x1874004634891136:12345-192.168.202.101@tcp:104: Request processed in 214us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787191339.929605:0:57570:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b51d1e680 x1874004626684416/t8589936851(8589936851) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191355 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787191339.929611:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1346 00000100:00100000:0.0:1787191339.929621:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626685696:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191339.929631:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191339.929636:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc88483a152 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4604fca expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.929637:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a263 lrc: 4/0,1 mode: --/EX res: [0x200000405:0xcc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460530b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.929648:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a263 lrc: 4/0,1 mode: --/CR res: [0x200000405:0xcc:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460530b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.929650:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cae600 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191339.929655:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc88483a152 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4604fca expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.929660:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a263 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xcc:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460530b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.929669:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a263 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xcc:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460530b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.929679:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a263 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xcc:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460530b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.929686:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a263 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xcc:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460530b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.929691:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc88483a152 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4604fca expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.929693:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a263 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xcc:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460530b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.929699:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000002:00100000:0.0:1787191339.929702:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b6a477480 x1874004626685696/t8589936857(8589936857) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 384/736 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191339.929716:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a263 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcc:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460530b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.929717:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc88483a152 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4604fca expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191339.929725:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a6295254/0xe5129dc88483a152 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4604fca expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000002:00010000:0.0:1787191339.929727:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a263 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcc:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460530b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.929742:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/204 (0 0) 00010000:00010000:3.0:1787191339.929744:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191339.929745:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191339.929747:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:0.0:1787191339.929748:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xcc:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191339.929758:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xcc:0x0](ffff936b5396d348) for lock 0xe5129dc88483a263 00000100:00100000:3.0:1787191339.929765:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626686080:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00010000:0.0:1787191339.929766:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a263 from it ffffa3fb41cab930 00010000:00010000:0.0:1787191339.929770:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a263 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcc:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460530b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.929777:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a263 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xcc:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460530b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191339.929791:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:0.0:1787191339.929798:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xcc:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:0.0:1787191339.929813:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a263 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xcc:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460530b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.929821:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a263 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xcc:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460530b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1787191339.929829:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xcc:0x0](000000002d349481) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a263 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcc:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460530b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.929888:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a263 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcc:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460530b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.929897:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a263 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xcc:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460530b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191339.929916:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xcc:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191339.929925:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xcc:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191339.929929:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191339.929934:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191339.929944:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191339.929963:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xcc:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:0.0:1787191339.929976:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a263 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xcc:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460530b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191339.929984:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a263 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xcc:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460530b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:0.0:1787191339.929992:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xcc:0x0](000000002d349481) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a263 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcc:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460530b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191339.930009:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xcc:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191339.930015:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xcc:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191339.930017:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191339.930020:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191339.930024:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191339.930030:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xcc:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:0.0:1787191339.930052:0:57570:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc88483a240 lrc: 1/0,0 mode: PR/PR res: [0x280000401:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46052a9 expref: -99 pid: 57887 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191339.930124:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xcc:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:0.0:1787191339.930129:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a263 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcc:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460530b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191339.930137:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a263 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xcc:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460530b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00020000:00200000:0.0:1787191339.930150:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xcc:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:0.0:1787191339.930154:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xcc:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191339.930156:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00010000:00010000:1.0:1787191339.930157:0:40919:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00020000:00200000:0.0:1787191339.930162:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000100:00100000:1.0:1787191339.930165:0:40919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+5:8420:x1874004634891904:12345-192.168.202.101@tcp:104: Request processed in 767us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1787191339.930174:0:40919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 36 00020000:00200000:0.0:1787191339.930175:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191339.930180:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000100:00100000:1.0:1787191339.930191:0:40919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 37 00000008:00010000:0.0:1787191339.930193:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:0.0:1787191339.930198:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f99db0, osc lock ffff936b50b63430, flags 0x80000000 00000100:00100000:1.0:1787191339.930201:0:40919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:30511:x1874004634892032:12345-192.168.202.101@tcp:104: 00000008:00010000:0.0:1787191339.930205:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:0.0:1787191339.930208:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f99df0, osc lock ffff936b50b62ab0, flags 0x80000000 00010000:00010000:1.0:1787191339.930213:0:40919:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:0.0:1787191339.930220:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b52377800 type 11 mode 2 res 10737419265/440 (0 1048575) 00010000:00010000:0.0:1787191339.930251:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.930255:0:40919:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1787191339.930264:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191339.930265:0:40919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:30511:x1874004634892032:12345-192.168.202.101@tcp:104: Request processed in 65us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1787191339.930280:0:40919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 37 00010000:00010000:0.0:1787191339.930285:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.930301:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1787191339.930304:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626686208:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191339.930308:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc88483a201 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000030000 nid: local remote: 0x7130d520e46051a6 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.930323:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd5c00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191339.930328:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc88483a201 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400030000 nid: local remote: 0x7130d520e46051a6 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.930352:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc88483a201 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e46051a6 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.930359:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191339.930374:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc88483a201 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e46051a6 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.930382:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000006d215329/0xe5129dc88483a201 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e46051a6 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.930395:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191339.930399:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:1.0:1787191339.930405:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9ac00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191339.930409:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:1.0:1787191339.930427:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:1.0:1787191339.930434:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191339.930440:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00000100:00100000:0.0:1787191339.930456:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99000 going to sleep for 11 seconds 00010000:00010000:0.0:1787191339.930472:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191339.930583:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c74bfb35/0xe5129dc88483a1a6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e46050b1 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:1.0:1787191339.930653:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191339.930655:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191339.930657:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191339.930789:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191339.930797:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b50881050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30353:x1874004634891264:12345-192.168.202.101@tcp:104: Request processed in 1251us (1629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191339.930803:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1347 00000100:00100000:1.0:1787191339.930822:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626686464:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787191339.930873:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191339.930880:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc88483a1f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4605183 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.930889:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd5200 already unused, calling callback (ffffffffc1208790) 00000100:00100000:1.0:1787191339.930892:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1787191339.930894:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc88483a1f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e4605183 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.930924:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc88483a1f3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4605183 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.930931:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191339.930938:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc88483a1f3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4605183 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.930945:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc88483a1f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4605183 expref: -99 pid: 57882 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191339.930959:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191339.930961:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191339.930962:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191339.930964:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626686336:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191339.930991:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787191339.930998:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626686592:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191339.932159:0:57887:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57887:1874004626685952:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191339.932175:0:57887:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a26a lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.932187:0:57887:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a26a lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.932194:0:57887:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a26a lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.932201:0:57887:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a26a lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.932209:0:57887:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a26a lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.932215:0:57887:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd4600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191339.932219:0:57887:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a26a lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.932231:0:57887:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a26a lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.932237:0:57887:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a26a lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.932244:0:57887:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191339.932249:0:57887:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a26a lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.932255:0:57887:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a26a lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57887 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191339.932278:0:57887:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b513b9f80 x1874004626685952/t8589936858(8589936858) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191339.932292:0:57887:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9f80 x1874004626685952/t8589936858(8589936858) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191339.932309:0:57887:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191339.932361:0:57887:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xcc:0x0](ffff936b5396d348): rc = 0 00000080:00010000:2.0:1787191339.932366:0:57887:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xcc:0x0](ffff936b5396d348) for lock 0x0 00000080:00200008:2.0:1787191339.932388:0:57887:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xcc:0x0](ffff936b5396d348), flags 154402 00000002:00100000:2.0:1787191339.932413:0:57887:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9f80 x1874004626685952/t8589936858(8589936858) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191339.932449:0:57887:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513b9f80 x1874004626685952/t8589936858(8589936858) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191339.932459:0:57887:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191339.932464:0:57887:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb800 x1874004626686848/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191339.932483:0:57887:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57887:1874004626686848:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191339.932546:0:57887:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787191339.936804:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626686080:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191339.937137:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626686336:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191339.937149:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626686464:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191339.939239:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:0.0:1787191339.939397:0:57887:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57887:1874004626686848:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191339.939428:0:57887:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513b9f80 x1874004626685952/t8589936858(8589936858) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191339.939506:0:57887:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xcc:0x0](ffff936b5396d348), inode mode 81a4 mask 46 00000080:00200080:0.0:1787191339.939592:0:57887:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xcc:0x0](ffff936b5396d348) cmd=800466af arg=7ffea745671c 00000080:00200080:0.0:1787191339.939610:0:57887:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xcc:0x0](ffff936b5396d348) cmd=80086601 arg=7ffea74566b8 00000100:00100000:2.0:1787191339.939641:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634892160 00000100:00100000:2.0:1787191339.939647:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634892160 00000100:00100000:0.0:1787191339.939653:0:57887:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57887:1874004626686976:192.168.202.101@tcp:33:lfs.0 00000100:00100000:1.0:1787191339.939767:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626686592:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191339.939774:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1348 00000100:00100000:2.0:1787191339.939783:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30511:x1874004634892160:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191339.939798:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc88483a240 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e46052a9 expref: -99 pid: 57887 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000100:00100000:0.0:1787191339.939822:0:57887:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00010000:00010000:2.0:1787191339.939864:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191339.939871:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30511:x1874004634892160:12345-192.168.202.101@tcp:104: Request processed in 89us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191339.939878:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1348 00010000:00010000:1.0:1787191339.939926:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191339.939934:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc88483a240 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e46052a9 expref: -99 pid: 57887 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191339.939943:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd4400 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191339.939950:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc88483a240 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e46052a9 expref: -99 pid: 57887 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191339.939990:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc88483a240 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e46052a9 expref: -99 pid: 57887 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191339.939997:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191339.940022:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc88483a240 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e46052a9 expref: -99 pid: 57887 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191339.940029:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000005af1f70/0xe5129dc88483a240 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e46052a9 expref: -99 pid: 57887 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191339.940050:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191339.940052:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191339.940053:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191339.940060:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787191339.940069:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626687104:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191339.942294:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:0.0:1787191339.942317:0:57887:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57887:1874004626686976:192.168.202.101@tcp:33:lfs.0 00000080:00200080:0.0:1787191339.942366:0:57887:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xcc:0x0](ffff936b5396d348) cmd=c00c66f3 arg=7ffea74566a4 00000080:00200008:0.0:1787191339.942529:0:57887:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xcc:0x0](ffff936b5396d348), flags 154002 00000100:00100000:0.0:1787191339.944408:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626686208:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191339.944435:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.944451:0:57570:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.944460:0:57570:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191339.944492:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634892288 00000100:00100000:3.0:1787191339.944499:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634892288 00000100:00100000:3.0:1787191339.944545:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1349 00000100:00100000:3.0:1787191339.944554:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:9508:x1874004634892288:12345-192.168.202.101@tcp:105: 00010000:00010000:3.0:1787191339.944566:0:51131:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.944576:0:51131:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.944586:0:51131:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.944595:0:51131:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080080020000 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.944605:0:51131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080080020000 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.944775:0:51131:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80080020000 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191339.944800:0:51131:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b44caf200) 00010000:00010000:0.0:1787191339.944879:0:57570:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.944889:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.944904:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191339.944916:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080020000 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.944928:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.944937:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191339.944937:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:9508:x1874004634892288:12345-192.168.202.101@tcp:105: Request processed in 383us (2650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191339.944944:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1349 00010000:00010000:0.0:1787191339.944995:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a278 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.945005:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a278 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.945015:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a278 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191339.945033:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626687232:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191339.945092:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99000 going to sleep for 11 seconds 00000100:00100000:1.0:1787191339.946645:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626687104:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191339.949503:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626687232:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191339.949529:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a278 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605358 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.949547:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a278 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4605358 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.949559:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a278 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4605358 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.949574:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a278 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4605358 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191339.949585:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a278 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4605358 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.949596:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a278 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4605358 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.949603:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a278 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4605358 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191339.949714:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626687488:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191339.949793:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787191339.949799:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626687360:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191339.953733:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626687360:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191339.953761:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626687488:192.168.202.101@tcp:10:bash.0 00000080:00200000:1.0:1787191339.958068:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xcc:0x0] updating i_size 0 i_blocks 0 00000020:00010000:1.0:1787191339.958083:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b497c9308 (ffff936b465cc6c8/0) at cl_lock_release():245 00000020:00010000:1.0:1787191339.958088:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b497c9308 (ffff936b465cc6c8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191339.958094:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99db0 (ffff936b47a17bd8/1) at cl_lock_cancel():142 00010000:00010000:1.0:1787191339.958105:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.958123:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1787191339.958144:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99df0 (ffff936b47a17cf8/1) at cl_lock_cancel():142 00010000:00010000:1.0:1787191339.958149:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a278 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4605358 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.958158:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a278 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4605358 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1787191339.958166:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b497c9308 (ffff936b465cc6c8/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191339.958169:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99db0 (ffff936b465cc6c8/1) at cl_lock_fini():72 00000020:00010000:1.0:1787191339.958174:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99df0 (ffff936b465cc6c8/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191339.958194:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xcc:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1787191339.958208:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xcc:0x0](ffff936b5396d348) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191339.000000000, mtime 1787191339.000000000, ctime 1787191339.000000000, rc 0 00000080:00200008:1.0:1787191339.958275:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xcc:0x0], ppos: 0, count: 5 00000080:00200000:1.0:1787191339.958287:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:1.0:1787191339.958292:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:1.0:1787191339.958297:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:1.0:1787191339.958301:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:1.0:1787191339.958307:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@000000006f9502d7[0x110, 1, [0x200000405:0xcc:0x0] hash] 00000020:00200000:1.0:1787191339.958309:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:1.0:1787191339.958313:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xcc:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:1.0:1787191339.958325:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xcc:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00000080:00200000:0.0:1787191339.958580:0:57888:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191339.958604:0:57888:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.958618:0:57888:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.958632:0:57888:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.958639:0:57888:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191339.958646:0:57888:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191339.958649:0:57888:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191339.958655:0:57888:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42203bf8 00010000:00010000:0.0:1787191339.958659:0:57888:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191339.958667:0:57888:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191339.958679:0:57888:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191339.958686:0:57888:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191339.958693:0:57888:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191339.958707:0:57888:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b51e76c00, open_flags d900, mode 0 opened 0 00000080:00200000:0.0:1787191339.958713:0:57888:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00020000:00200000:1.0:1787191339.959056:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xcc:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191339.959061:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:1.0:1787191339.959067:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:1.0:1787191339.959074:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:1.0:1787191339.959078:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1787191339.959097:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:1.0:1787191339.959113:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1787191339.959117:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b47d7d330, osc lock ffff936b46836130, flags 0x0 00010000:00010000:1.0:1787191339.959133:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.959143:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.959155:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.959164:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.959172:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191339.959184:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:1.0:1787191339.959194:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:1.0:1787191339.959233:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:1.0:1787191339.959241:0:57570:0:(rw26.c:927:ll_write_end()) page@00000000b494e85a[3 0000000044c1b95a 2 1 00000000904c7951 0 0 0] 00000080:00200000:1.0:1787191339.959244:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @000000004d5c3af6 17ffffc0001001 3:0 ffff936b43259460 0 lru 00000080:00200000:1.0:1787191339.959251:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@00000000c4df6f36 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000a2a44f55 00000000e7365a8f > 3< 0 0 > 4< 0 0 8 395337728 - | - - - - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1787191339.959254:0:57570:0:(rw26.c:927:ll_write_end()) end page@00000000b494e85a 00000080:00200000:1.0:1787191339.959255:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:1.0:1787191339.959259:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:1.0:1787191339.959279:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 0000000044993e68 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191339.959296:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b5396d4f8, count 1, dirtied 1 00000080:00200000:1.0:1787191339.959301:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:1.0:1787191339.959303:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:1.0:1787191339.959318:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b497c9308 (ffff936b465cc6c8/0) at cl_lock_release():245 00000020:00010000:1.0:1787191339.959322:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b497c9308 (ffff936b465cc6c8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191339.959324:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7d330 (ffff936b47a17cf8/1) at cl_lock_cancel():142 00010000:00010000:1.0:1787191339.960104:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.960120:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:1.0:1787191339.960198:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b497c9308 (ffff936b465cc6c8/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191339.960201:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7d330 (ffff936b465cc6c8/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191339.960211:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:1.0:1787191339.960218:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:1.0:1787191339.960226:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xcc:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191339.960230:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:1.0:1787191339.960240:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xcc:0x0] updating i_size 5 i_blocks 0 00000080:00200000:1.0:1787191339.960245:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:1.0:1787191339.960275:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xcc:0x0](ffff936b5396d348), flags 100001 00000002:00100000:1.0:1787191339.960470:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1e680 x1874004626684416/t8589936851(8589936851) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191355 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191339.960484:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191339.960490:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8000 x1874004626687744/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191339.960517:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8000 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626687744:192.168.202.101@tcp:35:bash.0 00000100:00100000:1.0:1787191339.960642:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628939c0 going to sleep for 11 seconds 00000002:00010000:0.0:1787191339.962281:0:57888:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:0.0:1787191339.964158:0:57888:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a27f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.964175:0:57888:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a27f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57888 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191339.964187:0:57888:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:0.0:1787191339.964198:0:57888:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477800 x1874004626688000/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191339.964208:0:57888:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a27f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57888 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191339.964231:0:57888:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57888:1874004626688000:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191339.964590:0:57888:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00000100:00100000:1.0:1787191339.970801:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8000 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626687744:192.168.202.101@tcp:35:bash.0 00000002:00100000:1.0:1787191339.970857:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1e680 x1874004626684416/t8589936851(8589936851) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787191339.979057:0:57888:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57888:1874004626688000:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191339.979087:0:57888:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a27f lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605374 expref: -99 pid: 57888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.979109:0:57888:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a27f lrc: 4/1,0 mode: --/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605374 expref: -99 pid: 57888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.979117:0:57888:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a27f lrc: 4/1,0 mode: --/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605374 expref: -99 pid: 57888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1787191339.979202:0:57889:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191339.979228:0:57889:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.979242:0:57889:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.979253:0:57889:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.979260:0:57889:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191339.979267:0:57889:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191339.979271:0:57889:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191339.979276:0:57889:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4220bb58 00010000:00010000:1.0:1787191339.979280:0:57889:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.979288:0:57889:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.979302:0:57889:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191339.979310:0:57889:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:1.0:1787191339.979316:0:57889:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00010000:00010000:0.0:1787191339.979363:0:57888:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a27f lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605374 expref: -99 pid: 57888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.979374:0:57888:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a27f lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605374 expref: -99 pid: 57888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.979387:0:57888:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a27f lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605374 expref: -99 pid: 57888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.979395:0:57888:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a27f lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605374 expref: -99 pid: 57888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.979403:0:57888:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a27f lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605374 expref: -99 pid: 57888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191339.979416:0:57888:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b6a477800 x1874004626688000/t8589936861(8589936861) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191339.979430:0:57888:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477800 x1874004626688000/t8589936861(8589936861) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191339.979444:0:57888:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a27f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605374 expref: -99 pid: 57888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191339.979457:0:57888:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a27f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605374 expref: -99 pid: 57888 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.979464:0:57888:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/204 (0 0) 00000080:00200000:0.0:1787191339.979468:0:57888:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191339.979522:0:57888:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xcc:0x0](ffff936b5396d348): rc = 0 00000080:00200000:0.0:1787191339.979538:0:57888:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xcc:0x0]: layout version change: 4 -> 4 00000080:00010000:0.0:1787191339.979544:0:57888:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xcc:0x0](ffff936b5396d348) for lock 0xe5129dc88483a27f 00000080:00200000:1.0:1787191339.979708:0:57889:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:1.0:1787191339.979713:0:57889:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191339.979729:0:57889:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191339.979774:0:57889:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a286 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.979782:0:57889:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a286 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.979791:0:57889:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a286 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57889 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191339.979812:0:57889:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8000 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57889:1874004626688128:192.168.202.101@tcp:101:rm.0 00000100:00100000:1.0:1787191339.979939:0:57889:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628939c0 going to sleep for 11 seconds 00000080:00010000:0.0:1787191339.982102:0:57888:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xcc:0x0](ffff936b5396d348) 00000100:00100000:1.0:1787191339.982779:0:57889:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8000 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57889:1874004626688128:192.168.202.101@tcp:101:rm.0 00010000:00010000:1.0:1787191339.982802:0:57889:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a286 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605397 expref: -99 pid: 57889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.982823:0:57889:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a286 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605397 expref: -99 pid: 57889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.982855:0:57889:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a286 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605397 expref: -99 pid: 57889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.982868:0:57889:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a286 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605397 expref: -99 pid: 57889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.982884:0:57889:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a286 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605397 expref: -99 pid: 57889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.982897:0:57889:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a286 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605397 expref: -99 pid: 57889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.982905:0:57889:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a286 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605397 expref: -99 pid: 57889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.982913:0:57889:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a286 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605397 expref: -99 pid: 57889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191339.982926:0:57889:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b453a8000 x1874004626688128/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/976 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191339.982938:0:57889:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a286 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605397 expref: -99 pid: 57889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191339.982949:0:57889:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a286 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605397 expref: -99 pid: 57889 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.982959:0:57889:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a27f lrc: 3/2,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605374 expref: -99 pid: 57888 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.982970:0:57889:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a27f lrc: 3/2,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605374 expref: -99 pid: 57888 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.982979:0:57889:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a286 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605397 expref: -99 pid: 57889 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.982986:0:57889:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a286 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x7130d520e4605397 expref: -99 pid: 57889 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.982993:0:57889:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a286 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x7130d520e4605397 expref: -99 pid: 57889 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.983020:0:57889:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000080:00200000:1.0:1787191339.983026:0:57889:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191339.983082:0:57889:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xcc:0x0](ffff936b5396d348): rc = 0 00000080:00200000:1.0:1787191339.983098:0:57889:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xcc:0x0]: layout version change: 4 -> 4 00000080:00010000:1.0:1787191339.983103:0:57889:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xcc:0x0](ffff936b5396d348) for lock 0xe5129dc88483a27f 00000080:00010000:1.0:1787191339.983115:0:57889:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xcc:0x0](ffff936b5396d348) 00000080:00010000:1.0:1787191339.983118:0:57889:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a27f from it ffffa3fb4220bb20 00010000:00010000:1.0:1787191339.983121:0:57889:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a27f lrc: 4/2,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605374 expref: -99 pid: 57888 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.983129:0:57889:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a27f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605374 expref: -99 pid: 57888 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000080:00200008:1.0:1787191339.983175:0:57889:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xcc:0x0](ffff936b5396d348), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191339.983183:0:57889:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xcc:0x0](ffff936b5396d348),name=f70.sanity-flr 00000002:00010000:1.0:1787191339.983206:0:57889:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xcc:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.983213:0:57889:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a27f lrc: 3/2,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605374 expref: -99 pid: 57888 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.983222:0:57889:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a27f lrc: 3/2,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605374 expref: -99 pid: 57888 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1787191339.983229:0:57889:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191339.983234:0:57889:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xcc:0x0](ffff936b5396d348) 00000080:00010000:1.0:1787191339.983237:0:57889:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xcc:0x0](ffff936b5396d348) for lock 0xe5129dc88483a27f 00000080:00010000:1.0:1787191339.983241:0:57889:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a27f from it ffffa3fb4220bcb8 00010000:00010000:1.0:1787191339.983243:0:57889:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a27f lrc: 4/2,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605374 expref: -99 pid: 57888 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191339.983250:0:57889:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a27f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605374 expref: -99 pid: 57888 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1787191339.983266:0:57889:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xcc:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:1.0:1787191339.983276:0:57889:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xcc:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191339.983280:0:57889:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191339.983284:0:57889:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xcc:0x0] 00000008:00010000:1.0:1787191339.983303:0:57889:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191339.983306:0:57889:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b47d7d330, osc lock ffff936b46836130, flags 0x400000400001002 00010000:00010000:1.0:1787191339.983322:0:57889:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191339.983333:0:57889:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1787191339.983345:0:57889:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191339.983349:0:57889:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191339.983363:0:57889:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:1.0:1787191339.983377:0:57889:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191339.983385:0:57889:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xcc:0x0] updating i_size 5 i_blocks 0 00000020:00010000:1.0:1787191339.983391:0:57889:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51654250 (ffff936b465cc6c8/0) at cl_lock_release():245 00000020:00010000:1.0:1787191339.983394:0:57889:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51654250 (ffff936b465cc6c8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191339.983397:0:57889:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7d330 (ffff936b47a17cf8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191339.983401:0:57889:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51654250 (ffff936b465cc6c8/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191339.983404:0:57889:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7d330 (ffff936b465cc6c8/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191339.983413:0:57889:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xcc:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191339.983456:0:57889:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191339.983464:0:57889:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191339.983472:0:57889:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.983480:0:57889:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.983487:0:57889:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191339.983491:0:57889:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191339.983494:0:57889:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191339.983498:0:57889:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4220bc10 00010000:00010000:1.0:1787191339.983502:0:57889:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191339.983514:0:57889:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191339.983523:0:57889:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191339.983529:0:57889:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:1.0:1787191339.983533:0:57889:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00010000:00010000:2.0:1787191339.983789:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787191339.983797:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a286 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x7130d520e4605397 expref: -99 pid: 57889 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.983806:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40031a00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191339.983811:0:40929:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a286 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x7130d520e4605397 expref: -99 pid: 57889 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.983819:0:40929:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a286 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x7130d520e4605397 expref: -99 pid: 57889 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.983827:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a286 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4605397 expref: -99 pid: 57889 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.983875:0:40929:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a27f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605374 expref: -99 pid: 57888 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.983907:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a286 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4605397 expref: -99 pid: 57889 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.983914:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191339.983939:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a286 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4605397 expref: -99 pid: 57889 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.983946:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a286 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4605397 expref: -99 pid: 57889 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191339.983960:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191339.983961:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191339.983963:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191339.983970:0:2392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787191339.983986:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626688256:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00200008:0.0:1787191339.989923:0:57888:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xcc:0x0](ffff936b5396d348), flags 154400 00000002:00100000:0.0:1787191339.989976:0:57888:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477800 x1874004626688000/t8589936861(8589936861) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191355 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191339.990052:0:57888:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a27f from it ffff936b495dcc60 00010000:00010000:0.0:1787191339.990063:0:57888:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a27f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605374 expref: -99 pid: 57888 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.990078:0:57888:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a27f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605374 expref: -99 pid: 57888 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191339.990108:0:57888:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xcc:0x0](ffff936b5396d348), inode mode 81a4 mask 44 00000080:00200000:1.0:1787191339.990174:0:57889:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:1.0:1787191339.990182:0:57889:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:1.0:1787191339.990187:0:57889:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:1.0:1787191339.990228:0:57889:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a263 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xcc:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e460530b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191339.990245:0:57889:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xcc:0x0]: losing layout lock 00010000:00010000:1.0:1787191339.990260:0:57889:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a27f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4605374 expref: -99 pid: 57888 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191339.990268:0:57889:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xcc:0x0]: losing layout lock 00010000:00010000:1.0:1787191339.990275:0:57889:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a24e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e46052cc expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.990322:0:57889:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a263 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xcc:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460530b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191339.990330:0:57889:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a27f lrc: 1/0,0 mode: --/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605374 expref: -99 pid: 57888 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.990336:0:57889:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a24e lrc: 1/0,0 mode: --/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46052cc expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.990347:0:57889:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:1.0:1787191339.990350:0:57889:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a263 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xcc:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460530b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191339.990364:0:57889:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a27f lrc: 0/0,0 mode: --/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605374 expref: -99 pid: 57888 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191339.990374:0:57889:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a24e lrc: 0/0,0 mode: --/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46052cc expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1787191339.990402:0:57889:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1787191339.990410:0:57889:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8000 x1874004626688512/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787191339.990434:0:57889:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8000 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57889:1874004626688512:192.168.202.101@tcp:36:rm.0 00000080:00200000:0.0:1787191339.990724:0:57888:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xcc:0x0](ffff936b5396d348), inode mode 81a4 mask 4 00000080:00200000:0.0:1787191339.990732:0:57888:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xcc:0x0](ffff936b5396d348), xattr lov 00000080:00200008:0.0:1787191339.990760:0:57888:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xcc:0x0](ffff936b5396d348), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191339.990766:0:57888:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xcc:0x0](ffff936b5396d348),name=f70.sanity-flr 00000002:00010000:0.0:1787191339.990779:0:57888:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xcc:0x0]) in obj [0x200000405:0xcc:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191339.990816:0:57888:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc88483a28d lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.990824:0:57888:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc88483a28d lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.990854:0:57888:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc88483a28d lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57888 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191339.990867:0:57888:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57888:1874004626688640:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191339.992091:0:57889:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191339.994688:0:57889:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8000 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57889:1874004626688512:192.168.202.101@tcp:36:rm.0 00000100:00100000:2.0:1787191339.995405:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626688256:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191339.996715:0:57888:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00000100:00100000:0.0:1787191339.996751:0:57888:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57888:1874004626688640:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191339.996770:0:57888:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc88483a28d lrc: 4/1,0 mode: --/CR res: [0x200000405:0xcc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46053ba expref: -99 pid: 57888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.996783:0:57888:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc88483a28d lrc: 4/1,0 mode: --/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46053ba expref: -99 pid: 57888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.996794:0:57888:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc88483a28d lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46053ba expref: -99 pid: 57888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.996805:0:57888:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc88483a28d lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46053ba expref: -99 pid: 57888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.996816:0:57888:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc88483a28d lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46053ba expref: -99 pid: 57888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.996825:0:57888:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc88483a28d lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46053ba expref: -99 pid: 57888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.996858:0:57888:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc88483a28d lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46053ba expref: -99 pid: 57888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191339.996870:0:57888:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b6a475c00 x1874004626688640/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/976 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191339.996883:0:57888:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc88483a28d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46053ba expref: -99 pid: 57888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191339.996896:0:57888:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc88483a28d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46053ba expref: -99 pid: 57888 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.996907:0:57888:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/204 (0 0) 00000080:00200000:0.0:1787191339.996912:0:57888:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xcc:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787191339.996971:0:57888:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xcc:0x0]: layout version change: 4294967294 -> 4 00000080:00010000:0.0:1787191339.996976:0:57888:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xcc:0x0](ffff936b5396d348) for lock 0xe5129dc88483a28d 00000080:00010000:0.0:1787191339.996982:0:57888:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xcc:0x0](ffff936b5396d348) 00000080:00010000:0.0:1787191339.996985:0:57888:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a28d from it ffffa3fb42203cd8 00010000:00010000:0.0:1787191339.996989:0:57888:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc88483a28d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46053ba expref: -99 pid: 57888 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191339.996998:0:57888:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae800/0xe5129dc88483a28d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcc:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46053ba expref: -99 pid: 57888 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191339.997034:0:57888:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xcc:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1787191339.997054:0:57888:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xcc:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191339.997058:0:57888:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191339.997061:0:57888:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xcc:0x0] 00000008:00010000:0.0:1787191339.997081:0:57888:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191339.997085:0:57888:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b46b503b0, osc lock ffff936b50b62f70, flags 0x400000400001002 00010000:00010000:0.0:1787191339.997102:0:57888:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191339.997116:0:57888:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:0.0:1787191339.997138:0:57888:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191339.997142:0:57888:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191339.997150:0:57888:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:0.0:1787191339.997160:0:57888:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191339.997170:0:57888:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xcc:0x0] updating i_size 5 i_blocks 0 00000020:00010000:0.0:1787191339.997175:0:57888:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c3a060 (ffff936b47a175a8/0) at cl_lock_release():245 00000020:00010000:0.0:1787191339.997179:0:57888:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c3a060 (ffff936b47a175a8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191339.997182:0:57888:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b46b503b0 (ffff936b47a17ea8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191339.997185:0:57888:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c3a060 (ffff936b47a175a8/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191339.997188:0:57888:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b46b503b0 (ffff936b47a175a8/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191339.997198:0:57888:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xcc:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1787191339.997247:0:57888:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xcc:0x0](ffff936b5396d348), flags 154000 00000002:00100000:0.0:1787191339.997295:0:57888:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a477800 x1874004626688000/t8589936861(8589936861) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191355 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191339.997305:0:57888:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191339.997310:0:57888:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475c00 x1874004626688896/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191339.997331:0:57888:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57888:1874004626688896:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191339.997415:0:57888:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.003753:0:57888:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57888:1874004626688896:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191340.003790:0:57888:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a477800 x1874004626688000/t8589936861(8589936861) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191355 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191340.003857:0:57888:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xcc:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00020000:00200000:0.0:1787191340.003868:0:57888:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xcc:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191340.003872:0:57888:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191340.003877:0:57888:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191340.003888:0:57888:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000008:00010000:0.0:1787191340.003905:0:57888:0:(osc_cache.c:1183:osc_extent_make_ready()) ### extent: 0000000044993e68 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000008:00010000:0.0:1787191340.003933:0:57888:0:(osc_cache.c:917:osc_extent_finish()) ### extent: 0000000044993e68 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000008:00010000:0.0:1787191340.003958:0:57888:0:(osc_cache.c:497:__osc_extent_remove()) ### extent: 0000000044993e68 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1787191340.003986:0:57888:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xcc:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191340.004049:0:57888:0:(llite_lib.c:2066:ll_clear_inode()) VFS Op:inode=[0x200000405:0xcc:0x0](ffff936b5396d348) 00000008:00010000:0.0:1787191340.004077:0:57888:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 5 blocks 0 [cma]time 1787191339 1787191339 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000008:00010000:0.0:1787191340.004098:0:57888:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191339 1787191339 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a278 lrc: 1/0,0 mode: PW/PW res: [0x2c0000401:0x1bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4605358 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191340.004374:0:57888:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191340.004639:0:57888:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.004657:0:57888:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.004670:0:57888:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.004678:0:57888:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191340.004684:0:57888:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191340.004688:0:57888:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191340.004697:0:57888:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42203b58 00010000:00010000:0.0:1787191340.004701:0:57888:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.004710:0:57888:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.004728:0:57888:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.004737:0:57888:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191340.004743:0:57888:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.004756:0:57888:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=9 00000080:00200000:0.0:1787191340.004761:0:57888:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:0.0:1787191340.004775:0:57888:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:0.0:1787191340.004823:0:57888:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a294 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.004859:0:57888:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a294 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.004870:0:57888:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a294 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57888 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191340.004892:0:57888:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57888:1874004626689024:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191340.004976:0:57888:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.007668:0:57888:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57888:1874004626689024:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191340.007690:0:57888:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a294 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.007702:0:57888:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a294 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.007709:0:57888:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a294 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.007716:0:57888:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a294 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.007725:0:57888:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a294 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.007731:0:57888:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cae200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191340.007736:0:57888:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a294 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.007743:0:57888:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a294 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.007749:0:57888:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a294 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.007755:0:57888:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191340.007762:0:57888:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a294 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.007768:0:57888:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a294 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57888 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191340.007791:0:57888:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b6a475c00 x1874004626689024/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191340.007806:0:57888:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191340.019438:0:57891:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191340.019468:0:57891:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191340.019484:0:57891:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191340.019499:0:57891:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191340.019507:0:57891:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191340.019514:0:57891:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191340.019518:0:57891:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191340.019525:0:57891:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4220bbf8 00010000:00010000:1.0:1787191340.019529:0:57891:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191340.019537:0:57891:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191340.019555:0:57891:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191340.019562:0:57891:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191340.019568:0:57891:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191340.019579:0:57891:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b484de600, open_flags d900, mode 0 opened 0 00000080:00200000:1.0:1787191340.019586:0:57891:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:1.0:1787191340.019600:0:57891:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:1.0:1787191340.020029:0:57891:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a29b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.020053:0:57891:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a29b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57891 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191340.020065:0:57891:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191340.020077:0:57891:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9880 x1874004626689280/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191340.020089:0:57891:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a29b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57891 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191340.020112:0:57891:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57891:1874004626689280:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191340.020381:0:57891:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191340.027822:0:57891:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57891:1874004626689280:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191340.027877:0:57891:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a29b lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.027891:0:57891:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a29b lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.027897:0:57891:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a29b lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.027903:0:57891:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a29b lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.027911:0:57891:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a29b lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.027916:0:57891:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030800 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191340.027920:0:57891:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a29b lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.027926:0:57891:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a29b lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.027932:0:57891:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a29b lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.027937:0:57891:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191340.027943:0:57891:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a29b lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.027952:0:57891:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a29b lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57891 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191340.027975:0:57891:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x7, status=0 req@ffff936b453a9880 x1874004626689280/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/608 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191340.027989:0:57891:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191340.028268:0:57891:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191340.028285:0:57891:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191340.028295:0:57891:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191340.028306:0:57891:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191340.028313:0:57891:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191340.028318:0:57891:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191340.028321:0:57891:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191340.028326:0:57891:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4220bb58 00010000:00010000:1.0:1787191340.028329:0:57891:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191340.028338:0:57891:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191340.028352:0:57891:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191340.028359:0:57891:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191340.028364:0:57891:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191340.028377:0:57891:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=9 00000080:00200000:1.0:1787191340.028381:0:57891:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191340.028681:0:57891:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191340.028728:0:57891:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a2a2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.028736:0:57891:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a2a2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.028745:0:57891:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a2a2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57891 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191340.028763:0:57891:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57891:1874004626689408:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191340.028865:0:57891:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00000080:00200000:2.0:1787191340.030775:0:57890:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191340.030801:0:57890:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191340.030813:0:57890:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191340.030826:0:57890:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191340.030853:0:57890:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191340.030860:0:57890:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191340.030864:0:57890:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191340.030871:0:57890:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42163b58 00010000:00010000:2.0:1787191340.030875:0:57890:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191340.030883:0:57890:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191340.030896:0:57890:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191340.030904:0:57890:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:2.0:1787191340.030909:0:57890:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:1.0:1787191340.030978:0:57891:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57891:1874004626689408:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191340.030990:0:57891:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a2a2 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.030999:0:57891:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a2a2 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.031005:0:57891:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a2a2 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.031011:0:57891:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a2a2 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.031017:0:57891:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a2a2 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.031026:0:57891:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191340.031030:0:57891:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a2a2 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.031063:0:57891:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a2a2 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.031070:0:57891:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a2a2 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.031076:0:57891:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191340.031081:0:57891:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a2a2 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.031087:0:57891:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a2a2 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57891 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191340.031106:0:57891:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b453a9880 x1874004626689408/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191340.031118:0:57891:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191340.031161:0:57890:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:2.0:1787191340.031166:0:57890:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191340.031179:0:57890:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191340.031215:0:57890:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a2a9 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.031223:0:57890:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a2a9 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.031230:0:57890:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a2a9 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191340.031248:0:57890:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57890:1874004626689536:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191340.031315:0:57890:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191340.039461:0:57890:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57890:1874004626689536:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191340.039483:0:57890:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a2a9 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.039497:0:57890:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a2a9 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.039504:0:57890:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a2a9 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.039515:0:57890:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a2a9 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.039523:0:57890:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a2a9 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.039528:0:57890:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd5200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191340.039532:0:57890:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a2a9 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.039539:0:57890:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a2a9 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.039547:0:57890:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a2a9 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.039554:0:57890:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191340.039560:0:57890:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a2a9 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.039567:0:57890:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a2a9 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191340.039589:0:57890:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513b9880 x1874004626689536/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191340.039603:0:57890:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191340.039698:0:57890:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191340.039713:0:57890:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191340.039723:0:57890:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191340.039735:0:57890:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191340.039741:0:57890:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191340.039747:0:57890:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191340.039750:0:57890:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191340.039755:0:57890:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42163be8 00010000:00010000:1.0:1787191340.039759:0:57890:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191340.039767:0:57890:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191340.039783:0:57890:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191340.039791:0:57890:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000080:00200000:1.0:1787191340.039798:0:57890:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191340.039809:0:57890:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:1.0:1787191340.039813:0:57890:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191340.039825:0:57890:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191340.039893:0:57890:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a2b0 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.039901:0:57890:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a2b0 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.039910:0:57890:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a2b0 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191340.039933:0:57890:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57890:1874004626689664:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191340.040012:0:57890:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00000080:00200000:0.0:1787191340.047897:0:57892:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191340.047934:0:57892:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.048020:0:57892:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.048047:0:57892:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.048057:0:57892:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191340.048066:0:57892:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191340.048069:0:57892:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191340.048077:0:57892:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421f3bf8 00010000:00010000:0.0:1787191340.048081:0:57892:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.048090:0:57892:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.048107:0:57892:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.048116:0:57892:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191340.048123:0:57892:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:1.0:1787191340.051665:0:57890:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57890:1874004626689664:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191340.051690:0:57890:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a2b0 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.051704:0:57890:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a2b0 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.051712:0:57890:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a2b0 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.051718:0:57890:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a2b0 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.051725:0:57890:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a2b0 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.051731:0:57890:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191340.051735:0:57890:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a2b0 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.051742:0:57890:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a2b0 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.051748:0:57890:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a2b0 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.051755:0:57890:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191340.051762:0:57890:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a2b0 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.051769:0:57890:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a2b0 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191340.051792:0:57890:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b453a9880 x1874004626689664/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191340.051805:0:57890:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191340.053260:0:57892:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b604ca600, open_flags d900, mode 0 opened 0 00000080:00200000:0.0:1787191340.053275:0:57892:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:0.0:1787191340.053300:0:57892:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:0.0:1787191340.053368:0:57892:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a2b7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.053378:0:57892:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a2b7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57892 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191340.053390:0:57892:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191340.053403:0:57892:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475c00 x1874004626689920/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191340.053412:0:57892:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a2b7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57892 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191340.053436:0:57892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57892:1874004626689920:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191340.053623:0:57892:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00010000:00010000:1.0:1787191340.054206:0:57890:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 30 res 8589937616/5 (0 0) 00000080:00200000:1.0:1787191340.054286:0:57890:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191340.054301:0:57890:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191340.054310:0:57890:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191340.054323:0:57890:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191340.054330:0:57890:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191340.054335:0:57890:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191340.054339:0:57890:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191340.054345:0:57890:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42163b58 00010000:00010000:1.0:1787191340.054349:0:57890:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191340.054357:0:57890:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191340.054371:0:57890:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191340.054378:0:57890:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:1.0:1787191340.054387:0:57890:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:1.0:1787191340.054392:0:57890:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:1.0:1787191340.054402:0:57890:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191340.054408:0:57890:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 83 lru_type: 1 00010000:00010000:1.0:1787191340.054416:0:57890:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 83 lru_type: 1 00000002:00010000:1.0:1787191340.054427:0:57890:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191340.054430:0:57890:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 30 res 8589937616/5 (0 0) 00010000:00010000:1.0:1787191340.054458:0:57890:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a2be lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.054465:0:57890:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a2be lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.054473:0:57890:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a2be lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191340.054490:0:57890:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57890:1874004626690048:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191340.054547:0:57890:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191340.060287:0:57890:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57890:1874004626690048:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191340.060310:0:57890:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a2be lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460544d expref: -99 pid: 57890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.060323:0:57890:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a2be lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460544d expref: -99 pid: 57890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.060351:0:57890:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a2be lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460544d expref: -99 pid: 57890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.060363:0:57890:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a2be lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460544d expref: -99 pid: 57890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.060376:0:57890:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a2be lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460544d expref: -99 pid: 57890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.060385:0:57890:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a2be lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460544d expref: -99 pid: 57890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.060393:0:57890:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a2be lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460544d expref: -99 pid: 57890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191340.060405:0:57890:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b453a9880 x1874004626690048/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191340.060419:0:57890:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a2be lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460544d expref: -99 pid: 57890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.060430:0:57890:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:1.0:1787191340.060438:0:57890:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a2be lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460544d expref: -99 pid: 57890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.060446:0:57890:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a2be lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460544d expref: -99 pid: 57890 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:1.0:1787191340.060478:0:57890:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00000100:00100000:0.0:1787191340.060481:0:57892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57892:1874004626689920:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191340.060488:0:57890:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 166 lru_type: 1 00010000:00010000:0.0:1787191340.060492:0:57892:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a2b7 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.060500:0:57892:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a2b7 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.060500:0:57890:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 166 lru_type: 1 00010000:00010000:0.0:1787191340.060507:0:57892:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a2b7 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.060509:0:57890:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 166 lru_type: 1 00010000:00010000:0.0:1787191340.060513:0:57892:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a2b7 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.060517:0:57890:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 167 lru_type: 1 00010000:00010000:0.0:1787191340.060520:0:57892:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a2b7 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.060525:0:57892:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cae200 already unused, calling callback (ffffffffc1b143c0) 00000080:00200000:1.0:1787191340.060527:0:57890:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00010000:00010000:0.0:1787191340.060529:0:57892:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a2b7 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.060536:0:57892:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a2b7 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57892 initiator: MDT0 lru_score: 0 lru_type: 0 00000080:00010000:1.0:1787191340.060536:0:57890:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:1.0:1787191340.060540:0:57890:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00010000:00010000:0.0:1787191340.060542:0:57892:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a2b7 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57892 initiator: MDT0 lru_score: 0 lru_type: 0 00000080:00010000:1.0:1787191340.060545:0:57890:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb42163cb8 00010000:00010000:1.0:1787191340.060548:0:57890:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 83 lru_type: 1 00010000:00010000:1.0:1787191340.060556:0:57890:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 84 lru_type: 1 00010000:00010000:0.0:1787191340.060559:0:57892:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191340.060565:0:57892:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a2b7 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57892 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191340.060569:0:57890:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.060571:0:57892:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a2b7 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57892 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.060574:0:57890:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a2be lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460544d expref: -99 pid: 57890 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00100000:0.0:1787191340.060585:0:57892:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x7, status=0 req@ffff936b6a475c00 x1874004626689920/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/608 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1787191340.060586:0:57890:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a2be lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460544d expref: -99 pid: 57890 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.060594:0:57890:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a2be lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460544d expref: -99 pid: 57890 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191340.060595:0:57892:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1787191340.060601:0:57890:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a2be lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460544d expref: -99 pid: 57890 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:1.0:1787191340.060607:0:57890:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.060610:0:57892:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a2be lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460544d expref: -99 pid: 57890 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191340.060612:0:57890:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 167 lru_type: 1 00010000:00010000:0.0:1787191340.060619:0:57892:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a2be lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460544d expref: -99 pid: 57890 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191340.060619:0:57890:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 167 lru_type: 1 00000080:00010000:0.0:1787191340.060626:0:57892:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a2be from it ffffa3fb421f39a0 00010000:00010000:1.0:1787191340.060627:0:57890:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 167 lru_type: 1 00010000:00010000:0.0:1787191340.060629:0:57892:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a2be lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460544d expref: -99 pid: 57890 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191340.060635:0:57890:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 168 lru_type: 1 00010000:00010000:0.0:1787191340.060636:0:57892:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a2be lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460544d expref: -99 pid: 57890 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191340.060854:0:57892:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191340.060866:0:57892:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.060873:0:57892:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.060881:0:57892:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.060891:0:57892:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191340.060897:0:57892:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191340.060899:0:57892:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191340.060902:0:57892:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421f3b58 00010000:00010000:0.0:1787191340.060905:0:57892:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.060912:0:57892:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.060920:0:57892:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.060926:0:57892:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191340.060931:0:57892:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.060934:0:57892:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=9 00000080:00200008:1.0:1787191340.061161:0:57890:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:1.0:1787191340.061166:0:57890:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191340.061173:0:57890:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191340.061180:0:57890:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191340.061192:0:57890:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191340.061198:0:57890:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191340.061202:0:57890:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191340.061205:0:57890:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191340.061208:0:57890:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42163cb8 00010000:00010000:1.0:1787191340.061211:0:57890:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191340.061219:0:57890:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191340.061298:0:57890:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191340.061305:0:57890:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191340.061311:0:57890:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191340.061319:0:57890:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191340.061324:0:57890:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191340.061328:0:57890:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191340.061330:0:57890:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191340.061333:0:57890:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42163b58 00010000:00010000:1.0:1787191340.061336:0:57890:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191340.061344:0:57890:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191340.061352:0:57890:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191340.061356:0:57890:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:1.0:1787191340.061359:0:57890:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191340.061362:0:57890:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=8 00000080:00200000:1.0:1787191340.061375:0:57890:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191340.061381:0:57890:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191340.061386:0:57890:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191340.061394:0:57890:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191340.061400:0:57890:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191340.061404:0:57890:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191340.061406:0:57890:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191340.061410:0:57890:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42163bf8 00010000:00010000:1.0:1787191340.061413:0:57890:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191340.061419:0:57890:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191340.061426:0:57890:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191340.061429:0:57890:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191340.061431:0:57890:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191340.061435:0:57890:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:1.0:1787191340.061438:0:57890:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:1.0:1787191340.061442:0:57890:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b484dfe00, open_flags a141, mode 81b6 opened 0 00000080:00200000:1.0:1787191340.061449:0:57890:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:1.0:1787191340.061464:0:57890:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xcd:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:1.0:1787191340.061473:0:57890:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a2be lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e460544d expref: -99 pid: 57890 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191340.061513:0:57890:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a2be lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e460544d expref: -99 pid: 57890 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191340.061518:0:57890:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191340.061521:0:57890:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a2be lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e460544d expref: -99 pid: 57890 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191340.061547:0:57890:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a2c5 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.061553:0:57890:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a2c5 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191340.061563:0:57890:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191340.061571:0:57890:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9880 x1874004626690304/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191340.061580:0:57890:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a2c5 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191340.061598:0:57890:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57890:1874004626690304:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191340.061712:0:57890:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191340.068274:0:57890:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57890:1874004626690304:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191340.068301:0:57890:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a2c5 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605469 expref: -99 pid: 57890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.068325:0:57890:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a2c5 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605469 expref: -99 pid: 57890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.068334:0:57890:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a2c5 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605469 expref: -99 pid: 57890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.068344:0:57890:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a2c5 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605469 expref: -99 pid: 57890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.068355:0:57890:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a2c5 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605469 expref: -99 pid: 57890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.068368:0:57890:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a2c5 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605469 expref: -99 pid: 57890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.068377:0:57890:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a2c5 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605469 expref: -99 pid: 57890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.068384:0:57890:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a2c5 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605469 expref: -99 pid: 57890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191340.068406:0:57890:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b453a9880 x1874004626690304/t8589936864(8589936864) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191340.068421:0:57890:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9880 x1874004626690304/t8589936864(8589936864) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191340.068433:0:57890:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a2c5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605469 expref: -99 pid: 57890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.068442:0:57890:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/205 (0 0) 00000080:00200000:1.0:1787191340.068449:0:57890:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191340.068462:0:57890:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:1.0:1787191340.068489:0:57890:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xcd:0x0](ffff936b5395aa08) 00000080:00200000:1.0:1787191340.068496:0:57890:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xcd:0x0], updating i_size 0 00000080:00200000:1.0:1787191340.068528:0:57890:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xcd:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:1.0:1787191340.068532:0:57890:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xcd:0x0](ffff936b5395aa08) 00000080:00010000:1.0:1787191340.068535:0:57890:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xcd:0x0](ffff936b5395aa08) for lock 0xe5129dc88483a2c5 00000080:00010000:1.0:1787191340.068543:0:57890:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xcd:0x0](ffff936b5395aa08) 00000080:00200008:1.0:1787191340.068567:0:57890:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xcd:0x0](ffff936b5395aa08), flags 120501 00000002:00100000:1.0:1787191340.068587:0:57890:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9880 x1874004626690304/t8589936864(8589936864) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191340.068614:0:57890:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a2c5 from it ffff936b5339fae0 00010000:00010000:1.0:1787191340.068618:0:57890:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a2c5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605469 expref: -99 pid: 57890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.068626:0:57890:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a2c5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605469 expref: -99 pid: 57890 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191340.068646:0:57890:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xcd:0x0](ffff936b5395aa08), inode mode 81a4 mask 40 00000080:00200000:1.0:1787191340.068701:0:57890:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xcd:0x0](ffff936b5395aa08), inode mode 81a4 mask 2 00000080:00200000:1.0:1787191340.068712:0:57890:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xcd:0x0](ffff936b5395aa08), xattr lov 00000002:00010000:1.0:1787191340.068731:0:57890:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xcd:0x0]) in obj [0x200000405:0xcd:0x0], intent: open flags 040000002 00010000:00010000:1.0:1787191340.068779:0:57890:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a2cc lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.068785:0:57890:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a2cc lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191340.068796:0:57890:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191340.068801:0:57890:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453ab100 x1874004626690560/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191340.068810:0:57890:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a2cc lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191340.068827:0:57890:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57890:1874004626690560:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191340.069463:0:57890:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00000080:00200000:3.0:1787191340.071875:0:57893:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191340.071903:0:57893:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191340.071917:0:57893:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191340.071932:0:57893:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191340.071940:0:57893:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191340.071947:0:57893:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191340.071950:0:57893:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191340.071956:0:57893:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42213bf8 00010000:00010000:3.0:1787191340.071960:0:57893:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191340.071969:0:57893:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191340.071982:0:57893:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191340.071989:0:57893:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191340.071994:0:57893:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191340.071997:0:57893:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:3.0:1787191340.072000:0:57893:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xcd:0x0](ffff936b5395aa08), inode mode 81a4 mask 44 00000080:00200008:3.0:1787191340.072005:0:57893:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xcd:0x0](ffff936b5395aa08), flags 154400 00000002:00010000:3.0:1787191340.072018:0:57893:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xcd:0x0]) in obj [0x200000405:0xcd:0x0], intent: open flags 0100240114401 00010000:00010000:3.0:1787191340.072074:0:57893:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a2d3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.072082:0:57893:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a2d3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57893 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191340.072093:0:57893:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:3.0:1787191340.072104:0:57893:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1fb80 x1874004626690816/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191340.072114:0:57893:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a2d3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191340.072133:0:57893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57893:1874004626690816:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191340.072268:0:57893:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1787191340.075958:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191340.076075:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634894080 00000100:00100000:3.0:1787191340.076085:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634894080 00000100:00100000:3.0:1787191340.076231:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1350 00000100:00100000:3.0:1787191340.076241:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634894080:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191340.076258:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a2c5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4605469 expref: -99 pid: 57890 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191340.076348:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191340.076355:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634894080:12345-192.168.202.101@tcp:104: Request processed in 116us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191340.076362:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1350 00010000:00010000:1.0:1787191340.076389:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191340.076405:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a2c5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4605469 expref: -99 pid: 57890 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.076414:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030800 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191340.076419:0:43384:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a2c5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4605469 expref: -99 pid: 57890 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.076428:0:43384:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a2c5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4605469 expref: -99 pid: 57890 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.076436:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a2c5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4605469 expref: -99 pid: 57890 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191340.076462:0:43384:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xcd:0x0]: losing layout lock 00010000:00010000:1.0:1787191340.076508:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a2c5 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4605469 expref: -99 pid: 57890 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.076515:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191340.076556:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a2c5 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4605469 expref: -99 pid: 57890 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.076564:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a2c5 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4605469 expref: -99 pid: 57890 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.076578:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191340.076580:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191340.076582:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191340.076590:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787191340.076606:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626690944:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191340.086003:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626690944:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191340.086163:0:57893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57893:1874004626690816:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191340.086180:0:57893:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a2d3 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.086193:0:57893:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a2d3 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.086200:0:57893:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a2d3 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.086207:0:57893:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a2d3 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.086216:0:57893:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a2d3 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.086223:0:57893:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9a600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191340.086228:0:57893:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a2d3 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.086236:0:57893:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a2d3 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.086243:0:57893:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a2d3 lrc: 5/0,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.086251:0:57893:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191340.086256:0:57893:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a2d3 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.086262:0:57893:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a2d3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57893 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191340.086281:0:57893:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b51d1fb80 x1874004626690816/t8589936865(8589936865) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191340.086293:0:57893:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1fb80 x1874004626690816/t8589936865(8589936865) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191340.086305:0:57893:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xcd:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1787191340.086323:0:57893:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xcd:0x0], updating i_size 0 00000002:00100000:3.0:1787191340.086342:0:57893:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1fb80 x1874004626690816/t8589936865(8589936865) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191340.086487:0:57893:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xcd:0x0](ffff936b5395aa08), inode mode 81a4 mask 4 00000080:00200000:3.0:1787191340.086495:0:57893:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xcd:0x0](ffff936b5395aa08), xattr lov 00000080:00200008:3.0:1787191340.086530:0:57893:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xcd:0x0](ffff936b5395aa08), flags 154000 00000002:00100000:3.0:1787191340.086823:0:57893:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1fb80 x1874004626690816/t8589936865(8589936865) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191356 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191340.086862:0:57893:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:3.0:1787191340.086867:0:57893:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1ed80 x1874004626691200/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191340.086888:0:57893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ed80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57893:1874004626691200:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191340.086971:0:57893:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1787191340.089381:0:57890:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57890:1874004626690560:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191340.089403:0:57890:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a2cc lrc: 4/1,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.089416:0:57890:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a2cc lrc: 4/1,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.089423:0:57890:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a2cc lrc: 4/1,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.089434:0:57890:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a2cc lrc: 3/0,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.089443:0:57890:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a2cc lrc: 4/0,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.089450:0:57890:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191340.089454:0:57890:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a2cc lrc: 4/0,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.089461:0:57890:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a2cc lrc: 4/0,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.089467:0:57890:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a2cc lrc: 5/0,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.089474:0:57890:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191340.089480:0:57890:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a2cc lrc: 3/0,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.089487:0:57890:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a2cc lrc: 0/0,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57890 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191340.089509:0:57890:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b453ab100 x1874004626690560/t8589936866(8589936866) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191340.089522:0:57890:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453ab100 x1874004626690560/t8589936866(8589936866) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191340.089538:0:57890:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xcd:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787191340.089584:0:57890:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xcd:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1787191340.089592:0:57890:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xcd:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191340.089651:0:57890:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xcd:0x0], updating i_size 0 00000002:00100000:1.0:1787191340.089670:0:57890:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453ab100 x1874004626690560/t8589936866(8589936866) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191340.089707:0:57890:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453ab100 x1874004626690560/t8589936866(8589936866) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191340.089715:0:57890:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191340.089720:0:57890:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453abb80 x1874004626691456/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191340.089738:0:57890:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57890:1874004626691456:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191340.089810:0:57890:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191340.091375:0:57893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ed80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57893:1874004626691200:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191340.091404:0:57893:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1fb80 x1874004626690816/t8589936865(8589936865) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191340.091573:0:57893:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191340.091590:0:57893:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191340.091606:0:57893:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191340.091688:0:57893:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191340.091697:0:57893:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191340.091703:0:57893:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191340.091707:0:57893:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191340.091714:0:57893:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42213bf8 00010000:00010000:3.0:1787191340.091718:0:57893:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191340.091725:0:57893:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191340.091739:0:57893:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191340.091746:0:57893:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191340.091751:0:57893:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191340.091763:0:57893:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b52619680, open_flags d900, mode 0 opened 0 00000080:00200000:3.0:1787191340.091769:0:57893:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:3.0:1787191340.091782:0:57893:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:3.0:1787191340.091827:0:57893:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a2da lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.091974:0:57893:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a2da lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57893 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191340.091985:0:57893:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:3.0:1787191340.091992:0:57893:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1dc00 x1874004626691712/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191340.092000:0:57893:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a2da lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191340.092018:0:57893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57893:1874004626691712:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191340.092300:0:57893:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1787191340.095305:0:57890:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57890:1874004626691456:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191340.095342:0:57890:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453ab100 x1874004626690560/t8589936866(8589936866) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1787191340.095400:0:57890:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xcd:0x0](ffff936b5395aa08), flags 100001 00000002:00100000:1.0:1787191340.095449:0:57890:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a9880 x1874004626690304/t8589936864(8589936864) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191356 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191340.095459:0:57890:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191340.095465:0:57890:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453ab800 x1874004626691968/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191340.095484:0:57890:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57890:1874004626691968:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191340.095583:0:57890:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191340.097869:0:57890:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57890:1874004626691968:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191340.097905:0:57890:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a9880 x1874004626690304/t8589936864(8589936864) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191340.099021:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191340.099054:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.099070:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.099083:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.099091:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191340.099097:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191340.099101:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191340.099109:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:0.0:1787191340.099112:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.099120:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.099135:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.099142:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191340.099148:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:0.0:1787191340.103758:0:57893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57893:1874004626691712:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191340.103784:0:57893:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a2da lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46054b6 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.103812:0:57893:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a2da lrc: 4/1,0 mode: --/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46054b6 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.103820:0:57893:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a2da lrc: 4/1,0 mode: --/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46054b6 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.103969:0:57893:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a2da lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46054b6 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.103983:0:57893:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a2da lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46054b6 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.103996:0:57893:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a2da lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46054b6 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.104005:0:57893:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a2da lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46054b6 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.104014:0:57893:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a2da lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46054b6 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191340.104025:0:57893:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b51d1dc00 x1874004626691712/t8589936870(8589936870) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191340.104050:0:57893:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1dc00 x1874004626691712/t8589936870(8589936870) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191340.104065:0:57893:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a2da lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46054b6 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191340.104079:0:57893:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a2da lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46054b6 expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.104089:0:57893:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/205 (0 0) 00000080:00200000:0.0:1787191340.104095:0:57893:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191340.104206:0:57893:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xcd:0x0](ffff936b5395aa08): rc = 0 00000080:00200000:0.0:1787191340.104225:0:57893:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xcd:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:0.0:1787191340.104230:0:57893:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xcd:0x0](ffff936b5395aa08) for lock 0xe5129dc88483a2da 00000080:00010000:0.0:1787191340.104241:0:57893:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xcd:0x0](ffff936b5395aa08) 00000080:00200008:0.0:1787191340.104254:0:57893:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xcd:0x0](ffff936b5395aa08), flags 154400 00000002:00100000:0.0:1787191340.104277:0:57893:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1dc00 x1874004626691712/t8589936870(8589936870) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191340.104323:0:57893:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a2da from it ffff936b466f4660 00010000:00010000:0.0:1787191340.104328:0:57893:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a2da lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46054b6 expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.104342:0:57893:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a2da lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46054b6 expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191340.104369:0:57893:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xcd:0x0](ffff936b5395aa08), inode mode 81a4 mask 44 00000080:00200000:3.0:1787191340.104412:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:3.0:1787191340.104420:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xcd:0x0](ffff936b5395aa08), inode mode 81a4 mask 42 00000080:00200008:3.0:1787191340.104426:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xcd:0x0](ffff936b5395aa08), flags 101101 00000002:00010000:3.0:1787191340.104442:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xcd:0x0]) in obj [0x200000405:0xcd:0x0], intent: open|creat flags 04240101102 00010000:00010000:3.0:1787191340.104454:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a2da lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46054b6 expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191340.104473:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xcd:0x0]: losing layout lock 00010000:00010000:3.0:1787191340.104507:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a2da lrc: 1/0,0 mode: --/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46054b6 expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191340.104514:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191340.104516:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a2da lrc: 0/0,0 mode: --/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46054b6 expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191340.104543:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a2e1 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.104550:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a2e1 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191340.104561:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191340.104568:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1c380 x1874004626692224/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191340.104576:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a2e1 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191340.104595:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626692224:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191340.104733:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c240 going to sleep for 11 seconds 00000080:00200000:0.0:1787191340.106965:0:57893:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xcd:0x0](ffff936b5395aa08), inode mode 81a4 mask 4 00000080:00200000:0.0:1787191340.106980:0:57893:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xcd:0x0](ffff936b5395aa08), xattr lov 00000080:00200008:0.0:1787191340.107017:0:57893:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xcd:0x0](ffff936b5395aa08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191340.107024:0:57893:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xcd:0x0](ffff936b5395aa08),name=f70.sanity-flr 00000002:00010000:0.0:1787191340.107054:0:57893:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xcd:0x0]) in obj [0x200000405:0xcd:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.107064:0:57893:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 30 res 8589935621/205 (0 0) 00010000:00010000:0.0:1787191340.107111:0:57893:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a2e8 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.107120:0:57893:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a2e8 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.107137:0:57893:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a2e8 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191340.107160:0:57893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57893:1874004626692352:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191340.107217:0:57893:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.108333:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626692224:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191340.108354:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a2e1 lrc: 4/0,1 mode: --/CW res: [0x200000405:0xcd:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46054cb expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.108369:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a2e1 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xcd:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46054cb expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.108380:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a2e1 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xcd:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46054cb expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191340.108449:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x200002b, status=0 req@ffff936b51d1c380 x1874004626692224/t8589936871(8589936871) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191340.108464:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1c380 x1874004626692224/t8589936871(8589936871) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191340.108476:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a2e1 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xcd:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46054cb expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191340.108489:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a2e1 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xcd:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46054cb expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.108498:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 8 res 8589935621/205 (0 0) 00000080:00200000:0.0:1787191340.108504:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000405:0xcd:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787191340.108553:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xcd:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:0.0:1787191340.108558:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xcd:0x0](ffff936b5395aa08) for lock 0xe5129dc88483a2e1 00000080:00010000:0.0:1787191340.108564:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a2e1 from it ffffa3fb41cabbf0 00010000:00010000:0.0:1787191340.108568:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a2e1 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xcd:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46054cb expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.108578:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a2e1 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xcd:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46054cb expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000002:00100000:0.0:1787191340.108604:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1c380 x1874004626692224/t8589936871(8589936871) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787191340.109130:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191340.109196:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634894208 00000100:00100000:3.0:1787191340.109204:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634894208 00000100:00100000:3.0:1787191340.109250:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1351 00000100:00100000:3.0:1787191340.109260:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634894208:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191340.109271:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a2e1 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xcd:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46054cb expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191340.109336:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191340.109344:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634894208:12345-192.168.202.101@tcp:104: Request processed in 86us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191340.109350:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1351 00010000:00010000:1.0:1787191340.109509:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191340.109517:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a2e1 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xcd:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46054cb expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.109524:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9a600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191340.109529:0:57627:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a2e1 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xcd:0x0].0x0 bits 0x1f/0x1f rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46054cb expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.109537:0:57627:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a2e1 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xcd:0x0].0x0 bits 0x1f/0x1f rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46054cb expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.109545:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a2e1 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0xcd:0x0].0x0 bits 0x1f/0x1f rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e46054cb expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191340.110644:0:57627:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xcd:0x0]: losing layout lock 00010000:00010000:1.0:1787191340.110690:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a2e1 lrc: 2/0,0 mode: --/CW res: [0x200000405:0xcd:0x0].0x0 bits 0x1f/0x1f rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46054cb expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.110698:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191340.110721:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a2e1 lrc: 1/0,0 mode: --/CW res: [0x200000405:0xcd:0x0].0x0 bits 0x1f/0x1f rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46054cb expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.110729:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a2e1 lrc: 0/0,0 mode: --/CW res: [0x200000405:0xcd:0x0].0x0 bits 0x1f/0x1f rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46054cb expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.110741:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191340.110743:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191340.110745:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191340.110761:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626692480:192.168.202.101@tcp:103:ldlm_bl.0 00000002:00010000:0.0:1787191340.111660:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xcd:0x0], intent: getxattr flags 0 00010000:00010000:0.0:1787191340.111702:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a2ef lrc: 3/1,0 mode: --/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.111711:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a2ef lrc: 3/1,0 mode: --/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.111722:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a2ef lrc: 3/1,0 mode: --/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191340.111740:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626692608:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191340.111797:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191340.116131:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626692608:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191340.116158:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a2ef lrc: 4/1,0 mode: --/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46054ee expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.116173:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a2ef lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46054ee expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.116185:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a2ef lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46054ee expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191340.116198:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b6a477800 x1874004626692608/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191340.116210:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a2ef lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46054ee expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.116222:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/205 (0 0) 00000080:00200000:3.0:1787191340.116227:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xcd:0x0] suppgids 0 -1: rc 0 00000080:00010000:3.0:1787191340.116252:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xcd:0x0](ffff936b5395aa08) for lock 0xe5129dc88483a2ef 00000080:00010000:3.0:1787191340.116259:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a2ef from it ffffa3fb41caba38 00010000:00010000:3.0:1787191340.116264:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a2ef lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46054ee expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.116277:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a2ef lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46054ee expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:3.0:1787191340.116313:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xcd:0x0](ffff936b5395aa08) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191340.000000000, mtime 1787191340.000000000, ctime 1787191340.000000000 00000020:00100000:3.0:1787191340.116357:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1787191340.116365:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1e680 x1874004626692864/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191340.116384:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1e680 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626692864:192.168.202.101@tcp:36:bash.0 00000100:00100000:3.0:1787191340.116458:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787191340.116602:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626692480:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191340.116685:0:57893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57893:1874004626692352:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191340.116695:0:57893:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a2e8 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46054e0 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.116703:0:57893:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a2e8 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46054e0 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.116710:0:57893:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a2e8 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46054e0 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.116718:0:57893:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a2e8 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46054e0 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.116727:0:57893:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a2e8 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46054e0 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.116740:0:57893:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a2e8 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46054e0 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.116747:0:57893:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a2e8 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46054e0 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191340.116755:0:57893:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b6a475c00 x1874004626692352/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/976 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191340.116765:0:57893:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a2e8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46054e0 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.116772:0:57893:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/205 (0 0) 00000080:00200000:0.0:1787191340.116776:0:57893:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xcd:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191340.116816:0:57893:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xcd:0x0](ffff936b5395aa08) for lock 0xe5129dc88483a2e8 00000080:00010000:0.0:1787191340.116820:0:57893:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xcd:0x0](ffff936b5395aa08) 00000080:00010000:0.0:1787191340.116823:0:57893:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a2e8 from it ffffa3fb42213cd8 00010000:00010000:0.0:1787191340.116826:0:57893:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a2e8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46054e0 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.116859:0:57893:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a2e8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46054e0 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191340.116880:0:57893:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xcd:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00010000:00010000:0.0:1787191340.116888:0:57893:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/205 (0 0) 00000080:00010000:0.0:1787191340.116895:0:57893:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xcd:0x0](ffff936b5395aa08) 00000002:00010000:0.0:1787191340.116902:0:57893:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xcd:0x0]) in obj [0x200000405:0xcd:0x0], intent: layout flags 0 00010000:00010000:0.0:1787191340.116925:0:57893:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a2f6 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.116931:0:57893:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a2f6 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.116940:0:57893:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a2f6 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191340.116950:0:57893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57893:1874004626692992:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191340.116977:0:57893:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00000100:00100000:2.0:1787191340.123969:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191340.124129:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634894336 00000100:00100000:3.0:1787191340.124138:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634894336 00000100:00100000:0.0:1787191340.124142:0:57893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57893:1874004626692992:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191340.124170:0:57893:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a2f6 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46054fc expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.124186:0:57893:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a2f6 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46054fc expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191340.124200:0:57893:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b6a475c00 x1874004626692992/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191340.124211:0:57893:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a2f6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46054fc expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191340.124223:0:57893:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a2f6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46054fc expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191340.124223:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1352 00000100:00100000:3.0:1787191340.124232:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634894336:12345-192.168.202.101@tcp:104: 00010000:00010000:0.0:1787191340.124234:0:57893:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/205 (0 0) 00000080:00200000:0.0:1787191340.124240:0:57893:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xcd:0x0] suppgids 0 0: rc 0 00010000:00010000:3.0:1787191340.124246:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a2e8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e46054e0 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1787191340.124257:0:57893:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xcd:0x0](ffff936b5395aa08) for lock 0xe5129dc88483a2f6 00000080:00010000:0.0:1787191340.124264:0:57893:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a2f6 from it ffffa3fb42213b68 00010000:00010000:0.0:1787191340.124268:0:57893:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a2f6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46054fc expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.124276:0:57893:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a2f6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46054fc expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.124298:0:57893:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a2f6 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46054fc expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.124310:0:57893:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a2f6 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46054fc expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191340.124317:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000080:00010000:0.0:1787191340.124318:0:57893:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xcd:0x0](000000008454039f) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a2f6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46054fc expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1787191340.124322:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634894336:12345-192.168.202.101@tcp:104: Request processed in 92us (365us total) trans 0 rc 0/0 00000080:00200000:0.0:1787191340.124365:0:57893:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xcd:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:0.0:1787191340.124371:0:57893:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a2f6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46054fc expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.124379:0:57893:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a2f6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46054fc expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:0.0:1787191340.124396:0:57893:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xcd:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191340.124399:0:57893:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191340.124404:0:57893:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xcd:0x0] 00010000:00010000:1.0:1787191340.124411:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191340.124419:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a2e8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e46054e0 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000008:00010000:0.0:1787191340.124422:0:57893:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191340.124425:0:57893:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f99630, osc lock ffff936b50b62f70, flags 0x400000400001002 00010000:00010000:1.0:1787191340.124427:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cae200 already unused, calling callback (ffffffffc1b143c0) 00000008:00010000:0.0:1787191340.124431:0:57893:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00010000:00010000:1.0:1787191340.124432:0:40930:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a2e8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x13/0x13 rrc: 4 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e46054e0 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000008:00010000:0.0:1787191340.124433:0:57893:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f99670, osc lock ffff936b50b62390, flags 0x400000400001002 00010000:00010000:1.0:1787191340.124440:0:40930:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a2e8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x13/0x13 rrc: 4 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e46054e0 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.124447:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a2e8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x13/0x13 rrc: 4 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x7130d520e46054e0 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.124474:0:57893:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a2fd lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.124477:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a2e8 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x13/0x13 rrc: 4 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e46054e0 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.124484:0:57893:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a2fd lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.124484:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191340.124493:0:57893:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b6a475c00 x1874004626693120/t0(0) o101->lustre-OST0000-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191340.124503:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a2e8 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x13/0x13 rrc: 4 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e46054e0 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.124511:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a2e8 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x13/0x13 rrc: 4 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e46054e0 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.124522:0:57893:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a304 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.124528:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191340.124529:0:57893:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a304 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.124530:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191340.124532:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191340.124537:0:57893:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b6a475180 x1874004626693376/t0(0) o101->lustre-OST0001-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191340.124545:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626693248:192.168.202.101@tcp:103:ldlm_bl.0 00000020:00200000:0.0:1787191340.124548:0:57893:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 2 items remaining. 00000100:00100000:1.0:1787191340.124608:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626693376:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191340.124636:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787191340.124646:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626693120:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191340.124702:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1352 00000100:00100000:0.0:1787191340.129213:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1e680 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626692864:192.168.202.101@tcp:36:bash.0 00000080:00200000:0.0:1787191340.129288:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:0.0:1787191340.129294:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xcd:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000100:00100000:1.0:1787191340.129300:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626693248:192.168.202.101@tcp:103:ldlm_bl.0 00020000:00200000:0.0:1787191340.129304:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xcd:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:0.0:1787191340.129309:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xcd:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191340.129312:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xcd:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:0.0:1787191340.129321:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xcd:0x0](ffff936b5395aa08) 00010000:00010000:1.0:1787191340.129328:0:2389:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a2fd lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191340.129346:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xcd:0x0]) in obj [0x200000405:0xcd:0x0], intent: layout flags 02 00010000:00010000:1.0:1787191340.129347:0:2389:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a2fd lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e460550a expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.129361:0:2389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a2fd lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460550a expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.129365:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a2f6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46054fc expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191340.129373:0:2389:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a2fd lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e460550a expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191340.129386:0:2389:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a2fd lrc: 5/2,0 mode: PR/PR res: [0x280000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460550a expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1787191340.129392:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xcd:0x0]: losing layout lock 00010000:00010000:0.0:1787191340.129424:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a2f6 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46054fc expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191340.129431:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191340.129434:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a2f6 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46054fc expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191340.129455:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a30b lrc: 3/0,1 mode: --/EX res: [0x200000405:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1787191340.129459:0:2389:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191340.129461:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a30b lrc: 3/0,1 mode: --/EX res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.129463:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a2fd lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460550a expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191340.129471:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00010000:00010000:1.0:1787191340.129471:0:2389:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a2fd lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460550a expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191340.129479:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a476d80 x1874004626693632/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191340.129479:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a2fd lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460550a expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.129488:0:2389:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a2fd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460550a expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.129489:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a30b lrc: 3/0,1 mode: --/EX res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191340.129501:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626693120:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191340.129507:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626693632:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191340.129517:0:2389:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a304 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.129527:0:2389:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a304 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605503 expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.129535:0:2389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a304 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605503 expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.129547:0:2389:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a304 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605503 expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191340.129555:0:2389:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a304 lrc: 5/2,0 mode: PR/PR res: [0x2c0000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605503 expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1787191340.129564:0:2389:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000100:00100000:0.0:1787191340.129578:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99840 going to sleep for 11 seconds 00010000:00010000:1.0:1787191340.131166:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a304 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605503 expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.131184:0:2389:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a304 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605503 expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.131193:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a304 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605503 expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.131201:0:2389:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a304 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605503 expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1787191340.131221:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626693376:192.168.202.101@tcp:101:lfs.0 00000080:00200000:2.0:1787191340.133857:0:57893:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xcd:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191340.133870:0:57893:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c3a060 (ffff936b47a175a8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191340.133875:0:57893:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c3a060 (ffff936b47a175a8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191340.133881:0:57893:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99630 (ffff936b47a17ea8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191340.133889:0:57893:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99670 (ffff936b47a176c8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191340.133892:0:57893:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c3a060 (ffff936b47a175a8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191340.133895:0:57893:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99630 (ffff936b47a175a8/1) at cl_lock_fini():72 00000020:00010000:2.0:1787191340.133903:0:57893:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99670 (ffff936b47a175a8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191340.133919:0:57893:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xcd:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:2.0:1787191340.133940:0:57893:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/205 (0 0) 00000080:00010000:2.0:1787191340.133954:0:57893:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xcd:0x0](ffff936b5395aa08) 00000002:00010000:2.0:1787191340.133965:0:57893:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xcd:0x0]) in obj [0x200000405:0xcd:0x0], intent: layout flags 0 00010000:00010000:2.0:1787191340.134015:0:57893:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a312 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.134025:0:57893:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a312 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.134044:0:57893:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a312 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191340.134069:0:57893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57893:1874004626693760:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191340.134163:0:57893:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.137438:0:57893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57893:1874004626693760:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191340.137466:0:57893:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a312 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460551f expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.137485:0:57893:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a312 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460551f expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191340.140562:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191340.140624:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191340.140761:0:40922:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787191340.140778:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634894720 00000100:00100000:2.0:1787191340.140787:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634894720 00000100:00100000:2.0:1787191340.140871:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634894848 00000100:00100000:2.0:1787191340.140873:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634894848 00000100:00100000:2.0:1787191340.140888:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1353 00000100:00100000:2.0:1787191340.140897:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8422:x1874004634894720:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191340.140914:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080030000 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191340.140977:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191340.140983:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8422:x1874004634894720:12345-192.168.202.101@tcp:104: Request processed in 87us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191340.140991:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1353 00000100:00100000:2.0:1787191340.141006:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1354 00000100:00100000:2.0:1787191340.141011:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b4121cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:29543:x1874004634894848:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191340.141018:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a278 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4605358 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191340.141060:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787191340.141066:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b4121cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:29543:x1874004634894848:12345-192.168.202.101@tcp:104: Request processed in 55us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191340.141072:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1354 00010000:00010000:1.0:1787191340.141212:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787191340.141219:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080030000 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191340.141234:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44caf200 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191340.141240:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428480030000 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191340.141282:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480030020 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191340.141289:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191340.141308:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480030020 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191340.141317:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000358ae053/0xe5129dc88483a271 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480030020 nid: local remote: 0x7130d520e4605351 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191340.141334:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191340.141338:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a278 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4605358 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.141344:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cafa00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191340.141347:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a278 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4605358 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.141364:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a278 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4605358 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.141376:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191340.141382:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a278 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4605358 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.141390:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a278 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4605358 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.141401:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191340.141402:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191340.141404:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191340.141416:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626693888:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191340.141476:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787191340.141481:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626694016:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787191340.141751:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191340.143998:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191340.144087:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634895360 00000100:00100000:3.0:1787191340.144097:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634895360 00000100:00100000:3.0:1787191340.144194:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1355 00000100:00100000:3.0:1787191340.144204:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634895360:12345-192.168.202.101@tcp:105: 00010000:00010000:3.0:1787191340.144219:0:40922:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a312 lrc: 5/1,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460551f expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.144232:0:40922:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a312 lrc: 5/1,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460551f expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.144242:0:40922:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a312 lrc: 5/1,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460551f expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.144252:0:40922:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a312 lrc: 5/1,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10080000000000 nid: local remote: 0x7130d520e460551f expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.144261:0:40922:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a312 lrc: 6/1,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10080000000000 nid: local remote: 0x7130d520e460551f expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.144270:0:40922:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a312 lrc: 6/1,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x80000000000 nid: local remote: 0x7130d520e460551f expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.144461:0:40922:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b51dd5e00) 00000100:00100000:3.0:1787191340.144513:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634895360:12345-192.168.202.101@tcp:105: Request processed in 310us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191340.144521:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1355 00010000:00010000:0.0:1787191340.147162:0:57893:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a312 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460551f expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.147185:0:57893:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a312 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460551f expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191340.147210:0:57893:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b513bbb80 x1874004626693760/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/344 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191340.147223:0:57893:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a312 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460551f expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.147235:0:57893:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/205 (0 0) 00000080:00200000:0.0:1787191340.147242:0:57893:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xcd:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191340.147262:0:57893:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xcd:0x0](ffff936b5395aa08) for lock 0xe5129dc88483a312 00000080:00010000:0.0:1787191340.147270:0:57893:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a312 from it ffffa3fb42213bc8 00010000:00010000:0.0:1787191340.147274:0:57893:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a312 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460551f expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.147285:0:57893:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a312 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460551f expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.147313:0:57893:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a312 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460551f expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.147326:0:57893:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a312 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460551f expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1787191340.147351:0:57893:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xcd:0x0](000000008454039f) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a312 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460551f expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1787191340.147413:0:57893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57893:1874004626694144:192.168.202.101@tcp:49:lfs.0 00000100:00100000:0.0:1787191340.147524:0:57893:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.149463:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626694016:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191340.149483:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626693888:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191340.149572:0:57570:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589936874 gen 1 00000100:00100000:3.0:1787191340.149667:0:57570:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b51d1dc00 x1874004626691712/t8589936870(8589936870) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787191340.149684:0:57570:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b51d1c380 x1874004626692224/t8589936871(8589936871) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787191340.149697:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626693632:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191340.149717:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a30b lrc: 4/0,1 mode: --/EX res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605518 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.149730:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a30b lrc: 4/0,1 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605518 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.149744:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a30b lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605518 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.149755:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a30b lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605518 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.149772:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a30b lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605518 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.149780:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a30b lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605518 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.149786:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a30b lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605518 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191340.149796:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b6a476d80 x1874004626693632/t8589936874(8589936874) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191340.149820:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a30b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605518 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191340.149961:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a30b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605518 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.149973:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/205 (0 0) 00000080:00200000:3.0:1787191340.149978:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xcd:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1787191340.149991:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xcd:0x0](ffff936b5395aa08) for lock 0xe5129dc88483a30b 00000080:00010000:3.0:1787191340.149999:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a30b from it ffffa3fb41cab930 00010000:00010000:3.0:1787191340.150002:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a30b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605518 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.150011:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a30b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605518 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191340.150030:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:3.0:1787191340.150047:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xcd:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00000100:00100000:0.0:1787191340.151256:0:57893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57893:1874004626694144:192.168.202.101@tcp:49:lfs.0 00010000:00010000:0.0:1787191340.151302:0:57893:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a312 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460551f expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.151310:0:57893:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a312 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460551f expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191340.151351:0:57893:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xcd:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191340.151359:0:57893:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xcd:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191340.151361:0:57893:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191340.151366:0:57893:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:0.0:1787191340.151458:0:57893:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xcd:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:0.0:1787191340.151476:0:57893:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a312 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460551f expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191340.151490:0:57893:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a312 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460551f expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:0.0:1787191340.151497:0:57893:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xcd:0x0](000000008454039f) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a312 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460551f expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191340.151517:0:57893:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xcd:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191340.151521:0:57893:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xcd:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191340.151524:0:57893:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191340.151526:0:57893:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:0.0:1787191340.151562:0:57893:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xcd:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:0.0:1787191340.151587:0:57893:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a2fd lrc: 1/0,0 mode: PR/PR res: [0x280000401:0x1bb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460550a expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000008:00010000:0.0:1787191340.151598:0:57893:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a304 lrc: 1/0,0 mode: PR/PR res: [0x2c0000401:0x1be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605503 expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191340.151640:0:57893:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xcd:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:0.0:1787191340.151644:0:57893:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a312 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460551f expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191340.151649:0:57893:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a312 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460551f expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191340.151656:0:57893:0:(vvp_io.c:397:vvp_io_fini()) [0x200000405:0xcd:0x0] layout changed from 3 to 4. 00000080:00200000:0.0:1787191340.151659:0:57893:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xcd:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00020000:00200000:0.0:1787191340.151663:0:57893:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xcd:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 1, mirror count: 2 00020000:00200000:0.0:1787191340.151664:0:57893:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191340.151667:0:57893:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xcd:0x0] 00000008:00010000:0.0:1787191340.151676:0:57893:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191340.151679:0:57893:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b46b503b0, osc lock ffff936b50b62be0, flags 0x400000400001002 00010000:00010000:0.0:1787191340.151712:0:57893:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000caedeff4/0xe5129dc88483a319 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.151718:0:57893:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000caedeff4/0xe5129dc88483a319 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.151726:0:57893:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b6a475180 x1874004626694272/t0(0) o101->lustre-OST0001-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:0.0:1787191340.151754:0:57893:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:1.0:1787191340.151792:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626694272:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191340.152964:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a312 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460551f expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191340.152979:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a312 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460551f expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:2.0:1787191340.152992:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xcd:0x0](000000008454039f) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a312 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460551f expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191340.153003:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a312 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460551f expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191340.153011:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a312 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460551f expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00020000:00200000:2.0:1787191340.153029:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xcd:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:2.0:1787191340.153033:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xcd:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191340.153045:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191340.153055:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191340.153070:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191340.153073:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:2.0:1787191340.153083:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:2.0:1787191340.153086:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b62b5f9f0, osc lock ffff936b44e62130, flags 0x80000000 00000008:00010000:2.0:1787191340.153090:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:2.0:1787191340.153092:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b62b5fa30, osc lock ffff936b44e63a20, flags 0x80000000 00010000:00010000:2.0:1787191340.153102:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b52373000 type 11 mode 2 res 11811161089/445 (0 1048575) 00010000:00010000:1.0:1787191340.153699:0:2390:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000caedeff4/0xe5129dc88483a319 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.153714:0:2390:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000caedeff4/0xe5129dc88483a319 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605542 expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.153727:0:2390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000caedeff4/0xe5129dc88483a319 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605542 expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.153740:0:2390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000caedeff4/0xe5129dc88483a319 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605542 expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191340.153752:0:2390:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000caedeff4/0xe5129dc88483a319 lrc: 5/2,0 mode: PR/PR res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605542 expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1787191340.153762:0:2390:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1787191340.153778:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000caedeff4/0xe5129dc88483a319 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605542 expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.153785:0:2390:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000caedeff4/0xe5129dc88483a319 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605542 expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.153792:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000caedeff4/0xe5129dc88483a319 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605542 expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.153799:0:2390:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000caedeff4/0xe5129dc88483a319 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605542 expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1787191340.153812:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626694272:192.168.202.101@tcp:101:lfs.0 00000080:00200000:0.0:1787191340.153927:0:57893:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xcd:0x0] updating i_size 0 i_blocks 0 00000020:00010000:0.0:1787191340.153933:0:57893:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c3a060 (ffff936b47a175a8/0) at cl_lock_release():245 00000020:00010000:0.0:1787191340.153936:0:57893:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c3a060 (ffff936b47a175a8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191340.153939:0:57893:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b46b503b0 (ffff936b47a17d88/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191340.153943:0:57893:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c3a060 (ffff936b47a175a8/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191340.153946:0:57893:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b46b503b0 (ffff936b47a175a8/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191340.153957:0:57893:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xcd:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1787191340.154010:0:57893:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xcd:0x0](ffff936b5395aa08), flags 154000 00000002:00100000:0.0:1787191340.154060:0:57893:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1dc00 x1874004626691712/t8589936870(8589936870) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191340.154071:0:57893:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191340.154077:0:57893:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475c00 x1874004626694656/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191340.154086:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.154095:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191340.154100:0:57893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57893:1874004626694656:192.168.202.101@tcp:35:lfs.0 00010000:00010000:2.0:1787191340.154105:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191340.154116:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626694400:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191340.154168:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.155149:0:57893:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191340.155479:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191340.155532:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634895872 00000100:00100000:2.0:1787191340.155540:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634895872 00000100:00100000:2.0:1787191340.155592:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1356 00000100:00100000:2.0:1787191340.155601:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30511:x1874004634895872:12345-192.168.202.101@tcp:104: 00000100:00100000:0.0:1787191340.155609:0:57893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57893:1874004626694656:192.168.202.101@tcp:35:lfs.0 00010000:00010000:2.0:1787191340.155613:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000caedeff4/0xe5129dc88483a319 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000010000 nid: local remote: 0x7130d520e4605542 expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000002:00100000:0.0:1787191340.155642:0:57893:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1dc00 x1874004626691712/t8589936870(8589936870) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1787191340.155671:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191340.155677:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30511:x1874004634895872:12345-192.168.202.101@tcp:104: Request processed in 78us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191340.155683:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1356 00000080:00200000:0.0:1787191340.155746:0:57893:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191340.155762:0:57893:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.155774:0:57893:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.155785:0:57893:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.155793:0:57893:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191340.155798:0:57893:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191340.155802:0:57893:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00010000:00010000:1.0:1787191340.155804:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000080:00010000:0.0:1787191340.155807:0:57893:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42213bf8 00010000:00010000:0.0:1787191340.155812:0:57893:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191340.155812:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000caedeff4/0xe5129dc88483a319 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000010000 nid: local remote: 0x7130d520e4605542 expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.155821:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44caea00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191340.155822:0:57893:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191340.155826:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000caedeff4/0xe5129dc88483a319 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800428400010000 nid: local remote: 0x7130d520e4605542 expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191340.155857:0:57893:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.155863:0:57893:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191340.155870:0:57893:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191340.155873:0:57627:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xcd:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1787191340.155883:0:57893:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b604ca600, open_flags d902, mode 0 opened 0 00000080:00200000:1.0:1787191340.155885:0:57627:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xcd:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00000080:00200000:0.0:1787191340.155889:0:57893:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:0.0:1787191340.155902:0:57893:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154403 00010000:00010000:1.0:1787191340.155917:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000caedeff4/0xe5129dc88483a319 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400010020 nid: local remote: 0x7130d520e4605542 expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.155924:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191340.155932:0:57893:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a327 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.155939:0:57893:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a327 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.155943:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000caedeff4/0xe5129dc88483a319 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400010020 nid: local remote: 0x7130d520e4605542 expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1787191340.155948:0:57893:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191340.155954:0:57893:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475c00 x1874004626695040/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191340.155962:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000caedeff4/0xe5129dc88483a319 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400010020 nid: local remote: 0x7130d520e4605542 expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.155963:0:57893:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a327 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.155974:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191340.155976:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191340.155977:0:57893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57893:1874004626695040:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191340.155978:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191340.155989:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626694784:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191340.156104:0:57893:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.158796:0:57893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57893:1874004626695040:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191340.158817:0:57893:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a327 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605565 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.158866:0:57893:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a327 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605565 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.158875:0:57893:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a327 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605565 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.158891:0:57893:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a327 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605565 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.158899:0:57893:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a327 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605565 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.158909:0:57893:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a327 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605565 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.158915:0:57893:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a327 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605565 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.158919:0:57893:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a327 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605565 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191340.158927:0:57893:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b6a475c00 x1874004626695040/t8589936876(8589936876) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191340.158935:0:57893:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475c00 x1874004626695040/t8589936876(8589936876) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191340.158944:0:57893:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a327 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605565 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191340.158956:0:57893:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a327 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605565 expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.158965:0:57893:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/205 (0 0) 00000080:00200000:0.0:1787191340.158972:0:57893:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191340.159047:0:57893:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xcd:0x0](ffff936b5395aa08): rc = 0 00000080:00200000:0.0:1787191340.159067:0:57893:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xcd:0x0]: layout version change: 4 -> 4 00000080:00010000:0.0:1787191340.159073:0:57893:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xcd:0x0](ffff936b5395aa08) for lock 0xe5129dc88483a327 00000080:00010000:0.0:1787191340.159087:0:57893:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xcd:0x0](ffff936b5395aa08) 00000080:00200008:0.0:1787191340.159102:0:57893:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xcd:0x0](ffff936b5395aa08), flags 154402 00000002:00100000:0.0:1787191340.159126:0:57893:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475c00 x1874004626695040/t8589936876(8589936876) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191340.159162:0:57893:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a475c00 x1874004626695040/t8589936876(8589936876) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191340.159172:0:57893:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191340.159182:0:57893:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477800 x1874004626695296/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191340.159203:0:57893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57893:1874004626695296:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191340.159276:0:57893:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191340.160239:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191340.160425:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634896000 00000100:00100000:3.0:1787191340.160433:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634896000 00000100:00100000:3.0:1787191340.160483:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1357 00000100:00100000:0.0:1787191340.160787:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626694400:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191340.160812:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e4605549 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.160824:0:57570:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4605549 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.160864:0:57570:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4605549 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191340.161203:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:6489:x1874004634896000:12345-192.168.202.101@tcp:105: 00010000:00010000:3.0:1787191340.161214:0:40922:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4605549 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.161229:0:40922:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4605549 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.161237:0:40922:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e4605549 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.161246:0:40922:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080080020000 nid: local remote: 0x7130d520e4605549 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.161255:0:40922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080080020000 nid: local remote: 0x7130d520e4605549 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.161264:0:40922:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80080020000 nid: local remote: 0x7130d520e4605549 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.161290:0:40922:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b51dd4600) 00000100:00100000:3.0:1787191340.161343:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:6489:x1874004634896000:12345-192.168.202.101@tcp:105: Request processed in 143us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191340.161350:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1357 00010000:00010000:0.0:1787191340.161755:0:57570:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4605549 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.161765:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4605549 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.161781:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e4605549 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191340.161795:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080020000 nid: local remote: 0x7130d520e4605549 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.161807:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4605549 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.161814:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4605549 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.163160:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483a32e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.163173:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483a32e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.163182:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483a32e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191340.163201:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626695424:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191340.163262:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.165905:0:57893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57893:1874004626695296:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191340.165947:0:57893:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a475c00 x1874004626695040/t8589936876(8589936876) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191340.166019:0:57893:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a327 from it ffff936b46b4ed80 00010000:00010000:0.0:1787191340.166028:0:57893:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a327 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605565 expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.166052:0:57893:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a327 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605565 expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191340.166078:0:57893:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xcd:0x0](ffff936b5395aa08), inode mode 81a4 mask 46 00000080:00200080:0.0:1787191340.166174:0:57893:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xcd:0x0](ffff936b5395aa08) cmd=800466af arg=7ffe3a8eda1c 00000080:00200080:0.0:1787191340.166192:0:57893:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xcd:0x0](ffff936b5395aa08) cmd=80086601 arg=7ffe3a8ed9b8 00000100:00100000:0.0:1787191340.166234:0:57893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57893:1874004626695552:192.168.202.101@tcp:33:lfs.0 00000100:00100000:0.0:1787191340.166308:0:57893:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191340.166401:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626694784:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191340.166481:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626695424:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191340.166502:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483a32e lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605573 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.166514:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483a32e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4605573 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.166523:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483a32e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4605573 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.166533:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483a32e lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4605573 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191340.166541:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483a32e lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4605573 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.166549:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483a32e lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4605573 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.166554:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483a32e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4605573 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191340.166619:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626695808:192.168.202.101@tcp:10:bash.0 00000100:00100000:3.0:1787191340.166643:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787191340.166647:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626695680:192.168.202.101@tcp:10:bash.0 00000100:00100000:3.0:1787191340.168899:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626695680:192.168.202.101@tcp:10:bash.0 00000100:00100000:3.0:1787191340.168911:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626695808:192.168.202.101@tcp:10:bash.0 00000080:00200000:1.0:1787191340.169010:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xcd:0x0] updating i_size 0 i_blocks 0 00000020:00010000:1.0:1787191340.169017:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b53cc53f8 (ffff936b47a172d8/0) at cl_lock_release():245 00000020:00010000:1.0:1787191340.169020:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b53cc53f8 (ffff936b47a172d8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191340.169024:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62b5f9f0 (ffff936b47a176c8/1) at cl_lock_cancel():142 00010000:00010000:1.0:1787191340.169033:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4605549 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.169058:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4605549 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1787191340.169073:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62b5fa30 (ffff936b47a17ea8/1) at cl_lock_cancel():142 00010000:00010000:1.0:1787191340.169078:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483a32e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4605573 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.169085:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483a32e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4605573 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1787191340.169094:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b53cc53f8 (ffff936b47a172d8/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191340.169096:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62b5f9f0 (ffff936b47a172d8/1) at cl_lock_fini():72 00000020:00010000:1.0:1787191340.169100:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62b5fa30 (ffff936b47a172d8/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191340.169118:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xcd:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1787191340.169129:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xcd:0x0](ffff936b5395aa08) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191340.000000000, mtime 1787191340.000000000, ctime 1787191340.000000000, rc 0 00000080:00200008:1.0:1787191340.169208:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xcd:0x0], ppos: 0, count: 5 00000080:00200000:1.0:1787191340.169220:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:1.0:1787191340.169226:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:1.0:1787191340.169231:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:1.0:1787191340.169236:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:1.0:1787191340.169241:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@0000000021a95ec9[0x110, 1, [0x200000405:0xcd:0x0] hash] 00000020:00200000:1.0:1787191340.169243:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:1.0:1787191340.169247:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xcd:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:1.0:1787191340.169258:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xcd:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:1.0:1787191340.169263:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xcd:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191340.169266:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:1.0:1787191340.169270:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:1.0:1787191340.169276:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:1.0:1787191340.169278:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1787191340.169291:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:1.0:1787191340.169301:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1787191340.169305:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b47d7d330, osc lock ffff936b46836130, flags 0x0 00010000:00010000:1.0:1787191340.169319:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4605549 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.169328:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4605549 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.169336:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4605549 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.169341:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4605549 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.169345:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4605549 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191340.169356:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:1.0:1787191340.169362:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:1.0:1787191340.169399:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:1.0:1787191340.169404:0:57570:0:(rw26.c:927:ll_write_end()) page@000000001cf086aa[3 00000000fbffc1a2 2 1 000000005f9a7ead 0 0 0] 00000080:00200000:1.0:1787191340.169406:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @0000000035eaf25d 17ffffc0001001 3:0 ffff936b43259c40 0 lru 00000080:00200000:1.0:1787191340.169412:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@00000000c2a81032 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000ef00a996 00000000f9406232 > 3< 0 0 > 4< 0 0 8 469995520 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1787191340.169413:0:57570:0:(rw26.c:927:ll_write_end()) end page@000000001cf086aa 00000080:00200000:1.0:1787191340.169414:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:1.0:1787191340.169418:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:1.0:1787191340.169431:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 000000004b21917f ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4605549 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191340.169445:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b5395abb8, count 1, dirtied 1 00000080:00200000:1.0:1787191340.169448:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:1.0:1787191340.169450:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:1.0:1787191340.169460:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b53cc53f8 (ffff936b47a172d8/0) at cl_lock_release():245 00000020:00010000:1.0:1787191340.169462:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b53cc53f8 (ffff936b47a172d8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191340.169464:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7d330 (ffff936b47a17ea8/1) at cl_lock_cancel():142 00010000:00010000:1.0:1787191340.169467:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4605549 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.169472:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4605549 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:1.0:1787191340.169478:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b53cc53f8 (ffff936b47a172d8/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191340.169479:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7d330 (ffff936b47a172d8/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191340.169482:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:1.0:1787191340.169486:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:1.0:1787191340.169551:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xcd:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191340.169557:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:1.0:1787191340.169562:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xcd:0x0] updating i_size 5 i_blocks 0 00000080:00200000:1.0:1787191340.169566:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:1.0:1787191340.169581:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xcd:0x0](ffff936b5395aa08), flags 100001 00000100:00100000:0.0:1787191340.170245:0:57893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57893:1874004626695552:192.168.202.101@tcp:33:lfs.0 00000080:00200080:0.0:1787191340.170283:0:57893:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xcd:0x0](ffff936b5395aa08) cmd=c00c66f3 arg=7ffe3a8ed9a4 00000002:00010000:0.0:1787191340.170303:0:57893:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xcd:0x0]) in obj [0x200000405:0xcd:0x0], intent: open flags 01004040000002 00010000:00010000:0.0:1787191340.170354:0:57893:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a335 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x10000000000000 pid: 57893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.170362:0:57893:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a335 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x0 pid: 57893 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191340.170372:0:57893:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191340.170380:0:57893:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475c00 x1874004626696064/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191340.170389:0:57893:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a335 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x81000000000000 pid: 57893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191340.170407:0:57893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57893:1874004626696064:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191340.170568:0:57893:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.172440:0:57893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57893:1874004626696064:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191340.172462:0:57893:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a335 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4605581 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.172474:0:57893:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a335 lrc: 4/1,0 mode: --/PW res: [0x200000405:0xcd:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4605581 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.172486:0:57893:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a335 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0xcd:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4605581 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.172497:0:57893:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a335 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0xcd:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4605581 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.172509:0:57893:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a335 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0xcd:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4605581 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.172517:0:57893:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a335 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0xcd:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4605581 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.172524:0:57893:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a335 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0xcd:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4605581 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191340.172536:0:57893:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x600002b, status=0 req@ffff936b6a475c00 x1874004626696064/t8589936878(8589936878) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191340.172550:0:57893:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475c00 x1874004626696064/t8589936878(8589936878) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191340.172564:0:57893:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a335 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xcd:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4605581 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.172576:0:57893:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 2 res 8589935621/205 (0 0) 00000080:00200000:0.0:1787191340.172582:0:57893:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xcd:0x0] suppgids 0 0: rc 0 00000002:00100000:0.0:1787191340.172599:0:57893:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475c00 x1874004626696064/t8589936878(8589936878) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191340.172606:0:57893:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xcd:0x0](ffff936b5395aa08) for lock 0xe5129dc88483a335 00000080:00010000:0.0:1787191340.172612:0:57893:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a335 from it ffffa3fb42213cc0 00010000:00010000:0.0:1787191340.172615:0:57893:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a335 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xcd:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4605581 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.172623:0:57893:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a335 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0xcd:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4605581 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00200080:0.0:1787191340.172913:0:57893:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xcd:0x0](ffff936b5395aa08) cmd=c00c66f3 arg=236f2e0 00010000:00010000:0.0:1787191340.172965:0:57893:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a335 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0xcd:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81008000000000 nid: local remote: 0x7130d520e4605581 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.172979:0:57893:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a335 lrc: 0/0,0 mode: --/PW res: [0x200000405:0xcd:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x85809400000000 nid: local remote: 0x7130d520e4605581 expref: -99 pid: 57893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191340.172992:0:57893:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a475c00 x1874004626696064/t8589936878(8589936878) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191340.173001:0:57893:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191340.173006:0:57893:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477800 x1874004626696320/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191340.173025:0:57893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57893:1874004626696320:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191340.173098:0:57893:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191340.175867:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191340.175901:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634896128 00000100:00100000:3.0:1787191340.175910:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634896128 00000100:00100000:3.0:1787191340.175961:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1358 00000100:00100000:3.0:1787191340.175970:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6509:x1874004634896128:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191340.175988:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a312 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e460551f expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191340.176105:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191340.176112:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6509:x1874004634896128:12345-192.168.202.101@tcp:104: Request processed in 143us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191340.176130:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1358 00000100:00100000:3.0:1787191340.176170:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191340.176244:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191340.176266:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191340.176289:0:40921:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787191340.176300:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634896256 00000100:00100000:3.0:1787191340.176303:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634896256 00000100:00100000:3.0:1787191340.176316:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634896384 00000100:00100000:3.0:1787191340.176319:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634896384 00000100:00100000:3.0:1787191340.176327:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634896512 00000100:00100000:3.0:1787191340.176329:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634896512 00000100:00100000:3.0:1787191340.176340:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1359 00000100:00100000:3.0:1787191340.176346:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+7:6509:x1874004634896256:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191340.176355:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a30b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e4605518 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.176419:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787191340.176426:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a312 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e460551f expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191340.176434:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd5e00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191340.176439:0:40930:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a312 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x8 rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e460551f expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191340.176448:0:40930:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a312 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x8 rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e460551f expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191340.176456:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a312 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x8 rrc: 5 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e460551f expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191340.176479:0:40930:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a327 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605565 expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191340.176783:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a312 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x8 rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e460551f expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191340.176792:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191340.176828:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a312 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x8 rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e460551f expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191340.176870:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a312 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x8 rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e460551f expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191340.176884:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191340.176887:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a30b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e4605518 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.176893:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cae600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191340.176897:0:40930:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a30b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0xa/0xa rrc: 4 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4605518 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.176904:0:40930:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a30b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0xa/0xa rrc: 4 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4605518 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.176911:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a30b lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0xa/0xa rrc: 4 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x7130d520e4605518 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.176923:0:40930:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a327 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605565 expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191340.176941:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a30b lrc: 2/0,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0xa/0xa rrc: 4 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e4605518 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.176947:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191340.176953:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a30b lrc: 1/0,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0xa/0xa rrc: 4 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e4605518 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.176964:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a30b lrc: 0/0,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0xa/0xa rrc: 4 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e4605518 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.176974:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191340.176976:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191340.176978:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191340.177004:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626696576:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191340.177069:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787191340.177075:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626696448:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00200000:2.0:1787191340.177408:0:57894:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191340.177429:0:57894:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191340.177440:0:57894:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191340.177449:0:57894:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191340.177455:0:57894:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191340.177462:0:57894:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191340.177465:0:57894:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191340.177471:0:57894:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4220bb58 00010000:00010000:2.0:1787191340.177475:0:57894:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191340.177482:0:57894:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191340.177494:0:57894:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191340.177501:0:57894:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191340.177507:0:57894:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191340.177512:0:57894:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=8 00000080:00200008:2.0:1787191340.177518:0:57894:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xcd:0x0](ffff936b5395aa08), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191340.177522:0:57894:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xcd:0x0](ffff936b5395aa08),name=f70.sanity-flr 00000002:00010000:2.0:1787191340.177535:0:57894:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xcd:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191340.177541:0:57894:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a327 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605565 expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191340.177549:0:57894:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a327 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605565 expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191340.177556:0:57894:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191340.177560:0:57894:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xcd:0x0](ffff936b5395aa08) 00000080:00010000:2.0:1787191340.177563:0:57894:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xcd:0x0](ffff936b5395aa08) for lock 0xe5129dc88483a327 00000080:00010000:2.0:1787191340.177566:0:57894:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a327 from it ffffa3fb4220bcb8 00010000:00010000:2.0:1787191340.177569:0:57894:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a327 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605565 expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191340.177577:0:57894:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a327 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605565 expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:2.0:1787191340.177601:0:57894:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xcd:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00020000:00200000:2.0:1787191340.177612:0:57894:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xcd:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191340.177615:0:57894:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191340.177619:0:57894:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xcd:0x0] 00000008:00010000:2.0:1787191340.177641:0:57894:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191340.177644:0:57894:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1230, osc lock ffff936b44e62980, flags 0x400000400001002 00010000:00010000:2.0:1787191340.177660:0:57894:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4605549 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191340.177672:0:57894:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4605549 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:2.0:1787191340.177683:0:57894:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191340.177687:0:57894:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4605549 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191340.177694:0:57894:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4605549 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:2.0:1787191340.177704:0:57894:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191340.177712:0:57894:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xcd:0x0] updating i_size 5 i_blocks 0 00000020:00010000:2.0:1787191340.177718:0:57894:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51655e10 (ffff936b465ccf38/0) at cl_lock_release():245 00000020:00010000:2.0:1787191340.177876:0:57894:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51655e10 (ffff936b465ccf38/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191340.177880:0:57894:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1230 (ffff936b465cc518/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191340.177884:0:57894:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51655e10 (ffff936b465ccf38/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191340.177887:0:57894:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1230 (ffff936b465ccf38/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191340.177898:0:57894:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xcd:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191340.177919:0:57894:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191340.177928:0:57894:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191340.177934:0:57894:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191340.177943:0:57894:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191340.178015:0:57894:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191340.178019:0:57894:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191340.178022:0:57894:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191340.178026:0:57894:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4220bc10 00010000:00010000:2.0:1787191340.178029:0:57894:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191340.178047:0:57894:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191340.178055:0:57894:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191340.178060:0:57894:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191340.178064:0:57894:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191340.178070:0:57894:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:2.0:1787191340.178073:0:57894:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:2.0:1787191340.178077:0:57894:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:2.0:1787191340.178101:0:57894:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a327 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4605565 expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:2.0:1787191340.178118:0:57894:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xcd:0x0]: losing layout lock 00010000:00010000:2.0:1787191340.178130:0:57894:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a2ef lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e46054ee expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191340.178139:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1787191340.178150:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+7:6509:x1874004634896256:12345-192.168.202.101@tcp:104: Request processed in 1800us (1976us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191340.178161:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1359 00010000:00010000:2.0:1787191340.178162:0:57894:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a327 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605565 expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191340.178168:0:57894:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a2ef lrc: 1/0,0 mode: --/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46054ee expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191340.178174:0:57894:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:2.0:1787191340.178176:0:57894:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a327 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605565 expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000100:00100000:3.0:1787191340.178185:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1360 00010000:00010000:2.0:1787191340.178187:0:57894:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a2ef lrc: 0/0,0 mode: --/PR res: [0x200000405:0xcd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46054ee expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1787191340.178193:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+6:6509:x1874004634896384:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191340.178199:0:40921:0:(ldlm_lockd.c:2455:ldlm_callback_handler()) callback on lock 0xe5129dc88483a327 - lock disappeared 00000020:00100000:2.0:1787191340.178206:0:57894:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 36, max 7 00000100:00100000:2.0:1787191340.178213:0:57894:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9500 x1874004626696832/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 496/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787191340.178232:0:57894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57894:1874004626696832:192.168.202.101@tcp:36:rm.0 00010000:00010000:3.0:1787191340.178234:0:40921:0:(ldlm_lockd.c:2352:ldlm_callback_errmsg()) @@@ Operate with invalid parameter, NID=12345-192.168.202.101@tcp lock=0xe5129dc88483a327: rc = 0 req@ffff936b51d1dc00 x1874004634896384/t0(0) o104->f10005b0-4ec5-4888-9c81-49c0b11e82c4@192.168.202.101@tcp:651/0 lens 328/224 e 0 to 0 dl 1787191351 ref 1 fl Interpret:/0/0 rc -22/-22 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191340.178244:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+6:6509:x1874004634896384:12345-192.168.202.101@tcp:104: Request processed in 54us (2001us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787191340.178250:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1360 00000100:00100000:3.0:1787191340.178261:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1361 00000100:00100000:2.0:1787191340.178263:0:57894:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f300 going to sleep for 11 seconds 00000100:00100000:3.0:1787191340.178268:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b50883850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6509:x1874004634896512:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191340.178273:0:40921:0:(ldlm_lockd.c:2455:ldlm_callback_handler()) callback on lock 0xe5129dc88483a2ef - lock disappeared 00010000:00010000:3.0:1787191340.178292:0:40921:0:(ldlm_lockd.c:2352:ldlm_callback_errmsg()) @@@ Operate with invalid parameter, NID=12345-192.168.202.101@tcp lock=0xe5129dc88483a2ef: rc = 0 req@ffff936b50883850 x1874004634896512/t0(0) o104->f10005b0-4ec5-4888-9c81-49c0b11e82c4@192.168.202.101@tcp:651/0 lens 328/224 e 0 to 0 dl 1787191351 ref 1 fl Interpret:/0/0 rc -22/-22 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191340.178302:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b50883850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6509:x1874004634896512:12345-192.168.202.101@tcp:104: Request processed in 35us (2036us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787191340.178308:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1361 00010000:00010000:1.0:1787191340.178450:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191340.179906:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191340.180913:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626696448:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191340.180929:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626696576:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191340.182745:0:57893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57893:1874004626696320:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191340.182745:0:57894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57894:1874004626696832:192.168.202.101@tcp:36:rm.0 00000080:00020000:0.0:1787191340.182764:0:57893:0:(file.c:251:ll_close_inode_openhandle()) lustre-clilmv-ffff936b581fb000: inode [0x200000405:0xcd:0x0] mdc close failed: rc = -1 00000002:00100000:0.0:1787191340.182782:0:57893:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a475c00 x1874004626696064/t8589936878(8589936878) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191340.182820:0:57893:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xcd:0x0](ffff936b5395aa08) 00000002:00010000:0.0:1787191340.182941:0:57893:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xcd:0x0]) in obj [0x200000405:0xcd:0x0], intent: layout flags 0 00010000:00010000:0.0:1787191340.182993:0:57893:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a33c lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.183002:0:57893:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a33c lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.183013:0:57893:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a33c lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191340.183032:0:57893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57893:1874004626696960:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191340.183196:0:57893:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191340.186253:0:57893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57893:1874004626696960:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191340.186286:0:57893:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a33c lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46055ab expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.186299:0:57893:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a33c lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46055ab expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191340.186310:0:57893:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b6a475c00 x1874004626696960/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191340.186319:0:57893:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a33c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46055ab expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191340.186332:0:57893:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a33c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46055ab expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.186340:0:57893:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/205 (0 0) 00000080:00200000:1.0:1787191340.186346:0:57893:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xcd:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191340.186362:0:57893:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xcd:0x0](ffff936b5395aa08) for lock 0xe5129dc88483a33c 00000080:00010000:1.0:1787191340.186369:0:57893:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a33c from it ffffa3fb42213bc8 00010000:00010000:1.0:1787191340.186372:0:57893:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a33c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46055ab expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.186378:0:57893:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a33c lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46055ab expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.186398:0:57893:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a33c lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46055ab expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.186410:0:57893:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a33c lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46055ab expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:1.0:1787191340.186418:0:57893:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xcd:0x0](000000008454039f) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a33c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46055ab expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191340.186458:0:57893:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xcd:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:1.0:1787191340.186464:0:57893:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a33c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46055ab expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.186471:0:57893:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf200/0xe5129dc88483a33c lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xcd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46055ab expref: -99 pid: 57893 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200008:1.0:1787191340.186595:0:57893:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xcd:0x0](ffff936b5395aa08), flags 154002 00000002:00100000:1.0:1787191340.186636:0:57893:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1c380 x1874004626692224/t8589936871(8589936871) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191340.186648:0:57893:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191340.186653:0:57893:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8a80 x1874004626697216/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191340.186674:0:57893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57893:1874004626697216:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191340.186747:0:57893:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893780 going to sleep for 11 seconds 00000100:00100000:3.0:1787191340.198056:0:57893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57893:1874004626697216:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191340.198094:0:57893:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1c380 x1874004626692224/t8589936871(8589936871) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191340.198157:0:57893:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xcd:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1787191340.198169:0:57893:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xcd:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191340.198173:0:57893:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191340.198180:0:57893:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191340.198190:0:57893:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000008:00010000:3.0:1787191340.198209:0:57893:0:(osc_cache.c:1183:osc_extent_make_ready()) ### extent: 000000004b21917f ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4605549 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1787191340.198240:0:57893:0:(osc_cache.c:917:osc_extent_finish()) ### extent: 000000004b21917f ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4605549 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1787191340.198262:0:57893:0:(osc_cache.c:497:__osc_extent_remove()) ### extent: 000000004b21917f ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4605549 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787191340.198286:0:57893:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xcd:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191340.198335:0:57893:0:(llite_lib.c:2066:ll_clear_inode()) VFS Op:inode=[0x200000405:0xcd:0x0](ffff936b5395aa08) 00000008:00010000:3.0:1787191340.198367:0:57893:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 5 blocks 0 [cma]time 1787191340 1787191340 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 1/0,0 mode: PW/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4605549 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1787191340.198390:0:57893:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191340 1787191340 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483a32e lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x1ba:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4605573 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191340.209891:0:57895:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191340.209928:0:57895:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.210418:0:57895:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.210437:0:57895:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.210447:0:57895:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191340.210455:0:57895:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191340.210459:0:57895:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191340.210467:0:57895:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42163b58 00010000:00010000:0.0:1787191340.210471:0:57895:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.210481:0:57895:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.210568:0:57895:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.210578:0:57895:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:0.0:1787191340.210584:0:57895:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.210594:0:57895:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:0.0:1787191340.210598:0:57895:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:0.0:1787191340.210612:0:57895:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:0.0:1787191340.210823:0:57895:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a343 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.210873:0:57895:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a343 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.210886:0:57895:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a343 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191340.210919:0:57895:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57895:1874004626697344:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191340.211251:0:57895:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00000080:00200000:2.0:1787191340.214350:0:57896:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191340.214385:0:57896:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191340.214521:0:57896:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191340.214539:0:57896:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191340.214548:0:57896:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191340.214556:0:57896:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191340.214560:0:57896:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191340.214568:0:57896:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42183bf8 00010000:00010000:2.0:1787191340.214572:0:57896:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191340.214580:0:57896:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191340.214599:0:57896:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191340.214607:0:57896:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191340.214682:0:57896:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:0.0:1787191340.218085:0:57895:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57895:1874004626697344:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191340.218107:0:57895:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a343 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.218121:0:57895:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a343 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.218128:0:57895:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a343 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.218135:0:57895:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a343 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.218143:0:57895:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a343 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.218149:0:57895:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cae200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191340.218153:0:57895:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a343 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.218161:0:57895:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a343 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.218169:0:57895:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a343 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.218176:0:57895:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191340.218184:0:57895:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a343 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.218191:0:57895:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a343 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191340.218213:0:57895:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b6a477480 x1874004626697344/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191340.218234:0:57895:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191340.218342:0:57895:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191340.218356:0:57895:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.218367:0:57895:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.218379:0:57895:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.218386:0:57895:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191340.218391:0:57895:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191340.218458:0:57895:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191340.218464:0:57895:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42163be8 00010000:00010000:0.0:1787191340.218468:0:57895:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.218477:0:57895:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.218491:0:57895:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.218499:0:57895:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000080:00200000:0.0:1787191340.218504:0:57895:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.218516:0:57895:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:0.0:1787191340.218520:0:57895:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:0.0:1787191340.218532:0:57895:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:0.0:1787191340.218575:0:57895:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a34a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.218588:0:57895:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a34a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.218597:0:57895:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a34a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191340.218616:0:57895:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57895:1874004626697472:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191340.218736:0:57895:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.221567:0:57895:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57895:1874004626697472:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191340.221586:0:57895:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a34a lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.221598:0:57895:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a34a lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.221605:0:57895:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a34a lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.221611:0:57895:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a34a lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.221619:0:57895:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a34a lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.221625:0:57895:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44caf000 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191340.221630:0:57895:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a34a lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.221636:0:57895:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a34a lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.221644:0:57895:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a34a lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.221651:0:57895:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191340.221657:0:57895:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a34a lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.221664:0:57895:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a34a lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191340.221687:0:57895:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b6a477480 x1874004626697472/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191340.221702:0:57895:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191340.221781:0:57895:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191340.221791:0:57895:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.221799:0:57895:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.221807:0:57895:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.221811:0:57895:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191340.221815:0:57895:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191340.221817:0:57895:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191340.221821:0:57895:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42163b58 00010000:00010000:0.0:1787191340.221822:0:57895:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.221865:0:57895:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.221881:0:57895:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.221889:0:57895:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:0.0:1787191340.221898:0:57895:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1787191340.221903:0:57895:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:0.0:1787191340.221914:0:57895:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.221921:0:57895:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 84 lru_type: 1 00010000:00010000:0.0:1787191340.221928:0:57895:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 84 lru_type: 1 00000002:00010000:0.0:1787191340.221934:0:57895:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.221966:0:57895:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a351 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.221971:0:57895:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a351 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.221978:0:57895:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a351 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191340.221997:0:57895:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57895:1874004626697600:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191340.222093:0:57895:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00000080:00200000:2.0:1787191340.222218:0:57896:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b464afb00, open_flags d900, mode 0 opened 0 00000080:00200000:2.0:1787191340.222227:0:57896:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:2.0:1787191340.222250:0:57896:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:2.0:1787191340.222283:0:57896:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a358 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.222290:0:57896:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a358 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57896 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191340.222299:0:57896:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191340.222305:0:57896:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9180 x1874004626697856/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191340.222314:0:57896:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a358 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57896 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191340.222325:0:57896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57896:1874004626697856:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191340.223321:0:57896:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f300 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.226191:0:57895:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57895:1874004626697600:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191340.226216:0:57895:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a351 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46055ea expref: -99 pid: 57895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.226228:0:57895:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a351 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46055ea expref: -99 pid: 57895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.226236:0:57895:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a351 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46055ea expref: -99 pid: 57895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.226244:0:57895:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a351 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46055ea expref: -99 pid: 57895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.226253:0:57895:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a351 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46055ea expref: -99 pid: 57895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.226258:0:57895:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a351 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46055ea expref: -99 pid: 57895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.226262:0:57895:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a351 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46055ea expref: -99 pid: 57895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191340.226269:0:57895:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b6a477480 x1874004626697600/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191340.226279:0:57895:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a351 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46055ea expref: -99 pid: 57895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.226287:0:57895:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:0.0:1787191340.226292:0:57895:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a351 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46055ea expref: -99 pid: 57895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.226298:0:57895:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a351 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46055ea expref: -99 pid: 57895 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:0.0:1787191340.226323:0:57895:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.226331:0:57895:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 168 lru_type: 1 00010000:00010000:0.0:1787191340.226340:0:57895:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 168 lru_type: 1 00010000:00010000:0.0:1787191340.226345:0:57895:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 168 lru_type: 1 00010000:00010000:0.0:1787191340.226349:0:57895:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 169 lru_type: 1 00000080:00200000:0.0:1787191340.226356:0:57895:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191340.226362:0:57895:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:0.0:1787191340.226365:0:57895:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:0.0:1787191340.226369:0:57895:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb42163cb8 00010000:00010000:0.0:1787191340.226371:0:57895:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 84 lru_type: 1 00010000:00010000:0.0:1787191340.226375:0:57895:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 85 lru_type: 1 00000002:00010000:0.0:1787191340.226386:0:57895:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.226390:0:57895:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a351 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46055ea expref: -99 pid: 57895 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.226397:0:57895:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a351 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46055ea expref: -99 pid: 57895 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.226404:0:57895:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a351 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46055ea expref: -99 pid: 57895 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.226412:0:57895:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a351 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46055ea expref: -99 pid: 57895 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:0.0:1787191340.226419:0:57895:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.226424:0:57895:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 169 lru_type: 1 00010000:00010000:0.0:1787191340.226431:0:57895:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 169 lru_type: 1 00010000:00010000:0.0:1787191340.226438:0:57895:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 169 lru_type: 1 00010000:00010000:0.0:1787191340.226444:0:57895:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 170 lru_type: 1 00000080:00200008:0.0:1787191340.227163:0:57895:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1787191340.227168:0:57895:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191340.227181:0:57895:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.227188:0:57895:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.227195:0:57895:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.227200:0:57895:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191340.227203:0:57895:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191340.227205:0:57895:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191340.227208:0:57895:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42163cb8 00010000:00010000:0.0:1787191340.227211:0:57895:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.227215:0:57895:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.227299:0:57895:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191340.227305:0:57895:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.227309:0:57895:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.227315:0:57895:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.227319:0:57895:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191340.227321:0:57895:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191340.227323:0:57895:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191340.227325:0:57895:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42163b58 00010000:00010000:0.0:1787191340.227327:0:57895:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.227332:0:57895:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.227337:0:57895:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.227341:0:57895:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:0.0:1787191340.227344:0:57895:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:3.0:1787191340.227439:0:57896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57896:1874004626697856:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191340.227453:0:57896:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a358 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.227459:0:57896:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a358 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.227466:0:57896:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a358 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.227470:0:57896:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a358 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.227474:0:57896:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a358 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.227477:0:57896:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd5400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191340.227481:0:57896:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a358 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.227485:0:57896:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a358 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.227489:0:57896:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a358 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.227495:0:57896:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191340.227501:0:57896:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a358 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57896 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.227507:0:57896:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a358 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57896 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191340.227521:0:57896:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x7, status=0 req@ffff936b513b9180 x1874004626697856/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/608 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191340.227533:0:57896:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1787191340.227556:0:57896:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a351 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46055ea expref: -99 pid: 57895 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191340.227563:0:57896:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a351 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46055ea expref: -99 pid: 57895 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:3.0:1787191340.227567:0:57896:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a351 from it ffffa3fb421839a0 00010000:00010000:3.0:1787191340.227569:0:57896:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a351 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46055ea expref: -99 pid: 57895 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191340.227573:0:57896:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a351 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46055ea expref: -99 pid: 57895 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787191340.227778:0:57896:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191340.227787:0:57896:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191340.227791:0:57896:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191340.227797:0:57896:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191340.227801:0:57896:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191340.227804:0:57896:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191340.227806:0:57896:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191340.227808:0:57896:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42183b58 00010000:00010000:3.0:1787191340.227810:0:57896:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191340.227815:0:57896:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191340.227824:0:57896:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191340.227826:0:57896:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191340.227829:0:57896:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191340.227968:0:57896:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=9 00000080:00200000:0.0:1787191340.229326:0:57895:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=8 00000080:00200000:0.0:1787191340.229364:0:57895:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191340.229381:0:57895:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.229392:0:57895:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.229405:0:57895:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.229413:0:57895:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191340.229418:0:57895:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191340.229421:0:57895:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191340.229427:0:57895:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42163bf8 00010000:00010000:0.0:1787191340.229431:0:57895:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.229439:0:57895:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.229451:0:57895:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.229455:0:57895:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191340.229459:0:57895:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.229463:0:57895:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:0.0:1787191340.229466:0:57895:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:0.0:1787191340.229470:0:57895:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b49563c80, open_flags a141, mode 81b6 opened 0 00000080:00200000:0.0:1787191340.229478:0:57895:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:0.0:1787191340.229497:0:57895:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xce:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:0.0:1787191340.229510:0:57895:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a351 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e46055ea expref: -99 pid: 57895 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191340.229570:0:57895:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a351 lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46055ea expref: -99 pid: 57895 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191340.229576:0:57895:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191340.229580:0:57895:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a351 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46055ea expref: -99 pid: 57895 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191340.230214:0:57895:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a35f lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.230225:0:57895:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a35f lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191340.230238:0:57895:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191340.230251:0:57895:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477480 x1874004626698112/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191340.230262:0:57895:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a35f lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191340.230286:0:57895:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57895:1874004626698112:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191340.230428:0:57895:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.233889:0:57895:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57895:1874004626698112:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191340.233920:0:57895:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a35f lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460561b expref: -99 pid: 57895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.233958:0:57895:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a35f lrc: 4/0,1 mode: --/PR res: [0x200000405:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460561b expref: -99 pid: 57895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.233966:0:57895:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a35f lrc: 4/0,1 mode: --/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460561b expref: -99 pid: 57895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.233978:0:57895:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a35f lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460561b expref: -99 pid: 57895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.233989:0:57895:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a35f lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460561b expref: -99 pid: 57895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.234003:0:57895:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a35f lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460561b expref: -99 pid: 57895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.234011:0:57895:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a35f lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460561b expref: -99 pid: 57895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.234019:0:57895:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a35f lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460561b expref: -99 pid: 57895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191340.234032:0:57895:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b6a477480 x1874004626698112/t8589936882(8589936882) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191340.234056:0:57895:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477480 x1874004626698112/t8589936882(8589936882) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191340.234068:0:57895:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a35f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460561b expref: -99 pid: 57895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.234077:0:57895:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/206 (0 0) 00000080:00200000:0.0:1787191340.234082:0:57895:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191340.234094:0:57895:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:0.0:1787191340.234147:0:57895:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xce:0x0](ffff936b5396d348) 00000080:00200000:0.0:1787191340.234155:0:57895:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xce:0x0], updating i_size 0 00000080:00200000:0.0:1787191340.234188:0:57895:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xce:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1787191340.234192:0:57895:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xce:0x0](ffff936b5396d348) 00000080:00010000:0.0:1787191340.234195:0:57895:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xce:0x0](ffff936b5396d348) for lock 0xe5129dc88483a35f 00000080:00010000:0.0:1787191340.234203:0:57895:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xce:0x0](ffff936b5396d348) 00000080:00200008:0.0:1787191340.234213:0:57895:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xce:0x0](ffff936b5396d348), flags 120501 00000002:00100000:0.0:1787191340.234233:0:57895:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477480 x1874004626698112/t8589936882(8589936882) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191340.234262:0:57895:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a35f from it ffff936b530f5b40 00010000:00010000:0.0:1787191340.234266:0:57895:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a35f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460561b expref: -99 pid: 57895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.234275:0:57895:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a35f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460561b expref: -99 pid: 57895 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191340.234298:0:57895:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xce:0x0](ffff936b5396d348), inode mode 81a4 mask 40 00000080:00200000:0.0:1787191340.234409:0:57895:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xce:0x0](ffff936b5396d348), inode mode 81a4 mask 2 00000080:00200000:0.0:1787191340.234420:0:57895:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xce:0x0](ffff936b5396d348), xattr lov 00000002:00010000:0.0:1787191340.234436:0:57895:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xce:0x0]) in obj [0x200000405:0xce:0x0], intent: open flags 040000002 00010000:00010000:0.0:1787191340.234479:0:57895:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a366 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.234486:0:57895:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a366 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191340.234496:0:57895:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191340.234502:0:57895:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474e00 x1874004626698368/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191340.234510:0:57895:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a366 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191340.234528:0:57895:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57895:1874004626698368:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191340.234678:0:57895:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00000100:00100000:3.0:1787191340.240402:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191340.240443:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634896640 00000100:00100000:3.0:1787191340.240451:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634896640 00000100:00100000:3.0:1787191340.240497:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1362 00000100:00100000:3.0:1787191340.240508:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634896640:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191340.240525:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a35f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e460561b expref: -99 pid: 57895 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191340.240612:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191340.240620:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634896640:12345-192.168.202.101@tcp:104: Request processed in 114us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191340.240628:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1362 00000080:00200000:2.0:1787191340.240763:0:57897:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191340.240790:0:57897:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191340.240805:0:57897:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191340.240818:0:57897:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191340.240827:0:57897:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191340.240865:0:57897:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191340.240869:0:57897:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191340.240876:0:57897:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4221bbf8 00010000:00010000:2.0:1787191340.240880:0:57897:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191340.240889:0:57897:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191340.240905:0:57897:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191340.240913:0:57897:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191340.240920:0:57897:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191340.240925:0:57897:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:2.0:1787191340.240929:0:57897:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xce:0x0](ffff936b5396d348), inode mode 81a4 mask 44 00000080:00200008:2.0:1787191340.240934:0:57897:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xce:0x0](ffff936b5396d348), flags 154400 00010000:00010000:1.0:1787191340.241053:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191340.241061:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a35f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e460561b expref: -99 pid: 57895 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.241069:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cae200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191340.241073:0:57627:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a35f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e460561b expref: -99 pid: 57895 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.241082:0:57627:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a35f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e460561b expref: -99 pid: 57895 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.241091:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a35f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e460561b expref: -99 pid: 57895 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191340.241109:0:57627:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xce:0x0]: losing layout lock 00010000:00010000:1.0:1787191340.241150:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a35f lrc: 2/0,0 mode: --/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e460561b expref: -99 pid: 57895 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.241161:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191340.241194:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a35f lrc: 1/0,0 mode: --/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e460561b expref: -99 pid: 57895 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.241201:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a35f lrc: 0/0,0 mode: --/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e460561b expref: -99 pid: 57895 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.241213:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191340.241214:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191340.241216:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191340.241225:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787191340.241238:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626698496:192.168.202.101@tcp:103:ldlm_bl.0 00000002:00010000:2.0:1787191340.241335:0:57897:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xce:0x0]) in obj [0x200000405:0xce:0x0], intent: open flags 0100240114401 00010000:00010000:2.0:1787191340.241374:0:57897:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a36d lrc: 3/1,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.241382:0:57897:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a36d lrc: 3/1,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57897 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191340.241666:0:57897:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:2.0:1787191340.241676:0:57897:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8700 x1874004626698752/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191340.241686:0:57897:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a36d lrc: 3/1,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191340.241703:0:57897:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57897:1874004626698752:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191340.241828:0:57897:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.244533:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626698496:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191340.247448:0:57897:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57897:1874004626698752:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191340.247472:0:57897:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a36d lrc: 4/1,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.247498:0:57897:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a36d lrc: 4/1,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.247506:0:57897:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a36d lrc: 4/1,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.247513:0:57897:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a36d lrc: 3/0,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.247528:0:57897:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a36d lrc: 4/0,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.247535:0:57897:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd5200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191340.247540:0:57897:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a36d lrc: 4/0,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.247548:0:57897:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a36d lrc: 4/0,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.247556:0:57897:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a36d lrc: 5/0,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.247563:0:57897:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191340.247570:0:57897:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a36d lrc: 3/0,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.247578:0:57897:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a36d lrc: 0/0,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57897 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191340.247599:0:57897:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b513b8700 x1874004626698752/t8589936883(8589936883) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191340.247614:0:57897:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b8700 x1874004626698752/t8589936883(8589936883) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191340.247627:0:57897:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xce:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1787191340.247647:0:57897:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xce:0x0], updating i_size 0 00000002:00100000:2.0:1787191340.247671:0:57897:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b8700 x1874004626698752/t8589936883(8589936883) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191340.247861:0:57897:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xce:0x0](ffff936b5396d348), inode mode 81a4 mask 4 00000080:00200000:2.0:1787191340.247870:0:57897:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xce:0x0](ffff936b5396d348), xattr lov 00000080:00200008:2.0:1787191340.247914:0:57897:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xce:0x0](ffff936b5396d348), flags 154000 00000002:00100000:2.0:1787191340.248175:0:57897:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513b8700 x1874004626698752/t8589936883(8589936883) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191356 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191340.248186:0:57897:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:2.0:1787191340.248191:0:57897:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8e00 x1874004626699008/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191340.248211:0:57897:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57897:1874004626699008:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191340.248294:0:57897:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191340.250620:0:57897:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57897:1874004626699008:192.168.202.101@tcp:35:lfs.0 00000002:00100000:2.0:1787191340.250653:0:57897:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513b8700 x1874004626698752/t8589936883(8589936883) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191340.251043:0:57897:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191340.251062:0:57897:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191340.251078:0:57897:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191340.251092:0:57897:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191340.251099:0:57897:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191340.251104:0:57897:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191340.251107:0:57897:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191340.251115:0:57897:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4221bbf8 00010000:00010000:2.0:1787191340.251119:0:57897:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191340.251127:0:57897:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191340.251140:0:57897:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191340.251147:0:57897:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191340.251152:0:57897:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191340.251163:0:57897:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b44d05080, open_flags d900, mode 0 opened 0 00000080:00200000:2.0:1787191340.251169:0:57897:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:2.0:1787191340.251183:0:57897:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:2.0:1787191340.251291:0:57897:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a374 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.251299:0:57897:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a374 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57897 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191340.251311:0:57897:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:2.0:1787191340.251318:0:57897:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8a80 x1874004626699264/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191340.251327:0:57897:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a374 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191340.251345:0:57897:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57897:1874004626699264:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191340.252338:0:57897:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.254044:0:57895:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57895:1874004626698368:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191340.254065:0:57895:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a366 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.254079:0:57895:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a366 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.254086:0:57895:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a366 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.254094:0:57895:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a366 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.254107:0:57895:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a366 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.254113:0:57895:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44caf000 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191340.254117:0:57895:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a366 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.254125:0:57895:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a366 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.254131:0:57895:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a366 lrc: 5/0,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.254138:0:57895:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191340.254144:0:57895:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a366 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.254150:0:57895:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a366 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57895 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191340.254174:0:57895:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b6a474e00 x1874004626698368/t8589936884(8589936884) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191340.254188:0:57895:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474e00 x1874004626698368/t8589936884(8589936884) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191340.254203:0:57895:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xce:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787191340.254247:0:57895:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xce:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1787191340.254256:0:57895:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xce:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191340.254306:0:57895:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xce:0x0], updating i_size 0 00000002:00100000:0.0:1787191340.254324:0:57895:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474e00 x1874004626698368/t8589936884(8589936884) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191340.254359:0:57895:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a474e00 x1874004626698368/t8589936884(8589936884) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191340.254368:0:57895:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191340.254374:0:57895:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474000 x1874004626699520/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191340.254436:0:57895:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57895:1874004626699520:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191340.254594:0:57895:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00000100:00100000:2.0:1787191340.257566:0:57897:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57897:1874004626699264:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191340.257594:0:57897:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a374 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605668 expref: -99 pid: 57897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.257623:0:57897:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a374 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605668 expref: -99 pid: 57897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.257632:0:57897:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a374 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605668 expref: -99 pid: 57897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.257644:0:57897:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a374 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605668 expref: -99 pid: 57897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.257656:0:57897:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a374 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605668 expref: -99 pid: 57897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.257670:0:57897:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a374 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605668 expref: -99 pid: 57897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.257678:0:57897:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a374 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605668 expref: -99 pid: 57897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.257685:0:57897:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a374 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605668 expref: -99 pid: 57897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191340.257697:0:57897:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b513b8a80 x1874004626699264/t8589936886(8589936886) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191340.257709:0:57897:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b8a80 x1874004626699264/t8589936886(8589936886) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191340.257723:0:57897:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a374 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605668 expref: -99 pid: 57897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191340.257738:0:57897:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a374 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605668 expref: -99 pid: 57897 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.257750:0:57897:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/206 (0 0) 00000080:00200000:2.0:1787191340.257756:0:57897:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191340.257814:0:57897:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xce:0x0](ffff936b5396d348): rc = 0 00000080:00200000:2.0:1787191340.258553:0:57897:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xce:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:2.0:1787191340.258563:0:57897:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xce:0x0](ffff936b5396d348) for lock 0xe5129dc88483a374 00000080:00010000:2.0:1787191340.258578:0:57897:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xce:0x0](ffff936b5396d348) 00000080:00200008:2.0:1787191340.258593:0:57897:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xce:0x0](ffff936b5396d348), flags 154400 00000002:00100000:2.0:1787191340.258619:0:57897:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b8a80 x1874004626699264/t8589936886(8589936886) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1787191340.258666:0:57897:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a374 from it ffff936b60dc4c60 00010000:00010000:2.0:1787191340.258672:0:57897:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a374 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605668 expref: -99 pid: 57897 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.258683:0:57897:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a374 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605668 expref: -99 pid: 57897 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191340.258709:0:57897:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xce:0x0](ffff936b5396d348), inode mode 81a4 mask 44 00000080:00200000:2.0:1787191340.258774:0:57897:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xce:0x0](ffff936b5396d348), inode mode 81a4 mask 4 00000080:00200000:2.0:1787191340.258782:0:57897:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xce:0x0](ffff936b5396d348), xattr lov 00000080:00200008:2.0:1787191340.258817:0:57897:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xce:0x0](ffff936b5396d348), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191340.258823:0:57897:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xce:0x0](ffff936b5396d348),name=f70.sanity-flr 00000002:00010000:2.0:1787191340.259045:0:57897:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xce:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191340.259057:0:57897:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a374 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605668 expref: -99 pid: 57897 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191340.259070:0:57897:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a374 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605668 expref: -99 pid: 57897 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191340.259077:0:57897:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191340.259082:0:57897:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xce:0x0](ffff936b5396d348) 00000080:00010000:2.0:1787191340.259085:0:57897:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xce:0x0](ffff936b5396d348) for lock 0xe5129dc88483a374 00000080:00010000:2.0:1787191340.259088:0:57897:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a374 from it ffffa3fb4221bcd8 00000100:00100000:0.0:1787191340.259092:0:57895:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57895:1874004626699520:192.168.202.101@tcp:35:lfs.0 00010000:00010000:2.0:1787191340.259092:0:57897:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a374 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605668 expref: -99 pid: 57897 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191340.259099:0:57897:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a374 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605668 expref: -99 pid: 57897 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191340.259117:0:57897:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xce:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:2.0:1787191340.259126:0:57897:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xce:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191340.259129:0:57897:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191340.259132:0:57897:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xce:0x0] 00000008:00010000:2.0:1787191340.259151:0:57897:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191340.259154:0:57897:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1230, osc lock ffff936b44e62980, flags 0x400000400001002 00010000:00010000:2.0:1787191340.259200:0:57897:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc88483a37b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.259210:0:57897:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc88483a37b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.259222:0:57897:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b513b9c00 x1874004626699648/t0(0) o101->lustre-OST0000-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000002:00100000:1.0:1787191340.259277:0:57895:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a474e00 x1874004626698368/t8589936884(8589936884) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787191340.259279:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626699648:192.168.202.101@tcp:101:lfs.0 00000080:00200008:1.0:1787191340.259322:0:57895:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xce:0x0](ffff936b5396d348), flags 100001 00000002:00100000:1.0:1787191340.259354:0:57895:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a477480 x1874004626698112/t8589936882(8589936882) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191356 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191340.259364:0:57895:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191340.259369:0:57895:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8700 x1874004626699904/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191340.259384:0:57895:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57895:1874004626699904:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191340.259466:0:57895:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893480 going to sleep for 11 seconds 00000020:00200000:2.0:1787191340.259700:0:57897:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:1.0:1787191340.261749:0:57895:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57895:1874004626699904:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191340.261785:0:57895:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a477480 x1874004626698112/t8589936882(8589936882) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191340.264589:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191340.264619:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191340.264636:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191340.264651:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191340.264659:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191340.264667:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191340.264670:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191340.264677:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:2.0:1787191340.264681:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191340.264689:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191340.264706:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191340.264713:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191340.264720:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191340.264727:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:2.0:1787191340.264732:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xce:0x0](ffff936b5396d348), inode mode 81a4 mask 42 00000080:00200008:2.0:1787191340.264741:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xce:0x0](ffff936b5396d348), flags 101101 00000002:00010000:2.0:1787191340.264757:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xce:0x0]) in obj [0x200000405:0xce:0x0], intent: open|creat flags 04240101102 00010000:00010000:2.0:1787191340.264770:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a374 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4605668 expref: -99 pid: 57897 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191340.264788:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xce:0x0]: losing layout lock 00010000:00010000:2.0:1787191340.264859:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a374 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605668 expref: -99 pid: 57897 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191340.264866:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191340.264870:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a374 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605668 expref: -99 pid: 57897 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191340.264903:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a382 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xce:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.264910:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a382 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191340.264921:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191340.264934:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513ba680 x1874004626700160/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191340.264944:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a382 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191340.264977:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626700160:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191340.265213:0:2392:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc88483a37b lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.265232:0:2392:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc88483a37b lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605676 expref: -99 pid: 57897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.265246:0:2392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc88483a37b lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605676 expref: -99 pid: 57897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191340.265259:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f9c0 going to sleep for 11 seconds 00010000:00010000:3.0:1787191340.265262:0:2392:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc88483a37b lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605676 expref: -99 pid: 57897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191340.265278:0:2392:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc88483a37b lrc: 5/2,0 mode: PR/PR res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605676 expref: -99 pid: 57897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1787191340.265289:0:2392:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1787191340.267689:0:2392:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc88483a37b lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605676 expref: -99 pid: 57897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.267710:0:2392:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc88483a37b lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605676 expref: -99 pid: 57897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.267718:0:2392:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc88483a37b lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605676 expref: -99 pid: 57897 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.267726:0:2392:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc88483a37b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605676 expref: -99 pid: 57897 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1787191340.267749:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626699648:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191340.268120:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626700160:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191340.268152:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a382 lrc: 4/0,1 mode: --/CW res: [0x200000405:0xce:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605684 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.268165:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a382 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xce:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605684 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.268177:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a382 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xce:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605684 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191340.268194:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x200002b, status=0 req@ffff936b513ba680 x1874004626700160/t8589936889(8589936889) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191340.268208:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513ba680 x1874004626700160/t8589936889(8589936889) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191340.268221:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a382 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xce:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605684 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191340.268235:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a382 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xce:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605684 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.268246:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 8 res 8589935621/206 (0 0) 00000080:00200000:1.0:1787191340.268251:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000405:0xce:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787191340.268311:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xce:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:1.0:1787191340.268316:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xce:0x0](ffff936b5396d348) for lock 0xe5129dc88483a382 00000080:00010000:1.0:1787191340.268323:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a382 from it ffffa3fb41cabbf0 00010000:00010000:1.0:1787191340.268327:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a382 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xce:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605684 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.268335:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a382 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xce:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605684 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000002:00100000:1.0:1787191340.268359:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513ba680 x1874004626700160/t8589936889(8589936889) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191340.268430:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xce:0x0], intent: getxattr flags 0 00010000:00010000:1.0:1787191340.268471:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a389 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xce:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.268478:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a389 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xce:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.268487:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a389 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xce:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191340.268507:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aaa00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626700288:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191340.268628:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893480 going to sleep for 11 seconds 00000080:00200000:2.0:1787191340.270882:0:57897:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xce:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191340.270891:0:57897:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51655e10 (ffff936b465ccf38/0) at cl_lock_release():245 00000020:00010000:2.0:1787191340.270897:0:57897:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51655e10 (ffff936b465ccf38/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191340.270902:0:57897:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1230 (ffff936b465cc518/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191340.270907:0:57897:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51655e10 (ffff936b465ccf38/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191340.270910:0:57897:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1230 (ffff936b465ccf38/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191340.270926:0:57897:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xce:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191340.270991:0:57897:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xce:0x0](ffff936b5396d348), flags 154000 00000002:00100000:2.0:1787191340.271065:0:57897:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513b8a80 x1874004626699264/t8589936886(8589936886) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191340.271076:0:57897:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191340.271081:0:57897:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8000 x1874004626700544/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191340.271103:0:57897:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57897:1874004626700544:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191340.271181:0:57897:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787191340.275110:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aaa00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626700288:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191340.275143:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a389 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xce:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605699 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.275160:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a389 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605699 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.275171:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a389 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605699 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191340.275185:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b453aaa00 x1874004626700288/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191340.275196:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a389 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605699 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.275205:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/206 (0 0) 00000080:00200000:1.0:1787191340.275212:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xce:0x0] suppgids 0 -1: rc 0 00000080:00010000:1.0:1787191340.275236:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xce:0x0](ffff936b5396d348) for lock 0xe5129dc88483a389 00000080:00010000:1.0:1787191340.275244:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a389 from it ffffa3fb41caba38 00010000:00010000:1.0:1787191340.275248:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a389 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605699 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.275257:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a389 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605699 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:1.0:1787191340.275290:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xce:0x0](ffff936b5396d348) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191340.000000000, mtime 1787191340.000000000, ctime 1787191340.000000000 00010000:00010000:1.0:1787191340.275319:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a382 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xce:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4605684 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191340.275339:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xce:0x0]: losing layout lock 00010000:00010000:1.0:1787191340.275378:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a382 lrc: 1/0,0 mode: --/CW res: [0x200000405:0xce:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605684 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.275385:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191340.275388:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a382 lrc: 0/0,0 mode: --/CW res: [0x200000405:0xce:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605684 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1787191340.275620:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 36, max 7 00000100:00100000:1.0:1787191340.275627:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453aaa00 x1874004626700800/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787191340.275649:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aaa00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626700800:192.168.202.101@tcp:36:bash.0 00000100:00100000:1.0:1787191340.275719:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893480 going to sleep for 11 seconds 00000100:00100000:1.0:1787191340.277423:0:57897:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57897:1874004626700544:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191340.277449:0:57897:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513b8a80 x1874004626699264/t8589936886(8589936886) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191340.277553:0:57897:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191340.277570:0:57897:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191340.277583:0:57897:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191340.277596:0:57897:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191340.277604:0:57897:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191340.277615:0:57897:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191340.277619:0:57897:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191340.277625:0:57897:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4221bbf8 00010000:00010000:1.0:1787191340.277629:0:57897:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191340.277637:0:57897:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191340.277651:0:57897:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191340.277658:0:57897:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191340.277664:0:57897:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191340.277677:0:57897:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b484dfe00, open_flags d902, mode 0 opened 0 00000080:00200000:1.0:1787191340.277684:0:57897:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:1.0:1787191340.277697:0:57897:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154403 00010000:00010000:1.0:1787191340.277741:0:57897:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a390 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.277749:0:57897:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a390 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57897 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191340.277760:0:57897:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191340.277766:0:57897:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8380 x1874004626701056/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191340.277774:0:57897:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a390 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191340.277791:0:57897:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57897:1874004626701056:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191340.277961:0:57897:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191340.281296:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aaa00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626700800:192.168.202.101@tcp:36:bash.0 00000080:00200000:1.0:1787191340.281344:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:1.0:1787191340.281351:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xce:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00010000:00010000:1.0:1787191340.281367:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/206 (0 0) 00000080:00010000:1.0:1787191340.281376:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xce:0x0](ffff936b5396d348) 00000002:00010000:1.0:1787191340.281385:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xce:0x0]) in obj [0x200000405:0xce:0x0], intent: layout flags 0 00010000:00010000:1.0:1787191340.281438:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a397 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.281447:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a397 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.281457:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a397 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191340.281475:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626701184:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191340.281551:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893480 going to sleep for 11 seconds 00000100:00100000:3.0:1787191340.281782:0:57897:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57897:1874004626701056:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191340.281796:0:57897:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a390 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46056bc expref: -99 pid: 57897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.281818:0:57897:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a390 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46056bc expref: -99 pid: 57897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.281825:0:57897:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a390 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46056bc expref: -99 pid: 57897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.281865:0:57897:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a390 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46056bc expref: -99 pid: 57897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.281878:0:57897:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a390 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46056bc expref: -99 pid: 57897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.281889:0:57897:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a390 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46056bc expref: -99 pid: 57897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.281896:0:57897:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a390 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46056bc expref: -99 pid: 57897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.281903:0:57897:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a390 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46056bc expref: -99 pid: 57897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191340.281914:0:57897:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b453a8380 x1874004626701056/t8589936893(8589936893) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191340.281927:0:57897:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8380 x1874004626701056/t8589936893(8589936893) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191340.281940:0:57897:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a390 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46056bc expref: -99 pid: 57897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191340.282028:0:57897:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a390 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46056bc expref: -99 pid: 57897 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.282050:0:57897:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/206 (0 0) 00000080:00200000:2.0:1787191340.282054:0:57897:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191340.282094:0:57897:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xce:0x0](ffff936b5396d348): rc = 0 00000080:00200000:2.0:1787191340.282109:0:57897:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xce:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:2.0:1787191340.282115:0:57897:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xce:0x0](ffff936b5396d348) for lock 0xe5129dc88483a390 00000080:00010000:2.0:1787191340.282139:0:57897:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xce:0x0](ffff936b5396d348) 00000080:00200008:2.0:1787191340.282155:0:57897:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xce:0x0](ffff936b5396d348), flags 154402 00000002:00100000:2.0:1787191340.282174:0:57897:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8380 x1874004626701056/t8589936893(8589936893) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191340.282200:0:57897:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a8380 x1874004626701056/t8589936893(8589936893) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191340.282210:0:57897:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191340.282215:0:57897:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb480 x1874004626701440/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191340.282228:0:57897:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57897:1874004626701440:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191340.282276:0:57897:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787191340.284465:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626701184:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191340.284496:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a397 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xce:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46056ca expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.284511:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a397 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xce:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46056ca expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191340.284525:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b453a9180 x1874004626701184/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191340.284536:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a397 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xce:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46056ca expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191340.284551:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a397 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xce:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46056ca expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.284561:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/206 (0 0) 00000080:00200000:1.0:1787191340.284567:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xce:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191340.284589:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xce:0x0](ffff936b5396d348) for lock 0xe5129dc88483a397 00000080:00010000:1.0:1787191340.284597:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a397 from it ffffa3fb41cab8c8 00010000:00010000:1.0:1787191340.284601:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a397 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xce:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46056ca expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.284622:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a397 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xce:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46056ca expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.284656:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a390 lrc: 3/2,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46056bc expref: -99 pid: 57897 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.284669:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a390 lrc: 3/2,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46056bc expref: -99 pid: 57897 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000080:00010000:1.0:1787191340.284678:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xce:0x0](000000002d349481) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a390 lrc: 4/2,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46056bc expref: -99 pid: 57897 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.284689:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a390 lrc: 4/2,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46056bc expref: -99 pid: 57897 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.284697:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a390 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46056bc expref: -99 pid: 57897 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00020000:00200000:1.0:1787191340.284715:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xce:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:1.0:1787191340.284724:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xce:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191340.284729:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xce:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:1.0:1787191340.284739:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xce:0x0](ffff936b5396d348) 00000002:00010000:1.0:1787191340.284750:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xce:0x0]) in obj [0x200000405:0xce:0x0], intent: layout flags 02 00010000:00010000:1.0:1787191340.284765:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a397 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xce:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e46056ca expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.284781:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a390 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46056bc expref: -99 pid: 57897 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.284813:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a397 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46056ca expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.284819:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191340.284823:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a397 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46056ca expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.285050:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a39e lrc: 3/0,1 mode: --/EX res: [0x200000405:0xce:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.285059:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a39e lrc: 3/0,1 mode: --/EX res: [0x200000405:0xce:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191340.285071:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:1.0:1787191340.285078:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9180 x1874004626701696/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191340.285088:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a39e lrc: 3/0,1 mode: --/EX res: [0x200000405:0xce:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191340.285107:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626701696:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191340.285961:0:57897:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57897:1874004626701440:192.168.202.101@tcp:35:lfs.0 00000002:00100000:2.0:1787191340.285987:0:57897:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a8380 x1874004626701056/t8589936893(8589936893) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787191340.286061:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893480 going to sleep for 11 seconds 00000080:00010000:2.0:1787191340.286072:0:57897:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a390 from it ffff936b5339f4e0 00010000:00010000:2.0:1787191340.286080:0:57897:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a390 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46056bc expref: -99 pid: 57897 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.286091:0:57897:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a390 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46056bc expref: -99 pid: 57897 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191340.286118:0:57897:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xce:0x0](ffff936b5396d348), inode mode 81a4 mask 46 00000080:00200080:2.0:1787191340.286225:0:57897:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xce:0x0](ffff936b5396d348) cmd=800466af arg=7fff595618cc 00000080:00200080:2.0:1787191340.286244:0:57897:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xce:0x0](ffff936b5396d348) cmd=80086601 arg=7fff59561868 00000100:00100000:2.0:1787191340.286274:0:57897:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57897:1874004626701824:192.168.202.101@tcp:33:lfs.0 00000100:00100000:3.0:1787191340.288582:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191340.288632:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634896768 00000100:00100000:3.0:1787191340.288643:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634896768 00000100:00100000:3.0:1787191340.288697:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1363 00000100:00100000:3.0:1787191340.288707:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634896768:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191340.288726:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a390 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46056bc expref: -99 pid: 57897 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191340.288808:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191340.288815:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634896768:12345-192.168.202.101@tcp:104: Request processed in 110us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191340.288823:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1363 00010000:00010000:1.0:1787191340.289101:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191340.289108:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a390 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46056bc expref: -99 pid: 57897 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.289131:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191340.289136:0:40930:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a390 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46056bc expref: -99 pid: 57897 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.289145:0:40930:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a390 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46056bc expref: -99 pid: 57897 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.289154:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a390 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e46056bc expref: -99 pid: 57897 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191340.289175:0:40930:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xce:0x0]: losing layout lock 00010000:00010000:1.0:1787191340.289216:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a390 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46056bc expref: -99 pid: 57897 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.289223:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191340.289254:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a390 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46056bc expref: -99 pid: 57897 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.289262:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a390 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46056bc expref: -99 pid: 57897 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.289277:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191340.289279:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191340.289280:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191340.289405:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626701952:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191340.289932:0:57897:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787191340.292932:0:57897:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57897:1874004626701824:192.168.202.101@tcp:33:lfs.0 00000080:00200080:2.0:1787191340.292987:0:57897:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xce:0x0](ffff936b5396d348) cmd=c00c66f3 arg=7fff59561854 00000080:00200008:2.0:1787191340.293139:0:57897:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xce:0x0](ffff936b5396d348), flags 154002 00000100:00100000:0.0:1787191340.294224:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626701952:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191340.301420:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191340.301454:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191340.301473:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191340.301534:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634897536 00000100:00100000:3.0:1787191340.301542:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634897536 00000100:00100000:3.0:1787191340.301577:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634897664 00000100:00100000:3.0:1787191340.301580:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634897664 00000100:00100000:3.0:1787191340.301590:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634897792 00000100:00100000:3.0:1787191340.301593:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634897792 00000100:00100000:3.0:1787191340.301607:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1364 00000100:00100000:3.0:1787191340.301627:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+5:8422:x1874004634897536:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191340.301646:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080030000 nid: local remote: 0x7130d520e4605549 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191340.301721:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191340.301727:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+5:8422:x1874004634897536:12345-192.168.202.101@tcp:104: Request processed in 102us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191340.301735:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1364 00000100:00100000:3.0:1787191340.301752:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1365 00000100:00100000:3.0:1787191340.301758:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8420:x1874004634897664:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191340.301766:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483a32e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4605573 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191340.301792:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787191340.301797:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8420:x1874004634897664:12345-192.168.202.101@tcp:104: Request processed in 40us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191340.301804:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1365 00000100:00100000:3.0:1787191340.301815:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1366 00000100:00100000:3.0:1787191340.301821:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8720:x1874004634897792:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191340.301828:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a304 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4605503 expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191340.301878:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787191340.301884:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8720:x1874004634897792:12345-192.168.202.101@tcp:104: Request processed in 63us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191340.301890:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1366 00010000:00010000:1.0:1787191340.302139:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787191340.302148:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080030000 nid: local remote: 0x7130d520e4605549 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191340.302162:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd4600 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191340.302168:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428480030000 nid: local remote: 0x7130d520e4605549 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191340.302216:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480030020 nid: local remote: 0x7130d520e4605549 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191340.302224:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191340.302242:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480030020 nid: local remote: 0x7130d520e4605549 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191340.302250:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000956c939e/0xe5129dc88483a320 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480030020 nid: local remote: 0x7130d520e4605549 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191340.302266:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787191340.302270:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483a32e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4605573 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.302278:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030200 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191340.302281:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483a32e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4605573 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.302301:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483a32e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4605573 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.302313:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191340.302320:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483a32e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4605573 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.302322:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191340.302332:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483a32e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4605573 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.302338:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a304 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4605503 expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.302346:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cafe00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191340.302347:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191340.302350:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a304 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e4605503 expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.302351:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191340.302354:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191340.302374:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a304 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4605503 expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.302380:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191340.302385:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a304 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4605503 expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.302390:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a304 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4605503 expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1787191340.302390:0:57570:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589936895 gen 1 00010000:00010000:0.0:1787191340.302407:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191340.302409:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191340.302411:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191340.302418:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191340.302429:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626702080:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191340.302480:0:57570:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b513ba680 x1874004626700160/t8589936889(8589936889) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787191340.302485:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626702336:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191340.302499:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626701696:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191340.302518:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a39e lrc: 4/0,1 mode: --/EX res: [0x200000405:0xce:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46056d8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191340.302528:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1787191340.302530:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a39e lrc: 4/0,1 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46056d8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191340.302537:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626702208:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787191340.302545:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a39e lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xce:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46056d8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.302559:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a39e lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xce:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46056d8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.302576:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a39e lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xce:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46056d8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.302584:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a39e lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xce:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46056d8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.302591:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a39e lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xce:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46056d8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191340.302600:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b453a9180 x1874004626701696/t8589936895(8589936895) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191340.302616:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a39e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xce:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46056d8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191340.302627:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a39e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xce:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46056d8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.302638:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/206 (0 0) 00000080:00200000:1.0:1787191340.302644:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xce:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191340.302659:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xce:0x0](ffff936b5396d348) for lock 0xe5129dc88483a39e 00000080:00010000:1.0:1787191340.302668:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a39e from it ffffa3fb41cab930 00010000:00010000:1.0:1787191340.302672:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a39e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xce:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46056d8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.302681:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a39e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xce:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46056d8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191340.302703:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:1.0:1787191340.302710:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xce:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:1.0:1787191340.302724:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a39e lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xce:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46056d8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.302732:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a39e lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xce:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46056d8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:1.0:1787191340.302741:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xce:0x0](000000002d349481) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a39e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xce:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46056d8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.302777:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a39e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xce:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46056d8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.302785:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a39e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xce:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46056d8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191340.302799:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xce:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1787191340.302811:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xce:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191340.302815:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191340.302821:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191340.302859:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191340.302881:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xce:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:1.0:1787191340.302893:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a39e lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xce:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46056d8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191340.302903:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a39e lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xce:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46056d8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:1.0:1787191340.302911:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xce:0x0](000000002d349481) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a39e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xce:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46056d8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191340.302931:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xce:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00020000:00200000:1.0:1787191340.302936:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xce:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191340.302939:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191340.302941:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191340.302945:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191340.302951:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xce:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:1.0:1787191340.302962:0:57570:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc88483a37b lrc: 1/0,0 mode: PR/PR res: [0x280000401:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605676 expref: -99 pid: 57897 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191340.303047:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xce:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:1.0:1787191340.303053:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a39e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xce:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46056d8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191340.303060:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a39e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xce:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46056d8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00020000:00200000:1.0:1787191340.303071:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xce:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:1.0:1787191340.303074:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xce:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191340.303077:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191340.303083:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191340.303093:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191340.303096:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:1.0:1787191340.303109:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:1.0:1787191340.303113:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b628934b0, osc lock ffff936b46836130, flags 0x80000000 00000008:00010000:1.0:1787191340.303118:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:1.0:1787191340.303120:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b628934f0, osc lock ffff936b46837c80, flags 0x80000000 00010000:00010000:1.0:1787191340.303133:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b52377800 type 11 mode 2 res 10737419265/444 (0 1048575) 00010000:00010000:1.0:1787191340.303161:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.303170:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.303179:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191340.303196:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626702464:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191340.303250:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893cc0 going to sleep for 11 seconds 00000080:00200000:2.0:1787191340.305433:0:57898:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191340.305466:0:57898:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191340.305484:0:57898:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191340.305500:0:57898:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191340.305508:0:57898:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191340.305515:0:57898:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191340.305519:0:57898:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191340.305526:0:57898:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42163bf8 00010000:00010000:2.0:1787191340.305530:0:57898:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191340.305539:0:57898:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191340.305554:0:57898:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191340.305561:0:57898:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191340.305567:0:57898:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191340.305580:0:57898:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b62b06f00, open_flags d900, mode 0 opened 0 00000080:00200000:2.0:1787191340.305586:0:57898:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:2.0:1787191340.305602:0:57898:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:2.0:1787191340.305652:0:57898:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a3ac lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.305660:0:57898:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a3ac lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57898 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191340.305673:0:57898:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191340.305686:0:57898:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb480 x1874004626702720/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191340.305696:0:57898:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a3ac lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57898 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191340.305715:0:57898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57898:1874004626702720:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191340.306100:0:57898:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787191340.307089:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191340.307216:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634898048 00000100:00100000:2.0:1787191340.307224:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634898048 00000100:00100000:2.0:1787191340.307312:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1367 00000100:00100000:2.0:1787191340.307322:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8419:x1874004634898048:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191340.307338:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a2fd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e460550a expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191340.307400:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191340.307407:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8419:x1874004634898048:12345-192.168.202.101@tcp:104: Request processed in 87us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191340.307414:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1367 00010000:00010000:1.0:1787191340.307429:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191340.307439:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a2fd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e460550a expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.307447:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cae400 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191340.307452:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a2fd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e460550a expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.307496:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a2fd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e460550a expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.307503:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191340.307531:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a2fd lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e460550a expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.307545:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a2fd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e460550a expref: -99 pid: 57893 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.307566:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191340.307568:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191340.307570:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191340.307611:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787191340.307626:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626702848:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191340.310643:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626702080:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191340.310921:0:57898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57898:1874004626702720:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191340.310944:0:57898:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a3ac lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605710 expref: -99 pid: 57898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.310965:0:57898:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a3ac lrc: 4/1,0 mode: --/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605710 expref: -99 pid: 57898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.310973:0:57898:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a3ac lrc: 4/1,0 mode: --/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605710 expref: -99 pid: 57898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.310984:0:57898:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a3ac lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605710 expref: -99 pid: 57898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.310994:0:57898:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a3ac lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605710 expref: -99 pid: 57898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.311005:0:57898:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a3ac lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605710 expref: -99 pid: 57898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.311012:0:57898:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a3ac lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605710 expref: -99 pid: 57898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.311021:0:57898:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a3ac lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605710 expref: -99 pid: 57898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191340.311031:0:57898:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b513bb480 x1874004626702720/t8589936896(8589936896) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191340.311055:0:57898:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bb480 x1874004626702720/t8589936896(8589936896) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191340.311068:0:57898:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a3ac lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605710 expref: -99 pid: 57898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191340.311082:0:57898:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a3ac lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605710 expref: -99 pid: 57898 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.311093:0:57898:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/206 (0 0) 00000080:00200000:1.0:1787191340.311100:0:57898:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191340.311262:0:57898:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xce:0x0](ffff936b5396d348): rc = 0 00000080:00200000:1.0:1787191340.311278:0:57898:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xce:0x0]: layout version change: 4 -> 4 00000080:00010000:1.0:1787191340.311284:0:57898:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xce:0x0](ffff936b5396d348) for lock 0xe5129dc88483a3ac 00000080:00010000:1.0:1787191340.311298:0:57898:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xce:0x0](ffff936b5396d348) 00000080:00200008:1.0:1787191340.311312:0:57898:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xce:0x0](ffff936b5396d348), flags 154400 00000002:00100000:1.0:1787191340.311336:0:57898:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bb480 x1874004626702720/t8589936896(8589936896) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191340.311381:0:57898:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a3ac from it ffff936b60dc4c60 00010000:00010000:1.0:1787191340.311385:0:57898:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a3ac lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605710 expref: -99 pid: 57898 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.311398:0:57898:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a3ac lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605710 expref: -99 pid: 57898 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191340.311424:0:57898:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xce:0x0](ffff936b5396d348), inode mode 81a4 mask 44 00000080:00200000:1.0:1787191340.311536:0:57898:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xce:0x0](ffff936b5396d348), inode mode 81a4 mask 4 00000080:00200000:1.0:1787191340.311544:0:57898:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xce:0x0](ffff936b5396d348), xattr lov 00000080:00200008:1.0:1787191340.311570:0:57898:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xce:0x0](ffff936b5396d348), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191340.311576:0:57898:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xce:0x0](ffff936b5396d348),name=f70.sanity-flr 00000002:00010000:1.0:1787191340.311597:0:57898:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xce:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191340.311607:0:57898:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a3ac lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605710 expref: -99 pid: 57898 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.311619:0:57898:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a3ac lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605710 expref: -99 pid: 57898 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191340.311626:0:57898:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191340.311631:0:57898:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xce:0x0](ffff936b5396d348) 00000080:00010000:1.0:1787191340.311635:0:57898:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xce:0x0](ffff936b5396d348) for lock 0xe5129dc88483a3ac 00000080:00010000:1.0:1787191340.311638:0:57898:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a3ac from it ffffa3fb42163cd8 00010000:00010000:1.0:1787191340.311642:0:57898:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a3ac lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605710 expref: -99 pid: 57898 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.311649:0:57898:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a3ac lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605710 expref: -99 pid: 57898 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191340.311667:0:57898:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xce:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:1.0:1787191340.311679:0:57898:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xce:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191340.311682:0:57898:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191340.311685:0:57898:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xce:0x0] 00000008:00010000:1.0:1787191340.311702:0:57898:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191340.311706:0:57898:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b47d7d1b0, osc lock ffff936b46837300, flags 0x400000400001002 00010000:00010000:1.0:1787191340.311722:0:57898:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc88483a37b lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1bc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605676 expref: -99 pid: 57897 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.311732:0:57898:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc88483a37b lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605676 expref: -99 pid: 57897 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000008:00010000:1.0:1787191340.311746:0:57898:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc88483a37b lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605676 expref: -99 pid: 57897 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1787191340.311757:0:57898:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191340.311761:0:57898:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc88483a37b lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605676 expref: -99 pid: 57897 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.311770:0:57898:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc88483a37b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605676 expref: -99 pid: 57897 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1787191340.311782:0:57898:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191340.311794:0:57898:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xce:0x0] updating i_size 0 i_blocks 0 00000020:00010000:1.0:1787191340.311798:0:57898:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51654250 (ffff936b465cc6c8/0) at cl_lock_release():245 00000020:00010000:1.0:1787191340.311801:0:57898:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51654250 (ffff936b465cc6c8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191340.311804:0:57898:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7d1b0 (ffff936b47a17cf8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191340.311808:0:57898:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51654250 (ffff936b465cc6c8/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191340.311811:0:57898:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7d1b0 (ffff936b465cc6c8/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191340.311821:0:57898:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xce:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:3.0:1787191340.311874:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000080:00200008:1.0:1787191340.311940:0:57898:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xce:0x0](ffff936b5396d348), flags 154000 00000002:00100000:1.0:1787191340.311984:0:57898:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513bb480 x1874004626702720/t8589936896(8589936896) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191340.311994:0:57898:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191340.311999:0:57898:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8700 x1874004626703104/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191340.312019:0:57898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57898:1874004626703104:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191340.312103:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626702848:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191340.312117:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626702208:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191340.312126:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626702336:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191340.312135:0:40921:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787191340.312147:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634898432 00000100:00100000:2.0:1787191340.312153:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634898432 00000100:00100000:1.0:1787191340.312185:0:57898:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893780 going to sleep for 11 seconds 00000100:00100000:2.0:1787191340.312197:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1368 00000100:00100000:2.0:1787191340.312208:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b4121c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8420:x1874004634898432:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191340.312220:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc88483a37b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000010000 nid: local remote: 0x7130d520e4605676 expref: -99 pid: 57897 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191340.312271:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191340.312280:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b4121c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8420:x1874004634898432:12345-192.168.202.101@tcp:104: Request processed in 73us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191340.312288:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1368 00010000:00010000:1.0:1787191340.312293:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191340.312302:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc88483a37b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000010000 nid: local remote: 0x7130d520e4605676 expref: -99 pid: 57897 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191340.312312:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd5200 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191340.312318:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc88483a37b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800428400010000 nid: local remote: 0x7130d520e4605676 expref: -99 pid: 57897 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191340.312333:0:57627:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xce:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1787191340.312343:0:57627:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xce:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1787191340.312373:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc88483a37b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400010020 nid: local remote: 0x7130d520e4605676 expref: -99 pid: 57897 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191340.312381:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191340.312405:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc88483a37b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400010020 nid: local remote: 0x7130d520e4605676 expref: -99 pid: 57897 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191340.312418:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000407864de/0xe5129dc88483a37b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400010020 nid: local remote: 0x7130d520e4605676 expref: -99 pid: 57897 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000100:00100000:0.0:1787191340.312426:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1787191340.312432:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191340.312435:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191340.312437:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191340.312439:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626703232:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191340.317491:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626702464:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191340.317522:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.317538:0:57570:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.317548:0:57570:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191340.321475:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191340.321524:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634898560 00000100:00100000:3.0:1787191340.321532:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634898560 00000100:00100000:3.0:1787191340.321580:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1369 00000100:00100000:3.0:1787191340.321590:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:9508:x1874004634898560:12345-192.168.202.101@tcp:105: 00010000:00010000:3.0:1787191340.321606:0:51131:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.321619:0:51131:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.321629:0:51131:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.321641:0:51131:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080080020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.321651:0:51131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080080020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.321662:0:51131:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80080020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.321693:0:51131:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b40030400) 00000100:00100000:3.0:1787191340.321752:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:9508:x1874004634898560:12345-192.168.202.101@tcp:105: Request processed in 163us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191340.321759:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1369 00010000:00010000:1.0:1787191340.321936:0:57570:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.321948:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.321964:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191340.321983:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.321993:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.321999:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.322079:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483a3b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.322088:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483a3b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.322098:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483a3b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191340.322100:0:57898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57898:1874004626703104:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191340.322129:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626703360:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191340.322176:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893cc0 going to sleep for 11 seconds 00000002:00100000:2.0:1787191340.322324:0:57898:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513bb480 x1874004626702720/t8589936896(8589936896) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191340.322562:0:57898:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191340.322579:0:57898:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191340.322590:0:57898:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191340.322601:0:57898:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191340.322608:0:57898:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191340.325632:0:57898:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000100:00100000:0.0:1787191340.325642:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626703232:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00010000:2.0:1787191340.325643:0:57898:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191340.325656:0:57898:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42163b58 00010000:00010000:2.0:1787191340.325664:0:57898:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191340.325678:0:57898:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191340.325700:0:57898:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191340.325711:0:57898:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191340.325764:0:57898:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.325772:0:57898:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=9 00000080:00200008:0.0:1787191340.325782:0:57898:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xce:0x0](ffff936b5396d348), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191340.325788:0:57898:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xce:0x0](ffff936b5396d348),name=f70.sanity-flr 00000002:00010000:0.0:1787191340.325810:0:57898:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xce:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.325822:0:57898:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a3ac lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605710 expref: -99 pid: 57898 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191340.325961:0:57898:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a3ac lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605710 expref: -99 pid: 57898 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191340.325971:0:57898:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191340.325978:0:57898:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xce:0x0](ffff936b5396d348) 00000080:00010000:0.0:1787191340.325981:0:57898:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xce:0x0](ffff936b5396d348) for lock 0xe5129dc88483a3ac 00000080:00010000:0.0:1787191340.325985:0:57898:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a3ac from it ffffa3fb42163cb8 00010000:00010000:0.0:1787191340.325988:0:57898:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a3ac lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605710 expref: -99 pid: 57898 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191340.325995:0:57898:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a3ac lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605710 expref: -99 pid: 57898 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191340.326015:0:57898:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xce:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:0.0:1787191340.326026:0:57898:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xce:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191340.326029:0:57898:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191340.326044:0:57898:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xce:0x0] 00000008:00010000:0.0:1787191340.326065:0:57898:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191340.326069:0:57898:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee6830, osc lock ffff936b50b62be0, flags 0x400000400001002 00010000:00010000:0.0:1787191340.326084:0:57898:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.326097:0:57898:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1787191340.326109:0:57898:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191340.326113:0:57898:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 7/0,2 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.326121:0:57898:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1787191340.326128:0:57898:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191340.326138:0:57898:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xce:0x0] updating i_size 0 i_blocks 0 00000020:00010000:0.0:1787191340.326142:0:57898:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c3a060 (ffff936b47a175a8/0) at cl_lock_release():245 00000020:00010000:0.0:1787191340.326145:0:57898:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c3a060 (ffff936b47a175a8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191340.326148:0:57898:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee6830 (ffff936b47a17d88/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191340.326153:0:57898:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c3a060 (ffff936b47a175a8/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191340.326155:0:57898:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee6830 (ffff936b47a175a8/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191340.326167:0:57898:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xce:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191340.326208:0:57898:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191340.326217:0:57898:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.326224:0:57898:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.326233:0:57898:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.326244:0:57898:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191340.326249:0:57898:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191340.326251:0:57898:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191340.326255:0:57898:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42163bf8 00010000:00010000:0.0:1787191340.326257:0:57898:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.326264:0:57898:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.326272:0:57898:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.326277:0:57898:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191340.326280:0:57898:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.326284:0:57898:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:0.0:1787191340.326286:0:57898:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xce:0x0](ffff936b5396d348), inode mode 81a4 mask 46 00000080:00200008:0.0:1787191340.326294:0:57898:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xce:0x0](ffff936b5396d348), flags 154402 00000080:00200000:0.0:1787191340.326408:0:57898:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xce:0x0](ffff936b5396d348), inode mode 81a4 mask 4 00000080:00200000:0.0:1787191340.326416:0:57898:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xce:0x0](ffff936b5396d348), xattr lov 00000080:00200008:0.0:1787191340.326441:0:57898:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xce:0x0](ffff936b5396d348), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191340.326445:0:57898:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xce:0x0](ffff936b5396d348),name=f70.sanity-flr 00000002:00010000:0.0:1787191340.326455:0:57898:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xce:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.326461:0:57898:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a3ac lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605710 expref: -99 pid: 57898 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191340.326470:0:57898:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a3ac lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605710 expref: -99 pid: 57898 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191340.326480:0:57898:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191340.326484:0:57898:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xce:0x0](ffff936b5396d348) 00000080:00010000:0.0:1787191340.326486:0:57898:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xce:0x0](ffff936b5396d348) for lock 0xe5129dc88483a3ac 00000080:00010000:0.0:1787191340.326490:0:57898:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a3ac from it ffffa3fb42163cd8 00010000:00010000:0.0:1787191340.326492:0:57898:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a3ac lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605710 expref: -99 pid: 57898 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191340.326499:0:57898:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a3ac lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605710 expref: -99 pid: 57898 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1787191340.326510:0:57898:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xce:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:0.0:1787191340.326516:0:57898:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xce:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191340.326518:0:57898:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191340.326520:0:57898:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xce:0x0] 00000008:00010000:0.0:1787191340.326527:0:57898:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191340.326529:0:57898:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee6830, osc lock ffff936b50b62be0, flags 0x400000400001002 00010000:00010000:0.0:1787191340.326537:0:57898:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.326546:0:57898:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1787191340.326555:0:57898:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191340.326558:0:57898:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 7/0,2 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.326572:0:57898:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1787191340.326578:0:57898:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191340.326583:0:57898:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xce:0x0] updating i_size 0 i_blocks 0 00000020:00010000:0.0:1787191340.326586:0:57898:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c3a060 (ffff936b47a175a8/0) at cl_lock_release():245 00000020:00010000:0.0:1787191340.326589:0:57898:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c3a060 (ffff936b47a175a8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191340.326591:0:57898:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee6830 (ffff936b47a17d88/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191340.326593:0:57898:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c3a060 (ffff936b47a175a8/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191340.326595:0:57898:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee6830 (ffff936b47a175a8/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191340.326601:0:57898:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xce:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200080:0.0:1787191340.326674:0:57898:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xce:0x0](ffff936b5396d348) cmd=c00c66f3 arg=23f02e0 00000080:00200008:0.0:1787191340.326747:0:57898:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xce:0x0](ffff936b5396d348), flags 154002 00000100:00100000:1.0:1787191340.328066:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626703360:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191340.328092:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483a3b3 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605725 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.328115:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483a3b3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4605725 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.328128:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483a3b3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4605725 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.328141:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483a3b3 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4605725 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191340.328152:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483a3b3 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4605725 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.328165:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483a3b3 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4605725 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.328172:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483a3b3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4605725 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191340.328259:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787191340.328274:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626703488:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191340.328387:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626703616:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191340.332135:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626703488:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191340.336935:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626703616:192.168.202.101@tcp:10:bash.0 00000080:00200000:0.0:1787191340.337629:0:57899:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191340.337654:0:57899:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.337671:0:57899:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.337686:0:57899:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.337694:0:57899:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191340.337703:0:57899:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191340.337707:0:57899:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191340.337714:0:57899:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421e3bf8 00010000:00010000:0.0:1787191340.337719:0:57899:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.337729:0:57899:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.337744:0:57899:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.337752:0:57899:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191340.337752:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xce:0x0] updating i_size 0 i_blocks 0 00000080:00200000:0.0:1787191340.337757:0:57899:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.337762:0:57899:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000020:00010000:3.0:1787191340.337763:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b53cc53f8 (ffff936b47a172d8/0) at cl_lock_release():245 00000080:00200000:0.0:1787191340.337766:0:57899:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xce:0x0](ffff936b5396d348), inode mode 81a4 mask 44 00000020:00010000:3.0:1787191340.337770:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b53cc53f8 (ffff936b47a172d8/0) at cl_lock_cancel():142 00000080:00200008:0.0:1787191340.337774:0:57899:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xce:0x0](ffff936b5396d348), flags 154400 00000020:00010000:3.0:1787191340.337777:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b628934b0 (ffff936b47a17ea8/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191340.337787:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191340.337791:0:57899:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xce:0x0]) in obj [0x200000405:0xce:0x0], intent: open flags 0104240114401 00010000:00010000:3.0:1787191340.337806:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1787191340.337821:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b628934f0 (ffff936b47a176c8/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191340.337826:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483a3b3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4605725 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.337853:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483a3b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4605725 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1787191340.337865:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b53cc53f8 (ffff936b47a172d8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191340.337868:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b628934b0 (ffff936b47a172d8/1) at cl_lock_fini():72 00000020:00010000:3.0:1787191340.337872:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b628934f0 (ffff936b47a172d8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191340.337915:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xce:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191340.337935:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xce:0x0](ffff936b5396d348) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191340.000000000, mtime 1787191340.000000000, ctime 1787191340.000000000, rc 0 00010000:00010000:0.0:1787191340.337948:0:57899:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a3ba lrc: 3/1,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.337957:0:57899:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a3ba lrc: 3/1,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57899 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191340.337970:0:57899:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191340.337982:0:57899:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477b80 x1874004626703872/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191340.337991:0:57899:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a3ba lrc: 3/1,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57899 initiator: MDT0 lru_score: 0 lru_type: 0 00000080:00200008:3.0:1787191340.338009:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xce:0x0], ppos: 0, count: 5 00000100:00100000:0.0:1787191340.338016:0:57899:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57899:1874004626703872:192.168.202.101@tcp:101:lfs.0 00000080:00200000:3.0:1787191340.338023:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:3.0:1787191340.338029:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:3.0:1787191340.338048:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:3.0:1787191340.338054:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:3.0:1787191340.338061:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@0000000062999b9a[0x110, 1, [0x200000405:0xce:0x0] hash] 00000020:00200000:3.0:1787191340.338063:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:3.0:1787191340.338067:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xce:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:3.0:1787191340.338078:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xce:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:3.0:1787191340.338084:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xce:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191340.338087:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:3.0:1787191340.338091:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1787191340.338099:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:3.0:1787191340.338102:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1787191340.338132:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:3.0:1787191340.338146:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:3.0:1787191340.338151:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b506672b0, osc lock ffff936b44f65c80, flags 0x0 00010000:00010000:3.0:1787191340.338174:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191340.338185:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191340.338196:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191340.338205:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191340.338213:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191340.338224:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:3.0:1787191340.338233:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000100:00100000:0.0:1787191340.338243:0:57899:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00000080:00200000:3.0:1787191340.338268:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:3.0:1787191340.338277:0:57570:0:(rw26.c:927:ll_write_end()) page@0000000006418ba2[3 0000000083f0256f 2 1 0000000097471822 0 0 0] 00000080:00200000:3.0:1787191340.338281:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @000000008330beb0 17ffffc0001001 3:0 ffff936b50842380 0 lru 00000080:00200000:3.0:1787191340.338290:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@000000001f7bb046 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000a2a44f55 00000000fca7e965 > 3< 0 0 > 4< 0 0 8 395309056 - | - - - - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1787191340.338292:0:57570:0:(rw26.c:927:ll_write_end()) end page@0000000006418ba2 00000080:00200000:3.0:1787191340.338294:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1787191340.338298:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:3.0:1787191340.338319:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 000000001fb5e07c ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191340.338339:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b5396d4f8, count 1, dirtied 1 00000080:00200000:3.0:1787191340.338344:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:3.0:1787191340.338347:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:3.0:1787191340.338363:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b53cc56c8 (ffff936b47a17ea8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191340.338367:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b53cc56c8 (ffff936b47a17ea8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191340.338370:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b506672b0 (ffff936b465cccf8/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191340.338375:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191340.338384:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:3.0:1787191340.338394:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b53cc56c8 (ffff936b47a17ea8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191340.338397:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b506672b0 (ffff936b47a17ea8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191340.338403:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:3.0:1787191340.338407:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1787191340.338412:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xce:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191340.338415:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:3.0:1787191340.338421:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xce:0x0] updating i_size 5 i_blocks 0 00000080:00200000:3.0:1787191340.338424:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:3.0:1787191340.338438:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xce:0x0](ffff936b5396d348), flags 100001 00000002:00100000:3.0:1787191340.338472:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513ba680 x1874004626700160/t8589936889(8589936889) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191340.338481:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:3.0:1787191340.338486:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1c000 x1874004626704128/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191340.338500:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626704128:192.168.202.101@tcp:35:bash.0 00000100:00100000:3.0:1787191340.338537:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787191340.341586:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626704128:192.168.202.101@tcp:35:bash.0 00000002:00100000:3.0:1787191340.341620:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513ba680 x1874004626700160/t8589936889(8589936889) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191340.345396:0:57900:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191340.345425:0:57900:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.345441:0:57900:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.345456:0:57900:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.345464:0:57900:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191340.345472:0:57900:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191340.345475:0:57900:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191340.345483:0:57900:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42183b58 00010000:00010000:0.0:1787191340.345487:0:57900:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.345496:0:57900:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.345511:0:57900:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.345518:0:57900:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:0.0:1787191340.345523:0:57900:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.345526:0:57900:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=8 00000080:00200008:0.0:1787191340.345532:0:57900:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xce:0x0](ffff936b5396d348), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191340.345537:0:57900:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xce:0x0](ffff936b5396d348),name=f70.sanity-flr 00000002:00010000:0.0:1787191340.345549:0:57900:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xce:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.345557:0:57900:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a3ac lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605710 expref: -99 pid: 57898 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191340.345566:0:57900:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a3ac lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605710 expref: -99 pid: 57898 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1787191340.345578:0:57900:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191340.345582:0:57900:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xce:0x0](ffff936b5396d348) 00000080:00010000:0.0:1787191340.345584:0:57900:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xce:0x0](ffff936b5396d348) for lock 0xe5129dc88483a3ac 00000080:00010000:0.0:1787191340.345588:0:57900:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a3ac from it ffffa3fb42183cb8 00010000:00010000:0.0:1787191340.345590:0:57900:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a3ac lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605710 expref: -99 pid: 57898 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191340.345598:0:57900:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a3ac lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605710 expref: -99 pid: 57898 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00000080:00200000:0.0:1787191340.345616:0:57900:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xce:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:0.0:1787191340.345628:0:57900:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xce:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191340.345631:0:57900:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191340.345634:0:57900:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xce:0x0] 00000008:00010000:0.0:1787191340.345651:0:57900:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191340.345654:0:57900:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee6830, osc lock ffff936b50b62be0, flags 0x400000400001002 00010000:00010000:0.0:1787191340.345668:0:57900:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191340.345678:0:57900:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:0.0:1787191340.345689:0:57900:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191340.345692:0:57900:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191340.345705:0:57900:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:0.0:1787191340.345713:0:57900:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191340.345720:0:57900:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xce:0x0] updating i_size 5 i_blocks 0 00000020:00010000:0.0:1787191340.345725:0:57900:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c3a060 (ffff936b47a175a8/0) at cl_lock_release():245 00000020:00010000:0.0:1787191340.345728:0:57900:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c3a060 (ffff936b47a175a8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191340.345730:0:57900:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee6830 (ffff936b47a17d88/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191340.345733:0:57900:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c3a060 (ffff936b47a175a8/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191340.345736:0:57900:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee6830 (ffff936b47a175a8/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191340.345745:0:57900:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xce:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191340.345761:0:57900:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191340.345767:0:57900:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.345773:0:57900:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.345780:0:57900:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.345786:0:57900:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191340.345789:0:57900:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191340.345792:0:57900:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191340.345795:0:57900:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42183c10 00010000:00010000:0.0:1787191340.345797:0:57900:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.345808:0:57900:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.345815:0:57900:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.345818:0:57900:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:0.0:1787191340.345821:0:57900:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.345825:0:57900:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:0.0:1787191340.345828:0:57900:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:0.0:1787191340.345861:0:57900:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:0.0:1787191340.345884:0:57900:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a39e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xce:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46056d8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191340.345898:0:57900:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xce:0x0]: losing layout lock 00010000:00010000:0.0:1787191340.345910:0:57900:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a3ac lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4605710 expref: -99 pid: 57898 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00000080:00200000:0.0:1787191340.345916:0:57900:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xce:0x0]: losing layout lock 00010000:00010000:0.0:1787191340.345923:0:57900:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a389 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4605699 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.345968:0:57900:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a39e lrc: 1/0,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46056d8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191340.345976:0:57900:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a3ac lrc: 1/0,0 mode: --/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605710 expref: -99 pid: 57898 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00010000:00010000:0.0:1787191340.345983:0:57900:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a389 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xce:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4605699 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.345993:0:57900:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:0.0:1787191340.345996:0:57900:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a39e lrc: 0/0,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46056d8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191340.346008:0:57900:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5400/0xe5129dc88483a3ac lrc: 0/0,0 mode: --/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605710 expref: -99 pid: 57898 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00010000:00010000:0.0:1787191340.346016:0:57900:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a389 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xce:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4605699 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1787191340.346030:0:57900:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 36, max 7 00000100:00100000:0.0:1787191340.346221:0:57900:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474380 x1874004626704384/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787191340.346255:0:57899:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57899:1874004626703872:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191340.346269:0:57899:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a3ba lrc: 4/1,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605733 expref: -99 pid: 57899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.346278:0:57899:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a3ba lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xce:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605733 expref: -99 pid: 57899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.346285:0:57899:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a3ba lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xce:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605733 expref: -99 pid: 57899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191340.346292:0:57899:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x200002b, status=0 req@ffff936b6a477b80 x1874004626703872/t8589936899(8589936899) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191340.346300:0:57899:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477b80 x1874004626703872/t8589936899(8589936899) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191340.346309:0:57899:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a3ba lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xce:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605733 expref: -99 pid: 57899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191340.346317:0:57899:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a3ba lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xce:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605733 expref: -99 pid: 57899 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.346322:0:57899:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/206 (0 0) 00000080:00200000:1.0:1787191340.346325:0:57899:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xce:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787191340.346357:0:57899:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xce:0x0]: layout version change: 4294967294 -> 4 00000080:00010000:1.0:1787191340.346361:0:57899:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xce:0x0](ffff936b5396d348) for lock 0xe5129dc88483a3ba 00000080:00010000:1.0:1787191340.346364:0:57899:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a3ba from it ffffa3fb421e3bf0 00010000:00010000:1.0:1787191340.346366:0:57899:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a3ba lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xce:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605733 expref: -99 pid: 57899 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.346372:0:57899:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a3ba lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xce:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605733 expref: -99 pid: 57899 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000002:00100000:1.0:1787191340.346384:0:57899:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477b80 x1874004626703872/t8589936899(8589936899) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787191340.346577:0:57900:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57900:1874004626704384:192.168.202.101@tcp:36:rm.0 00000100:00100000:0.0:1787191340.346699:0:57900:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000080:00200000:1.0:1787191340.346814:0:57899:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xce:0x0](ffff936b5396d348), inode mode 81a4 mask 4 00000080:00200000:1.0:1787191340.346823:0:57899:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xce:0x0](ffff936b5396d348), xattr lov 00000080:00200008:1.0:1787191340.346884:0:57899:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xce:0x0](ffff936b5396d348), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191340.346891:0:57899:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xce:0x0](ffff936b5396d348),name=f70.sanity-flr 00000002:00010000:1.0:1787191340.346900:0:57899:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xce:0x0]) in obj [0x200000405:0xce:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191340.346906:0:57899:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 30 res 8589935621/206 (0 0) 00010000:00010000:1.0:1787191340.346935:0:57899:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a3c1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.346942:0:57899:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a3c1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.346957:0:57899:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a3c1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191340.346969:0:57899:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57899:1874004626704512:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191340.346997:0:57899:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191340.350088:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191340.358624:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634898688 00000100:00100000:2.0:1787191340.358640:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634898688 00000100:00100000:2.0:1787191340.358719:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1370 00000100:00100000:2.0:1787191340.358730:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634898688:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191340.358749:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a3ba lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xce:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4605733 expref: -99 pid: 57899 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191340.358863:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191340.358870:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634898688:12345-192.168.202.101@tcp:104: Request processed in 142us (8791us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191340.358877:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1370 00010000:00010000:1.0:1787191340.359061:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191340.359069:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a3ba lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xce:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4605733 expref: -99 pid: 57899 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.359083:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cafe00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191340.359088:0:43384:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a3ba lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xce:0x0].0x0 bits 0xd/0xd rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4605733 expref: -99 pid: 57899 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.359097:0:43384:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a3ba lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xce:0x0].0x0 bits 0xd/0xd rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4605733 expref: -99 pid: 57899 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.359106:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a3ba lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xce:0x0].0x0 bits 0xd/0xd rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4605733 expref: -99 pid: 57899 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191340.359131:0:43384:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xce:0x0]: losing layout lock 00010000:00010000:1.0:1787191340.359180:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a3ba lrc: 2/0,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0xd/0xd rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4605733 expref: -99 pid: 57899 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.359188:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191340.359213:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a3ba lrc: 1/0,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0xd/0xd rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4605733 expref: -99 pid: 57899 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.359220:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a3ba lrc: 0/0,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0xd/0xd rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4605733 expref: -99 pid: 57899 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.359234:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191340.359236:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191340.359238:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191340.359252:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626704640:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191340.364227:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626704640:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191340.364349:0:57899:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57899:1874004626704512:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191340.364369:0:57899:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a3c1 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xce:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460575d expref: -99 pid: 57899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.364381:0:57899:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a3c1 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460575d expref: -99 pid: 57899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.364392:0:57899:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a3c1 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460575d expref: -99 pid: 57899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.364408:0:57899:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a3c1 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460575d expref: -99 pid: 57899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.364419:0:57899:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a3c1 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460575d expref: -99 pid: 57899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.364426:0:57899:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a3c1 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460575d expref: -99 pid: 57899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.364432:0:57899:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a3c1 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460575d expref: -99 pid: 57899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191340.364442:0:57899:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b453a9880 x1874004626704512/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/976 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191340.364453:0:57899:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a3c1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460575d expref: -99 pid: 57899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191340.364465:0:57899:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a3c1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460575d expref: -99 pid: 57899 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.364476:0:57899:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/206 (0 0) 00000080:00200000:0.0:1787191340.364482:0:57899:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xce:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787191340.364542:0:57899:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xce:0x0]: layout version change: 4294967294 -> 4 00000080:00010000:0.0:1787191340.364548:0:57899:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xce:0x0](ffff936b5396d348) for lock 0xe5129dc88483a3c1 00000080:00010000:0.0:1787191340.364554:0:57899:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xce:0x0](ffff936b5396d348) 00000080:00010000:0.0:1787191340.364557:0:57899:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a3c1 from it ffffa3fb421e3cd8 00010000:00010000:0.0:1787191340.364561:0:57899:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a3c1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460575d expref: -99 pid: 57899 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.364570:0:57899:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031600/0xe5129dc88483a3c1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xce:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460575d expref: -99 pid: 57899 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191340.364598:0:57899:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xce:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:0.0:1787191340.364608:0:57899:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xce:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191340.364612:0:57899:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191340.364615:0:57899:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xce:0x0] 00000008:00010000:0.0:1787191340.364633:0:57899:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191340.364636:0:57899:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee6830, osc lock ffff936b50b62be0, flags 0x400000400001002 00010000:00010000:0.0:1787191340.364654:0:57899:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191340.364669:0:57899:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:0.0:1787191340.364679:0:57899:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191340.364683:0:57899:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191340.364690:0:57899:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:0.0:1787191340.364700:0:57899:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191340.364710:0:57899:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xce:0x0] updating i_size 5 i_blocks 0 00000020:00010000:0.0:1787191340.364715:0:57899:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c3a060 (ffff936b47a175a8/0) at cl_lock_release():245 00000020:00010000:0.0:1787191340.364719:0:57899:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c3a060 (ffff936b47a175a8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191340.364721:0:57899:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee6830 (ffff936b47a17d88/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191340.364725:0:57899:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c3a060 (ffff936b47a175a8/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191340.364728:0:57899:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee6830 (ffff936b47a175a8/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191340.364737:0:57899:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xce:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1787191340.364817:0:57899:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xce:0x0](ffff936b5396d348), flags 154000 00000002:00100000:0.0:1787191340.364903:0:57899:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a477b80 x1874004626703872/t8589936899(8589936899) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191340.364913:0:57899:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191340.364919:0:57899:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475500 x1874004626704896/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191340.364939:0:57899:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57899:1874004626704896:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191340.365023:0:57899:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99840 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.365070:0:57900:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57900:1874004626704384:192.168.202.101@tcp:36:rm.0 00000080:00200000:0.0:1787191340.374816:0:57901:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191340.374883:0:57901:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.374901:0:57901:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.374916:0:57901:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.374924:0:57901:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191340.374932:0:57901:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191340.374936:0:57901:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191340.374943:0:57901:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42223b58 00010000:00010000:0.0:1787191340.374948:0:57901:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.374957:0:57901:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.374974:0:57901:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.374982:0:57901:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:0.0:1787191340.374988:0:57901:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.374999:0:57901:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:0.0:1787191340.375004:0:57901:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:0.0:1787191340.375018:0:57901:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00000100:00100000:1.0:1787191340.376492:0:57899:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57899:1874004626704896:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191340.376525:0:57899:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a477b80 x1874004626703872/t8589936899(8589936899) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191340.376573:0:57899:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xce:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00020000:00200000:1.0:1787191340.376584:0:57899:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xce:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191340.376587:0:57899:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191340.376592:0:57899:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191340.376601:0:57899:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000008:00010000:1.0:1787191340.376619:0:57899:0:(osc_cache.c:1183:osc_extent_make_ready()) ### extent: 000000001fb5e07c ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000008:00010000:1.0:1787191340.376646:0:57899:0:(osc_cache.c:917:osc_extent_finish()) ### extent: 000000001fb5e07c ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000008:00010000:1.0:1787191340.376669:0:57899:0:(osc_cache.c:497:__osc_extent_remove()) ### extent: 000000001fb5e07c ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1787191340.376691:0:57899:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xce:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191340.376736:0:57899:0:(llite_lib.c:2066:ll_clear_inode()) VFS Op:inode=[0x200000405:0xce:0x0](ffff936b5396d348) 00000008:00010000:1.0:1787191340.376765:0:57899:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 5 blocks 0 [cma]time 1787191340 1787191340 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000008:00010000:1.0:1787191340.376786:0:57899:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191340 1787191340 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483a3b3 lrc: 1/0,0 mode: PW/PW res: [0x2c0000401:0x1bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4605725 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191340.377072:0:57899:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191340.377093:0:57899:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191340.377104:0:57899:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191340.377116:0:57899:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191340.377122:0:57899:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191340.377128:0:57899:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191340.377131:0:57899:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191340.377138:0:57899:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421e3b58 00010000:00010000:1.0:1787191340.377141:0:57899:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191340.377149:0:57899:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191340.377163:0:57899:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191340.377170:0:57899:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191340.377176:0:57899:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00010000:00010000:0.0:1787191340.383525:0:57901:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a3c8 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.383543:0:57901:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a3c8 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.383555:0:57901:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a3c8 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191340.383581:0:57901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57901:1874004626705024:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191340.384261:0:57901:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.390444:0:57901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57901:1874004626705024:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191340.390468:0:57901:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a3c8 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.390484:0:57901:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a3c8 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.390495:0:57901:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a3c8 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.390502:0:57901:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a3c8 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.390511:0:57901:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a3c8 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.390517:0:57901:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44caf000 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191340.390521:0:57901:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a3c8 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.390528:0:57901:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a3c8 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.390535:0:57901:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a3c8 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.390542:0:57901:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191340.390548:0:57901:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a3c8 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.390554:0:57901:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a3c8 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191340.390577:0:57901:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b6a477100 x1874004626705024/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191340.390592:0:57901:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191340.390708:0:57901:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191340.390725:0:57901:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.390737:0:57901:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.390750:0:57901:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.390758:0:57901:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191340.390764:0:57901:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191340.390767:0:57901:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191340.390773:0:57901:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42223be8 00010000:00010000:0.0:1787191340.390776:0:57901:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.390785:0:57901:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.390800:0:57901:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.390807:0:57901:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000080:00200000:0.0:1787191340.390812:0:57901:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.390824:0:57901:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:0.0:1787191340.390828:0:57901:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:0.0:1787191340.391410:0:57901:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:0.0:1787191340.391455:0:57901:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a3cf lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.391464:0:57901:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a3cf lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.391478:0:57901:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a3cf lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191340.391498:0:57901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57901:1874004626705152:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191340.391581:0:57901:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.399290:0:57901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57901:1874004626705152:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191340.399312:0:57901:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a3cf lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.399325:0:57901:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a3cf lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.399332:0:57901:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a3cf lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.399339:0:57901:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a3cf lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.399349:0:57901:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a3cf lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.399356:0:57901:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cafa00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191340.399360:0:57901:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a3cf lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.399366:0:57901:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a3cf lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.399373:0:57901:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a3cf lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.399380:0:57901:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191340.399386:0:57901:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a3cf lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.399392:0:57901:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a3cf lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191340.399414:0:57901:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b6a477100 x1874004626705152/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191340.399428:0:57901:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191340.399527:0:57901:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191340.399541:0:57901:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.399550:0:57901:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.399561:0:57901:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.399568:0:57901:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191340.399572:0:57901:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191340.399575:0:57901:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191340.399579:0:57901:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42223b58 00010000:00010000:0.0:1787191340.399583:0:57901:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.399590:0:57901:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.399607:0:57901:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.399614:0:57901:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:0.0:1787191340.399622:0:57901:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1787191340.399626:0:57901:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:0.0:1787191340.399636:0:57901:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.399644:0:57901:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 85 lru_type: 1 00010000:00010000:0.0:1787191340.399651:0:57901:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 85 lru_type: 1 00000002:00010000:0.0:1787191340.399659:0:57901:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.399698:0:57901:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a3d6 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.399705:0:57901:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a3d6 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.399713:0:57901:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a3d6 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191340.399732:0:57901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57901:1874004626705280:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191340.399823:0:57901:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000080:00200000:1.0:1787191340.401417:0:57899:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=9 00000080:00200000:1.0:1787191340.401427:0:57899:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191340.401451:0:57899:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191340.401499:0:57899:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a3dd lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.401510:0:57899:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a3dd lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.401520:0:57899:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a3dd lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191340.401540:0:57899:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57899:1874004626705408:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191340.401616:0:57899:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.402386:0:57901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57901:1874004626705280:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191340.402402:0:57901:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a3d6 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460579c expref: -99 pid: 57901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.402417:0:57901:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a3d6 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460579c expref: -99 pid: 57901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.402429:0:57901:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a3d6 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460579c expref: -99 pid: 57901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.402440:0:57901:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a3d6 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460579c expref: -99 pid: 57901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.402451:0:57901:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a3d6 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460579c expref: -99 pid: 57901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.402458:0:57901:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a3d6 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460579c expref: -99 pid: 57901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.402466:0:57901:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a3d6 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460579c expref: -99 pid: 57901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191340.402476:0:57901:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b6a477100 x1874004626705280/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191340.402487:0:57901:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460579c expref: -99 pid: 57901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.402496:0:57901:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:0.0:1787191340.402502:0:57901:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460579c expref: -99 pid: 57901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.402513:0:57901:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a3d6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460579c expref: -99 pid: 57901 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:0.0:1787191340.402535:0:57901:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.402544:0:57901:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 170 lru_type: 1 00010000:00010000:0.0:1787191340.402555:0:57901:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 170 lru_type: 1 00010000:00010000:0.0:1787191340.402564:0:57901:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 170 lru_type: 1 00010000:00010000:0.0:1787191340.402572:0:57901:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 171 lru_type: 1 00000080:00200000:0.0:1787191340.402584:0:57901:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191340.402592:0:57901:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:0.0:1787191340.402596:0:57901:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:0.0:1787191340.402602:0:57901:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb42223cb8 00010000:00010000:0.0:1787191340.402605:0:57901:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 85 lru_type: 1 00010000:00010000:0.0:1787191340.402612:0:57901:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 86 lru_type: 1 00000002:00010000:0.0:1787191340.402624:0:57901:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.402630:0:57901:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a3d6 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460579c expref: -99 pid: 57901 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.402637:0:57901:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a3d6 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460579c expref: -99 pid: 57901 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.402645:0:57901:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460579c expref: -99 pid: 57901 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.402653:0:57901:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a3d6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460579c expref: -99 pid: 57901 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:0.0:1787191340.402662:0:57901:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.402667:0:57901:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 171 lru_type: 1 00010000:00010000:0.0:1787191340.402674:0:57901:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 171 lru_type: 1 00010000:00010000:0.0:1787191340.402682:0:57901:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 171 lru_type: 1 00010000:00010000:0.0:1787191340.402689:0:57901:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 172 lru_type: 1 00000080:00200008:0.0:1787191340.403349:0:57901:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1787191340.403356:0:57901:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191340.403371:0:57901:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.403380:0:57901:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.403389:0:57901:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.403396:0:57901:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191340.403401:0:57901:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191340.403405:0:57901:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191340.403409:0:57901:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42223cb8 00010000:00010000:0.0:1787191340.403412:0:57901:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.403419:0:57901:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.403540:0:57901:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191340.403550:0:57901:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.403556:0:57901:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.403565:0:57901:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.403571:0:57901:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191340.403575:0:57901:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191340.403577:0:57901:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191340.403581:0:57901:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42223b58 00010000:00010000:0.0:1787191340.403584:0:57901:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.403591:0:57901:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.403599:0:57901:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.403605:0:57901:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:0.0:1787191340.403610:0:57901:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:1.0:1787191340.404175:0:57899:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57899:1874004626705408:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191340.404189:0:57899:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a3dd lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.404201:0:57899:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a3dd lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.404208:0:57899:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a3dd lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.404214:0:57899:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a3dd lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.404222:0:57899:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a3dd lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.404229:0:57899:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191340.404234:0:57899:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a3dd lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.404241:0:57899:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a3dd lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.404248:0:57899:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a3dd lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.404256:0:57899:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191340.404262:0:57899:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a3dd lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.404268:0:57899:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a3dd lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57899 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191340.404284:0:57899:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b453a8000 x1874004626705408/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191340.404295:0:57899:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1787191340.404327:0:57899:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a3d6 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460579c expref: -99 pid: 57901 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191340.404337:0:57899:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a3d6 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460579c expref: -99 pid: 57901 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:1.0:1787191340.404343:0:57899:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a3d6 from it ffffa3fb421e3930 00010000:00010000:1.0:1787191340.404347:0:57899:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460579c expref: -99 pid: 57901 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191340.404354:0:57899:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a3d6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460579c expref: -99 pid: 57901 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191340.405432:0:57901:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=8 00000080:00200000:2.0:1787191340.405472:0:57901:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191340.405489:0:57901:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191340.405500:0:57901:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191340.405511:0:57901:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191340.405519:0:57901:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191340.405525:0:57901:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191340.405528:0:57901:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191340.405534:0:57901:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42223bf8 00010000:00010000:2.0:1787191340.405538:0:57901:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191340.405546:0:57901:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191340.405557:0:57901:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191340.405563:0:57901:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191340.405567:0:57901:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191340.405573:0:57901:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:2.0:1787191340.405576:0:57901:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:2.0:1787191340.405581:0:57901:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b5127b500, open_flags a141, mode 81b6 opened 0 00000080:00200000:2.0:1787191340.405590:0:57901:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:2.0:1787191340.405608:0:57901:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xcf:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:2.0:1787191340.405619:0:57901:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a3d6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e460579c expref: -99 pid: 57901 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191340.405667:0:57901:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a3d6 lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e460579c expref: -99 pid: 57901 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191340.405673:0:57901:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191340.405676:0:57901:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a3d6 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e460579c expref: -99 pid: 57901 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191340.405707:0:57901:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a3e4 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.405713:0:57901:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a3e4 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191340.405727:0:57901:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191340.405735:0:57901:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb480 x1874004626705664/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191340.405743:0:57901:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a3e4 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191340.405762:0:57901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57901:1874004626705664:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191340.405917:0:57901:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.410368:0:57901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57901:1874004626705664:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191340.410390:0:57901:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a3e4 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46057cd expref: -99 pid: 57901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.410413:0:57901:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a3e4 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46057cd expref: -99 pid: 57901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.410420:0:57901:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a3e4 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46057cd expref: -99 pid: 57901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.410429:0:57901:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a3e4 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46057cd expref: -99 pid: 57901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.410445:0:57901:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a3e4 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46057cd expref: -99 pid: 57901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.410455:0:57901:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a3e4 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46057cd expref: -99 pid: 57901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.410461:0:57901:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a3e4 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46057cd expref: -99 pid: 57901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.410467:0:57901:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a3e4 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46057cd expref: -99 pid: 57901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191340.410475:0:57901:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b513bb480 x1874004626705664/t8589936902(8589936902) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191340.410484:0:57901:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bb480 x1874004626705664/t8589936902(8589936902) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191340.410492:0:57901:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a3e4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46057cd expref: -99 pid: 57901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.410499:0:57901:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/207 (0 0) 00000080:00200000:0.0:1787191340.410503:0:57901:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191340.410513:0:57901:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:0.0:1787191340.410541:0:57901:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xcf:0x0](ffff936b5396aa08) 00000080:00200000:0.0:1787191340.410546:0:57901:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xcf:0x0], updating i_size 0 00000080:00200000:0.0:1787191340.410571:0:57901:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xcf:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1787191340.410574:0:57901:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xcf:0x0](ffff936b5396aa08) 00000080:00010000:0.0:1787191340.410576:0:57901:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xcf:0x0](ffff936b5396aa08) for lock 0xe5129dc88483a3e4 00000080:00010000:0.0:1787191340.410584:0:57901:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xcf:0x0](ffff936b5396aa08) 00000080:00200008:0.0:1787191340.410593:0:57901:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xcf:0x0](ffff936b5396aa08), flags 120501 00000002:00100000:0.0:1787191340.410607:0:57901:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bb480 x1874004626705664/t8589936902(8589936902) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191340.410631:0:57901:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a3e4 from it ffff936b60dc4540 00010000:00010000:0.0:1787191340.410635:0:57901:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a3e4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46057cd expref: -99 pid: 57901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.410641:0:57901:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a3e4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46057cd expref: -99 pid: 57901 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191340.410657:0:57901:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xcf:0x0](ffff936b5396aa08), inode mode 81a4 mask 40 00000080:00200000:0.0:1787191340.410700:0:57901:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xcf:0x0](ffff936b5396aa08), inode mode 81a4 mask 2 00000080:00200000:0.0:1787191340.410709:0:57901:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xcf:0x0](ffff936b5396aa08), xattr lov 00000002:00010000:0.0:1787191340.410723:0:57901:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xcf:0x0]) in obj [0x200000405:0xcf:0x0], intent: open flags 040000002 00010000:00010000:0.0:1787191340.410778:0:57901:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a3eb lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.410786:0:57901:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a3eb lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191340.410796:0:57901:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191340.410802:0:57901:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477100 x1874004626705920/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191340.410812:0:57901:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a3eb lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191340.410829:0:57901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57901:1874004626705920:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191340.411184:0:57901:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191340.415161:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191340.415203:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634898816 00000100:00100000:2.0:1787191340.415213:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634898816 00000100:00100000:2.0:1787191340.415264:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1371 00000100:00100000:2.0:1787191340.415274:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634898816:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191340.415293:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a3e4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46057cd expref: -99 pid: 57901 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191340.415372:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191340.415379:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634898816:12345-192.168.202.101@tcp:104: Request processed in 106us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191340.415386:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1371 00010000:00010000:0.0:1787191340.415720:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191340.415727:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a3e4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46057cd expref: -99 pid: 57901 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.415736:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd4400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191340.415741:0:40929:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a3e4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46057cd expref: -99 pid: 57901 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.415749:0:40929:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a3e4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46057cd expref: -99 pid: 57901 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.415757:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a3e4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e46057cd expref: -99 pid: 57901 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191340.415779:0:40929:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xcf:0x0]: losing layout lock 00010000:00010000:0.0:1787191340.415818:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a3e4 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46057cd expref: -99 pid: 57901 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.415825:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191340.415889:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a3e4 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46057cd expref: -99 pid: 57901 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.415897:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a3e4 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46057cd expref: -99 pid: 57901 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.415909:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191340.415911:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191340.415912:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191340.416012:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787191340.416031:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626706048:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00200000:3.0:1787191340.419549:0:57902:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191340.419579:0:57902:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191340.419595:0:57902:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191340.419611:0:57902:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191340.419618:0:57902:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191340.419625:0:57902:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191340.419628:0:57902:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191340.419635:0:57902:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42163bf8 00010000:00010000:3.0:1787191340.419639:0:57902:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191340.419648:0:57902:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191340.419662:0:57902:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191340.419670:0:57902:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191340.419676:0:57902:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191340.419689:0:57902:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b464a9800, open_flags d900, mode 0 opened 0 00000080:00200000:3.0:1787191340.419696:0:57902:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:3.0:1787191340.419711:0:57902:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:3.0:1787191340.419764:0:57902:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483a3f2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.419772:0:57902:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483a3f2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57902 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191340.419785:0:57902:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:3.0:1787191340.419919:0:57902:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1d500 x1874004626706304/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191340.419931:0:57902:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483a3f2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191340.419955:0:57902:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57902:1874004626706304:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191340.420176:0:57902:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787191340.420541:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626706048:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191340.423624:0:57901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57901:1874004626705920:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191340.423643:0:57901:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a3eb lrc: 4/1,0 mode: --/CR res: [0x200000405:0xcf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.423656:0:57901:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a3eb lrc: 4/1,0 mode: --/CR res: [0x200000405:0xcf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.423661:0:57901:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a3eb lrc: 4/1,0 mode: --/CR res: [0x200000405:0xcf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.423667:0:57901:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a3eb lrc: 3/0,0 mode: --/CR res: [0x200000405:0xcf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.423673:0:57901:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a3eb lrc: 4/0,0 mode: --/CR res: [0x200000405:0xcf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.423677:0:57901:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44caf000 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191340.423680:0:57901:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a3eb lrc: 4/0,0 mode: --/CR res: [0x200000405:0xcf:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.423685:0:57901:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a3eb lrc: 4/0,0 mode: --/CR res: [0x200000405:0xcf:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.423690:0:57901:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a3eb lrc: 5/0,0 mode: --/CR res: [0x200000405:0xcf:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.423694:0:57901:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191340.423699:0:57901:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a3eb lrc: 3/0,0 mode: --/CR res: [0x200000405:0xcf:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.423703:0:57901:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a3eb lrc: 0/0,0 mode: --/CR res: [0x200000405:0xcf:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57901 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191340.423723:0:57901:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b6a477100 x1874004626705920/t8589936903(8589936903) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191340.423732:0:57901:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477100 x1874004626705920/t8589936903(8589936903) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191340.423745:0:57901:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xcf:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787191340.423796:0:57901:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xcf:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1787191340.423804:0:57901:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xcf:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191340.423883:0:57901:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xcf:0x0], updating i_size 0 00000002:00100000:0.0:1787191340.423897:0:57901:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477100 x1874004626705920/t8589936903(8589936903) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191340.423928:0:57901:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a477100 x1874004626705920/t8589936903(8589936903) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191340.423935:0:57901:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191340.423938:0:57901:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a476680 x1874004626706560/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191340.423961:0:57901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57901:1874004626706560:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191340.424028:0:57901:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.431149:0:57901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57901:1874004626706560:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191340.431186:0:57901:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a477100 x1874004626705920/t8589936903(8589936903) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1787191340.431238:0:57901:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xcf:0x0](ffff936b5396aa08), flags 100001 00000002:00100000:0.0:1787191340.431283:0:57901:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513bb480 x1874004626705664/t8589936902(8589936902) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191356 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191340.431293:0:57901:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191340.431298:0:57901:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475880 x1874004626706816/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191340.431317:0:57901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57901:1874004626706816:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191340.431395:0:57901:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191340.439681:0:57901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57901:1874004626706816:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191340.439716:0:57901:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513bb480 x1874004626705664/t8589936902(8589936902) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787191340.440728:0:57902:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57902:1874004626706304:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191340.440746:0:57902:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483a3f2 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605805 expref: -99 pid: 57902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.440768:0:57902:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483a3f2 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605805 expref: -99 pid: 57902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.440774:0:57902:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483a3f2 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605805 expref: -99 pid: 57902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.440782:0:57902:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483a3f2 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605805 expref: -99 pid: 57902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.440789:0:57902:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483a3f2 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605805 expref: -99 pid: 57902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.440798:0:57902:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483a3f2 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605805 expref: -99 pid: 57902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.440803:0:57902:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483a3f2 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605805 expref: -99 pid: 57902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.440808:0:57902:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483a3f2 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605805 expref: -99 pid: 57902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191340.440815:0:57902:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b51d1d500 x1874004626706304/t8589936904(8589936904) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191340.440823:0:57902:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1d500 x1874004626706304/t8589936904(8589936904) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191340.440851:0:57902:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483a3f2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605805 expref: -99 pid: 57902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191340.440861:0:57902:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483a3f2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605805 expref: -99 pid: 57902 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.440868:0:57902:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/207 (0 0) 00000080:00200000:0.0:1787191340.440872:0:57902:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191340.440910:0:57902:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xcf:0x0](ffff936b5396aa08): rc = 0 00000080:00200000:0.0:1787191340.440920:0:57902:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xcf:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:0.0:1787191340.440924:0:57902:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xcf:0x0](ffff936b5396aa08) for lock 0xe5129dc88483a3f2 00000080:00010000:0.0:1787191340.440931:0:57902:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xcf:0x0](ffff936b5396aa08) 00000080:00200008:0.0:1787191340.440941:0:57902:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xcf:0x0](ffff936b5396aa08), flags 154400 00000002:00100000:0.0:1787191340.440956:0:57902:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1d500 x1874004626706304/t8589936904(8589936904) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191340.440987:0:57902:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a3f2 from it ffff936b466f49c0 00010000:00010000:0.0:1787191340.440990:0:57902:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483a3f2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605805 expref: -99 pid: 57902 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.440996:0:57902:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483a3f2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605805 expref: -99 pid: 57902 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191340.441017:0:57902:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xcf:0x0](ffff936b5396aa08), inode mode 81a4 mask 44 00000080:00200000:0.0:1787191340.441104:0:57902:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xcf:0x0](ffff936b5396aa08), inode mode 81a4 mask 4 00000080:00200000:0.0:1787191340.441112:0:57902:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xcf:0x0](ffff936b5396aa08), xattr lov 00000080:00200008:0.0:1787191340.441140:0:57902:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xcf:0x0](ffff936b5396aa08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191340.441147:0:57902:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xcf:0x0](ffff936b5396aa08),name=f70.sanity-flr 00000002:00010000:0.0:1787191340.441168:0:57902:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xcf:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.441178:0:57902:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483a3f2 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605805 expref: -99 pid: 57902 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.441189:0:57902:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483a3f2 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605805 expref: -99 pid: 57902 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191340.441196:0:57902:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191340.441201:0:57902:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xcf:0x0](ffff936b5396aa08) 00000080:00010000:0.0:1787191340.441204:0:57902:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xcf:0x0](ffff936b5396aa08) for lock 0xe5129dc88483a3f2 00000080:00010000:0.0:1787191340.441208:0:57902:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a3f2 from it ffffa3fb42163cd8 00010000:00010000:0.0:1787191340.441211:0:57902:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483a3f2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605805 expref: -99 pid: 57902 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.441218:0:57902:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483a3f2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605805 expref: -99 pid: 57902 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191340.441237:0:57902:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xcf:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:0.0:1787191340.441247:0:57902:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xcf:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191340.441251:0:57902:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191340.441254:0:57902:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xcf:0x0] 00000008:00010000:0.0:1787191340.441270:0:57902:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191340.441273:0:57902:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f99630, osc lock ffff936b50b62be0, flags 0x400000400001002 00000008:00010000:0.0:1787191340.441279:0:57902:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191340.441281:0:57902:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f99670, osc lock ffff936b50b63690, flags 0x400000400001002 00010000:00010000:0.0:1787191340.441325:0:57902:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a3f9 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.441342:0:57902:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a3f9 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.441354:0:57902:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b6a474700 x1874004626706944/t0(0) o101->lustre-OST0000-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191340.441405:0:57902:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a400 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.441414:0:57902:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a400 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.441422:0:57902:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b6a476a00 x1874004626707072/t0(0) o101->lustre-OST0001-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:0.0:1787191340.441432:0:57902:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 2 items remaining. 00000100:00100000:1.0:1787191340.441508:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626706944:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191340.441893:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787191340.441901:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626707072:192.168.202.101@tcp:101:lfs.0 00000080:00200000:2.0:1787191340.443017:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191340.443050:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191340.443063:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191340.443075:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191340.443084:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191340.443091:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191340.443095:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191340.443100:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:2.0:1787191340.443104:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191340.443112:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191340.443125:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191340.443132:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191340.443137:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191340.443143:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:2.0:1787191340.443148:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xcf:0x0](ffff936b5396aa08), inode mode 81a4 mask 42 00000080:00200008:2.0:1787191340.443155:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xcf:0x0](ffff936b5396aa08), flags 101101 00000002:00010000:2.0:1787191340.443170:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xcf:0x0]) in obj [0x200000405:0xcf:0x0], intent: open|creat flags 04240101102 00010000:00010000:2.0:1787191340.443181:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483a3f2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4605805 expref: -99 pid: 57902 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191340.443197:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xcf:0x0]: losing layout lock 00010000:00010000:2.0:1787191340.443231:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483a3f2 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605805 expref: -99 pid: 57902 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191340.443239:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191340.443242:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483a3f2 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605805 expref: -99 pid: 57902 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191340.443276:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a407 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.443284:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a407 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191340.443295:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191340.443303:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8e00 x1874004626707328/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191340.443313:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a407 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191340.443453:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626707328:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191340.444078:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787191340.447471:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626707328:192.168.202.101@tcp:101:bash.0 00010000:00010000:2.0:1787191340.447499:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a407 lrc: 4/0,1 mode: --/CW res: [0x200000405:0xcf:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460581a expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.447514:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a407 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xcf:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460581a expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.447525:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a407 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xcf:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460581a expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191340.447539:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x200002b, status=0 req@ffff936b513b8e00 x1874004626707328/t8589936907(8589936907) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191340.447556:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b8e00 x1874004626707328/t8589936907(8589936907) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191340.447567:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a407 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xcf:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460581a expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191340.447580:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a407 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xcf:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460581a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.447591:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 8 res 8589935621/207 (0 0) 00000080:00200000:2.0:1787191340.447597:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000405:0xcf:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1787191340.447653:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xcf:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:2.0:1787191340.447658:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xcf:0x0](ffff936b5396aa08) for lock 0xe5129dc88483a407 00000080:00010000:2.0:1787191340.447664:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a407 from it ffffa3fb41cabbf0 00010000:00010000:2.0:1787191340.447668:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a407 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xcf:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460581a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.447679:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a407 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xcf:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460581a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000002:00100000:3.0:1787191340.448073:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b8e00 x1874004626707328/t8589936907(8589936907) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191340.448138:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xcf:0x0], intent: getxattr flags 0 00010000:00010000:3.0:1787191340.448179:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a40e lrc: 3/1,0 mode: --/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.448188:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a40e lrc: 3/1,0 mode: --/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.448197:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a40e lrc: 3/1,0 mode: --/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191340.448217:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626707456:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191340.448296:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cb40 going to sleep for 11 seconds 00010000:00010000:1.0:1787191340.456161:0:2389:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a400 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.456188:0:2389:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a400 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e460582f expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.456201:0:2389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a400 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460582f expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.456212:0:2389:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a400 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e460582f expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191340.456226:0:2389:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a400 lrc: 5/2,0 mode: PR/PR res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460582f expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1787191340.456237:0:2389:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191340.456242:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a400 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460582f expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.456250:0:2389:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a400 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460582f expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.456257:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a400 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460582f expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.456266:0:2389:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a400 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460582f expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1787191340.456286:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626707072:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191340.456303:0:2389:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a3f9 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.456312:0:2389:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a3f9 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605828 expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.456320:0:2389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a3f9 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605828 expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.456328:0:2389:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a3f9 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605828 expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191340.456337:0:2389:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a3f9 lrc: 5/2,0 mode: PR/PR res: [0x280000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605828 expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1787191340.456346:0:2389:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1787191340.456361:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a3f9 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605828 expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.456368:0:2389:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a3f9 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605828 expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.456377:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a3f9 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605828 expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.456384:0:2389:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a3f9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605828 expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1787191340.456395:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626706944:192.168.202.101@tcp:101:lfs.0 00000080:00200000:0.0:1787191340.456486:0:57902:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xcf:0x0] updating i_size 0 i_blocks 0 00000020:00010000:0.0:1787191340.456493:0:57902:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c3a060 (ffff936b47a175a8/0) at cl_lock_release():245 00000020:00010000:0.0:1787191340.456496:0:57902:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c3a060 (ffff936b47a175a8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191340.456501:0:57902:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99630 (ffff936b47a17d88/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191340.456505:0:57902:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99670 (ffff936b47a17008/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191340.456508:0:57902:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c3a060 (ffff936b47a175a8/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191340.456511:0:57902:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99630 (ffff936b47a175a8/1) at cl_lock_fini():72 00000020:00010000:0.0:1787191340.456515:0:57902:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99670 (ffff936b47a175a8/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191340.456529:0:57902:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xcf:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1787191340.456590:0:57902:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xcf:0x0](ffff936b5396aa08), flags 154000 00000002:00100000:0.0:1787191340.456654:0:57902:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1d500 x1874004626706304/t8589936904(8589936904) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191340.456665:0:57902:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191340.456670:0:57902:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475500 x1874004626707712/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191340.456691:0:57902:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57902:1874004626707712:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191340.456777:0:57902:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00000100:00100000:1.0:1787191340.458781:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626707456:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191340.458803:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a40e lrc: 4/1,0 mode: --/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460583d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.458818:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a40e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460583d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.458829:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a40e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460583d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191340.459069:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b51d1c380 x1874004626707456/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191340.459081:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a40e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460583d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.459090:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/207 (0 0) 00000080:00200000:1.0:1787191340.459097:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xcf:0x0] suppgids 0 -1: rc 0 00000080:00010000:1.0:1787191340.459126:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xcf:0x0](ffff936b5396aa08) for lock 0xe5129dc88483a40e 00000080:00010000:1.0:1787191340.459134:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a40e from it ffffa3fb41caba38 00010000:00010000:1.0:1787191340.459138:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a40e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460583d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.459147:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a40e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460583d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:1.0:1787191340.459188:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xcf:0x0](ffff936b5396aa08) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191340.000000000, mtime 1787191340.000000000, ctime 1787191340.000000000 00010000:00010000:1.0:1787191340.459220:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a407 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xcf:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e460581a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191340.459242:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xcf:0x0]: losing layout lock 00010000:00010000:1.0:1787191340.459282:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a407 lrc: 1/0,0 mode: --/CW res: [0x200000405:0xcf:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460581a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.459289:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191340.459292:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a407 lrc: 0/0,0 mode: --/CW res: [0x200000405:0xcf:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460581a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1787191340.459318:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 36, max 7 00000100:00100000:1.0:1787191340.459325:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8000 x1874004626707968/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787191340.459347:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8000 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626707968:192.168.202.101@tcp:36:bash.0 00000100:00100000:1.0:1787191340.459487:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191340.464274:0:57902:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57902:1874004626707712:192.168.202.101@tcp:35:lfs.0 00000002:00100000:2.0:1787191340.464310:0:57902:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1d500 x1874004626706304/t8589936904(8589936904) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787191340.464357:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8000 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626707968:192.168.202.101@tcp:36:bash.0 00000080:00200000:1.0:1787191340.464400:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:1.0:1787191340.464408:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xcf:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00010000:00010000:1.0:1787191340.464423:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/207 (0 0) 00000080:00010000:1.0:1787191340.464435:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xcf:0x0](ffff936b5396aa08) 00000002:00010000:1.0:1787191340.464445:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xcf:0x0]) in obj [0x200000405:0xcf:0x0], intent: layout flags 0 00010000:00010000:1.0:1787191340.464492:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a415 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000080:00200000:2.0:1787191340.464494:0:57902:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00010000:00010000:1.0:1787191340.464505:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a415 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191340.464506:0:57902:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191340.464519:0:57902:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191340.464522:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a415 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.464534:0:57902:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191340.464541:0:57902:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191340.464546:0:57902:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191340.464549:0:57902:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000100:00100000:1.0:1787191340.464552:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626708096:192.168.202.101@tcp:101:bash.0 00000080:00010000:2.0:1787191340.464556:0:57902:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42163bf8 00010000:00010000:2.0:1787191340.464560:0:57902:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191340.464584:0:57902:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191340.464593:0:57902:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191340.464599:0:57902:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191340.464603:0:57902:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191340.464613:0:57902:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b5127b800, open_flags d900, mode 0 opened 0 00000080:00200000:2.0:1787191340.464618:0:57902:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:2.0:1787191340.464636:0:57902:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00000100:00100000:1.0:1787191340.464645:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00010000:00010000:2.0:1787191340.464672:0:57902:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483a41c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.464680:0:57902:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483a41c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57902 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191340.464689:0:57902:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191340.464697:0:57902:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8700 x1874004626708352/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191340.464705:0:57902:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483a41c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191340.464717:0:57902:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57902:1874004626708352:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191340.464861:0:57902:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.467568:0:57902:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57902:1874004626708352:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191340.467594:0:57902:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483a41c lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605867 expref: -99 pid: 57902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.467616:0:57902:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483a41c lrc: 4/1,0 mode: --/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605867 expref: -99 pid: 57902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.467625:0:57902:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483a41c lrc: 4/1,0 mode: --/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605867 expref: -99 pid: 57902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.467638:0:57902:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483a41c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605867 expref: -99 pid: 57902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.467649:0:57902:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483a41c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605867 expref: -99 pid: 57902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.467662:0:57902:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483a41c lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605867 expref: -99 pid: 57902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.467670:0:57902:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483a41c lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605867 expref: -99 pid: 57902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.467682:0:57902:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483a41c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605867 expref: -99 pid: 57902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191340.467694:0:57902:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b513b8700 x1874004626708352/t8589936911(8589936911) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191340.467707:0:57902:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b8700 x1874004626708352/t8589936911(8589936911) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191340.467721:0:57902:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483a41c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605867 expref: -99 pid: 57902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191340.467734:0:57902:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483a41c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605867 expref: -99 pid: 57902 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.467744:0:57902:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/207 (0 0) 00000080:00200000:0.0:1787191340.467750:0:57902:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191340.467796:0:57902:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xcf:0x0](ffff936b5396aa08): rc = 0 00000080:00200000:0.0:1787191340.467809:0:57902:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xcf:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:0.0:1787191340.467814:0:57902:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xcf:0x0](ffff936b5396aa08) for lock 0xe5129dc88483a41c 00000080:00010000:0.0:1787191340.467828:0:57902:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xcf:0x0](ffff936b5396aa08) 00000080:00200008:0.0:1787191340.467867:0:57902:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xcf:0x0](ffff936b5396aa08), flags 154400 00000002:00100000:0.0:1787191340.467890:0:57902:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b8700 x1874004626708352/t8589936911(8589936911) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191340.467930:0:57902:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a41c from it ffff936b60dc45a0 00010000:00010000:0.0:1787191340.467935:0:57902:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483a41c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605867 expref: -99 pid: 57902 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.467949:0:57902:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483a41c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605867 expref: -99 pid: 57902 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191340.467971:0:57902:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xcf:0x0](ffff936b5396aa08), inode mode 81a4 mask 44 00000080:00200000:0.0:1787191340.468047:0:57902:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xcf:0x0](ffff936b5396aa08), inode mode 81a4 mask 4 00000080:00200000:0.0:1787191340.468055:0:57902:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xcf:0x0](ffff936b5396aa08), xattr lov 00000080:00200008:0.0:1787191340.468079:0:57902:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xcf:0x0](ffff936b5396aa08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191340.468085:0:57902:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xcf:0x0](ffff936b5396aa08),name=f70.sanity-flr 00000002:00010000:0.0:1787191340.468105:0:57902:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xcf:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.468114:0:57902:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483a41c lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605867 expref: -99 pid: 57902 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.468126:0:57902:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483a41c lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605867 expref: -99 pid: 57902 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191340.468133:0:57902:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191340.468138:0:57902:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xcf:0x0](ffff936b5396aa08) 00000080:00010000:0.0:1787191340.468141:0:57902:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xcf:0x0](ffff936b5396aa08) for lock 0xe5129dc88483a41c 00000080:00010000:0.0:1787191340.468145:0:57902:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a41c from it ffffa3fb42163cd8 00010000:00010000:0.0:1787191340.468148:0:57902:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483a41c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605867 expref: -99 pid: 57902 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.468156:0:57902:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483a41c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605867 expref: -99 pid: 57902 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191340.468176:0:57902:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xcf:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00020000:00200000:0.0:1787191340.468189:0:57902:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xcf:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191340.468193:0:57902:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191340.468196:0:57902:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xcf:0x0] 00000008:00010000:0.0:1787191340.468214:0:57902:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191340.468217:0:57902:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f993f0, osc lock ffff936b50b63690, flags 0x400000400001002 00000008:00010000:0.0:1787191340.468223:0:57902:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191340.468224:0:57902:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f99430, osc lock ffff936b50b62be0, flags 0x400000400001002 00010000:00010000:0.0:1787191340.468241:0:57902:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a3f9 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605828 expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.468252:0:57902:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a3f9 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605828 expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:0.0:1787191340.468265:0:57902:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191340.468269:0:57902:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a3f9 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605828 expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.468277:0:57902:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a3f9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605828 expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191340.468291:0:57902:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a400 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460582f expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.468299:0:57902:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a400 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460582f expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:0.0:1787191340.468306:0:57902:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191340.468309:0:57902:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a400 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460582f expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.468317:0:57902:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a400 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460582f expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:0.0:1787191340.468325:0:57902:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191340.468333:0:57902:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xcf:0x0] updating i_size 0 i_blocks 0 00000020:00010000:0.0:1787191340.468336:0:57902:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c3a060 (ffff936b47a175a8/0) at cl_lock_release():245 00000020:00010000:0.0:1787191340.468339:0:57902:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c3a060 (ffff936b47a175a8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191340.468342:0:57902:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f993f0 (ffff936b47a17008/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191340.468345:0:57902:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99430 (ffff936b47a17d88/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191340.468347:0:57902:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c3a060 (ffff936b47a175a8/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191340.468350:0:57902:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f993f0 (ffff936b47a175a8/1) at cl_lock_fini():72 00000020:00010000:0.0:1787191340.468353:0:57902:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99430 (ffff936b47a175a8/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191340.468361:0:57902:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xcf:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1787191340.468387:0:57902:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xcf:0x0](ffff936b5396aa08), flags 154000 00000002:00100000:0.0:1787191340.468421:0:57902:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513b8700 x1874004626708352/t8589936911(8589936911) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191340.468431:0:57902:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191340.468437:0:57902:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477b80 x1874004626708608/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191340.468457:0:57902:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57902:1874004626708608:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191340.468538:0:57902:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191340.470658:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626708096:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191340.470687:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a415 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xcf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460584b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.470708:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a415 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xcf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460584b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191340.470721:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b453a9500 x1874004626708096/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191340.470731:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a415 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460584b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191340.470743:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a415 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460584b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.470752:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/207 (0 0) 00000080:00200000:1.0:1787191340.470758:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xcf:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191340.470775:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xcf:0x0](ffff936b5396aa08) for lock 0xe5129dc88483a415 00000080:00010000:1.0:1787191340.470782:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a415 from it ffffa3fb41cab8c8 00010000:00010000:1.0:1787191340.470785:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a415 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460584b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.470794:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a415 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xcf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460584b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.470816:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483a41c lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605867 expref: -99 pid: 57902 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191340.470826:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483a41c lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605867 expref: -99 pid: 57902 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:1.0:1787191340.470896:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xcf:0x0](00000000de5f59ae) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483a41c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605867 expref: -99 pid: 57902 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191340.470908:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483a41c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605867 expref: -99 pid: 57902 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191340.470916:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483a41c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605867 expref: -99 pid: 57902 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00020000:00200000:1.0:1787191340.470933:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xcf:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:1.0:1787191340.470941:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xcf:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191340.470944:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xcf:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:1.0:1787191340.470952:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xcf:0x0](ffff936b5396aa08) 00000002:00010000:1.0:1787191340.470961:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xcf:0x0]) in obj [0x200000405:0xcf:0x0], intent: layout flags 02 00010000:00010000:1.0:1787191340.470978:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a415 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xcf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e460584b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191340.470996:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xcf:0x0]: losing layout lock 00010000:00010000:1.0:1787191340.471012:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483a41c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4605867 expref: -99 pid: 57902 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191340.471020:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xcf:0x0]: losing layout lock 00010000:00010000:1.0:1787191340.471104:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a415 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xcf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e460584b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.471113:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483a41c lrc: 1/0,0 mode: --/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605867 expref: -99 pid: 57902 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191340.471188:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:1.0:1787191340.471192:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a415 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xcf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e460584b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.471205:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4e00/0xe5129dc88483a41c lrc: 0/0,0 mode: --/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605867 expref: -99 pid: 57902 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191340.471225:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a423 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.471231:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a423 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xcf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191340.471241:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:1.0:1787191340.471247:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9500 x1874004626708864/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 384/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191340.471256:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a423 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xcf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191340.471274:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626708864:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191340.471406:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.477450:0:57902:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57902:1874004626708608:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191340.477493:0:57902:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513b8700 x1874004626708352/t8589936911(8589936911) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191340.477579:0:57902:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191340.477597:0:57902:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.477613:0:57902:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.477626:0:57902:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.477634:0:57902:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191340.477640:0:57902:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191340.477643:0:57902:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191340.477651:0:57902:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42163bf8 00010000:00010000:0.0:1787191340.477656:0:57902:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.477665:0:57902:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.477681:0:57902:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.477688:0:57902:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191340.477693:0:57902:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.477707:0:57902:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b60796180, open_flags d902, mode 0 opened 0 00000080:00200000:0.0:1787191340.477713:0:57902:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:0.0:1787191340.477729:0:57902:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154403 00010000:00010000:0.0:1787191340.477775:0:57902:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a42a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.477783:0:57902:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a42a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57902 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191340.477793:0:57902:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191340.477800:0:57902:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477b80 x1874004626709120/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191340.477809:0:57902:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a42a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191340.477849:0:57902:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57902:1874004626709120:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191340.478012:0:57902:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191340.504237:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191340.504274:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634899456 00000100:00100000:3.0:1787191340.504284:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634899456 00000100:00100000:3.0:1787191340.504334:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1372 00000100:00100000:3.0:1787191340.504345:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30511:x1874004634899456:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191340.504365:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080030000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000100:00100000:0.0:1787191340.504400:0:57902:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57902:1874004626709120:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191340.504420:0:57902:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a42a lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.504431:0:57902:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a42a lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.504439:0:57902:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a42a lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.504444:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1787191340.504448:0:57902:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a42a lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191340.504455:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30511:x1874004634899456:12345-192.168.202.101@tcp:104: Request processed in 110us (227us total) trans 0 rc 0/0 00010000:00010000:0.0:1787191340.504461:0:57902:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a42a lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191340.504468:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1372 00010000:00010000:0.0:1787191340.504473:0:57902:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44caea00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191340.504480:0:57902:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a42a lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.504486:0:57902:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a42a lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.504493:0:57902:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a42a lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.504500:0:57902:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191340.504507:0:57902:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a42a lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.504514:0:57902:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a42a lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57902 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191340.504539:0:57902:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b6a477b80 x1874004626709120/t8589936914(8589936914) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191340.504554:0:57902:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477b80 x1874004626709120/t8589936914(8589936914) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191340.504570:0:57902:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191340.504618:0:57902:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xcf:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191340.504628:0:57902:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xcf:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191340.504632:0:57902:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191340.504639:0:57902:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:0.0:1787191340.504671:0:57902:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xcf:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:0.0:1787191340.504702:0:57902:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a3f9 lrc: 1/0,0 mode: PR/PR res: [0x280000401:0x1bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605828 expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:0.0:1787191340.504725:0:57902:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a400 lrc: 1/0,0 mode: PR/PR res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460582f expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191340.504775:0:57902:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xcf:0x0](ffff936b5396aa08): rc = 0 00010000:00010000:1.0:1787191340.504775:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000080:00010000:0.0:1787191340.504784:0:57902:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xcf:0x0](ffff936b5396aa08) for lock 0x0 00010000:00010000:1.0:1787191340.504786:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080030000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191340.504797:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030400 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191340.504802:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428480030000 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000080:00200008:0.0:1787191340.504807:0:57902:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xcf:0x0](ffff936b5396aa08), flags 154402 00000002:00100000:0.0:1787191340.504868:0:57902:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477b80 x1874004626709120/t8589936914(8589936914) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1787191340.504881:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480030020 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191340.504890:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000002:00100000:0.0:1787191340.504901:0:57902:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a477b80 x1874004626709120/t8589936914(8589936914) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1787191340.504910:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480030020 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00100000:0.0:1787191340.504912:0:57902:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191340.504921:0:57902:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474000 x1874004626709504/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191340.504925:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a3a5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480030020 nid: local remote: 0x7130d520e460571e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000100:00100000:0.0:1787191340.504949:0:57902:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57902:1874004626709504:192.168.202.101@tcp:35:lfs.0 00010000:00010000:1.0:1787191340.504952:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191340.504955:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191340.504957:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191340.504969:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626709248:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191340.505014:0:57902:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191340.511303:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626709248:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191340.512594:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:1.0:1787191340.512679:0:57570:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589936913 gen 1 00000100:00100000:1.0:1787191340.512735:0:57570:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b513b8e00 x1874004626707328/t8589936907(8589936907) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787191340.512747:0:57570:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff936b6a477b80 x1874004626709120/t8589936914(8589936914) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787191340.512755:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626708864:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191340.512771:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a423 lrc: 4/0,1 mode: --/EX res: [0x200000405:0xcf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460587c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.512783:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a423 lrc: 4/0,1 mode: --/CR res: [0x200000405:0xcf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460587c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.512792:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a423 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xcf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460587c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.512799:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a423 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xcf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460587c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.512809:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a423 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xcf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460587c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.512814:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a423 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xcf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460587c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.512819:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a423 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xcf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460587c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191340.512824:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b453a9500 x1874004626708864/t8589936913(8589936913) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 384/736 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191340.512870:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a423 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460587c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191340.512878:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a423 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460587c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.512889:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/207 (0 0) 00000080:00200000:1.0:1787191340.512894:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xcf:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191340.512903:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xcf:0x0](ffff936b5396aa08) for lock 0xe5129dc88483a423 00000080:00010000:1.0:1787191340.512909:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a423 from it ffffa3fb41cab930 00010000:00010000:1.0:1787191340.512911:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a423 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460587c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.512917:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a423 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xcf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460587c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191340.512932:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:1.0:1787191340.512938:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xcf:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:1.0:1787191340.512948:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a423 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xcf:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460587c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.512956:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a423 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xcf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460587c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:1.0:1787191340.512961:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xcf:0x0](00000000de5f59ae) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a423 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460587c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191340.512991:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xcf:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:1.0:1787191340.512994:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a423 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460587c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.512999:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a423 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xcf:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460587c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:1.0:1787191340.513012:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xcf:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:1.0:1787191340.513016:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xcf:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191340.513018:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191340.513026:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191340.513053:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191340.513058:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:1.0:1787191340.513071:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:1.0:1787191340.513075:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b628930f0, osc lock ffff936b46837300, flags 0x80000000 00000008:00010000:1.0:1787191340.513078:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:1.0:1787191340.513080:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b62893130, osc lock ffff936b46836260, flags 0x80000000 00010000:00010000:1.0:1787191340.513133:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a431 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.513143:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a431 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.513154:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a431 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191340.513171:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626709632:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191340.513233:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628939c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191340.513367:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634900096 00000100:00100000:2.0:1787191340.513373:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634900096 00000100:00100000:2.0:1787191340.513415:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1373 00000100:00100000:2.0:1787191340.513424:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:29543:x1874004634900096:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191340.513435:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483a3b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4605725 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191340.513480:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191340.513485:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:29543:x1874004634900096:12345-192.168.202.101@tcp:104: Request processed in 64us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191340.513490:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1373 00010000:00010000:1.0:1787191340.513540:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191340.513545:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483a3b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4605725 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.513551:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030200 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191340.513555:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483a3b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4605725 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.513578:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483a3b3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4605725 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.513583:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191340.513605:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483a3b3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4605725 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.513610:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483a3b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4605725 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.513624:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191340.513625:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191340.513626:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191340.513631:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787191340.513637:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626709760:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191340.521111:0:57902:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57902:1874004626709504:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191340.521153:0:57902:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a477b80 x1874004626709120/t8589936914(8589936914) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787191340.521160:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626709632:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191340.521186:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a431 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46058c2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.521206:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a431 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e46058c2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.521219:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a431 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e46058c2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.521241:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a431 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e46058c2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1787191340.521243:0:57902:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xcf:0x0](ffff936b5396aa08), inode mode 81a4 mask 46 00000008:00010000:1.0:1787191340.521266:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a431 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e46058c2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.521277:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a431 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46058c2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.521285:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a431 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46058c2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200080:0.0:1787191340.521336:0:57902:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xcf:0x0](ffff936b5396aa08) cmd=800466af arg=7ffe7c83374c 00010000:00010000:1.0:1787191340.521355:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a438 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200080:0.0:1787191340.521357:0:57902:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xcf:0x0](ffff936b5396aa08) cmd=80086601 arg=7ffe7c8336e8 00010000:00010000:1.0:1787191340.521371:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a438 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.521383:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a438 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191340.521407:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626709888:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191340.521409:0:57902:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57902:1874004626710016:192.168.202.101@tcp:33:lfs.0 00000100:00100000:1.0:1787191340.521579:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628939c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.521713:0:57902:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191340.526742:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626709760:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191340.528432:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626709888:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191340.528463:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a438 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46058c9 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.528484:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a438 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e46058c9 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.528497:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a438 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e46058c9 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.528512:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a438 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e46058c9 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191340.528525:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a438 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e46058c9 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.528537:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a438 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46058c9 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.528544:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a438 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46058c9 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191340.528659:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787191340.528675:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626710144:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191340.528787:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626710272:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191340.538813:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626710144:192.168.202.101@tcp:10:bash.0 00000100:00100000:0.0:1787191340.539960:0:57902:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57902:1874004626710016:192.168.202.101@tcp:33:lfs.0 00000080:00200080:0.0:1787191340.540004:0:57902:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xcf:0x0](ffff936b5396aa08) cmd=c00c66f3 arg=7ffe7c8336d4 00000080:00200008:0.0:1787191340.540192:0:57902:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xcf:0x0](ffff936b5396aa08), flags 154002 00000100:00100000:1.0:1787191340.541128:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626710272:192.168.202.101@tcp:10:bash.0 00000080:00200000:3.0:1787191340.541909:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xcf:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1787191340.541916:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b497c9308 (ffff936b465cc6c8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191340.541920:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b497c9308 (ffff936b465cc6c8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191340.541925:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b628930f0 (ffff936b47a17cf8/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191340.541936:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a431 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46058c2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.541950:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a431 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46058c2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1787191340.541967:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62893130 (ffff936b47a17bd8/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191340.541971:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a438 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46058c9 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.541978:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a438 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46058c9 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1787191340.541986:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b497c9308 (ffff936b465cc6c8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191340.541988:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b628930f0 (ffff936b465cc6c8/1) at cl_lock_fini():72 00000020:00010000:3.0:1787191340.541992:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62893130 (ffff936b465cc6c8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191340.542052:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xcf:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191340.542075:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xcf:0x0](ffff936b5396aa08) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191340.000000000, mtime 1787191340.000000000, ctime 1787191340.000000000, rc 0 00000080:00200008:3.0:1787191340.542162:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xcf:0x0], ppos: 0, count: 5 00000080:00200000:3.0:1787191340.542175:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:3.0:1787191340.542180:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:3.0:1787191340.542185:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:3.0:1787191340.542191:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:3.0:1787191340.542196:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@00000000551929f2[0x110, 1, [0x200000405:0xcf:0x0] hash] 00000020:00200000:3.0:1787191340.542198:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:3.0:1787191340.542204:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xcf:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:3.0:1787191340.542215:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xcf:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:3.0:1787191340.542220:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xcf:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191340.542223:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:3.0:1787191340.542228:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1787191340.542234:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:3.0:1787191340.542238:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1787191340.542253:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:3.0:1787191340.542267:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:3.0:1787191340.542271:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667730, osc lock ffff936b44f65c80, flags 0x0 00010000:00010000:3.0:1787191340.542286:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a431 lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46058c2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191340.542299:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a431 lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46058c2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191340.542309:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a431 lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46058c2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191340.542317:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a431 lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46058c2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191340.542323:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a431 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46058c2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191340.542333:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:3.0:1787191340.542340:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:3.0:1787191340.542378:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:3.0:1787191340.542386:0:57570:0:(rw26.c:927:ll_write_end()) page@0000000036ccd153[3 000000006213f2a4 2 1 0000000097471822 0 0 0] 00000080:00200000:3.0:1787191340.542390:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @0000000044a01909 17ffffc0001001 3:0 ffff936b50842ee0 0 lru 00000080:00200000:3.0:1787191340.542515:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@00000000d0d57e22 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000ef00a996 00000000280494ef > 3< 0 0 > 4< 0 0 8 469966848 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1787191340.542518:0:57570:0:(rw26.c:927:ll_write_end()) end page@0000000036ccd153 00000080:00200000:3.0:1787191340.542519:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1787191340.542523:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:3.0:1787191340.542543:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 000000001cff57ca ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a431 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46058c2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191340.542561:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b5396abb8, count 1, dirtied 1 00000080:00200000:3.0:1787191340.542565:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:3.0:1787191340.542568:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:3.0:1787191340.542582:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b53cc56c8 (ffff936b47a17ea8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191340.542586:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b53cc56c8 (ffff936b47a17ea8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191340.542588:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667730 (ffff936b465cccf8/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191340.542593:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a431 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46058c2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191340.542601:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a431 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46058c2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:3.0:1787191340.542623:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b53cc56c8 (ffff936b47a17ea8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191340.542626:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667730 (ffff936b47a17ea8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191340.542632:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:3.0:1787191340.542637:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1787191340.542642:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xcf:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191340.542645:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:3.0:1787191340.542651:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xcf:0x0] updating i_size 5 i_blocks 0 00000080:00200000:3.0:1787191340.542655:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:3.0:1787191340.542671:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xcf:0x0](ffff936b5396aa08), flags 100001 00000002:00100000:3.0:1787191340.542726:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513b8e00 x1874004626707328/t8589936907(8589936907) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191340.542738:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191340.542744:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1ea00 x1874004626710528/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191340.542764:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626710528:192.168.202.101@tcp:35:bash.0 00000100:00100000:3.0:1787191340.543294:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787191340.551468:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626710528:192.168.202.101@tcp:35:bash.0 00000002:00100000:2.0:1787191340.551503:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513b8e00 x1874004626707328/t8589936907(8589936907) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191340.567390:0:57904:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191340.567421:0:57904:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191340.567439:0:57904:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191340.567457:0:57904:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191340.567465:0:57904:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191340.567474:0:57904:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191340.567478:0:57904:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191340.567485:0:57904:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42213b58 00010000:00010000:3.0:1787191340.567489:0:57904:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191340.567498:0:57904:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191340.567515:0:57904:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191340.567522:0:57904:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:3.0:1787191340.567528:0:57904:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191340.567539:0:57904:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:3.0:1787191340.567543:0:57904:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:3.0:1787191340.567555:0:57904:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1787191340.567601:0:57904:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a43f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.567622:0:57904:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a43f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57904 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.567633:0:57904:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a43f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57904 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191340.567659:0:57904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ce00 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57904:1874004626710656:192.168.202.101@tcp:101:rm.0 00000100:00100000:3.0:1787191340.567807:0:57904:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cd80 going to sleep for 11 seconds 00000080:00200000:0.0:1787191340.574942:0:57903:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191340.574974:0:57903:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.574990:0:57903:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.575006:0:57903:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.575015:0:57903:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191340.575022:0:57903:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191340.575473:0:57903:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191340.575484:0:57903:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4220bbf8 00010000:00010000:0.0:1787191340.575489:0:57903:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.575499:0:57903:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.575515:0:57903:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.575523:0:57903:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191340.575528:0:57903:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:0.0:1787191340.578422:0:57904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ce00 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57904:1874004626710656:192.168.202.101@tcp:101:rm.0 00010000:00010000:0.0:1787191340.578452:0:57904:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a43f lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46058e5 expref: -99 pid: 57904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.578477:0:57904:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a43f lrc: 4/1,0 mode: --/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46058e5 expref: -99 pid: 57904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.578485:0:57904:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a43f lrc: 4/1,0 mode: --/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46058e5 expref: -99 pid: 57904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.578497:0:57904:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a43f lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46058e5 expref: -99 pid: 57904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.578508:0:57904:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a43f lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46058e5 expref: -99 pid: 57904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.578520:0:57904:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a43f lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46058e5 expref: -99 pid: 57904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.578528:0:57904:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a43f lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46058e5 expref: -99 pid: 57904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.578535:0:57904:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a43f lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46058e5 expref: -99 pid: 57904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191340.578545:0:57904:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b51d1ce00 x1874004626710656/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/976 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191340.578555:0:57904:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a43f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46058e5 expref: -99 pid: 57904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191340.578573:0:57904:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a43f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46058e5 expref: -99 pid: 57904 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.578582:0:57904:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/207 (0 0) 00000080:00200000:0.0:1787191340.578588:0:57904:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191340.578648:0:57904:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xcf:0x0](ffff936b5396aa08): rc = 0 00000080:00200000:0.0:1787191340.578662:0:57904:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xcf:0x0]: layout version change: 4 -> 4 00000080:00010000:0.0:1787191340.578666:0:57904:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xcf:0x0](ffff936b5396aa08) for lock 0xe5129dc88483a43f 00000080:00010000:0.0:1787191340.578689:0:57904:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xcf:0x0](ffff936b5396aa08) 00000080:00010000:0.0:1787191340.578693:0:57904:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a43f from it ffffa3fb42213b20 00010000:00010000:0.0:1787191340.578697:0:57904:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a43f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46058e5 expref: -99 pid: 57904 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.578707:0:57904:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a43f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46058e5 expref: -99 pid: 57904 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200008:0.0:1787191340.578746:0:57904:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xcf:0x0](ffff936b5396aa08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191340.578751:0:57904:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xcf:0x0](ffff936b5396aa08),name=f70.sanity-flr 00000002:00010000:0.0:1787191340.578772:0:57904:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xcf:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.578779:0:57904:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a43f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46058e5 expref: -99 pid: 57904 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.578789:0:57904:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a43f lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46058e5 expref: -99 pid: 57904 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191340.578795:0:57904:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191340.578800:0:57904:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xcf:0x0](ffff936b5396aa08) 00000080:00010000:0.0:1787191340.578803:0:57904:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xcf:0x0](ffff936b5396aa08) for lock 0xe5129dc88483a43f 00000080:00010000:0.0:1787191340.578806:0:57904:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a43f from it ffffa3fb42213cb8 00010000:00010000:0.0:1787191340.578808:0:57904:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a43f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46058e5 expref: -99 pid: 57904 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.578815:0:57904:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a43f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46058e5 expref: -99 pid: 57904 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191340.579097:0:57904:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xcf:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00020000:00200000:0.0:1787191340.579108:0:57904:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xcf:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191340.579112:0:57904:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191340.579125:0:57904:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xcf:0x0] 00000008:00010000:0.0:1787191340.579143:0:57904:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191340.579146:0:57904:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee6430, osc lock ffff936b50b62be0, flags 0x400000400001002 00010000:00010000:0.0:1787191340.579162:0:57904:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a431 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46058c2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191340.579174:0:57904:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a431 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46058c2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:0.0:1787191340.579186:0:57904:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191340.579190:0:57904:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a431 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46058c2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191340.579198:0:57904:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a431 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46058c2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:0.0:1787191340.579214:0:57904:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191340.579222:0:57904:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xcf:0x0] updating i_size 5 i_blocks 0 00000020:00010000:0.0:1787191340.579229:0:57904:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c3a060 (ffff936b47a175a8/0) at cl_lock_release():245 00000020:00010000:0.0:1787191340.579232:0:57904:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c3a060 (ffff936b47a175a8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191340.579235:0:57904:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee6430 (ffff936b47a17d88/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191340.579238:0:57904:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c3a060 (ffff936b47a175a8/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191340.579241:0:57904:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee6430 (ffff936b47a175a8/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191340.579250:0:57904:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xcf:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191340.579292:0:57904:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191340.579302:0:57904:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.579310:0:57904:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.579318:0:57904:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.579708:0:57904:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191340.579714:0:57904:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191340.579718:0:57904:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191340.579722:0:57904:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42213c10 00010000:00010000:0.0:1787191340.579726:0:57904:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.579734:0:57904:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.579749:0:57904:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.579757:0:57904:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:0.0:1787191340.579762:0:57904:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191340.579867:0:57903:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:2.0:1787191340.579884:0:57903:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xcf:0x0](ffff936b5396aa08), inode mode 81a4 mask 44 00000080:00200008:2.0:1787191340.579892:0:57903:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xcf:0x0](ffff936b5396aa08), flags 154400 00000002:00010000:2.0:1787191340.579910:0:57903:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xcf:0x0]) in obj [0x200000405:0xcf:0x0], intent: open flags 0104240114401 00010000:00010000:2.0:1787191340.579956:0:57903:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a446 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.579968:0:57903:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a446 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57903 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191340.579979:0:57903:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191340.579988:0:57903:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8e00 x1874004626710912/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191340.579998:0:57903:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a446 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57903 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191340.580019:0:57903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57903:1874004626710912:192.168.202.101@tcp:101:lfs.0 00000080:00200000:0.0:1787191340.580324:0:57904:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:0.0:1787191340.580331:0:57904:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:0.0:1787191340.580337:0:57904:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:0.0:1787191340.580363:0:57904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a423 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xcf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e460587c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191340.580377:0:57904:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xcf:0x0]: losing layout lock 00010000:00010000:0.0:1787191340.580390:0:57904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a43f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46058e5 expref: -99 pid: 57904 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191340.580398:0:57904:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xcf:0x0]: losing layout lock 00010000:00010000:0.0:1787191340.580406:0:57904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a40e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e460583d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.580439:0:57904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a423 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xcf:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460587c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191340.580447:0:57904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a43f lrc: 1/0,0 mode: --/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46058e5 expref: -99 pid: 57904 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191340.580454:0:57904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a40e lrc: 1/0,0 mode: --/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e460583d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.580460:0:57904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:0.0:1787191340.580463:0:57904:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a423 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xcf:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460587c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191340.580475:0:57904:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a43f lrc: 0/0,0 mode: --/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46058e5 expref: -99 pid: 57904 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191340.580484:0:57904:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a40e lrc: 0/0,0 mode: --/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e460583d expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1787191340.580497:0:57904:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 36, max 7 00000100:00100000:0.0:1787191340.580503:0:57904:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477b80 x1874004626711168/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787191340.580517:0:57904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57904:1874004626711168:192.168.202.101@tcp:36:rm.0 00000100:00100000:0.0:1787191340.580561:0:57904:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.581048:0:57903:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f300 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.583957:0:57903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57903:1874004626710912:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191340.583985:0:57903:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a446 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xcf:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46058f3 expref: -99 pid: 57903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.584000:0:57903:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a446 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xcf:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46058f3 expref: -99 pid: 57903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.584013:0:57903:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a446 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xcf:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46058f3 expref: -99 pid: 57903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191340.584187:0:57903:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x200002b, status=0 req@ffff936b513b8e00 x1874004626710912/t8589936917(8589936917) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191340.584209:0:57903:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b8e00 x1874004626710912/t8589936917(8589936917) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191340.584223:0:57903:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a446 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcf:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46058f3 expref: -99 pid: 57903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191340.585003:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191340.585046:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634900608 00000100:00100000:3.0:1787191340.585055:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634900608 00000100:00100000:3.0:1787191340.585100:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1374 00000100:00100000:3.0:1787191340.585110:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634900608:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191340.585134:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a446 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xcf:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e46058f3 expref: -99 pid: 57903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.585205:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191340.585213:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634900608:12345-192.168.202.101@tcp:104: Request processed in 104us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191340.585221:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1374 00010000:00010000:1.0:1787191340.585795:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191340.585803:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a446 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xcf:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e46058f3 expref: -99 pid: 57903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.585812:0:43384:0:(ldlm_lockd.c:1935:ldlm_handle_bl_callback()) Lock ffff936b51dd5e00 is referenced, will be cancelled later 00010000:00010000:1.0:1787191340.585816:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a446 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xcf:0x0].0x0 bits 0xd/0x3 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e46058f3 expref: -99 pid: 57903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.585825:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191340.585826:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191340.585828:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000002:00010000:2.0:1787191340.590320:0:57903:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a446 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcf:0x0].0x0 bits 0xd/0x3 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e46058f3 expref: -99 pid: 57903 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.590348:0:57903:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/207 (0 0) 00000080:00200000:2.0:1787191340.590354:0:57903:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xcf:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1787191340.590426:0:57903:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xcf:0x0]: layout version change: 4294967294 -> 4 00000080:00010000:2.0:1787191340.590432:0:57903:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xcf:0x0](ffff936b5396aa08) for lock 0xe5129dc88483a446 00000080:00010000:2.0:1787191340.590439:0:57903:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a446 from it ffffa3fb4220bbf0 00010000:00010000:2.0:1787191340.590443:0:57903:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a446 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xcf:0x0].0x0 bits 0xd/0x3 rrc: 2 type: IBT gid 0 flags: 0x10420400000000 nid: local remote: 0x7130d520e46058f3 expref: -99 pid: 57903 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.590451:0:57903:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a446 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xcf:0x0].0x0 bits 0xd/0x3 rrc: 2 type: IBT gid 0 flags: 0x10420400000000 nid: local remote: 0x7130d520e46058f3 expref: -99 pid: 57903 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.590514:0:57903:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000002:00100000:2.0:1787191340.590543:0:57903:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b8e00 x1874004626710912/t8589936917(8589936917) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191340.590705:0:57903:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xcf:0x0](ffff936b5396aa08), inode mode 81a4 mask 4 00000080:00200000:2.0:1787191340.590714:0:57903:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xcf:0x0](ffff936b5396aa08), xattr lov 00000080:00200008:2.0:1787191340.590740:0:57903:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xcf:0x0](ffff936b5396aa08), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191340.590747:0:57903:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xcf:0x0](ffff936b5396aa08),name=f70.sanity-flr 00000002:00010000:2.0:1787191340.590759:0:57903:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xcf:0x0]) in obj [0x200000405:0xcf:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191340.590766:0:57903:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 30 res 8589935621/207 (0 0) 00010000:00010000:2.0:1787191340.590806:0:57903:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a44d lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.590814:0:57903:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a44d lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.590824:0:57903:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a44d lrc: 3/1,0 mode: --/CR res: [0x200000405:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57903 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191340.590865:0:57903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57903:1874004626711296:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191340.590955:0:57903:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5fa80 going to sleep for 11 seconds 00010000:00010000:0.0:1787191340.596696:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191340.596712:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a446 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xcf:0x0].0x0 bits 0xd/0x3 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46058f3 expref: -99 pid: 57903 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.596727:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd5e00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191340.596732:0:40929:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a446 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xcf:0x0].0x0 bits 0xd/0xd rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46058f3 expref: -99 pid: 57903 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.596741:0:40929:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a446 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xcf:0x0].0x0 bits 0xd/0xd rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46058f3 expref: -99 pid: 57903 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.596751:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a446 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xcf:0x0].0x0 bits 0xd/0xd rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e46058f3 expref: -99 pid: 57903 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1787191340.597369:0:40929:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xcf:0x0]: losing layout lock 00010000:00010000:1.0:1787191340.597434:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a446 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xcf:0x0].0x0 bits 0xd/0xd rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46058f3 expref: -99 pid: 57903 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.597443:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191340.597479:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a446 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xcf:0x0].0x0 bits 0xd/0xd rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46058f3 expref: -99 pid: 57903 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.597486:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a446 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xcf:0x0].0x0 bits 0xd/0xd rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46058f3 expref: -99 pid: 57903 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191340.597508:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787191340.597529:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626711424:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787191340.597807:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191340.597810:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191340.597812:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191340.600233:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626711424:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191340.606979:0:57903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57903:1874004626711296:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191340.607007:0:57903:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a44d lrc: 4/1,0 mode: --/CR res: [0x200000405:0xcf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460591d expref: -99 pid: 57903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.607020:0:57903:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a44d lrc: 4/1,0 mode: --/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460591d expref: -99 pid: 57903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.607043:0:57903:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a44d lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460591d expref: -99 pid: 57903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.607055:0:57903:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a44d lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460591d expref: -99 pid: 57903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.607068:0:57903:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a44d lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460591d expref: -99 pid: 57903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.607077:0:57903:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a44d lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460591d expref: -99 pid: 57903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.607085:0:57903:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a44d lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460591d expref: -99 pid: 57903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191340.607097:0:57903:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b513b9500 x1874004626711296/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/976 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191340.607121:0:57903:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a44d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460591d expref: -99 pid: 57903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191340.607135:0:57903:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a44d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460591d expref: -99 pid: 57903 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.607146:0:57903:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/207 (0 0) 00000080:00200000:1.0:1787191340.607152:0:57903:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xcf:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787191340.607216:0:57903:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xcf:0x0]: layout version change: 4294967294 -> 4 00000080:00010000:1.0:1787191340.607221:0:57903:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xcf:0x0](ffff936b5396aa08) for lock 0xe5129dc88483a44d 00000080:00010000:1.0:1787191340.607228:0:57903:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xcf:0x0](ffff936b5396aa08) 00000080:00010000:1.0:1787191340.607232:0:57903:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a44d from it ffffa3fb4220bcd8 00010000:00010000:1.0:1787191340.607235:0:57903:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a44d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460591d expref: -99 pid: 57903 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.607244:0:57903:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5c00/0xe5129dc88483a44d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xcf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460591d expref: -99 pid: 57903 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191340.607278:0:57903:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xcf:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:1.0:1787191340.607290:0:57903:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xcf:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191340.607294:0:57903:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191340.607298:0:57903:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xcf:0x0] 00000008:00010000:1.0:1787191340.607317:0:57903:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191340.607321:0:57903:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b47d7d330, osc lock ffff936b468365f0, flags 0x400000400001002 00010000:00010000:1.0:1787191340.607339:0:57903:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a431 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46058c2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191340.607360:0:57903:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a431 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46058c2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:1.0:1787191340.607372:0:57903:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191340.607376:0:57903:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a431 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46058c2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191340.607385:0:57903:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a431 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46058c2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:1.0:1787191340.607408:0:57903:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191340.607418:0:57903:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xcf:0x0] updating i_size 5 i_blocks 0 00000020:00010000:1.0:1787191340.607423:0:57903:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c39030 (ffff936b47a17c68/0) at cl_lock_release():245 00000020:00010000:1.0:1787191340.607426:0:57903:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c39030 (ffff936b47a17c68/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191340.607429:0:57903:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7d330 (ffff936b465cc998/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191340.607432:0:57903:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c39030 (ffff936b47a17c68/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191340.607435:0:57903:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7d330 (ffff936b47a17c68/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191340.607444:0:57903:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xcf:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1787191340.607503:0:57903:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xcf:0x0](ffff936b5396aa08), flags 154000 00000002:00100000:1.0:1787191340.607549:0:57903:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513b8e00 x1874004626710912/t8589936917(8589936917) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191340.607560:0:57903:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191340.607565:0:57903:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453aa680 x1874004626711680/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191340.607586:0:57903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57903:1874004626711680:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191340.607670:0:57903:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628939c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.608229:0:57904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57904:1874004626711168:192.168.202.101@tcp:36:rm.0 00000100:00100000:1.0:1787191340.619669:0:57903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57903:1874004626711680:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191340.619709:0:57903:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513b8e00 x1874004626710912/t8589936917(8589936917) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191340.619759:0:57903:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xcf:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00020000:00200000:1.0:1787191340.619770:0:57903:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xcf:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191340.619774:0:57903:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191340.619779:0:57903:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191340.619791:0:57903:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000008:00010000:1.0:1787191340.619810:0:57903:0:(osc_cache.c:1183:osc_extent_make_ready()) ### extent: 000000001cff57ca ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a431 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46058c2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000008:00010000:1.0:1787191340.619877:0:57903:0:(osc_cache.c:917:osc_extent_finish()) ### extent: 000000001cff57ca ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a431 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46058c2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000008:00010000:1.0:1787191340.619901:0:57903:0:(osc_cache.c:497:__osc_extent_remove()) ### extent: 000000001cff57ca ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a431 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46058c2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1787191340.619928:0:57903:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xcf:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191340.619978:0:57903:0:(llite_lib.c:2066:ll_clear_inode()) VFS Op:inode=[0x200000405:0xcf:0x0](ffff936b5396aa08) 00000008:00010000:1.0:1787191340.620006:0:57903:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 5 blocks 0 [cma]time 1787191340 1787191340 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a431 lrc: 1/0,0 mode: PW/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46058c2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000008:00010000:1.0:1787191340.620027:0:57903:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191340 1787191340 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a438 lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x1be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46058c9 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191340.620287:0:57903:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191340.620305:0:57903:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191340.620317:0:57903:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191340.620329:0:57903:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191340.620337:0:57903:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191340.620342:0:57903:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191340.620345:0:57903:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191340.620352:0:57903:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4220bb58 00010000:00010000:1.0:1787191340.620356:0:57903:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191340.620364:0:57903:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191340.620378:0:57903:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191340.620385:0:57903:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191340.620390:0:57903:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191340.621545:0:57903:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=9 00000080:00200000:1.0:1787191340.621551:0:57903:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191340.621571:0:57903:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191340.624710:0:57903:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a454 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.624730:0:57903:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a454 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.624743:0:57903:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a454 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57903 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191340.624770:0:57903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57903:1874004626711808:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191340.625633:0:57903:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628939c0 going to sleep for 11 seconds 00000080:00200000:3.0:1787191340.631222:0:57905:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191340.631257:0:57905:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191340.631275:0:57905:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191340.631291:0:57905:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191340.631300:0:57905:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191340.631308:0:57905:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191340.631311:0:57905:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191340.631319:0:57905:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421e3b58 00010000:00010000:3.0:1787191340.631323:0:57905:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191340.631332:0:57905:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191340.631348:0:57905:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191340.631356:0:57905:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:3.0:1787191340.631361:0:57905:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:1.0:1787191340.641190:0:57903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57903:1874004626711808:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191340.641213:0:57903:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a454 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.641230:0:57903:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a454 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.641238:0:57903:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a454 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.641245:0:57903:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a454 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.641255:0:57903:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a454 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.641262:0:57903:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191340.641266:0:57903:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a454 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.641274:0:57903:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a454 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.641281:0:57903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a454 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.641287:0:57903:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191340.641293:0:57903:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a454 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57903 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.641299:0:57903:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a454 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57903 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191340.641321:0:57903:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b453aa680 x1874004626711808/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191340.641336:0:57903:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191340.641781:0:57905:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:3.0:1787191340.641789:0:57905:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:3.0:1787191340.641815:0:57905:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1787191340.641960:0:57905:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a45b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.641969:0:57905:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a45b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.641979:0:57905:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a45b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191340.641999:0:57905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ce00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57905:1874004626711936:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191340.642317:0:57905:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191340.645296:0:57905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ce00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57905:1874004626711936:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191340.645317:0:57905:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a45b lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.645332:0:57905:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a45b lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.645340:0:57905:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a45b lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.645346:0:57905:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a45b lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.645356:0:57905:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a45b lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.645362:0:57905:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9bc00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191340.645367:0:57905:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a45b lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.645374:0:57905:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a45b lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.645381:0:57905:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a45b lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.645388:0:57905:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191340.645405:0:57905:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a45b lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.645413:0:57905:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a45b lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191340.645435:0:57905:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b51d1ce00 x1874004626711936/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191340.645449:0:57905:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191340.645535:0:57905:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191340.645550:0:57905:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191340.645561:0:57905:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191340.645571:0:57905:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191340.645578:0:57905:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191340.645583:0:57905:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191340.645586:0:57905:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191340.645591:0:57905:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421e3be8 00010000:00010000:3.0:1787191340.645594:0:57905:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191340.645602:0:57905:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191340.645744:0:57905:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191340.645753:0:57905:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000080:00200000:3.0:1787191340.645759:0:57905:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191340.645772:0:57905:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:3.0:1787191340.645776:0:57905:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:3.0:1787191340.645789:0:57905:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1787191340.646199:0:57905:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a462 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.646209:0:57905:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a462 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.646219:0:57905:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a462 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191340.651764:0:57905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ce00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57905:1874004626712064:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191340.652899:0:57905:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5ff00 going to sleep for 11 seconds 00000080:00200000:1.0:1787191340.658203:0:57906:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191340.658234:0:57906:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191340.658252:0:57906:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191340.658269:0:57906:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191340.658276:0:57906:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191340.658286:0:57906:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191340.658289:0:57906:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191340.658297:0:57906:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42163bf8 00010000:00010000:1.0:1787191340.658301:0:57906:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191340.658314:0:57906:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191340.658331:0:57906:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191340.658339:0:57906:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191340.658345:0:57906:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:1.0:1787191340.660522:0:57905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ce00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57905:1874004626712064:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191340.660542:0:57905:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a462 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.660557:0:57905:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a462 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.660565:0:57905:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a462 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.660572:0:57905:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a462 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.660582:0:57905:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a462 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.660589:0:57905:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9a000 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191340.660593:0:57905:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a462 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.660601:0:57905:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a462 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.660682:0:57905:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a462 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.660689:0:57905:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191340.660696:0:57905:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a462 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.660704:0:57905:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a462 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191340.660725:0:57905:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b51d1ce00 x1874004626712064/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191340.660741:0:57905:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191340.661062:0:57906:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b5233c300, open_flags d900, mode 0 opened 0 00000080:00200000:0.0:1787191340.661073:0:57906:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:0.0:1787191340.661095:0:57906:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:0.0:1787191340.661158:0:57906:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a469 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.661172:0:57906:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a469 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57906 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191340.661183:0:57906:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191340.661191:0:57906:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474000 x1874004626712320/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191340.661201:0:57906:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a469 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57906 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191340.661221:0:57906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57906:1874004626712320:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191340.661414:0:57906:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.664703:0:57906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57906:1874004626712320:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191340.664728:0:57906:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a469 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.664742:0:57906:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a469 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.664749:0:57906:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a469 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.664757:0:57906:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a469 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.664767:0:57906:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a469 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.664774:0:57906:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44caea00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191340.664780:0:57906:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a469 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.664788:0:57906:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a469 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.664796:0:57906:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a469 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.664803:0:57906:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191340.664810:0:57906:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a469 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.664817:0:57906:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a469 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57906 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191340.664856:0:57906:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x7, status=0 req@ffff936b6a474000 x1874004626712320/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/608 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191340.664871:0:57906:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191340.665162:0:57906:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191340.665178:0:57906:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.665189:0:57906:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.665200:0:57906:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.665206:0:57906:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191340.665212:0:57906:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191340.665215:0:57906:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191340.665221:0:57906:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42163b58 00010000:00010000:0.0:1787191340.665225:0:57906:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.665232:0:57906:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.665247:0:57906:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.665254:0:57906:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191340.665259:0:57906:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.665271:0:57906:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=9 00000080:00200000:0.0:1787191340.665275:0:57906:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:0.0:1787191340.665286:0:57906:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:0.0:1787191340.665325:0:57906:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a470 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.665332:0:57906:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a470 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.665341:0:57906:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a470 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57906 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191340.665360:0:57906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57906:1874004626712448:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191340.665435:0:57906:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000080:00200000:1.0:1787191340.666193:0:57905:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191340.666209:0:57905:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191340.666220:0:57905:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191340.666232:0:57905:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191340.666239:0:57905:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191340.666246:0:57905:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191340.666249:0:57905:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191340.666254:0:57905:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421e3b58 00010000:00010000:1.0:1787191340.666259:0:57905:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191340.666273:0:57905:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191340.666286:0:57905:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191340.666291:0:57905:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:1.0:1787191340.666300:0:57905:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:1.0:1787191340.666305:0:57905:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:1.0:1787191340.666316:0:57905:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191340.666323:0:57905:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 86 lru_type: 1 00010000:00010000:1.0:1787191340.666332:0:57905:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 86 lru_type: 1 00000002:00010000:1.0:1787191340.666343:0:57905:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191340.666347:0:57905:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 30 res 8589937616/5 (0 0) 00010000:00010000:1.0:1787191340.666373:0:57905:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a477 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.666380:0:57905:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a477 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.666388:0:57905:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a477 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191340.668581:0:57905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57905:1874004626712576:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191340.668811:0:57906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57906:1874004626712448:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191340.668827:0:57906:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a470 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.668863:0:57906:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a470 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.668872:0:57906:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a470 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.668880:0:57906:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a470 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.668889:0:57906:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a470 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.668896:0:57906:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cae600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191340.668900:0:57906:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a470 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.668908:0:57906:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a470 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.668916:0:57906:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a470 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.668924:0:57906:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191340.668930:0:57906:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a470 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.668937:0:57906:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a470 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57906 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191340.668955:0:57906:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b6a474000 x1874004626712448/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191340.668971:0:57906:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1787191340.668993:0:57906:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 30 res 8589937616/5 (0 0) 00000100:00100000:1.0:1787191340.671785:0:57905:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628939c0 going to sleep for 11 seconds 00000080:00200000:2.0:1787191340.685804:0:57907:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191340.685919:0:57907:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191340.685936:0:57907:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191340.685953:0:57907:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191340.685967:0:57907:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191340.685976:0:57907:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191340.685980:0:57907:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191340.685987:0:57907:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4222bbf8 00010000:00010000:2.0:1787191340.685991:0:57907:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191340.686000:0:57907:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191340.686016:0:57907:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191340.686024:0:57907:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191340.686047:0:57907:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191340.686060:0:57907:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b604ca180, open_flags d900, mode 0 opened 0 00000080:00200000:2.0:1787191340.686066:0:57907:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:2.0:1787191340.686080:0:57907:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:2.0:1787191340.686194:0:57907:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a47e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.686203:0:57907:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a47e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57907 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191340.686215:0:57907:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191340.686229:0:57907:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8000 x1874004626712832/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191340.686239:0:57907:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a47e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57907 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191340.686260:0:57907:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57907:1874004626712832:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191340.686451:0:57907:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787191340.689330:0:57907:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57907:1874004626712832:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191340.689354:0:57907:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a47e lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.689367:0:57907:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a47e lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.689374:0:57907:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a47e lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.689381:0:57907:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a47e lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.689390:0:57907:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a47e lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.689403:0:57907:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd4600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191340.689407:0:57907:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a47e lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.689415:0:57907:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a47e lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.689422:0:57907:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a47e lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.689428:0:57907:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191340.689433:0:57907:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a47e lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.689440:0:57907:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4600/0xe5129dc88483a47e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57907 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191340.689460:0:57907:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x7, status=0 req@ffff936b513b8000 x1874004626712832/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/608 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191340.689474:0:57907:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1787191340.689497:0:57907:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 30 res 8589937616/5 (0 0) 00000080:00200000:2.0:1787191340.689749:0:57907:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191340.689766:0:57907:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191340.689774:0:57907:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191340.689786:0:57907:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191340.689792:0:57907:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191340.689797:0:57907:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191340.689801:0:57907:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191340.689806:0:57907:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4222bb58 00010000:00010000:2.0:1787191340.689809:0:57907:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191340.689817:0:57907:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191340.689851:0:57907:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191340.689858:0:57907:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191340.689864:0:57907:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191340.689876:0:57907:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=9 00000080:00200000:2.0:1787191340.689880:0:57907:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191340.689890:0:57907:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191340.689924:0:57907:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a485 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.689931:0:57907:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a485 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.689939:0:57907:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a485 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57907 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191340.689957:0:57907:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57907:1874004626712960:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191340.690023:0:57907:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787191340.691192:0:57905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57905:1874004626712576:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191340.691209:0:57905:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a477 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460599b expref: -99 pid: 57905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.691219:0:57905:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a477 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460599b expref: -99 pid: 57905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.691230:0:57905:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a477 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460599b expref: -99 pid: 57905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.691240:0:57905:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a477 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460599b expref: -99 pid: 57905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.691256:0:57905:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a477 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460599b expref: -99 pid: 57905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.691264:0:57905:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a477 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460599b expref: -99 pid: 57905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.691272:0:57905:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a477 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460599b expref: -99 pid: 57905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191340.691283:0:57905:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b453aa680 x1874004626712576/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191340.691295:0:57905:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a477 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460599b expref: -99 pid: 57905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.691305:0:57905:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:2.0:1787191340.691311:0:57905:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a477 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460599b expref: -99 pid: 57905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.691320:0:57905:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a477 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460599b expref: -99 pid: 57905 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:2.0:1787191340.691344:0:57905:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191340.691354:0:57905:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 172 lru_type: 1 00010000:00010000:2.0:1787191340.691365:0:57905:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 172 lru_type: 1 00010000:00010000:2.0:1787191340.691373:0:57905:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 172 lru_type: 1 00010000:00010000:2.0:1787191340.691380:0:57905:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 173 lru_type: 1 00000080:00200000:2.0:1787191340.691535:0:57905:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1787191340.691546:0:57905:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:2.0:1787191340.691549:0:57905:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:2.0:1787191340.691555:0:57905:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb421e3cb8 00010000:00010000:2.0:1787191340.691559:0:57905:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 86 lru_type: 1 00010000:00010000:2.0:1787191340.691567:0:57905:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 87 lru_type: 1 00000002:00010000:2.0:1787191340.691583:0:57905:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191340.691589:0:57905:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a477 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460599b expref: -99 pid: 57905 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191340.691597:0:57905:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a477 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460599b expref: -99 pid: 57905 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191340.691615:0:57905:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a477 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460599b expref: -99 pid: 57905 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191340.691622:0:57905:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a477 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460599b expref: -99 pid: 57905 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:2.0:1787191340.691631:0:57905:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191340.691636:0:57905:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 173 lru_type: 1 00010000:00010000:2.0:1787191340.691643:0:57905:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 173 lru_type: 1 00010000:00010000:2.0:1787191340.691650:0:57905:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 173 lru_type: 1 00010000:00010000:2.0:1787191340.691656:0:57905:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 174 lru_type: 1 00000100:00100000:0.0:1787191340.693972:0:57907:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57907:1874004626712960:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191340.693992:0:57907:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a485 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.694006:0:57907:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a485 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.694012:0:57907:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a485 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.694019:0:57907:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a485 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.694028:0:57907:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a485 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.694068:0:57907:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd4400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191340.694071:0:57907:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a485 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.694078:0:57907:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a485 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.694084:0:57907:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a485 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.694091:0:57907:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191340.694097:0:57907:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a485 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57907 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.694103:0:57907:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd4400/0xe5129dc88483a485 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57907 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191340.694132:0:57907:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513b8000 x1874004626712960/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191340.694145:0:57907:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1787191340.694173:0:57907:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a477 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460599b expref: -99 pid: 57905 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191340.694185:0:57907:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a477 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460599b expref: -99 pid: 57905 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:0.0:1787191340.694194:0:57907:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a477 from it ffffa3fb4222b930 00010000:00010000:0.0:1787191340.694198:0:57907:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a477 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460599b expref: -99 pid: 57905 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191340.694205:0:57907:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a477 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460599b expref: -99 pid: 57905 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200008:2.0:1787191340.697265:0:57905:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:2.0:1787191340.697276:0:57905:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191340.697302:0:57905:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191340.697318:0:57905:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191340.697334:0:57905:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191340.697343:0:57905:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191340.697351:0:57905:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191340.697355:0:57905:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191340.697363:0:57905:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421e3cb8 00010000:00010000:2.0:1787191340.697367:0:57905:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191340.697377:0:57905:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191340.697507:0:57905:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191340.697516:0:57905:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191340.697522:0:57905:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191340.697531:0:57905:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191340.697536:0:57905:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191340.697539:0:57905:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191340.697542:0:57905:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191340.697545:0:57905:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421e3b58 00010000:00010000:2.0:1787191340.697547:0:57905:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191340.697554:0:57905:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191340.697562:0:57905:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191340.697568:0:57905:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191340.697574:0:57905:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191340.697577:0:57905:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=8 00000080:00200000:2.0:1787191340.697596:0:57905:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191340.697601:0:57905:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191340.697625:0:57905:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191340.697633:0:57905:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191340.697639:0:57905:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191340.697643:0:57905:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191340.697646:0:57905:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191340.697649:0:57905:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421e3bf8 00010000:00010000:2.0:1787191340.697651:0:57905:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191340.697658:0:57905:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191340.697665:0:57905:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191340.697669:0:57905:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191340.697672:0:57905:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191340.697677:0:57905:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:2.0:1787191340.697681:0:57905:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:2.0:1787191340.697685:0:57905:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b604ca600, open_flags a141, mode 81b6 opened 0 00000080:00200000:2.0:1787191340.697693:0:57905:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:2.0:1787191340.697712:0:57905:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xd0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:2.0:1787191340.697723:0:57905:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a477 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e460599b expref: -99 pid: 57905 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191340.697775:0:57905:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a477 lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e460599b expref: -99 pid: 57905 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191340.697782:0:57905:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191340.697785:0:57905:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a477 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e460599b expref: -99 pid: 57905 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191340.697823:0:57905:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a48c lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.697858:0:57905:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a48c lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191340.697872:0:57905:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191340.697886:0:57905:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8a80 x1874004626713216/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191340.697896:0:57905:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a48c lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191340.697918:0:57905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57905:1874004626713216:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191340.698078:0:57905:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787191340.703278:0:57905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57905:1874004626713216:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191340.703304:0:57905:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a48c lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46059e1 expref: -99 pid: 57905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.703331:0:57905:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a48c lrc: 4/0,1 mode: --/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46059e1 expref: -99 pid: 57905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.703340:0:57905:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a48c lrc: 4/0,1 mode: --/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46059e1 expref: -99 pid: 57905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.703356:0:57905:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a48c lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46059e1 expref: -99 pid: 57905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.703367:0:57905:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a48c lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46059e1 expref: -99 pid: 57905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.703380:0:57905:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a48c lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46059e1 expref: -99 pid: 57905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.703387:0:57905:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a48c lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46059e1 expref: -99 pid: 57905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.703672:0:57905:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a48c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46059e1 expref: -99 pid: 57905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191340.703686:0:57905:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b513b8a80 x1874004626713216/t8589936920(8589936920) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191340.703698:0:57905:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b8a80 x1874004626713216/t8589936920(8589936920) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191340.703710:0:57905:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a48c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46059e1 expref: -99 pid: 57905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.703719:0:57905:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/208 (0 0) 00000080:00200000:2.0:1787191340.703724:0:57905:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191340.703735:0:57905:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:2.0:1787191340.703763:0:57905:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8) 00000080:00200000:2.0:1787191340.703769:0:57905:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xd0:0x0], updating i_size 0 00000080:00200000:2.0:1787191340.703797:0:57905:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd0:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:2.0:1787191340.703801:0:57905:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) 00000080:00010000:2.0:1787191340.703804:0:57905:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) for lock 0xe5129dc88483a48c 00000080:00010000:2.0:1787191340.703813:0:57905:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) 00000080:00200008:2.0:1787191340.703823:0:57905:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xd0:0x0](ffff936b489880c8), flags 120501 00000002:00100000:2.0:1787191340.704378:0:57905:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b8a80 x1874004626713216/t8589936920(8589936920) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1787191340.704687:0:57905:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a48c from it ffff936b60dc46c0 00010000:00010000:2.0:1787191340.704694:0:57905:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a48c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46059e1 expref: -99 pid: 57905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.704703:0:57905:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a48c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46059e1 expref: -99 pid: 57905 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191340.704727:0:57905:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8), inode mode 81a4 mask 40 00000080:00200000:2.0:1787191340.704779:0:57905:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8), inode mode 81a4 mask 2 00000080:00200000:2.0:1787191340.704788:0:57905:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8), xattr lov 00000002:00010000:2.0:1787191340.704807:0:57905:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd0:0x0]) in obj [0x200000405:0xd0:0x0], intent: open flags 040000002 00010000:00010000:2.0:1787191340.704980:0:57905:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a493 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.704989:0:57905:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a493 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191340.705001:0:57905:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191340.705008:0:57905:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9c00 x1874004626713472/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191340.705023:0:57905:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a493 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191340.705052:0:57905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57905:1874004626713472:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191340.708005:0:57905:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5fa80 going to sleep for 11 seconds 00000080:00200000:3.0:1787191340.716572:0:57908:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191340.716617:0:57908:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191340.716636:0:57908:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191340.716655:0:57908:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191340.716663:0:57908:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191340.716672:0:57908:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191340.716675:0:57908:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191340.716683:0:57908:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42233bf8 00010000:00010000:3.0:1787191340.716687:0:57908:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191340.716696:0:57908:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191340.716714:0:57908:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191340.716722:0:57908:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191340.716729:0:57908:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191340.716733:0:57908:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:3.0:1787191340.716736:0:57908:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8), inode mode 81a4 mask 44 00000080:00200008:3.0:1787191340.716742:0:57908:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xd0:0x0](ffff936b489880c8), flags 154400 00000002:00010000:3.0:1787191340.716757:0:57908:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd0:0x0]) in obj [0x200000405:0xd0:0x0], intent: open flags 0100240114401 00010000:00010000:3.0:1787191340.716809:0:57908:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a49a lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.716817:0:57908:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a49a lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57908 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191340.716851:0:57908:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:3.0:1787191340.716865:0:57908:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1ea00 x1874004626713728/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191340.716875:0:57908:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a49a lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57908 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191340.716898:0:57908:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57908:1874004626713728:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191340.717621:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191340.717770:0:51131:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787191340.717784:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634900736 00000100:00100000:2.0:1787191340.717791:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634900736 00000100:00100000:2.0:1787191340.717858:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1375 00000100:00100000:2.0:1787191340.717869:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b50883050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634900736:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191340.717882:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a48c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46059e1 expref: -99 pid: 57905 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191340.717940:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191340.717947:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b50883050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634900736:12345-192.168.202.101@tcp:104: Request processed in 80us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191340.717954:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1375 00010000:00010000:1.0:1787191340.718426:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191340.718435:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a48c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46059e1 expref: -99 pid: 57905 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.718444:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd5200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191340.718448:0:40930:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a48c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46059e1 expref: -99 pid: 57905 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.718457:0:40930:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a48c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46059e1 expref: -99 pid: 57905 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.718466:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a48c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e46059e1 expref: -99 pid: 57905 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191340.718486:0:40930:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xd0:0x0]: losing layout lock 00010000:00010000:1.0:1787191340.718523:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a48c lrc: 2/0,0 mode: --/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46059e1 expref: -99 pid: 57905 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.718530:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191340.718553:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a48c lrc: 1/0,0 mode: --/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46059e1 expref: -99 pid: 57905 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.718559:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5200/0xe5129dc88483a48c lrc: 0/0,0 mode: --/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46059e1 expref: -99 pid: 57905 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.718571:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191340.718572:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191340.718574:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191340.718586:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626713856:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191340.724282:0:57908:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787191340.724624:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626713856:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191340.724662:0:57905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57905:1874004626713472:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191340.724676:0:57905:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a493 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.724689:0:57905:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a493 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.724696:0:57905:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a493 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.724703:0:57905:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a493 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.724712:0:57905:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a493 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.724717:0:57905:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51dd5e00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191340.724721:0:57905:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a493 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.724729:0:57905:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a493 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.724736:0:57905:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a493 lrc: 5/0,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.724742:0:57905:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191340.724748:0:57905:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a493 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.724755:0:57905:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51dd5e00/0xe5129dc88483a493 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57905 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191340.724771:0:57905:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b513b9c00 x1874004626713472/t8589936922(8589936922) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191340.724785:0:57905:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9c00 x1874004626713472/t8589936922(8589936922) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191340.724800:0:57905:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xd0:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787191340.724865:0:57905:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd0:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1787191340.724873:0:57905:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd0:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191340.724920:0:57905:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xd0:0x0], updating i_size 0 00000002:00100000:1.0:1787191340.724936:0:57905:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9c00 x1874004626713472/t8589936922(8589936922) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191340.724969:0:57905:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513b9c00 x1874004626713472/t8589936922(8589936922) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191340.724978:0:57905:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191340.724983:0:57905:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8e00 x1874004626714112/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191340.725002:0:57905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57905:1874004626714112:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191340.725071:0:57905:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.725829:0:57908:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57908:1874004626713728:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191340.726210:0:57908:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a49a lrc: 4/1,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.726222:0:57908:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a49a lrc: 4/1,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.726229:0:57908:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a49a lrc: 4/1,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.726236:0:57908:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a49a lrc: 3/0,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.726245:0:57908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a49a lrc: 4/0,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.726251:0:57908:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9b400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191340.726254:0:57908:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a49a lrc: 4/0,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.726261:0:57908:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a49a lrc: 4/0,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.726267:0:57908:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a49a lrc: 5/0,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.726274:0:57908:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191340.726279:0:57908:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a49a lrc: 3/0,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.726285:0:57908:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a49a lrc: 0/0,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57908 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191340.726305:0:57908:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b51d1ea00 x1874004626713728/t8589936921(8589936921) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191340.726315:0:57908:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1ea00 x1874004626713728/t8589936921(8589936921) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191340.726325:0:57908:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xd0:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787191340.726339:0:57908:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xd0:0x0], updating i_size 0 00000002:00100000:0.0:1787191340.729019:0:57908:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1ea00 x1874004626713728/t8589936921(8589936921) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787191340.729523:0:57905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57905:1874004626714112:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191340.729546:0:57905:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513b9c00 x1874004626713472/t8589936922(8589936922) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1787191340.729599:0:57905:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xd0:0x0](ffff936b489880c8), flags 100001 00000002:00100000:1.0:1787191340.729659:0:57905:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513b8a80 x1874004626713216/t8589936920(8589936920) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191356 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191340.729670:0:57905:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191340.729676:0:57905:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453ab480 x1874004626714368/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191340.729697:0:57905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57905:1874004626714368:192.168.202.101@tcp:35:lfs.0 00000080:00200000:0.0:1787191340.729857:0:57908:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8), inode mode 81a4 mask 4 00000080:00200000:0.0:1787191340.729865:0:57908:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8), xattr lov 00000080:00200008:0.0:1787191340.729898:0:57908:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xd0:0x0](ffff936b489880c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191340.729906:0:57908:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8),name=f70.sanity-flr 00000002:00010000:0.0:1787191340.729918:0:57908:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd0:0x0]) in obj [0x200000405:0xd0:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.729960:0:57908:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a4a1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.729971:0:57908:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a4a1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.729981:0:57908:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a4a1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57908 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191340.729993:0:57908:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57908:1874004626714496:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191340.730349:0:57905:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.730404:0:57908:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191340.735049:0:57905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57905:1874004626714368:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191340.735089:0:57905:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513b8a80 x1874004626713216/t8589936920(8589936920) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787191340.736320:0:57908:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57908:1874004626714496:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191340.736341:0:57908:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a4a1 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605a20 expref: -99 pid: 57908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.736354:0:57908:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a4a1 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605a20 expref: -99 pid: 57908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.736369:0:57908:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a4a1 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605a20 expref: -99 pid: 57908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.736380:0:57908:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a4a1 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605a20 expref: -99 pid: 57908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.736407:0:57908:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a4a1 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605a20 expref: -99 pid: 57908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.736416:0:57908:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a4a1 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605a20 expref: -99 pid: 57908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.736423:0:57908:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a4a1 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605a20 expref: -99 pid: 57908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191340.736434:0:57908:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b6a474000 x1874004626714496/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/976 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191340.736445:0:57908:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a4a1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605a20 expref: -99 pid: 57908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191340.736458:0:57908:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a4a1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605a20 expref: -99 pid: 57908 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.736469:0:57908:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/208 (0 0) 00000080:00200000:0.0:1787191340.736476:0:57908:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xd0:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787191340.736534:0:57908:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd0:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:0.0:1787191340.736539:0:57908:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) for lock 0xe5129dc88483a4a1 00000080:00010000:0.0:1787191340.736545:0:57908:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) 00000080:00010000:0.0:1787191340.736548:0:57908:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a4a1 from it ffffa3fb42233cd8 00010000:00010000:0.0:1787191340.736552:0:57908:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a4a1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605a20 expref: -99 pid: 57908 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.736566:0:57908:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a4a1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605a20 expref: -99 pid: 57908 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191340.736600:0:57908:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd0:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:0.0:1787191340.736624:0:57908:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd0:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191340.736628:0:57908:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191340.736631:0:57908:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xd0:0x0] 00000008:00010000:0.0:1787191340.736652:0:57908:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191340.736656:0:57908:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee64b0, osc lock ffff936b50b62be0, flags 0x400000400001002 00010000:00010000:0.0:1787191340.736705:0:57908:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000caedeff4/0xe5129dc88483a4a8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.736717:0:57908:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000caedeff4/0xe5129dc88483a4a8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.736728:0:57908:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b6a474000 x1874004626714624/t0(0) o101->lustre-OST0000-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:0.0:1787191340.736764:0:57908:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:3.0:1787191340.737207:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191340.737229:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191340.737242:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191340.737254:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191340.737261:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191340.737266:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191340.737270:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191340.737275:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:3.0:1787191340.737278:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191340.737287:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191340.737297:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191340.737304:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191340.737310:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191340.737324:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:3.0:1787191340.737329:0:57570:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b60796900, open_flags 8241, mode 81b6 opened 0 00000080:00200000:3.0:1787191340.737337:0:57570:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:3.0:1787191340.737356:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xd1:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0101102 00010000:00010000:3.0:1787191340.737411:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a4af lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.737419:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a4af lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191340.737429:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191340.737436:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1d500 x1874004626714880/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191340.737451:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a4af lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191340.737469:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626714880:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191340.737973:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787191340.740721:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626714624:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191340.742581:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626714880:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191340.742614:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a4af lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605a3c expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.742637:0:57570:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a4af lrc: 4/0,1 mode: --/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605a3c expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.742646:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a4af lrc: 4/0,1 mode: --/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605a3c expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.742657:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a4af lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605a3c expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.742668:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a4af lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605a3c expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.742680:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a4af lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605a3c expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.742688:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a4af lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605a3c expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.742695:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a4af lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605a3c expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191340.742706:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x2b, status=0 req@ffff936b51d1d500 x1874004626714880/t8589936925(8589936925) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191340.742719:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1d500 x1874004626714880/t8589936925(8589936925) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191340.742731:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a4af lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605a3c expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191340.742744:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a4af lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605a3c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.742755:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a4a1 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605a20 expref: -99 pid: 57908 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.742766:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a4a1 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605a20 expref: -99 pid: 57908 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.742775:0:57570:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a4af lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605a3c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.742782:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a4af lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x7130d520e4605a3c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.742789:0:57570:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a4af lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x7130d520e4605a3c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.742808:0:57570:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000080:00200000:1.0:1787191340.742813:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191340.742871:0:57570:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xd0:0x0](ffff936b489880c8): rc = 0 00000080:00200000:1.0:1787191340.742886:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd0:0x0]: layout version change: 3 -> 3 00000080:00010000:1.0:1787191340.742890:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) for lock 0xe5129dc88483a4a1 00000080:00010000:1.0:1787191340.742903:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) 00000080:00200008:1.0:1787191340.742917:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xd0:0x0](ffff936b489880c8), flags 101101 00000002:00100000:1.0:1787191340.742937:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1d500 x1874004626714880/t8589936925(8589936925) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191340.742971:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a4a1 from it ffff936b466f4cc0 00010000:00010000:1.0:1787191340.742976:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a4a1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605a20 expref: -99 pid: 57908 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.742985:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a4a1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605a20 expref: -99 pid: 57908 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191340.743006:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8), inode mode 81a4 mask 42 00000002:00010000:1.0:1787191340.743055:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xd0:0x0], intent: getxattr flags 0 00010000:00010000:1.0:1787191340.743092:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a4b6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.743099:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a4b6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.743108:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a4b6 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191340.743135:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626715008:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191340.743190:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893180 going to sleep for 11 seconds 00010000:00010000:1.0:1787191340.743207:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191340.743214:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a4af lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x7130d520e4605a3c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.743222:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9bc00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191340.743227:0:57627:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a4af lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x7130d520e4605a3c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.743236:0:57627:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a4af lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x7130d520e4605a3c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.743245:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a4af lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4605a3c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.743260:0:57627:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a4a1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605a20 expref: -99 pid: 57908 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191340.743280:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a4af lrc: 2/0,0 mode: --/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4605a3c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.743287:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191340.743675:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a4af lrc: 1/0,0 mode: --/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4605a3c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.743687:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a4af lrc: 0/0,0 mode: --/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4605a3c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.743699:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191340.743701:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191340.743703:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191340.743716:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626715136:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787191340.746402:0:2389:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000caedeff4/0xe5129dc88483a4a8 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.746432:0:2389:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000caedeff4/0xe5129dc88483a4a8 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605a4a expref: -99 pid: 57908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.746448:0:2389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000caedeff4/0xe5129dc88483a4a8 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605a4a expref: -99 pid: 57908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.746466:0:2389:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000caedeff4/0xe5129dc88483a4a8 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605a4a expref: -99 pid: 57908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191340.746482:0:2389:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000caedeff4/0xe5129dc88483a4a8 lrc: 5/2,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605a4a expref: -99 pid: 57908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1787191340.746493:0:2389:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1787191340.746515:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000caedeff4/0xe5129dc88483a4a8 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605a4a expref: -99 pid: 57908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.746523:0:2389:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000caedeff4/0xe5129dc88483a4a8 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605a4a expref: -99 pid: 57908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.746530:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000caedeff4/0xe5129dc88483a4a8 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605a4a expref: -99 pid: 57908 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.746538:0:2389:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000caedeff4/0xe5129dc88483a4a8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605a4a expref: -99 pid: 57908 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1787191340.746557:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626714624:192.168.202.101@tcp:101:lfs.0 00000080:00200000:3.0:1787191340.746655:0:57908:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd0:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1787191340.746661:0:57908:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c3a060 (ffff936b47a175a8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191340.746664:0:57908:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c3a060 (ffff936b47a175a8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191340.746669:0:57908:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee64b0 (ffff936b47a17d88/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191340.746673:0:57908:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c3a060 (ffff936b47a175a8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191340.746676:0:57908:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee64b0 (ffff936b47a175a8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191340.746713:0:57908:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd0:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191340.746778:0:57908:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xd0:0x0](ffff936b489880c8), flags 154000 00000002:00100000:3.0:1787191340.746872:0:57908:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1ea00 x1874004626713728/t8589936921(8589936921) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191356 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191340.746884:0:57908:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191340.746890:0:57908:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1c380 x1874004626715392/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191340.746911:0:57908:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57908:1874004626715392:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191340.746981:0:57908:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191340.749199:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626715008:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191340.749227:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a4b6 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605a58 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.749244:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a4b6 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605a58 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.749255:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a4b6 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605a58 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191340.749269:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b453aa680 x1874004626715008/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191340.749280:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a4b6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605a58 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.749294:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/208 (0 0) 00000080:00200000:1.0:1787191340.749300:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xd0:0x0] suppgids 0 -1: rc 0 00000080:00010000:1.0:1787191340.749326:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) for lock 0xe5129dc88483a4b6 00000080:00010000:1.0:1787191340.749334:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a4b6 from it ffffa3fb41caba38 00010000:00010000:1.0:1787191340.749338:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a4b6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605a58 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.749349:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a4b6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605a58 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:1.0:1787191340.749385:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xd0:0x0](ffff936b489880c8) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191340.000000000, mtime 1787191340.000000000, ctime 1787191340.000000000 00010000:00010000:1.0:1787191340.749420:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a4a1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4605a20 expref: -99 pid: 57908 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191340.749438:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xd0:0x0]: losing layout lock 00010000:00010000:1.0:1787191340.749473:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a4a1 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605a20 expref: -99 pid: 57908 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191340.749480:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191340.749483:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a4a1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605a20 expref: -99 pid: 57908 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000020:00100000:1.0:1787191340.749500:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 36, max 7 00000100:00100000:1.0:1787191340.749506:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453aa680 x1874004626715648/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787191340.749525:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626715648:192.168.202.101@tcp:36:bash.0 00000100:00100000:1.0:1787191340.749586:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893180 going to sleep for 11 seconds 00000100:00100000:1.0:1787191340.753757:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626715136:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191340.753883:0:57908:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57908:1874004626715392:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191340.753915:0:57908:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1ea00 x1874004626713728/t8589936921(8589936921) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191340.754151:0:57908:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191340.754170:0:57908:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.754186:0:57908:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.754199:0:57908:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.754206:0:57908:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191340.754212:0:57908:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191340.754216:0:57908:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191340.754223:0:57908:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42233bf8 00010000:00010000:0.0:1787191340.754227:0:57908:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.754236:0:57908:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.754251:0:57908:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.754257:0:57908:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191340.754263:0:57908:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.754276:0:57908:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b5258f980, open_flags d900, mode 0 opened 0 00000080:00200000:0.0:1787191340.754282:0:57908:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:0.0:1787191340.754296:0:57908:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:0.0:1787191340.754346:0:57908:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a4bd lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.754359:0:57908:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a4bd lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57908 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191340.754371:0:57908:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191340.754378:0:57908:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474000 x1874004626715904/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191340.754388:0:57908:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a4bd lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57908 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191340.754408:0:57908:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57908:1874004626715904:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191340.754575:0:57908:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191340.758520:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626715648:192.168.202.101@tcp:36:bash.0 00000080:00200000:2.0:1787191340.758567:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:2.0:1787191340.758573:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd0:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:2.0:1787191340.758590:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/208 (0 0) 00000080:00010000:2.0:1787191340.758600:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xd0:0x0](ffff936b489880c8) 00000002:00010000:2.0:1787191340.758615:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd0:0x0]) in obj [0x200000405:0xd0:0x0], intent: layout flags 0 00010000:00010000:2.0:1787191340.758657:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a4c4 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.758670:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a4c4 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.758679:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a4c4 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191340.758696:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626716032:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191340.758760:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.759950:0:57908:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57908:1874004626715904:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191340.759966:0:57908:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a4bd lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605a7b expref: -99 pid: 57908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.759984:0:57908:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a4bd lrc: 4/1,0 mode: --/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605a7b expref: -99 pid: 57908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.759993:0:57908:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a4bd lrc: 4/1,0 mode: --/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605a7b expref: -99 pid: 57908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.760004:0:57908:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a4bd lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605a7b expref: -99 pid: 57908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.760014:0:57908:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a4bd lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605a7b expref: -99 pid: 57908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.760040:0:57908:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a4bd lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605a7b expref: -99 pid: 57908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.760048:0:57908:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a4bd lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605a7b expref: -99 pid: 57908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.760056:0:57908:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a4bd lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605a7b expref: -99 pid: 57908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191340.760066:0:57908:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b6a474000 x1874004626715904/t8589936929(8589936929) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191340.760077:0:57908:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474000 x1874004626715904/t8589936929(8589936929) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191340.760089:0:57908:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a4bd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605a7b expref: -99 pid: 57908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191340.760101:0:57908:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a4bd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605a7b expref: -99 pid: 57908 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.760109:0:57908:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/208 (0 0) 00000080:00200000:0.0:1787191340.760124:0:57908:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191340.760170:0:57908:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xd0:0x0](ffff936b489880c8): rc = 0 00000080:00200000:0.0:1787191340.760185:0:57908:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd0:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:0.0:1787191340.760190:0:57908:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) for lock 0xe5129dc88483a4bd 00000080:00010000:0.0:1787191340.760205:0:57908:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) 00000080:00200008:0.0:1787191340.760219:0:57908:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xd0:0x0](ffff936b489880c8), flags 154400 00000002:00100000:0.0:1787191340.760240:0:57908:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474000 x1874004626715904/t8589936929(8589936929) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191340.760299:0:57908:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a4bd from it ffff936b530f5600 00010000:00010000:0.0:1787191340.760304:0:57908:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a4bd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605a7b expref: -99 pid: 57908 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.760314:0:57908:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a4bd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605a7b expref: -99 pid: 57908 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191340.760337:0:57908:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8), inode mode 81a4 mask 44 00000080:00200000:0.0:1787191340.760404:0:57908:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8), inode mode 81a4 mask 4 00000080:00200000:0.0:1787191340.760411:0:57908:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8), xattr lov 00000080:00200008:0.0:1787191340.760435:0:57908:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xd0:0x0](ffff936b489880c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191340.760441:0:57908:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8),name=f70.sanity-flr 00000002:00010000:0.0:1787191340.760460:0:57908:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.760470:0:57908:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a4bd lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605a7b expref: -99 pid: 57908 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.760480:0:57908:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a4bd lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605a7b expref: -99 pid: 57908 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191340.760487:0:57908:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191340.760493:0:57908:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) 00000080:00010000:0.0:1787191340.760496:0:57908:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) for lock 0xe5129dc88483a4bd 00000080:00010000:0.0:1787191340.760500:0:57908:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a4bd from it ffffa3fb42233cd8 00010000:00010000:0.0:1787191340.760503:0:57908:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a4bd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605a7b expref: -99 pid: 57908 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.760512:0:57908:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a4bd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605a7b expref: -99 pid: 57908 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191340.760530:0:57908:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd0:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1787191340.760540:0:57908:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd0:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191340.760544:0:57908:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191340.760548:0:57908:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xd0:0x0] 00000008:00010000:0.0:1787191340.760568:0:57908:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191340.760572:0:57908:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee67b0, osc lock ffff936b50b63690, flags 0x400000400001002 00010000:00010000:0.0:1787191340.760588:0:57908:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000caedeff4/0xe5129dc88483a4a8 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605a4a expref: -99 pid: 57908 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.760598:0:57908:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000caedeff4/0xe5129dc88483a4a8 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605a4a expref: -99 pid: 57908 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:0.0:1787191340.760617:0:57908:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191340.760620:0:57908:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000caedeff4/0xe5129dc88483a4a8 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605a4a expref: -99 pid: 57908 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.760628:0:57908:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000caedeff4/0xe5129dc88483a4a8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605a4a expref: -99 pid: 57908 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:0.0:1787191340.760638:0:57908:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191340.760648:0:57908:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd0:0x0] updating i_size 0 i_blocks 0 00000020:00010000:0.0:1787191340.760652:0:57908:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c386f0 (ffff936b47a17008/0) at cl_lock_release():245 00000020:00010000:0.0:1787191340.760655:0:57908:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c386f0 (ffff936b47a17008/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191340.760658:0:57908:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee67b0 (ffff936b47a17248/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191340.760661:0:57908:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c386f0 (ffff936b47a17008/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191340.760664:0:57908:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee67b0 (ffff936b47a17008/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191340.760674:0:57908:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd0:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1787191340.760704:0:57908:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xd0:0x0](ffff936b489880c8), flags 154000 00000002:00100000:0.0:1787191340.760736:0:57908:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a474000 x1874004626715904/t8589936929(8589936929) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191340.760746:0:57908:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191340.760751:0:57908:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474e00 x1874004626716288/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191340.760768:0:57908:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57908:1874004626716288:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191340.760860:0:57908:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191340.764590:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626716032:192.168.202.101@tcp:101:bash.0 00010000:00010000:2.0:1787191340.764632:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a4c4 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605a89 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.764648:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a4c4 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605a89 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191340.764661:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b513ba680 x1874004626716032/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191340.764671:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a4c4 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605a89 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191340.764683:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a4c4 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605a89 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.764693:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/208 (0 0) 00000080:00200000:2.0:1787191340.764699:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xd0:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1787191340.764715:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) for lock 0xe5129dc88483a4c4 00000080:00010000:2.0:1787191340.764725:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a4c4 from it ffffa3fb41cab8c8 00010000:00010000:2.0:1787191340.764729:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a4c4 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605a89 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.764738:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a4c4 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605a89 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191340.764762:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a4bd lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605a7b expref: -99 pid: 57908 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191340.764774:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a4bd lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605a7b expref: -99 pid: 57908 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:2.0:1787191340.764784:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xd0:0x0](000000009457cdc2) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a4bd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605a7b expref: -99 pid: 57908 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191340.764795:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a4bd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605a7b expref: -99 pid: 57908 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191340.764802:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a4bd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605a7b expref: -99 pid: 57908 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00020000:00200000:2.0:1787191340.764819:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xd0:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:2.0:1787191340.764826:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd0:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191340.764829:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xd0:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:2.0:1787191340.764872:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xd0:0x0](ffff936b489880c8) 00000002:00010000:2.0:1787191340.764881:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd0:0x0]) in obj [0x200000405:0xd0:0x0], intent: layout flags 02 00010000:00010000:2.0:1787191340.764895:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a4c4 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4605a89 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191340.764913:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xd0:0x0]: losing layout lock 00010000:00010000:2.0:1787191340.764927:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a4bd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4605a7b expref: -99 pid: 57908 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191340.764935:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xd0:0x0]: losing layout lock 00010000:00010000:2.0:1787191340.764961:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a4c4 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4605a89 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191340.764970:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a4bd lrc: 1/0,0 mode: --/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605a7b expref: -99 pid: 57908 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191340.764976:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:2.0:1787191340.764980:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a4c4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4605a89 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191340.764992:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a4bd lrc: 0/0,0 mode: --/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605a7b expref: -99 pid: 57908 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191340.765012:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a4cb lrc: 3/0,1 mode: --/EX res: [0x200000405:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.765019:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a4cb lrc: 3/0,1 mode: --/EX res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191340.765042:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:2.0:1787191340.765050:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513ba680 x1874004626716544/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 384/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191340.765060:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a4cb lrc: 3/0,1 mode: --/EX res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191340.765079:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626716544:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191340.765162:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.765330:0:57908:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57908:1874004626716288:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191340.765349:0:57908:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a474000 x1874004626715904/t8589936929(8589936929) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191340.765445:0:57908:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191340.765456:0:57908:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.765465:0:57908:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.765475:0:57908:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.765482:0:57908:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191340.765487:0:57908:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191340.765491:0:57908:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191340.765496:0:57908:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42233bf8 00010000:00010000:0.0:1787191340.765500:0:57908:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.765507:0:57908:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.765517:0:57908:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.765522:0:57908:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191340.765528:0:57908:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.765541:0:57908:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b5258e480, open_flags d902, mode 0 opened 0 00000080:00200000:0.0:1787191340.765548:0:57908:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:0.0:1787191340.765561:0:57908:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154403 00010000:00010000:0.0:1787191340.765590:0:57908:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a4d2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.765597:0:57908:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a4d2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57908 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191340.765605:0:57908:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191340.765610:0:57908:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474e00 x1874004626716800/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191340.765618:0:57908:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a4d2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57908 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191340.765630:0:57908:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57908:1874004626716800:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191340.765760:0:57908:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.771295:0:57908:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57908:1874004626716800:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191340.771322:0:57908:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a4d2 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.771336:0:57908:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a4d2 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.771344:0:57908:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a4d2 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.771351:0:57908:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a4d2 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.771360:0:57908:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a4d2 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.771367:0:57908:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cae400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191340.771372:0:57908:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a4d2 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.771380:0:57908:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a4d2 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.771388:0:57908:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a4d2 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.771705:0:57908:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191340.771713:0:57908:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a4d2 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.771720:0:57908:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a4d2 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57908 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191340.771752:0:57908:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b6a474e00 x1874004626716800/t8589936931(8589936931) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191340.771766:0:57908:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474e00 x1874004626716800/t8589936931(8589936931) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191340.771783:0:57908:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191340.771866:0:57908:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xd0:0x0](ffff936b489880c8): rc = 0 00000080:00010000:0.0:1787191340.771872:0:57908:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) for lock 0x0 00000080:00200008:0.0:1787191340.771896:0:57908:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xd0:0x0](ffff936b489880c8), flags 154402 00000002:00100000:0.0:1787191340.771919:0:57908:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474e00 x1874004626716800/t8589936931(8589936931) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191340.771958:0:57908:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a474e00 x1874004626716800/t8589936931(8589936931) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191340.771968:0:57908:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191340.771972:0:57908:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474000 x1874004626717056/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191340.771993:0:57908:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57908:1874004626717056:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191340.772083:0:57908:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191340.777112:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191340.777169:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191340.777246:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634901376 00000100:00100000:2.0:1787191340.777256:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634901376 00000100:00100000:2.0:1787191340.777307:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634901504 00000100:00100000:2.0:1787191340.777310:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634901504 00000100:00100000:2.0:1787191340.777326:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1376 00000100:00100000:2.0:1787191340.777335:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+5:30510:x1874004634901376:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191340.777353:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a431 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e46058c2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191340.777439:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191340.777447:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+5:30510:x1874004634901376:12345-192.168.202.101@tcp:104: Request processed in 112us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191340.777454:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1376 00000100:00100000:2.0:1787191340.777471:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1377 00000100:00100000:2.0:1787191340.777478:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8420:x1874004634901504:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191340.777487:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a400 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e460582f expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191340.777520:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787191340.777525:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8420:x1874004634901504:12345-192.168.202.101@tcp:104: Request processed in 48us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191340.777531:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1377 00010000:00010000:1.0:1787191340.777698:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787191340.777706:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a431 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e46058c2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191340.777715:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030600 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191340.777720:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a431 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e46058c2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191340.777766:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a431 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e46058c2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191340.777773:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191340.777796:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a431 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e46058c2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191340.777804:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a431 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e46058c2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191340.777824:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191340.777827:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a400 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e460582f expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191340.777875:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cafa00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191340.777878:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a400 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e460582f expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191340.777899:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a400 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e460582f expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191340.777905:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191340.777912:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a400 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e460582f expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191340.777919:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a400 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e460582f expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191340.777933:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191340.777935:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191340.777936:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191340.777952:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626717184:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191340.778019:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787191340.778025:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626717312:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787191340.780705:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191340.782348:0:57908:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589936932 gen 1 00000100:00100000:0.0:1787191340.782430:0:57908:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b51d1d500 x1874004626714880/t8589936925(8589936925) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787191340.782450:0:57908:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff936b6a474000 x1874004626717056/t8589936933(8589936933) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/456 e 0 to 0 dl 1787191356 ref 3 fl Rpc:RQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787191340.782467:0:57908:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57908:1874004626717056:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191340.782493:0:57908:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a474e00 x1874004626716800/t8589936931(8589936931) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RMQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191340.782559:0:57908:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8), inode mode 81a4 mask 46 00000080:00200080:0.0:1787191340.782652:0:57908:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8) cmd=800466af arg=7ffec14897cc 00000080:00200080:0.0:1787191340.782668:0:57908:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8) cmd=80086601 arg=7ffec1489768 00000100:00100000:0.0:1787191340.782705:0:57908:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57908:1874004626717440:192.168.202.101@tcp:33:lfs.0 00000100:00100000:0.0:1787191340.782780:0:57908:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191340.786587:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191340.786632:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191340.786663:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634902144 00000100:00100000:2.0:1787191340.786672:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634902144 00000100:00100000:2.0:1787191340.786713:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634902272 00000100:00100000:2.0:1787191340.786716:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634902272 00000100:00100000:2.0:1787191340.786732:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1378 00000100:00100000:2.0:1787191340.786742:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+5:8419:x1874004634902144:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191340.786760:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a438 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e46058c9 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191340.786861:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191340.786868:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+5:8419:x1874004634902144:12345-192.168.202.101@tcp:104: Request processed in 128us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191340.786875:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1378 00000100:00100000:2.0:1787191340.786893:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1379 00000100:00100000:2.0:1787191340.786900:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30353:x1874004634902272:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191340.786908:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a3f9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4605828 expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191340.786939:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787191340.786945:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30353:x1874004634902272:12345-192.168.202.101@tcp:104: Request processed in 46us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191340.786952:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1379 00010000:00010000:2.0:1787191340.786968:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787191340.786974:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a438 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e46058c9 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191340.786987:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030400 already unused, calling callback (ffffffffc1208790) 00010000:00010000:2.0:1787191340.786992:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a438 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e46058c9 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191340.787043:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a438 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e46058c9 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191340.787051:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191340.787068:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a438 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e46058c9 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191340.787075:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a438 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e46058c9 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191340.787095:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787191340.787098:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a3f9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4605828 expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191340.787103:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44caf000 already unused, calling callback (ffffffffc1208790) 00010000:00010000:2.0:1787191340.787106:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a3f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e4605828 expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191340.787239:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a3f9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4605828 expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191340.787251:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191340.787258:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a3f9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4605828 expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191340.787264:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a3f9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4605828 expref: -99 pid: 57902 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191340.787277:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191340.787279:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191340.787281:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191340.788006:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191340.788113:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626716544:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191340.788146:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a4cb lrc: 4/0,1 mode: --/EX res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605a97 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.788157:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a4cb lrc: 4/0,1 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605a97 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.788170:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a4cb lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605a97 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.788182:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a4cb lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605a97 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.788194:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a4cb lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605a97 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.788202:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a4cb lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605a97 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.788210:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a4cb lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605a97 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191340.788222:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b513ba680 x1874004626716544/t8589936932(8589936932) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 384/736 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191340.788241:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a4cb lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605a97 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191340.788253:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a4cb lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605a97 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.788263:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/208 (0 0) 00000080:00200000:1.0:1787191340.788269:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xd0:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191340.788283:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) for lock 0xe5129dc88483a4cb 00000080:00010000:1.0:1787191340.788291:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a4cb from it ffffa3fb41cab930 00010000:00010000:1.0:1787191340.788295:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a4cb lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605a97 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.788308:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a4cb lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605a97 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191340.788324:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:1.0:1787191340.788331:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd0:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:1.0:1787191340.788344:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a4cb lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605a97 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.788354:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a4cb lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605a97 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:1.0:1787191340.788361:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xd0:0x0](000000009457cdc2) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a4cb lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605a97 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.788409:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a4cb lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605a97 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.788418:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a4cb lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605a97 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191340.788432:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd0:0x0] ignore/verify layout 1/0, layout version 5 restore needed 0 00020000:00200000:1.0:1787191340.788440:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd0:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191340.788444:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191340.788449:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191340.788458:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191340.788476:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd0:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:1.0:1787191340.788488:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a4cb lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605a97 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191340.788498:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a4cb lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605a97 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:1.0:1787191340.788505:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xd0:0x0](000000009457cdc2) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a4cb lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605a97 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191340.788523:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd0:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1787191340.788528:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd0:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191340.788531:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191340.788533:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191340.788537:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191340.788543:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd0:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:1.0:1787191340.788554:0:57570:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000caedeff4/0xe5129dc88483a4a8 lrc: 1/0,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605a4a expref: -99 pid: 57908 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191340.788636:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd0:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:1.0:1787191340.788642:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a4cb lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605a97 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191340.788649:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a4cb lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605a97 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00020000:00200000:1.0:1787191340.788660:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xd0:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:1.0:1787191340.788664:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd0:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191340.788666:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191340.788671:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191340.788682:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191340.788686:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:1.0:1787191340.788700:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:1.0:1787191340.788705:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b62893db0, osc lock ffff936b468365f0, flags 0x80000000 00000008:00010000:1.0:1787191340.788708:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:1.0:1787191340.788711:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b62893df0, osc lock ffff936b46837b50, flags 0x80000000 00010000:00010000:1.0:1787191340.788722:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b52377800 type 11 mode 2 res 10737419265/448 (0 1048575) 00010000:00010000:1.0:1787191340.788751:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.788759:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.788769:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191340.788788:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626717824:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191340.788909:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:3.0:1787191340.789171:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626717568:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191340.789211:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787191340.789218:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626717696:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191340.795897:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626717184:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191340.798549:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626717312:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191340.801397:0:57908:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57908:1874004626717440:192.168.202.101@tcp:33:lfs.0 00000080:00200080:0.0:1787191340.801444:0:57908:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8) cmd=c00c66f3 arg=7ffec1489754 00000080:00200008:0.0:1787191340.801584:0:57908:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xd0:0x0](ffff936b489880c8), flags 154002 00000100:00100000:3.0:1787191340.811567:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191340.811615:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634902400 00000100:00100000:3.0:1787191340.811623:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634902400 00000100:00100000:3.0:1787191340.811671:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1380 00000100:00100000:3.0:1787191340.811681:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8422:x1874004634902400:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191340.811700:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000caedeff4/0xe5129dc88483a4a8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4605a4a expref: -99 pid: 57908 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191340.811781:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191340.811787:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8422:x1874004634902400:12345-192.168.202.101@tcp:104: Request processed in 108us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191340.811795:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1380 00000100:00100000:3.0:1787191340.811955:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626717568:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787191340.812051:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191340.812059:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000caedeff4/0xe5129dc88483a4a8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4605a4a expref: -99 pid: 57908 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191340.812069:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44caea00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191340.812074:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000caedeff4/0xe5129dc88483a4a8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e4605a4a expref: -99 pid: 57908 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191340.812130:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000caedeff4/0xe5129dc88483a4a8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4605a4a expref: -99 pid: 57908 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191340.812137:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191340.812164:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000caedeff4/0xe5129dc88483a4a8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4605a4a expref: -99 pid: 57908 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191340.812173:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000caedeff4/0xe5129dc88483a4a8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4605a4a expref: -99 pid: 57908 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191340.812187:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191340.812189:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191340.812190:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191340.812196:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787191340.812209:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626717952:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00200000:3.0:1787191340.816083:0:57909:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191340.816184:0:57909:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191340.816203:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191340.816219:0:57909:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191340.816227:0:57909:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191340.816236:0:57909:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191340.816240:0:57909:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191340.816247:0:57909:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4223bbf8 00010000:00010000:3.0:1787191340.816251:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191340.816260:0:57909:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191340.816278:0:57909:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191340.816285:0:57909:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191340.816290:0:57909:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191340.816303:0:57909:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b60797c80, open_flags d900, mode 0 opened 0 00000080:00200000:3.0:1787191340.816309:0:57909:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:3.0:1787191340.816326:0:57909:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:3.0:1787191340.816380:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a4e0 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.816388:0:57909:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a4e0 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191340.816560:0:57909:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191340.816572:0:57909:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1ed80 x1874004626718208/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191340.816582:0:57909:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a4e0 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191340.816603:0:57909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ed80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626718208:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191340.817247:0:57909:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1787191340.823109:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191340.825914:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634902528 00000100:00100000:2.0:1787191340.825927:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634902528 00000100:00100000:2.0:1787191340.825990:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1381 00000100:00100000:2.0:1787191340.826001:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:37090:x1874004634902528:12345-192.168.202.101@tcp:105: 00010000:00010000:2.0:1787191340.826017:0:40922:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.826041:0:40922:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.826052:0:40922:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.826063:0:40922:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080000000000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.826078:0:40922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080000000000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.826090:0:40922:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000000000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.826111:0:40922:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b40030600) 00000100:00100000:2.0:1787191340.826188:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:37090:x1874004634902528:12345-192.168.202.101@tcp:105: Request processed in 188us (3087us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191340.826195:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1381 00000100:00100000:2.0:1787191340.826249:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626717696:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191340.827268:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626717824:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191340.827289:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.827307:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000020000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191340.827320:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000020000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.827339:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.827347:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.827418:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000be88ce23/0xe5129dc88483a4e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.827428:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000be88ce23/0xe5129dc88483a4e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.827437:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000be88ce23/0xe5129dc88483a4e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191340.827456:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626718336:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191340.827517:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.829346:0:57909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ed80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626718208:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191340.829368:0:57909:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a4e0 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605af9 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.829389:0:57909:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a4e0 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605af9 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.829412:0:57909:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a4e0 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605af9 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.829423:0:57909:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a4e0 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605af9 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.829439:0:57909:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a4e0 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605af9 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.829451:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a4e0 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605af9 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.829459:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a4e0 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605af9 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.829466:0:57909:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a4e0 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605af9 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191340.829479:0:57909:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b51d1ed80 x1874004626718208/t8589936934(8589936934) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191340.829493:0:57909:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1ed80 x1874004626718208/t8589936934(8589936934) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191340.829506:0:57909:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a4e0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605af9 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191340.829520:0:57909:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a4e0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605af9 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.829528:0:57909:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/208 (0 0) 00000080:00200000:0.0:1787191340.829535:0:57909:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191340.829583:0:57909:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xd0:0x0](ffff936b489880c8): rc = 0 00000080:00200000:0.0:1787191340.829601:0:57909:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd0:0x0]: layout version change: 4 -> 4 00000080:00010000:0.0:1787191340.829618:0:57909:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) for lock 0xe5129dc88483a4e0 00000080:00010000:0.0:1787191340.829633:0:57909:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) 00000080:00200008:0.0:1787191340.829647:0:57909:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xd0:0x0](ffff936b489880c8), flags 154400 00000002:00100000:0.0:1787191340.829670:0:57909:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1ed80 x1874004626718208/t8589936934(8589936934) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191340.829724:0:57909:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a4e0 from it ffff936b466f4960 00010000:00010000:0.0:1787191340.829729:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a4e0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605af9 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.829738:0:57909:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a4e0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605af9 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191340.829762:0:57909:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8), inode mode 81a4 mask 44 00000080:00200000:0.0:1787191340.829912:0:57909:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8), inode mode 81a4 mask 4 00000080:00200000:0.0:1787191340.829920:0:57909:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8), xattr lov 00000080:00200008:0.0:1787191340.829948:0:57909:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xd0:0x0](ffff936b489880c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191340.829954:0:57909:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8),name=f70.sanity-flr 00000002:00010000:0.0:1787191340.829972:0:57909:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.829982:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a4e0 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605af9 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.829992:0:57909:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a4e0 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605af9 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191340.830000:0:57909:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191340.830006:0:57909:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) 00000080:00010000:0.0:1787191340.830010:0:57909:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) for lock 0xe5129dc88483a4e0 00000080:00010000:0.0:1787191340.830014:0:57909:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a4e0 from it ffffa3fb4223bcd8 00010000:00010000:0.0:1787191340.830018:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a4e0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605af9 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.830025:0:57909:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a4e0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605af9 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191340.830056:0:57909:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd0:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00020000:00200000:0.0:1787191340.830066:0:57909:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd0:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191340.830070:0:57909:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191340.830073:0:57909:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xd0:0x0] 00000008:00010000:0.0:1787191340.830094:0:57909:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191340.830098:0:57909:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee67b0, osc lock ffff936b50b63690, flags 0x400000400001002 00010000:00010000:0.0:1787191340.830113:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.830123:0:57909:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1787191340.830135:0:57909:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191340.830139:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 7/0,2 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.830146:0:57909:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1787191340.830153:0:57909:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191340.830166:0:57909:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd0:0x0] updating i_size 0 i_blocks 0 00000020:00010000:0.0:1787191340.830170:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c386f0 (ffff936b47a17008/0) at cl_lock_release():245 00000020:00010000:0.0:1787191340.830173:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c386f0 (ffff936b47a17008/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191340.830176:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee67b0 (ffff936b47a17248/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191340.830180:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c386f0 (ffff936b47a17008/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191340.830182:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee67b0 (ffff936b47a17008/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191340.830191:0:57909:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd0:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1787191340.830225:0:57909:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xd0:0x0](ffff936b489880c8), flags 154000 00000002:00100000:0.0:1787191340.830262:0:57909:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1ed80 x1874004626718208/t8589936934(8589936934) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191340.830273:0:57909:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191340.830279:0:57909:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474e00 x1874004626718592/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191340.830300:0:57909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626718592:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191340.830378:0:57909:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.834307:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626717952:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191340.834475:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626718336:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191340.834495:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000be88ce23/0xe5129dc88483a4e7 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605b07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.834511:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000be88ce23/0xe5129dc88483a4e7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4605b07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.834528:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000be88ce23/0xe5129dc88483a4e7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4605b07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.834541:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000be88ce23/0xe5129dc88483a4e7 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4605b07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191340.834552:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000be88ce23/0xe5129dc88483a4e7 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4605b07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.834563:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000be88ce23/0xe5129dc88483a4e7 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4605b07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.834571:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000be88ce23/0xe5129dc88483a4e7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4605b07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191340.834665:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787191340.834677:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626718720:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191340.834784:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626718848:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191340.837696:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626718848:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191340.837734:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626718720:192.168.202.101@tcp:10:bash.0 00000080:00200000:2.0:1787191340.837869:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd0:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191340.837877:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b42ff6e48 (ffff936b465ccf38/0) at cl_lock_release():245 00000020:00010000:2.0:1787191340.837880:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42ff6e48 (ffff936b465ccf38/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191340.837885:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62893db0 (ffff936b47a17c68/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191340.837895:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.837910:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191340.837927:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62893df0 (ffff936b465cc998/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191340.837932:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000be88ce23/0xe5129dc88483a4e7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4605b07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191340.837946:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000be88ce23/0xe5129dc88483a4e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4605b07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191340.837954:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42ff6e48 (ffff936b465ccf38/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191340.837958:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62893db0 (ffff936b465ccf38/1) at cl_lock_fini():72 00000020:00010000:2.0:1787191340.837964:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62893df0 (ffff936b465ccf38/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191340.837982:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd0:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191340.837995:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xd0:0x0](ffff936b489880c8) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191340.000000000, mtime 1787191340.000000000, ctime 1787191340.000000000, rc 0 00000080:00200008:2.0:1787191340.838091:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xd0:0x0], ppos: 0, count: 5 00000080:00200000:2.0:1787191340.838104:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191340.838110:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:2.0:1787191340.838124:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:2.0:1787191340.838128:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1787191340.838135:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@00000000368c9109[0x110, 1, [0x200000405:0xd0:0x0] hash] 00000020:00200000:2.0:1787191340.838137:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:2.0:1787191340.838141:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd0:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:2.0:1787191340.838156:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xd0:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:2.0:1787191340.838160:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd0:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191340.838163:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1787191340.838168:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1787191340.838175:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:2.0:1787191340.838178:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1787191340.838193:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:2.0:1787191340.838208:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1787191340.838213:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1830, osc lock ffff936b44e62980, flags 0x0 00010000:00010000:2.0:1787191340.838230:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191340.838247:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191340.838258:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191340.838266:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191340.838273:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191340.838283:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:2.0:1787191340.838292:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191340.838335:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:2.0:1787191340.838342:0:57570:0:(rw26.c:927:ll_write_end()) page@000000004e3c4999[3 00000000e870821a 2 1 00000000b88602bc 0 0 0] 00000080:00200000:2.0:1787191340.838345:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @00000000294682f4 17ffffc0001001 3:0 ffff936b43a1e8c0 0 lru 00000080:00200000:2.0:1787191340.838352:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@000000005104a24f 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000a2a44f55 00000000fca7e965 > 3< 0 0 > 4< 0 0 8 395280384 - | - - - - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1787191340.838355:0:57570:0:(rw26.c:927:ll_write_end()) end page@000000004e3c4999 00000080:00200000:2.0:1787191340.838356:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:2.0:1787191340.838359:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:2.0:1787191340.838376:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 00000000a1af3917 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191340.838394:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b48988278, count 1, dirtied 1 00000080:00200000:2.0:1787191340.838397:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:2.0:1787191340.838400:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:2.0:1787191340.838412:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b42ff6e48 (ffff936b465ccf38/0) at cl_lock_release():245 00000020:00010000:2.0:1787191340.838414:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42ff6e48 (ffff936b465ccf38/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191340.838417:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1830 (ffff936b465cc998/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191340.838421:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191340.838428:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:2.0:1787191340.838437:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42ff6e48 (ffff936b465ccf38/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191340.838440:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1830 (ffff936b465ccf38/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191340.838445:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:2.0:1787191340.838449:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1787191340.838454:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd0:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191340.838457:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:2.0:1787191340.838462:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd0:0x0] updating i_size 5 i_blocks 0 00000080:00200000:2.0:1787191340.838465:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:2.0:1787191340.838481:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xd0:0x0](ffff936b489880c8), flags 100001 00000002:00100000:2.0:1787191340.838535:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1d500 x1874004626714880/t8589936925(8589936925) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191340.838545:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:2.0:1787191340.838550:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bbb80 x1874004626719104/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191340.838570:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626719104:192.168.202.101@tcp:35:bash.0 00000100:00100000:2.0:1787191340.838655:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f300 going to sleep for 11 seconds 00000100:00100000:2.0:1787191340.841176:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626719104:192.168.202.101@tcp:35:bash.0 00000002:00100000:2.0:1787191340.841212:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1d500 x1874004626714880/t8589936925(8589936925) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191340.845278:0:57910:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191340.845313:0:57910:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191340.845333:0:57910:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191340.845352:0:57910:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191340.845361:0:57910:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191340.845369:0:57910:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191340.845372:0:57910:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191340.845379:0:57910:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42243b58 00010000:00010000:3.0:1787191340.845384:0:57910:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191340.845392:0:57910:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191340.845410:0:57910:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191340.845418:0:57910:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:3.0:1787191340.845423:0:57910:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191340.845427:0:57910:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=8 00000080:00200008:3.0:1787191340.845433:0:57910:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xd0:0x0](ffff936b489880c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191340.845439:0:57910:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8),name=f70.sanity-flr 00000002:00010000:3.0:1787191340.845451:0:57910:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191340.845459:0:57910:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a4e0 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605af9 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191340.845467:0:57910:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a4e0 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605af9 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191340.845480:0:57910:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191340.845484:0:57910:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) 00000080:00010000:3.0:1787191340.845487:0:57910:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) for lock 0xe5129dc88483a4e0 00000080:00010000:3.0:1787191340.845490:0:57910:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a4e0 from it ffffa3fb42243cb8 00010000:00010000:3.0:1787191340.845493:0:57910:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a4e0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605af9 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191340.845501:0:57910:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a4e0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605af9 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787191340.845523:0:57910:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd0:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:3.0:1787191340.847438:0:57910:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd0:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191340.847447:0:57910:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191340.847453:0:57910:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xd0:0x0] 00000100:00100000:3.0:1787191340.848049:0:57909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626718592:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191340.848089:0:57909:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1ed80 x1874004626718208/t8589936934(8589936934) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191340.848363:0:57909:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191340.848382:0:57909:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191340.848399:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191340.848414:0:57909:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191340.848426:0:57909:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191340.848432:0:57909:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191340.848436:0:57909:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191340.848442:0:57909:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4223bb58 00010000:00010000:3.0:1787191340.848446:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191340.848454:0:57909:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191340.848469:0:57909:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191340.848475:0:57909:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191340.848481:0:57909:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191340.848485:0:57909:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=9 00000080:00200008:3.0:1787191340.848492:0:57909:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xd0:0x0](ffff936b489880c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191340.848496:0:57909:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8),name=f70.sanity-flr 00000002:00010000:3.0:1787191340.848508:0:57909:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191340.848515:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a4e0 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605af9 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191340.848524:0:57909:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a4e0 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605af9 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787191340.848531:0:57909:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191340.848535:0:57909:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) 00000080:00010000:3.0:1787191340.848537:0:57909:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) for lock 0xe5129dc88483a4e0 00000080:00010000:3.0:1787191340.848542:0:57909:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a4e0 from it ffffa3fb4223bcb8 00010000:00010000:3.0:1787191340.848545:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a4e0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605af9 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191340.848553:0:57909:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a4e0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605af9 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:3.0:1787191340.848573:0:57909:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd0:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:3.0:1787191340.848583:0:57909:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd0:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191340.848586:0:57909:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191340.848589:0:57909:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xd0:0x0] 00000008:00010000:3.0:1787191340.848607:0:57909:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191340.848611:0:57909:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667eb0, osc lock ffff936b44f65c80, flags 0x400000400001002 00010000:00010000:3.0:1787191340.848627:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191340.848638:0:57909:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:3.0:1787191340.848650:0:57909:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191340.848654:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191340.848661:0:57909:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:3.0:1787191340.848671:0:57909:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191340.848679:0:57909:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd0:0x0] updating i_size 5 i_blocks 0 00000020:00010000:3.0:1787191340.848685:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51656bf0 (ffff936b465cccf8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191340.848688:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51656bf0 (ffff936b465cccf8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191340.848691:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667eb0 (ffff936b465cc008/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191340.848695:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51656bf0 (ffff936b465cccf8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191340.848697:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667eb0 (ffff936b465cccf8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191340.848706:0:57909:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd0:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191340.848729:0:57909:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191340.848736:0:57909:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191340.848742:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191340.848750:0:57909:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191340.848757:0:57909:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191340.848761:0:57909:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191340.848763:0:57909:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191340.848766:0:57909:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4223bbf8 00010000:00010000:3.0:1787191340.848770:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191340.848776:0:57909:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191340.848784:0:57909:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191340.848787:0:57909:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191340.848791:0:57909:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191340.848794:0:57909:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:3.0:1787191340.848798:0:57909:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8), inode mode 81a4 mask 46 00000080:00200008:3.0:1787191340.848806:0:57909:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xd0:0x0](ffff936b489880c8), flags 154402 00000002:00010000:3.0:1787191340.848819:0:57909:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd0:0x0]) in obj [0x200000405:0xd0:0x0], intent: open flags 0104240114403 00010000:00010000:3.0:1787191340.849245:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483a4ee lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.849254:0:57909:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483a4ee lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191340.849265:0:57909:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191340.849275:0:57909:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1ed80 x1874004626719360/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191340.849284:0:57909:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483a4ee lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191340.849304:0:57909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ed80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626719360:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191340.849512:0:57909:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c240 going to sleep for 11 seconds 00000008:00010000:0.0:1787191340.849973:0:57910:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191340.849978:0:57910:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee67b0, osc lock ffff936b50b63690, flags 0x400000400001002 00010000:00010000:0.0:1787191340.849998:0:57910:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191340.850011:0:57910:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:0.0:1787191340.850022:0:57910:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191340.850026:0:57910:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191340.850051:0:57910:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:0.0:1787191340.850064:0:57910:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191340.850072:0:57910:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd0:0x0] updating i_size 5 i_blocks 0 00000020:00010000:0.0:1787191340.850077:0:57910:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c38000 (ffff936b47a17ea8/0) at cl_lock_release():245 00000020:00010000:0.0:1787191340.850081:0:57910:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c38000 (ffff936b47a17ea8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191340.850084:0:57910:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee67b0 (ffff936b47a17008/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191340.850088:0:57910:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c38000 (ffff936b47a17ea8/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191340.850090:0:57910:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee67b0 (ffff936b47a17ea8/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191340.850102:0:57910:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd0:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191340.850211:0:57910:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191340.850229:0:57910:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.850239:0:57910:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.850248:0:57910:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.850255:0:57910:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191340.850260:0:57910:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191340.850263:0:57910:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191340.850268:0:57910:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42243c10 00010000:00010000:0.0:1787191340.850271:0:57910:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.850282:0:57910:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.850292:0:57910:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.850297:0:57910:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:0.0:1787191340.850301:0:57910:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.850307:0:57910:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:0.0:1787191340.850310:0:57910:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:0.0:1787191340.850315:0:57910:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:0.0:1787191340.850337:0:57910:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a4cb lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4605a97 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191340.850350:0:57910:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xd0:0x0]: losing layout lock 00010000:00010000:0.0:1787191340.850362:0:57910:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a4e0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4605af9 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1787191340.850370:0:57910:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xd0:0x0]: losing layout lock 00010000:00010000:0.0:1787191340.850376:0:57910:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a4b6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4605a58 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.850494:0:57910:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a4cb lrc: 1/0,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605a97 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191340.850502:0:57910:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a4e0 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605af9 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191340.850508:0:57910:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a4b6 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4605a58 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.850518:0:57910:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:0.0:1787191340.850521:0:57910:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a4cb lrc: 0/0,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605a97 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191340.850534:0:57910:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a4e0 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605af9 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191340.850543:0:57910:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a4b6 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4605a58 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1787191340.850557:0:57910:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 36, max 7 00000100:00100000:0.0:1787191340.850567:0:57910:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474000 x1874004626719616/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787191340.850585:0:57910:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57910:1874004626719616:192.168.202.101@tcp:36:rm.0 00000100:00100000:0.0:1787191340.850856:0:57910:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787191340.854057:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191340.854225:0:40921:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787191340.854243:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634902656 00000100:00100000:2.0:1787191340.854251:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634902656 00000100:00100000:2.0:1787191340.854333:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1382 00000100:00100000:2.0:1787191340.854343:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b50881c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634902656:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191340.854355:0:40921:0:(ldlm_lockd.c:2455:ldlm_callback_handler()) callback on lock 0xe5129dc88483a4e0 - lock disappeared 00010000:00010000:2.0:1787191340.854427:0:40921:0:(ldlm_lockd.c:2352:ldlm_callback_errmsg()) @@@ Operate with invalid parameter, NID=12345-192.168.202.101@tcp lock=0xe5129dc88483a4e0: rc = 0 req@ffff936b50881c50 x1874004634902656/t0(0) o104->f10005b0-4ec5-4888-9c81-49c0b11e82c4@192.168.202.101@tcp:651/0 lens 328/224 e 0 to 0 dl 1787191351 ref 1 fl Interpret:/0/0 rc -22/-22 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787191340.854439:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b50881c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634902656:12345-192.168.202.101@tcp:104: Request processed in 99us (392us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787191340.854447:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1382 00000100:00100000:0.0:1787191340.856896:0:57909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ed80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626719360:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191340.856921:0:57909:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CW ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483a4ee lrc: 4/1,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605b15 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.856933:0:57909:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483a4ee lrc: 4/1,0 mode: --/CW res: [0x200000405:0xd0:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605b15 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.856940:0:57909:0:(ldlm_request.c:795:ldlm_cli_enqueue_fini()) ### enqueue reply includes blocking AST ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483a4ee lrc: 4/1,0 mode: --/CW res: [0x200000405:0xd0:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4605b15 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.856956:0:57909:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483a4ee lrc: 4/1,0 mode: CW/CW res: [0x200000405:0xd0:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e4605b15 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.856966:0:57909:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483a4ee lrc: 4/1,0 mode: CW/CW res: [0x200000405:0xd0:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4605b15 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.856978:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483a4ee lrc: 5/1,1 mode: CW/CW res: [0x200000405:0xd0:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e4605b15 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.856987:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483a4ee lrc: 5/1,1 mode: CW/CW res: [0x200000405:0xd0:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e4605b15 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.856994:0:57909:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483a4ee lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xd0:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e4605b15 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191340.857006:0:57909:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x200002b, status=0 req@ffff936b51d1ed80 x1874004626719360/t8589936937(8589936937) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191340.857019:0:57909:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1ed80 x1874004626719360/t8589936937(8589936937) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191340.857043:0:57909:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483a4ee lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xd0:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4605b15 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.857055:0:57909:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 8 res 8589935621/208 (0 0) 00000080:00200000:0.0:1787191340.857061:0:57909:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xd0:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191340.857112:0:57909:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) for lock 0xe5129dc88483a4ee 00000080:00010000:0.0:1787191340.857125:0:57909:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a4ee from it ffffa3fb4223bbf0 00010000:00010000:0.0:1787191340.857129:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483a4ee lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xd0:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e4605b15 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.857136:0:57909:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483a4ee lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xd0:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e4605b15 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.857151:0:57909:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000002:00100000:0.0:1787191340.857168:0:57909:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1ed80 x1874004626719360/t8589936937(8589936937) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191340.857318:0:57909:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8), inode mode 81a4 mask 4 00000080:00200000:0.0:1787191340.857326:0:57909:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8), xattr lov 00000080:00200008:0.0:1787191340.857353:0:57909:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xd0:0x0](ffff936b489880c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191340.857360:0:57909:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8),name=f70.sanity-flr 00000002:00010000:0.0:1787191340.857373:0:57909:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd0:0x0]) in obj [0x200000405:0xd0:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.857380:0:57909:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 30 res 8589935621/208 (0 0) 00010000:00010000:0.0:1787191340.857449:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a4f5 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.857458:0:57909:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a4f5 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.857468:0:57909:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a4f5 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191340.857488:0:57909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626719744:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191340.857566:0:57909:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99b40 going to sleep for 11 seconds 00010000:00010000:1.0:1787191340.857671:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191340.857679:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483a4ee lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xd0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4605b15 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.857687:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9b600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191340.857691:0:40929:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483a4ee lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xd0:0x0].0x0 bits 0x5/0x5 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4605b15 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.857699:0:40929:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483a4ee lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xd0:0x0].0x0 bits 0x5/0x5 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4605b15 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.857707:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483a4ee lrc: 3/0,0 mode: CW/CW res: [0x200000405:0xd0:0x0].0x0 bits 0x5/0x5 rrc: 3 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x7130d520e4605b15 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.857741:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483a4ee lrc: 2/0,0 mode: --/CW res: [0x200000405:0xd0:0x0].0x0 bits 0x5/0x5 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e4605b15 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.857748:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191340.857769:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483a4ee lrc: 1/0,0 mode: --/CW res: [0x200000405:0xd0:0x0].0x0 bits 0x5/0x5 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e4605b15 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.857776:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483a4ee lrc: 0/0,0 mode: --/CW res: [0x200000405:0xd0:0x0].0x0 bits 0x5/0x5 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e4605b15 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.857789:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191340.857790:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191340.857791:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191340.857799:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787191340.857811:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626719872:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191340.863378:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626719872:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191340.863556:0:57910:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57910:1874004626719616:192.168.202.101@tcp:36:rm.0 00000100:00100000:0.0:1787191340.864094:0:57909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626719744:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191340.864111:0:57909:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a4f5 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605b3f expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.864123:0:57909:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a4f5 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605b3f expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.864135:0:57909:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a4f5 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605b3f expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.864146:0:57909:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a4f5 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605b3f expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.864158:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a4f5 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605b3f expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.864166:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a4f5 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605b3f expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.864174:0:57909:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a4f5 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605b3f expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191340.864186:0:57909:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b6a477b80 x1874004626719744/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/976 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191340.864197:0:57909:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a4f5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605b3f expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191340.864215:0:57909:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a4f5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605b3f expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.864224:0:57909:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/208 (0 0) 00000080:00200000:0.0:1787191340.864230:0:57909:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xd0:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787191340.864286:0:57909:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd0:0x0]: layout version change: 4294967294 -> 4 00000080:00010000:0.0:1787191340.864292:0:57909:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) for lock 0xe5129dc88483a4f5 00000080:00010000:0.0:1787191340.864299:0:57909:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) 00000080:00010000:0.0:1787191340.864302:0:57909:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a4f5 from it ffffa3fb4223bcd8 00010000:00010000:0.0:1787191340.864305:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a4f5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605b3f expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.864314:0:57909:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a4f5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605b3f expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191340.864342:0:57909:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd0:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:0.0:1787191340.864352:0:57909:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd0:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191340.864355:0:57909:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191340.864359:0:57909:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xd0:0x0] 00000008:00010000:0.0:1787191340.864376:0:57909:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191340.864379:0:57909:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee67b0, osc lock ffff936b50b63690, flags 0x400000400001002 00010000:00010000:0.0:1787191340.864528:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191340.864544:0:57909:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:0.0:1787191340.864562:0:57909:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191340.864566:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191340.864574:0:57909:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000020:00200000:0.0:1787191340.864586:0:57909:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191340.864595:0:57909:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd0:0x0] updating i_size 5 i_blocks 0 00000020:00010000:0.0:1787191340.864611:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c38000 (ffff936b47a17ea8/0) at cl_lock_release():245 00000020:00010000:0.0:1787191340.864615:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c38000 (ffff936b47a17ea8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191340.864619:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee67b0 (ffff936b47a17008/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191340.864623:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c38000 (ffff936b47a17ea8/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191340.864626:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee67b0 (ffff936b47a17ea8/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191340.864637:0:57909:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd0:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200080:0.0:1787191340.864704:0:57909:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8) cmd=c00c66f3 arg=22402e0 00000002:00010000:0.0:1787191340.864726:0:57909:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd0:0x0]) in obj [0x200000405:0xd0:0x0], intent: open flags 05004040000002 00010000:00010000:0.0:1787191340.864766:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a4fc lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.864774:0:57909:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a4fc lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191340.864785:0:57909:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191340.864792:0:57909:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477b80 x1874004626720128/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191340.864806:0:57909:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a4fc lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x81000000000000 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191340.864825:0:57909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626720128:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191340.868220:0:57909:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.871522:0:57909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626720128:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191340.871545:0:57909:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a4fc lrc: 4/1,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4605b4d expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.871559:0:57909:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a4fc lrc: 4/1,0 mode: --/PW res: [0x200000405:0xd0:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4605b4d expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.871571:0:57909:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a4fc lrc: 4/1,0 mode: PW/PW res: [0x200000405:0xd0:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4605b4d expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.871582:0:57909:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a4fc lrc: 4/1,0 mode: PW/PW res: [0x200000405:0xd0:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4605b4d expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.871595:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a4fc lrc: 5/1,1 mode: PW/PW res: [0x200000405:0xd0:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4605b4d expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.872201:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a4fc lrc: 5/1,1 mode: PW/PW res: [0x200000405:0xd0:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4605b4d expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.872214:0:57909:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a4fc lrc: 4/0,1 mode: PW/PW res: [0x200000405:0xd0:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4605b4d expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191340.872232:0:57909:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x600002b, status=0 req@ffff936b6a477b80 x1874004626720128/t8589936939(8589936939) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191340.872246:0:57909:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477b80 x1874004626720128/t8589936939(8589936939) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191340.872261:0:57909:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a4fc lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xd0:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4605b4d expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.872271:0:57909:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 2 res 8589935621/208 (0 0) 00000080:00200000:0.0:1787191340.872277:0:57909:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xd0:0x0] suppgids 0 0: rc 0 00000002:00100000:0.0:1787191340.872296:0:57909:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477b80 x1874004626720128/t8589936939(8589936939) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191340.872305:0:57909:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) for lock 0xe5129dc88483a4fc 00000080:00010000:0.0:1787191340.872310:0:57909:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a4fc from it ffffa3fb4223bcc0 00010000:00010000:0.0:1787191340.872314:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a4fc lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xd0:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4605b4d expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.872322:0:57909:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a4fc lrc: 2/0,0 mode: PW/PW res: [0x200000405:0xd0:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4605b4d expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1787191340.872376:0:57909:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd0:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:0.0:1787191340.872387:0:57909:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd0:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191340.872391:0:57909:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191340.872546:0:57909:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191340.872557:0:57909:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000100:00100000:0.0:1787191340.872746:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626720256:192.168.202.101@tcp:1:lfs.0 00000080:00200000:1.0:1787191340.876825:0:57911:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191340.876973:0:57911:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191340.876989:0:57911:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191340.877003:0:57911:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191340.877011:0:57911:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191340.877018:0:57911:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191340.877021:0:57911:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191340.877037:0:57911:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4220bb58 00010000:00010000:1.0:1787191340.877041:0:57911:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191340.877052:0:57911:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191340.877067:0:57911:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191340.877074:0:57911:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:1.0:1787191340.877081:0:57911:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191340.877091:0:57911:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:1.0:1787191340.877096:0:57911:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191340.877108:0:57911:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191340.877219:0:57911:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a503 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.877227:0:57911:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a503 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.877238:0:57911:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a503 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191340.877260:0:57911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57911:1874004626720384:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191340.877331:0:57911:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:1.0:1787191340.879988:0:57911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57911:1874004626720384:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191340.880011:0:57911:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a503 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.880025:0:57911:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a503 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.880043:0:57911:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a503 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.880049:0:57911:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a503 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.880059:0:57911:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a503 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.880065:0:57911:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40031e00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191340.880070:0:57911:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a503 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.880078:0:57911:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a503 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.880085:0:57911:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a503 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.880092:0:57911:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191340.880099:0:57911:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a503 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.880106:0:57911:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a503 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191340.880220:0:57911:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b453ab800 x1874004626720384/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191340.880237:0:57911:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191340.880327:0:57911:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191340.880341:0:57911:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191340.880351:0:57911:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191340.880363:0:57911:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191340.880371:0:57911:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191340.880376:0:57911:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191340.880379:0:57911:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191340.880385:0:57911:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4220bbe8 00010000:00010000:1.0:1787191340.880389:0:57911:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191340.880408:0:57911:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191340.880428:0:57911:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191340.880436:0:57911:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000080:00200000:1.0:1787191340.880441:0:57911:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191340.880453:0:57911:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:1.0:1787191340.880457:0:57911:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191340.880469:0:57911:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191340.880510:0:57911:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a50a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.880517:0:57911:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a50a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.880526:0:57911:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a50a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191340.880545:0:57911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57911:1874004626720512:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191340.880772:0:57911:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:3.0:1787191340.883021:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:1.0:1787191340.883303:0:57911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57911:1874004626720512:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191340.883320:0:57911:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a50a lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.883334:0:57911:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a50a lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.883341:0:57911:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a50a lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.883349:0:57911:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a50a lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.883358:0:57911:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a50a lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.883364:0:57911:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191340.883368:0:57911:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a50a lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.883374:0:57911:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a50a lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.883380:0:57911:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a50a lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.883387:0:57911:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191340.883404:0:57911:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a50a lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.883412:0:57911:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a50a lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191340.883434:0:57911:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b453ab800 x1874004626720512/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191340.883448:0:57911:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191340.883530:0:57911:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191340.883545:0:57911:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191340.883554:0:57911:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191340.883565:0:57911:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191340.883572:0:57911:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191340.883577:0:57911:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191340.883581:0:57911:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191340.883585:0:57911:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4220bb58 00010000:00010000:1.0:1787191340.883589:0:57911:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191340.883597:0:57911:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000100:00100000:3.0:1787191340.883722:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634902784 00000100:00100000:3.0:1787191340.883729:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634902784 00000100:00100000:3.0:1787191340.883776:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1383 00000100:00100000:3.0:1787191340.883786:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30511:x1874004634902784:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191340.883799:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000020000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1787191340.883898:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191340.883906:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30511:x1874004634902784:12345-192.168.202.101@tcp:104: Request processed in 121us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191340.883913:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1383 00010000:00010000:0.0:1787191340.884359:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191340.884367:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000020000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1787191340.884377:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030600 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191340.884383:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800428400020000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000008:00010000:0.0:1787191340.884411:0:57627:0:(osc_cache.c:2029:try_to_add_extent_for_io()) ### extent: 00000000a1af3917 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800429400020000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000008:00010000:0.0:1787191340.884424:0:57627:0:(osc_cache.c:1183:osc_extent_make_ready()) ### extent: 00000000a1af3917 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800429400020000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1787191340.884469:0:57627:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800429400020000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000008:00100000:0.0:1787191340.884536:0:57627:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff936b6a477800 - object 0x280000401:448 offset 0<>5 00000100:00100000:0.0:1787191340.884582:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626720640:192.168.202.101@tcp:4:bash.0 00000080:00200000:1.0:1787191340.885199:0:57911:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191340.885211:0:57911:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:1.0:1787191340.885223:0:57911:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:1.0:1787191340.885229:0:57911:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:1.0:1787191340.885250:0:57911:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191340.885262:0:57911:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 87 lru_type: 1 00010000:00010000:1.0:1787191340.885271:0:57911:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 87 lru_type: 1 00000002:00010000:1.0:1787191340.885280:0:57911:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191340.885314:0:57911:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a511 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.885322:0:57911:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a511 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.885335:0:57911:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a511 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191340.885352:0:57911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57911:1874004626720768:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191340.885544:0:57911:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000008:00010000:0.0:1787191340.896178:0:2390:0:(osc_cache.c:917:osc_extent_finish()) ### extent: 00000000a1af3917 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800429400020000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000008:00010000:0.0:1787191340.896249:0:2390:0:(osc_cache.c:497:__osc_extent_remove()) ### extent: 00000000a1af3917 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800429400020000 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000100:00100000:0.0:1787191340.896281:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626720640:192.168.202.101@tcp:4:bash.0 00000080:00200000:2.0:1787191340.896623:0:57627:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd0:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1787191340.896678:0:57627:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd0:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:2.0:1787191340.896751:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400020020 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1787191340.896760:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191340.896790:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400020020 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1787191340.896799:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a4d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400020020 nid: local remote: 0x7130d520e4605add expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1787191340.896826:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191340.896828:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191340.897093:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626720896:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787191340.897739:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191340.897942:0:57911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57911:1874004626720768:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191340.897961:0:57911:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a511 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605b93 expref: -99 pid: 57911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.897973:0:57911:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a511 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605b93 expref: -99 pid: 57911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.897985:0:57911:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a511 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605b93 expref: -99 pid: 57911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.897997:0:57911:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a511 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605b93 expref: -99 pid: 57911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.898009:0:57911:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a511 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605b93 expref: -99 pid: 57911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.898017:0:57911:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a511 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605b93 expref: -99 pid: 57911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.898025:0:57911:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a511 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605b93 expref: -99 pid: 57911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191340.898075:0:57911:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b453ab800 x1874004626720768/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191340.898089:0:57911:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a511 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605b93 expref: -99 pid: 57911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.898100:0:57911:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:1.0:1787191340.898107:0:57911:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a511 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605b93 expref: -99 pid: 57911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.898126:0:57911:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a511 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605b93 expref: -99 pid: 57911 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:1.0:1787191340.898152:0:57911:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191340.898163:0:57911:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 174 lru_type: 1 00010000:00010000:1.0:1787191340.898174:0:57911:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 174 lru_type: 1 00010000:00010000:1.0:1787191340.898183:0:57911:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 174 lru_type: 1 00010000:00010000:1.0:1787191340.898190:0:57911:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 175 lru_type: 1 00000080:00200000:1.0:1787191340.898202:0:57911:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191340.898210:0:57911:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:1.0:1787191340.898214:0:57911:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:1.0:1787191340.898221:0:57911:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb4220bcb8 00010000:00010000:1.0:1787191340.898224:0:57911:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 87 lru_type: 1 00010000:00010000:1.0:1787191340.898231:0:57911:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 88 lru_type: 1 00000002:00010000:1.0:1787191340.898246:0:57911:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191340.898251:0:57911:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a511 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605b93 expref: -99 pid: 57911 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.898259:0:57911:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a511 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605b93 expref: -99 pid: 57911 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.898265:0:57911:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a511 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605b93 expref: -99 pid: 57911 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.898272:0:57911:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a511 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605b93 expref: -99 pid: 57911 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:1.0:1787191340.898279:0:57911:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191340.898284:0:57911:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 175 lru_type: 1 00010000:00010000:1.0:1787191340.898291:0:57911:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 175 lru_type: 1 00010000:00010000:1.0:1787191340.898303:0:57911:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 175 lru_type: 1 00010000:00010000:1.0:1787191340.898310:0:57911:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 176 lru_type: 1 00000080:00200008:1.0:1787191340.898826:0:57911:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:1.0:1787191340.898861:0:57911:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191340.898876:0:57911:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191340.898886:0:57911:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191340.898896:0:57911:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191340.898902:0:57911:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191340.898907:0:57911:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191340.898910:0:57911:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191340.898914:0:57911:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4220bcb8 00010000:00010000:1.0:1787191340.898917:0:57911:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191340.898925:0:57911:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191340.899047:0:57911:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191340.899056:0:57911:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191340.899063:0:57911:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191340.899071:0:57911:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191340.899078:0:57911:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191340.899082:0:57911:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191340.899084:0:57911:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191340.899088:0:57911:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4220bb58 00010000:00010000:1.0:1787191340.899091:0:57911:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191340.899099:0:57911:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191340.899107:0:57911:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191340.899113:0:57911:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:1.0:1787191340.899118:0:57911:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191340.899127:0:57911:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:1.0:1787191340.899131:0:57911:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191340.899142:0:57911:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191340.899180:0:57911:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a518 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.899188:0:57911:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a518 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.899198:0:57911:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a518 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191340.899219:0:57911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57911:1874004626721024:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191340.899294:0:57911:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.901257:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626720256:192.168.202.101@tcp:1:lfs.0 00010000:00010000:2.0:1787191340.901345:0:57909:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a4f5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4605b3f expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191340.901366:0:57909:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xd0:0x0]: losing layout lock 00010000:00010000:2.0:1787191340.901423:0:57909:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a4f5 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605b3f expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191340.901430:0:57909:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191340.901433:0:57909:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a4f5 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605b3f expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:2.0:1787191340.901450:0:57909:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1787191340.901460:0:57909:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb100 x1874004626721280/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 472/440 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787191340.901481:0:57909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626721280:192.168.202.101@tcp:36:lfs.0 00000100:00100000:2.0:1787191340.901545:0:57909:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787191340.901702:0:57911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57911:1874004626721024:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191340.901714:0:57911:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a518 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.901723:0:57911:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a518 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.901730:0:57911:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a518 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.901736:0:57911:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a518 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.901743:0:57911:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a518 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.901750:0:57911:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191340.901754:0:57911:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a518 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.901760:0:57911:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a518 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.901767:0:57911:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a518 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.901772:0:57911:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191340.901777:0:57911:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a518 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.901782:0:57911:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a518 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191340.901795:0:57911:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b453ab800 x1874004626721024/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191340.901809:0:57911:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1787191340.901827:0:57911:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a511 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605b93 expref: -99 pid: 57911 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191340.901869:0:57911:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a511 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605b93 expref: -99 pid: 57911 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:1.0:1787191340.901878:0:57911:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a511 from it ffffa3fb4220b930 00010000:00010000:1.0:1787191340.901882:0:57911:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a511 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605b93 expref: -99 pid: 57911 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191340.901891:0:57911:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a511 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605b93 expref: -99 pid: 57911 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191340.901954:0:57911:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191340.901968:0:57911:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191340.901976:0:57911:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191340.901985:0:57911:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191340.901998:0:57911:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191340.902002:0:57911:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191340.902005:0:57911:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191340.902010:0:57911:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4220bbf8 00010000:00010000:1.0:1787191340.902013:0:57911:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191340.902021:0:57911:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191340.902041:0:57911:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191340.902048:0:57911:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191340.902054:0:57911:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191340.902060:0:57911:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:1.0:1787191340.902064:0:57911:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:1.0:1787191340.902069:0:57911:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b484df680, open_flags a141, mode 81b6 opened 0 00000080:00200000:1.0:1787191340.902078:0:57911:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:1.0:1787191340.902097:0:57911:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xd2:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:1.0:1787191340.902106:0:57911:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a511 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4605b93 expref: -99 pid: 57911 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191340.902133:0:57911:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a511 lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4605b93 expref: -99 pid: 57911 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191340.902140:0:57911:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191340.902143:0:57911:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a511 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4605b93 expref: -99 pid: 57911 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191340.902173:0:57911:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a51f lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.902180:0:57911:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a51f lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191340.902189:0:57911:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:1.0:1787191340.902194:0:57911:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453ab800 x1874004626721536/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191340.902203:0:57911:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a51f lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191340.902216:0:57911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57911:1874004626721536:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191340.902298:0:57911:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:3.0:1787191340.902496:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626720896:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191340.907565:0:57911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57911:1874004626721536:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191340.907587:0:57911:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a51f lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605bcb expref: -99 pid: 57911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.907609:0:57911:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a51f lrc: 4/0,1 mode: --/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605bcb expref: -99 pid: 57911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.907617:0:57911:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a51f lrc: 4/0,1 mode: --/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605bcb expref: -99 pid: 57911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.907628:0:57911:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a51f lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605bcb expref: -99 pid: 57911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.907643:0:57911:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a51f lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605bcb expref: -99 pid: 57911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.907657:0:57911:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a51f lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605bcb expref: -99 pid: 57911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.907664:0:57911:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a51f lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605bcb expref: -99 pid: 57911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.907669:0:57911:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a51f lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605bcb expref: -99 pid: 57911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191340.907678:0:57911:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b453ab800 x1874004626721536/t8589936941(8589936941) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191340.907687:0:57911:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453ab800 x1874004626721536/t8589936941(8589936941) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191340.907696:0:57911:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a51f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605bcb expref: -99 pid: 57911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.907703:0:57911:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/210 (0 0) 00000080:00200000:1.0:1787191340.907708:0:57911:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191340.907718:0:57911:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:1.0:1787191340.907743:0:57911:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xd2:0x0](ffff936b5395a1c8) 00000080:00200000:1.0:1787191340.907748:0:57911:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xd2:0x0], updating i_size 0 00000080:00200000:1.0:1787191340.907777:0:57911:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd2:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:1.0:1787191340.907781:0:57911:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xd2:0x0](ffff936b5395a1c8) 00000080:00010000:1.0:1787191340.907783:0:57911:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd2:0x0](ffff936b5395a1c8) for lock 0xe5129dc88483a51f 00000080:00010000:1.0:1787191340.907790:0:57911:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd2:0x0](ffff936b5395a1c8) 00000080:00200008:1.0:1787191340.907803:0:57911:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xd2:0x0](ffff936b5395a1c8), flags 120501 00000002:00100000:1.0:1787191340.907817:0:57911:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453ab800 x1874004626721536/t8589936941(8589936941) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191340.907889:0:57911:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a51f from it ffff936b5339fa80 00010000:00010000:1.0:1787191340.907894:0:57911:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a51f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605bcb expref: -99 pid: 57911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.907904:0:57911:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a51f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605bcb expref: -99 pid: 57911 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191340.907925:0:57911:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd2:0x0](ffff936b5395a1c8), inode mode 81a4 mask 40 00000080:00200000:1.0:1787191340.907972:0:57911:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd2:0x0](ffff936b5395a1c8), inode mode 81a4 mask 2 00000080:00200000:1.0:1787191340.907979:0:57911:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xd2:0x0](ffff936b5395a1c8), xattr lov 00000002:00010000:1.0:1787191340.907993:0:57911:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd2:0x0]) in obj [0x200000405:0xd2:0x0], intent: open flags 040000002 00010000:00010000:1.0:1787191340.908027:0:57911:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a526 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.908045:0:57911:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a526 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191340.908060:0:57911:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:1.0:1787191340.908067:0:57911:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453aaa00 x1874004626721792/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191340.908075:0:57911:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a526 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191340.908095:0:57911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aaa00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57911:1874004626721792:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191340.908433:0:57911:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:2.0:1787191340.912825:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:0.0:1787191340.912987:0:57909:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589936941 gen 1 00000100:00100000:0.0:1787191340.912999:0:57909:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b51d1ed80 x1874004626719360/t8589936937(8589936937) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787191340.913022:0:57909:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b6a477b80 x1874004626720128/t8589936939(8589936939) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787191340.913078:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634903424 00000100:00100000:3.0:1787191340.913085:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634903424 00000100:00100000:3.0:1787191340.913142:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1384 00000100:00100000:3.0:1787191340.913152:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634903424:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191340.913170:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a51f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4605bcb expref: -99 pid: 57911 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1787191340.913220:0:57909:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b453ab800 x1874004626721536/t8589936941(8589936941) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191356 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787191340.913231:0:57909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626721280:192.168.202.101@tcp:36:lfs.0 00010000:00010000:3.0:1787191340.913254:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191340.913261:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634903424:12345-192.168.202.101@tcp:104: Request processed in 110us (446us total) trans 0 rc 0/0 00010000:00010000:0.0:1787191340.913267:0:57909:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/208 (0 0) 00000100:00100000:3.0:1787191340.913268:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1384 00000080:00010000:0.0:1787191340.913280:0:57909:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xd0:0x0](ffff936b489880c8) 00000002:00010000:0.0:1787191340.913290:0:57909:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd0:0x0]) in obj [0x200000405:0xd0:0x0], intent: layout flags 0 00010000:00010000:0.0:1787191340.913326:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a52d lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.913335:0:57909:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a52d lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.913345:0:57909:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a52d lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191340.913363:0:57909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626721920:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191340.914043:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191340.914052:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a51f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4605bcb expref: -99 pid: 57911 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.914061:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40031e00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191340.914066:0:40930:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a51f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4605bcb expref: -99 pid: 57911 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.914074:0:40930:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a51f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4605bcb expref: -99 pid: 57911 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.914083:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a51f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4605bcb expref: -99 pid: 57911 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191340.914103:0:40930:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xd2:0x0]: losing layout lock 00010000:00010000:1.0:1787191340.914153:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a51f lrc: 2/0,0 mode: --/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4605bcb expref: -99 pid: 57911 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.914161:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191340.914189:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a51f lrc: 1/0,0 mode: --/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4605bcb expref: -99 pid: 57911 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.914197:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a51f lrc: 0/0,0 mode: --/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4605bcb expref: -99 pid: 57911 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191340.914212:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191340.914214:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191340.914216:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191340.914591:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626722048:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191340.914788:0:57909:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.917299:0:57909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626721920:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191340.917329:0:57909:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a52d lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605be7 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.917344:0:57909:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a52d lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605be7 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191340.917358:0:57909:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b6a474000 x1874004626721920/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191340.917370:0:57909:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a52d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605be7 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191340.917383:0:57909:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a52d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605be7 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.917451:0:57909:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/208 (0 0) 00000080:00200000:0.0:1787191340.917459:0:57909:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xd0:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191340.917477:0:57909:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) for lock 0xe5129dc88483a52d 00000080:00010000:0.0:1787191340.917484:0:57909:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a52d from it ffffa3fb4223bc70 00010000:00010000:0.0:1787191340.917489:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a52d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605be7 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.917498:0:57909:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a52d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605be7 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.917522:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a52d lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605be7 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.917538:0:57909:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a52d lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605be7 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1787191340.917547:0:57909:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xd0:0x0](000000009457cdc2) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a52d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605be7 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.917586:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a52d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605be7 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.917595:0:57909:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a52d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605be7 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191340.917705:0:57909:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd0:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191340.917715:0:57909:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd0:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191340.917718:0:57909:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191340.917724:0:57909:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191340.917749:0:57909:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191340.917768:0:57909:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd0:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:0.0:1787191340.917782:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a52d lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605be7 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191340.917791:0:57909:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a52d lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605be7 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:0.0:1787191340.917799:0:57909:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xd0:0x0](000000009457cdc2) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a52d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605be7 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191340.917824:0:57909:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd0:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191340.917829:0:57909:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd0:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191340.917997:0:57909:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191340.918001:0:57909:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191340.918018:0:57909:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191340.918024:0:57909:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd0:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:0.0:1787191340.918064:0:57909:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191340 1787191340 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000be88ce23/0xe5129dc88483a4e7 lrc: 1/0,0 mode: PW/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4605b07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191340.918201:0:57909:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd0:0x0]: layout version change: 4294967294 -> 5 00010000:00010000:0.0:1787191340.918207:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a52d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605be7 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191340.918216:0:57909:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a52d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605be7 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200080:0.0:1787191340.918238:0:57909:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8) cmd=66f4 arg=22402e0 00000080:00200008:0.0:1787191340.918253:0:57909:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xd0:0x0](ffff936b489880c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191340.918262:0:57909:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8),name=f70.sanity-flr 00000002:00010000:0.0:1787191340.918279:0:57909:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd0:0x0]) in obj [0x200000405:0xd0:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.918287:0:57909:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 30 res 8589935621/208 (0 0) 00010000:00010000:0.0:1787191340.918330:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a534 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.918338:0:57909:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a534 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.918355:0:57909:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a534 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191340.918378:0:57909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626722176:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191340.918585:0:57909:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.922676:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626722048:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191340.922763:0:57911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aaa00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57911:1874004626721792:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191340.922779:0:57911:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a526 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xd2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.922794:0:57911:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a526 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xd2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.922801:0:57911:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a526 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xd2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.922808:0:57911:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a526 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xd2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.922817:0:57911:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a526 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xd2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.922823:0:57911:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030e00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191340.922828:0:57911:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a526 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xd2:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.922874:0:57911:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a526 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xd2:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.922881:0:57911:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a526 lrc: 5/0,0 mode: --/CR res: [0x200000405:0xd2:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.922888:0:57911:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191340.922895:0:57911:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a526 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xd2:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.922902:0:57911:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a526 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xd2:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57911 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191340.922928:0:57911:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b453aaa00 x1874004626721792/t8589936942(8589936942) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191340.922943:0:57911:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453aaa00 x1874004626721792/t8589936942(8589936942) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191340.922959:0:57911:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xd2:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1787191340.923003:0:57911:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd2:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1787191340.923011:0:57911:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd2:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191340.923072:0:57911:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xd2:0x0], updating i_size 0 00000002:00100000:3.0:1787191340.923090:0:57911:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453aaa00 x1874004626721792/t8589936942(8589936942) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191340.923136:0:57911:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453aaa00 x1874004626721792/t8589936942(8589936942) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191340.923147:0:57911:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191340.923153:0:57911:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1ce00 x1874004626722432/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191340.923174:0:57911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ce00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57911:1874004626722432:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191340.923236:0:57911:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787191340.925357:0:57911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ce00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57911:1874004626722432:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191340.925389:0:57911:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453aaa00 x1874004626721792/t8589936942(8589936942) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:3.0:1787191340.925451:0:57911:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xd2:0x0](ffff936b5395a1c8), flags 100001 00000002:00100000:3.0:1787191340.925493:0:57911:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453ab800 x1874004626721536/t8589936941(8589936941) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191356 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191340.925502:0:57911:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191340.925508:0:57911:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1df80 x1874004626722688/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191340.925527:0:57911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57911:1874004626722688:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191340.925593:0:57911:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c180 going to sleep for 11 seconds 00000100:00100000:1.0:1787191340.926622:0:57909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626722176:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191340.926644:0:57909:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a534 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605bf5 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.926657:0:57909:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a534 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605bf5 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.926670:0:57909:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a534 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605bf5 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.926681:0:57909:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a534 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605bf5 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.926694:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a534 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605bf5 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.926704:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a534 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605bf5 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.926712:0:57909:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a534 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605bf5 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191340.926723:0:57909:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b6a474000 x1874004626722176/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/976 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191340.926735:0:57909:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a534 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605bf5 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191340.926750:0:57909:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a534 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605bf5 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.926761:0:57909:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/208 (0 0) 00000080:00200000:1.0:1787191340.926767:0:57909:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xd0:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787191340.926822:0:57909:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd0:0x0]: layout version change: 5 -> 5 00000080:00010000:1.0:1787191340.926828:0:57909:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) for lock 0xe5129dc88483a534 00000080:00010000:1.0:1787191340.926865:0:57909:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) 00000080:00010000:1.0:1787191340.926868:0:57909:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a534 from it ffffa3fb4223bcd8 00010000:00010000:1.0:1787191340.926872:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a534 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605bf5 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.926881:0:57909:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a534 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605bf5 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191340.926918:0:57909:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd0:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:1.0:1787191340.926929:0:57909:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd0:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191340.926933:0:57909:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191340.926937:0:57909:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xd0:0x0] 00000008:00010000:1.0:1787191340.926955:0:57909:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191340.926958:0:57909:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b47d7d330, osc lock ffff936b46837690, flags 0x400000400001002 00010000:00010000:1.0:1787191340.927003:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.927014:0:57909:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191340.927025:0:57909:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b453a8a80 x1874004626722816/t0(0) o101->lustre-OST0000-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:1.0:1787191340.927077:0:57909:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:0.0:1787191340.927173:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626722816:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191340.929562:0:2390:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.929586:0:2390:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.929601:0:2390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.929623:0:2390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191340.929640:0:2390:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 5, setting rss=5; kms=5, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 5/2,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1787191340.929652:0:2390:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1787191340.929667:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.929682:0:2390:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.929690:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.929699:0:2390:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1787191340.929718:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626722816:192.168.202.101@tcp:101:lfs.0 00000080:00200000:1.0:1787191340.929878:0:57909:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd0:0x0] updating i_size 5 i_blocks 8 00000020:00010000:1.0:1787191340.929883:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c3abf0 (ffff936b47a17f38/0) at cl_lock_release():245 00000020:00010000:1.0:1787191340.929887:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c3abf0 (ffff936b47a17f38/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191340.929891:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7d330 (ffff936b465cc5a8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191340.929895:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c3abf0 (ffff936b47a17f38/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191340.929898:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7d330 (ffff936b47a17f38/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191340.929910:0:57909:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd0:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:3.0:1787191340.936485:0:57911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57911:1874004626722688:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191340.936522:0:57911:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453ab800 x1874004626721536/t8589936941(8589936941) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191340.939386:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191340.939415:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191340.939432:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.939447:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.939454:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191340.939461:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191340.939464:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191340.939471:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:0.0:1787191340.939476:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191340.939490:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191340.939505:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.939511:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191340.939516:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191340.939526:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:0.0:1787191340.939530:0:57570:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b5258e180, open_flags 8241, mode 81b6 opened 0 00000080:00200000:0.0:1787191340.939538:0:57570:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:0.0:1787191340.939554:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xd3:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0101102 00010000:00010000:0.0:1787191340.939602:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a542 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.940101:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a542 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191340.940118:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191340.940131:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477480 x1874004626723072/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191340.940140:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a542 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191340.940162:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626723072:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191340.940338:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.951334:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626723072:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191340.951370:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a542 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605c1f expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.951413:0:57570:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a542 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605c1f expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.951425:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a542 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605c1f expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.951441:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a542 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605c1f expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.951455:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a542 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605c1f expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.951472:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a542 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605c1f expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.951481:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a542 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605c1f expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.951488:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a542 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605c1f expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191340.951501:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x2b, status=0 req@ffff936b6a477480 x1874004626723072/t8589936945(8589936945) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191340.951516:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477480 x1874004626723072/t8589936945(8589936945) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191340.951530:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a542 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605c1f expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191340.951544:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a542 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605c1f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.951554:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/210 (0 0) 00000080:00200000:0.0:1787191340.951562:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191340.951616:0:57570:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xd2:0x0](ffff936b5395a1c8): rc = 0 00000080:00200000:0.0:1787191340.951633:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd2:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:0.0:1787191340.951638:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd2:0x0](ffff936b5395a1c8) for lock 0xe5129dc88483a542 00000080:00010000:0.0:1787191340.951651:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd2:0x0](ffff936b5395a1c8) 00000080:00200008:0.0:1787191340.951667:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xd2:0x0](ffff936b5395a1c8), flags 101101 00000002:00100000:0.0:1787191340.951693:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477480 x1874004626723072/t8589936945(8589936945) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191340.951732:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a542 from it ffff936b530f5420 00010000:00010000:0.0:1787191340.951738:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a542 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605c1f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.951748:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a542 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605c1f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191340.951774:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd2:0x0](ffff936b5395a1c8), inode mode 81a4 mask 42 00000002:00010000:0.0:1787191340.951802:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xd2:0x0], intent: getxattr flags 0 00010000:00010000:0.0:1787191340.951862:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a549 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.951870:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a549 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.951884:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a549 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191340.951905:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626723200:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191340.952011:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.956224:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626723200:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191340.956256:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a549 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605c34 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.956273:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a549 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605c34 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.956289:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a549 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605c34 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191340.956305:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b6a475c00 x1874004626723200/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191340.956318:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a549 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605c34 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.956333:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/210 (0 0) 00000080:00200000:0.0:1787191340.956340:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xd2:0x0] suppgids 0 -1: rc 0 00000080:00010000:0.0:1787191340.956370:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd2:0x0](ffff936b5395a1c8) for lock 0xe5129dc88483a549 00000080:00010000:0.0:1787191340.956380:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a549 from it ffffa3fb41caba38 00010000:00010000:0.0:1787191340.956385:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a549 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605c34 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.956401:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a549 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605c34 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:0.0:1787191340.956440:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xd2:0x0](ffff936b5395a1c8) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191340.000000000, mtime 1787191340.000000000, ctime 1787191340.000000000 00010000:00010000:0.0:1787191340.956475:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a542 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4605c1f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191340.956497:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xd2:0x0]: losing layout lock 00010000:00010000:0.0:1787191340.956538:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a542 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605c1f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.956545:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191340.956548:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a542 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605c1f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1787191340.956568:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1787191340.956575:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475c00 x1874004626723456/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787191340.956598:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626723456:192.168.202.101@tcp:36:bash.0 00000100:00100000:0.0:1787191340.956687:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.964814:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626723456:192.168.202.101@tcp:36:bash.0 00000080:00200000:0.0:1787191340.964877:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:0.0:1787191340.964884:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd2:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00010000:00010000:0.0:1787191340.964899:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/210 (0 0) 00000080:00010000:0.0:1787191340.964912:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xd2:0x0](ffff936b5395a1c8) 00000002:00010000:0.0:1787191340.964922:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd2:0x0]) in obj [0x200000405:0xd2:0x0], intent: layout flags 0 00010000:00010000:0.0:1787191340.964970:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a550 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.964980:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a550 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.964990:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a550 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191340.965007:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626723584:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191340.965111:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.969149:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626723584:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191340.969181:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a550 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xd2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605c42 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.969197:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a550 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xd2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605c42 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191340.969212:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b6a475180 x1874004626723584/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191340.969224:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a550 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605c42 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191340.969237:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a550 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605c42 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.969254:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/210 (0 0) 00000080:00200000:0.0:1787191340.969261:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xd2:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191340.969280:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd2:0x0](ffff936b5395a1c8) for lock 0xe5129dc88483a550 00000080:00010000:0.0:1787191340.969288:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a550 from it ffffa3fb41cab8c8 00010000:00010000:0.0:1787191340.969292:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a550 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605c42 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.969301:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a550 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605c42 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.969324:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a550 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605c42 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.969336:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a550 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605c42 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1787191340.969344:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xd2:0x0](00000000cdc23562) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a550 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605c42 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191340.969390:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd2:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:0.0:1787191340.969395:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a550 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605c42 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.969403:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a550 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605c42 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:0.0:1787191340.969418:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xd2:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:0.0:1787191340.969426:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd2:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191340.969430:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xd2:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:0.0:1787191340.969437:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xd2:0x0](ffff936b5395a1c8) 00000002:00010000:0.0:1787191340.969446:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd2:0x0]) in obj [0x200000405:0xd2:0x0], intent: layout flags 02 00010000:00010000:0.0:1787191340.969461:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a550 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4605c42 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191340.969475:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xd2:0x0]: losing layout lock 00010000:00010000:0.0:1787191340.969505:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a550 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xd2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605c42 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191340.969513:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191340.969516:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a550 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xd2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605c42 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191340.969540:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a557 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xd2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.969548:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a557 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xd2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191340.969560:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191340.969568:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475180 x1874004626723840/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191340.969577:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a557 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xd2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191340.969598:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626723840:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191340.969686:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.984916:0:57570:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589936948 gen 1 00000100:00100000:0.0:1787191340.985001:0:57570:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b6a477480 x1874004626723072/t8589936945(8589936945) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787191340.985021:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626723840:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191340.985056:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a557 lrc: 4/0,1 mode: --/EX res: [0x200000405:0xd2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605c50 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.985068:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a557 lrc: 4/0,1 mode: --/CR res: [0x200000405:0xd2:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605c50 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.985080:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a557 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xd2:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605c50 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.985093:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a557 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xd2:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605c50 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.985106:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a557 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xd2:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605c50 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.985114:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a557 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xd2:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605c50 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.985122:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a557 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xd2:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605c50 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191340.985132:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b6a475180 x1874004626723840/t8589936948(8589936948) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191340.985158:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a557 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd2:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605c50 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191340.985169:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a557 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd2:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605c50 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.985180:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/210 (0 0) 00000080:00200000:0.0:1787191340.985188:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xd2:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191340.985199:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd2:0x0](ffff936b5395a1c8) for lock 0xe5129dc88483a557 00000080:00010000:0.0:1787191340.985207:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a557 from it ffffa3fb41cab930 00010000:00010000:0.0:1787191340.985211:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a557 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd2:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605c50 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.985221:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a557 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd2:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605c50 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191340.985239:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:0.0:1787191340.985247:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd2:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:0.0:1787191340.985261:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a557 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd2:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605c50 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.985272:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a557 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd2:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605c50 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1787191340.985280:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xd2:0x0](00000000cdc23562) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a557 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd2:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605c50 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.985327:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a557 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd2:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605c50 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191340.985336:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a557 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd2:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605c50 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191340.985350:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd2:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191340.985359:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd2:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191340.985363:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191340.985369:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191340.985379:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191340.985399:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd2:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:0.0:1787191340.985421:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a557 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd2:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605c50 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191340.985431:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a557 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd2:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605c50 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:0.0:1787191340.985438:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xd2:0x0](00000000cdc23562) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a557 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd2:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605c50 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191340.985456:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd2:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191340.985461:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd2:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191340.985463:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191340.985466:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191340.985497:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191340.985505:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd2:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191340.985582:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd2:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:0.0:1787191340.985588:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a557 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd2:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605c50 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191340.985595:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a557 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd2:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605c50 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00020000:00200000:0.0:1787191340.985607:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xd2:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:0.0:1787191340.985611:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd2:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191340.985613:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191340.985619:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191340.985630:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191340.985633:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:0.0:1787191340.985645:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:0.0:1787191340.985649:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f99db0, osc lock ffff936b50b63690, flags 0x80000000 00000008:00010000:0.0:1787191340.985654:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:0.0:1787191340.985655:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f99df0, osc lock ffff936b50b624c0, flags 0x80000000 00010000:00010000:0.0:1787191340.985702:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003e2b3831/0xe5129dc88483a55e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.985711:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003e2b3831/0xe5129dc88483a55e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.985723:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003e2b3831/0xe5129dc88483a55e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191340.985745:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626723968:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191340.985854:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.990655:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626723968:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191340.990688:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003e2b3831/0xe5129dc88483a55e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605c57 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.990710:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003e2b3831/0xe5129dc88483a55e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4605c57 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.990726:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003e2b3831/0xe5129dc88483a55e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4605c57 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.990742:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003e2b3831/0xe5129dc88483a55e lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4605c57 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191340.990759:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003e2b3831/0xe5129dc88483a55e lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4605c57 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.990773:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003e2b3831/0xe5129dc88483a55e lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4605c57 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.990781:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003e2b3831/0xe5129dc88483a55e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4605c57 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.990872:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc88483a565 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.990880:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc88483a565 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.990896:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc88483a565 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191340.990918:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626724096:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191340.991040:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787191340.994734:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626724096:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191340.994760:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc88483a565 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605c5e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.994779:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc88483a565 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4605c5e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.994792:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc88483a565 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4605c5e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.994808:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc88483a565 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4605c5e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191340.994821:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc88483a565 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4605c5e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.994848:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc88483a565 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4605c5e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191340.994861:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc88483a565 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4605c5e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191340.994953:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787191340.994970:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626724224:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191340.995146:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787191340.995156:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626724352:192.168.202.101@tcp:10:bash.0 00000100:00100000:0.0:1787191340.997902:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626724352:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191340.997902:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626724224:192.168.202.101@tcp:10:bash.0 00000080:00200000:3.0:1787191340.998055:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd2:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1787191340.998062:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894998 (ffff936b47a171b8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191340.998066:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894998 (ffff936b47a171b8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191340.998071:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99db0 (ffff936b47a17128/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191340.998081:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003e2b3831/0xe5129dc88483a55e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4605c57 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.998096:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003e2b3831/0xe5129dc88483a55e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4605c57 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1787191340.998123:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99df0 (ffff936b47a17908/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191340.998129:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc88483a565 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4605c5e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191340.998137:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc88483a565 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4605c5e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1787191340.998147:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894998 (ffff936b47a171b8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191340.998149:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99db0 (ffff936b47a171b8/1) at cl_lock_fini():72 00000020:00010000:3.0:1787191340.998154:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99df0 (ffff936b47a171b8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191340.998195:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd2:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191340.998217:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xd2:0x0](ffff936b5395a1c8) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191340.000000000, mtime 1787191340.000000000, ctime 1787191340.000000000, rc 0 00000080:00200008:3.0:1787191340.998305:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xd2:0x0], ppos: 0, count: 5 00000080:00200000:3.0:1787191340.998318:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:3.0:1787191340.998324:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:3.0:1787191340.998329:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:3.0:1787191340.998333:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:3.0:1787191340.998341:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@0000000017a04194[0x110, 1, [0x200000405:0xd2:0x0] hash] 00000020:00200000:3.0:1787191340.998343:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:3.0:1787191340.998347:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd2:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:3.0:1787191340.998360:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xd2:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:3.0:1787191340.998365:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd2:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191340.998368:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:3.0:1787191340.998373:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1787191340.998380:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:3.0:1787191340.998384:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1787191340.998400:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:3.0:1787191340.998416:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:3.0:1787191340.998421:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667db0, osc lock ffff936b44f65c80, flags 0x0 00010000:00010000:3.0:1787191340.998438:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003e2b3831/0xe5129dc88483a55e lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4605c57 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191340.998451:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003e2b3831/0xe5129dc88483a55e lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4605c57 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191340.998462:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003e2b3831/0xe5129dc88483a55e lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4605c57 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191340.998471:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003e2b3831/0xe5129dc88483a55e lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4605c57 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191340.998477:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003e2b3831/0xe5129dc88483a55e lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4605c57 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191340.998494:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:3.0:1787191340.998504:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:3.0:1787191340.998544:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:3.0:1787191340.998552:0:57570:0:(rw26.c:927:ll_write_end()) page@000000008e59576a[3 000000000e6d7102 2 1 000000001d879872 0 0 0] 00000080:00200000:3.0:1787191340.998555:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @00000000fbf9bd10 17ffffc0001001 3:0 ffff936b50842a80 0 lru 00000080:00200000:3.0:1787191340.998563:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@0000000021bf1179 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000ef00a996 00000000a9621480 > 3< 0 0 > 4< 0 0 8 469938176 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1787191340.998565:0:57570:0:(rw26.c:927:ll_write_end()) end page@000000008e59576a 00000080:00200000:3.0:1787191340.998566:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1787191340.998570:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:3.0:1787191340.998589:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 00000000588a850c ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003e2b3831/0xe5129dc88483a55e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4605c57 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191340.998606:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b5395a378, count 1, dirtied 1 00000080:00200000:3.0:1787191340.998610:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:3.0:1787191340.998612:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:3.0:1787191340.998625:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894a88 (ffff936b47a17128/0) at cl_lock_release():245 00000020:00010000:3.0:1787191340.998628:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894a88 (ffff936b47a17128/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191340.998630:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667db0 (ffff936b465cccf8/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191340.998635:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003e2b3831/0xe5129dc88483a55e lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4605c57 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191340.998643:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003e2b3831/0xe5129dc88483a55e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4605c57 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:3.0:1787191340.998653:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894a88 (ffff936b47a17128/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191340.998655:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667db0 (ffff936b47a17128/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191340.998661:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:3.0:1787191340.998665:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1787191340.998670:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd2:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191340.998673:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:3.0:1787191340.998678:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd2:0x0] updating i_size 5 i_blocks 0 00000080:00200000:3.0:1787191340.998681:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:3.0:1787191340.998700:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xd2:0x0](ffff936b5395a1c8), flags 100001 00000002:00100000:3.0:1787191340.998753:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a477480 x1874004626723072/t8589936945(8589936945) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191340.998764:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191340.998769:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1c000 x1874004626724608/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191340.998790:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626724608:192.168.202.101@tcp:35:bash.0 00000080:00200080:2.0:1787191340.999560:0:57909:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8) cmd=400866b1 arg=1 00000080:00200008:2.0:1787191340.999574:0:57909:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xd0:0x0](ffff936b489880c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191340.999581:0:57909:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8),name=f70.sanity-flr 00000002:00010000:2.0:1787191340.999596:0:57909:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd0:0x0]) in obj [0x200000405:0xd0:0x0], intent: getattr flags 0 00000100:00100000:3.0:1787191341.000289:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c180 going to sleep for 10 seconds 00010000:00010000:2.0:1787191341.000606:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a534 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605bf5 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.000637:0:57909:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a534 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605bf5 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191341.000647:0:57909:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xd0:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191341.000655:0:57909:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) 00000080:00010000:2.0:1787191341.000659:0:57909:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) for lock 0xe5129dc88483a534 00000080:00010000:2.0:1787191341.000666:0:57909:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a534 from it ffffa3fb4223bcd8 00010000:00010000:2.0:1787191341.000670:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a534 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605bf5 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.000679:0:57909:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a534 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605bf5 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191341.000703:0:57909:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd0:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:2.0:1787191341.000714:0:57909:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd0:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191341.000718:0:57909:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191341.000722:0:57909:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xd0:0x0] 00000008:00010000:2.0:1787191341.000741:0:57909:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191341.000745:0:57909:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1830, osc lock ffff936b44e62980, flags 0x400000400001002 00010000:00010000:2.0:1787191341.000761:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.000771:0:57909:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:2.0:1787191341.000783:0:57909:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191341.000787:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.000795:0:57909:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:2.0:1787191341.000805:0:57909:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191341.000814:0:57909:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd0:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191341.000818:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c39bc0 (ffff936b47a17e18/0) at cl_lock_release():245 00000020:00010000:2.0:1787191341.000821:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c39bc0 (ffff936b47a17e18/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191341.000824:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1830 (ffff936b465ccf38/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191341.000827:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c39bc0 (ffff936b47a17e18/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191341.000854:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1830 (ffff936b47a17e18/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191341.000864:0:57909:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd0:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191341.000884:0:57909:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xd0:0x0], offset: 0, type: SEEK_DATA 00000080:00200000:2.0:1787191341.000889:0:57909:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd0:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:2.0:1787191341.000894:0:57909:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd0:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191341.000896:0:57909:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191341.000901:0:57909:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191341.000906:0:57909:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191341.000918:0:57909:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd0:0x0] updating i_size 5 i_blocks 8 00000080:00200000:2.0:1787191341.000925:0:57909:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd0:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191341.000930:0:57909:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000080:00200000:2.0:1787191341.000932:0:57909:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd0:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191341.000936:0:57909:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191341.000939:0:57909:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191341.000941:0:57909:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:2.0:1787191341.000948:0:57909:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:2.0:1787191341.000950:0:57909:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1830, osc lock ffff936b44e62980, flags 0x0 00010000:00010000:2.0:1787191341.000959:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191341.000969:0:57909:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191341.000977:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191341.000986:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191341.000994:0:57909:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191341.001004:0:57909:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd0:0x0] updating i_size 5 i_blocks 8 00000100:00100000:3.0:1787191341.001323:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626724736:192.168.202.101@tcp:23:lfs.0 00000100:00100000:2.0:1787191341.003447:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626724736:192.168.202.101@tcp:23:lfs.0 00000020:00010000:0.0:1787191341.004189:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b628948a8 (ffff936b47a17e18/0) at cl_lock_release():245 00000020:00010000:0.0:1787191341.004196:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b628948a8 (ffff936b47a17e18/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191341.004201:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1830 (ffff936b465ccf38/1) at cl_lock_cancel():142 00010000:00010000:0.0:1787191341.004212:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.004229:0:57909:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00010000:0.0:1787191341.004246:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b628948a8 (ffff936b47a17e18/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191341.004249:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1830 (ffff936b47a17e18/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191341.004266:0:57909:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd0:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1787191341.004280:0:57909:0:(file.c:5244:ll_file_seek()) COMPLETED file f70.sanity-flr:[0x200000405:0xd0:0x0], offset: 0, type: SEEK_DATA, rc = 0 00000080:00200008:0.0:1787191341.004292:0:57909:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xd0:0x0], offset: 0, type: SEEK_HOLE 00000080:00200000:0.0:1787191341.004300:0:57909:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd0:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:0.0:1787191341.004309:0:57909:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd0:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191341.004312:0:57909:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191341.004317:0:57909:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191341.004325:0:57909:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191341.004342:0:57909:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd0:0x0] updating i_size 5 i_blocks 8 00000080:00200000:0.0:1787191341.004348:0:57909:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd0:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191341.004353:0:57909:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000080:00200000:0.0:1787191341.004356:0:57909:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd0:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191341.004360:0:57909:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191341.004363:0:57909:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191341.004366:0:57909:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:0.0:1787191341.004378:0:57909:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:0.0:1787191341.004382:0:57909:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee6930, osc lock ffff936b50b630a0, flags 0x0 00010000:00010000:0.0:1787191341.004400:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.004427:0:57909:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.004438:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.004448:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.004455:0:57909:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191341.004467:0:57909:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd0:0x0] updating i_size 5 i_blocks 8 00000100:00100000:1.0:1787191341.004893:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626724864:192.168.202.101@tcp:23:lfs.0 00000100:00100000:3.0:1787191341.005140:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626724608:192.168.202.101@tcp:35:bash.0 00000002:00100000:3.0:1787191341.005168:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a477480 x1874004626723072/t8589936945(8589936945) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191341.008473:0:57912:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191341.008497:0:57912:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191341.008510:0:57912:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.008522:0:57912:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.008527:0:57912:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191341.008533:0:57912:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191341.008535:0:57912:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191341.008541:0:57912:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4220bb58 00010000:00010000:1.0:1787191341.008544:0:57912:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.008550:0:57912:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.008562:0:57912:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191341.008567:0:57912:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:1.0:1787191341.008571:0:57912:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191341.008577:0:57912:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:1.0:1787191341.008580:0:57912:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191341.008589:0:57912:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191341.008628:0:57912:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a56c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.008636:0:57912:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a56c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57912 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.008645:0:57912:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a56c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57912 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191341.008669:0:57912:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57912:1874004626724992:192.168.202.101@tcp:101:rm.0 00000100:00100000:1.0:1787191341.008738:0:57912:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:0.0:1787191341.013239:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626724864:192.168.202.101@tcp:23:lfs.0 00000020:00010000:2.0:1787191341.013486:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b628948a8 (ffff936b47a17e18/0) at cl_lock_release():245 00000020:00010000:2.0:1787191341.013491:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b628948a8 (ffff936b47a17e18/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191341.013496:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee6930 (ffff936b465ccf38/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191341.013507:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191341.013523:0:57909:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00010000:2.0:1787191341.013547:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b628948a8 (ffff936b47a17e18/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191341.013549:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee6930 (ffff936b47a17e18/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191341.013565:0:57909:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd0:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191341.013575:0:57909:0:(file.c:5244:ll_file_seek()) COMPLETED file f70.sanity-flr:[0x200000405:0xd0:0x0], offset: 0, type: SEEK_HOLE, rc = 5 00000080:00200080:2.0:1787191341.013589:0:57909:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8) cmd=400866b1 arg=0 00000080:00200080:2.0:1787191341.013599:0:57909:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8) cmd=400866b1 arg=1 00000080:00200008:2.0:1787191341.013616:0:57909:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xd0:0x0](ffff936b489880c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191341.013624:0:57909:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8),name=f70.sanity-flr 00000002:00010000:2.0:1787191341.013647:0:57909:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd0:0x0]) in obj [0x200000405:0xd0:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191341.013661:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a534 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605bf5 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191341.013673:0:57909:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a534 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605bf5 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191341.013681:0:57909:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xd0:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191341.013689:0:57909:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) 00000080:00010000:2.0:1787191341.013693:0:57909:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) for lock 0xe5129dc88483a534 00000080:00010000:2.0:1787191341.013699:0:57909:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a534 from it ffffa3fb4223bcd8 00010000:00010000:2.0:1787191341.013702:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a534 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605bf5 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191341.013710:0:57909:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a534 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605bf5 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191341.013734:0:57909:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd0:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:2.0:1787191341.013744:0:57909:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd0:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191341.013747:0:57909:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191341.013750:0:57909:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xd0:0x0] 00000008:00010000:2.0:1787191341.013767:0:57909:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191341.013770:0:57909:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1530, osc lock ffff936b44e638f0, flags 0x400000400001002 00010000:00010000:2.0:1787191341.013784:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191341.013793:0:57909:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:2.0:1787191341.013804:0:57909:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191341.013808:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191341.013815:0:57909:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000020:00200000:2.0:1787191341.013824:0:57909:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191341.013914:0:57909:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd0:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191341.013918:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c39bc0 (ffff936b47a17e18/0) at cl_lock_release():245 00000020:00010000:2.0:1787191341.013921:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c39bc0 (ffff936b47a17e18/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191341.013924:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1530 (ffff936b465ccf38/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191341.013927:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c39bc0 (ffff936b47a17e18/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191341.013929:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1530 (ffff936b47a17e18/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191341.013938:0:57909:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd0:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191341.013960:0:57909:0:(file.c:2483:do_file_read_iter()) START file f70.sanity-flr:[0x200000405:0xd0:0x0], ppos: 0, count: 4096 00000080:00200000:2.0:1787191341.013967:0:57909:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: read ppos: 0, bytes: 4096 00000080:00200000:2.0:1787191341.013975:0:57909:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000020:00200000:2.0:1787191341.013980:0:57909:0:(cl_io.c:214:cl_io_rw_init()) header@00000000368c9109[0x110, 2, [0x200000405:0xd0:0x0] hash] 00000020:00200000:2.0:1787191341.013982:0:57909:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 4096) 2048 0 00000080:00200000:2.0:1787191341.013985:0:57909:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd0:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00000080:00200000:2.0:1787191341.013993:0:57909:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1787191341.013999:0:57909:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:2.0:1787191341.014003:0:57909:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1787191341.014016:0:57909:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:2.0:1787191341.014024:0:57909:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:2.0:1787191341.014038:0:57909:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1530, osc lock ffff936b44e638f0, flags 0x40000 00000080:00200000:2.0:1787191341.014044:0:57909:0:(vvp_io.c:835:vvp_io_read_start()) f70.sanity-flr: read [0, 4096) 00000001:00010000:2.0:1787191341.014050:0:57909:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xd0:0x0] 00000008:00010000:2.0:1787191341.014055:0:57909:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191341.014057:0:57909:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d18b0, osc lock ffff936b44e63300, flags 0x400001002 00010000:00010000:2.0:1787191341.014064:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1787191341.014074:0:57909:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000020:00200000:2.0:1787191341.014081:0:57909:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191341.014084:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1787191341.014092:0:57909:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00000020:00200000:2.0:1787191341.014107:0:57909:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191341.014278:0:57909:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd0:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191341.014282:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c39bc0 (ffff936b47a17e18/0) at cl_lock_release():245 00000020:00010000:2.0:1787191341.014285:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c39bc0 (ffff936b47a17e18/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191341.014288:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d18b0 (ffff936b465ccf38/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191341.014291:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c39bc0 (ffff936b47a17e18/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191341.014293:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d18b0 (ffff936b47a17e18/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191341.014303:0:57909:0:(vvp_io.c:893:vvp_io_read_start()) count:4096 iocb pos:0 00000080:00200000:2.0:1787191341.014309:0:57909:0:(rw26.c:362:ll_direct_IO()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8), size=4096 (max 536870912), offset=0=0x0, pages 1 (max 131072), lockless, parallel 00000020:00200000:2.0:1787191341.014360:0:57909:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1787191341.014362:0:57909:0:(rw26.c:544:ll_direct_IO()) result 0 tot_bytes 5 count 5 file_offset 5 00000020:00010000:2.0:1787191341.014367:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b628948a8 (ffff936b47a17e18/0) at cl_lock_release():245 00000020:00010000:2.0:1787191341.014370:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b628948a8 (ffff936b47a17e18/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191341.014372:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1530 (ffff936b465ccf38/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191341.014375:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b628948a8 (ffff936b47a17e18/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191341.014377:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1530 (ffff936b47a17e18/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191341.014382:0:57909:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000020:00200000:2.0:1787191341.014386:0:57909:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:1.0:1787191341.014720:0:57912:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57912:1874004626724992:192.168.202.101@tcp:101:rm.0 00010000:00010000:1.0:1787191341.014738:0:57912:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a56c lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605c7a expref: -99 pid: 57912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.014757:0:57912:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a56c lrc: 4/1,0 mode: --/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605c7a expref: -99 pid: 57912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.014770:0:57912:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a56c lrc: 4/1,0 mode: --/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605c7a expref: -99 pid: 57912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.014781:0:57912:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a56c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605c7a expref: -99 pid: 57912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.014793:0:57912:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a56c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605c7a expref: -99 pid: 57912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.014804:0:57912:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a56c lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605c7a expref: -99 pid: 57912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.014811:0:57912:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a56c lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605c7a expref: -99 pid: 57912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.014818:0:57912:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a56c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605c7a expref: -99 pid: 57912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191341.014888:0:57912:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b453a8380 x1874004626724992/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/976 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191341.014902:0:57912:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a56c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605c7a expref: -99 pid: 57912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191341.014915:0:57912:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a56c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605c7a expref: -99 pid: 57912 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.014927:0:57912:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/210 (0 0) 00000080:00200000:1.0:1787191341.014933:0:57912:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191341.014976:0:57912:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xd2:0x0](ffff936b5395a1c8): rc = 0 00000080:00200000:1.0:1787191341.014990:0:57912:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd2:0x0]: layout version change: 4 -> 4 00000080:00010000:1.0:1787191341.014995:0:57912:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd2:0x0](ffff936b5395a1c8) for lock 0xe5129dc88483a56c 00000080:00010000:1.0:1787191341.015005:0:57912:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd2:0x0](ffff936b5395a1c8) 00000080:00010000:1.0:1787191341.015008:0:57912:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a56c from it ffffa3fb4220bb20 00010000:00010000:1.0:1787191341.015011:0:57912:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a56c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605c7a expref: -99 pid: 57912 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.015018:0:57912:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a56c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605c7a expref: -99 pid: 57912 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200008:1.0:1787191341.015062:0:57912:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xd2:0x0](ffff936b5395a1c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191341.015068:0:57912:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xd2:0x0](ffff936b5395a1c8),name=f70.sanity-flr 00000002:00010000:1.0:1787191341.015086:0:57912:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd2:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191341.015094:0:57912:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a56c lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605c7a expref: -99 pid: 57912 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.015102:0:57912:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a56c lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605c7a expref: -99 pid: 57912 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191341.015108:0:57912:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191341.015123:0:57912:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd2:0x0](ffff936b5395a1c8) 00000080:00010000:1.0:1787191341.015127:0:57912:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd2:0x0](ffff936b5395a1c8) for lock 0xe5129dc88483a56c 00000080:00010000:1.0:1787191341.015131:0:57912:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a56c from it ffffa3fb4220bcb8 00010000:00010000:1.0:1787191341.015135:0:57912:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a56c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605c7a expref: -99 pid: 57912 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.015141:0:57912:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a56c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605c7a expref: -99 pid: 57912 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191341.015155:0:57912:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd2:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:1.0:1787191341.015162:0:57912:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd2:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191341.015165:0:57912:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191341.015167:0:57912:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xd2:0x0] 00000008:00010000:1.0:1787191341.015180:0:57912:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191341.015182:0:57912:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b47d7d330, osc lock ffff936b46837690, flags 0x400000400001002 00010000:00010000:1.0:1787191341.015194:0:57912:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003e2b3831/0xe5129dc88483a55e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4605c57 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191341.015203:0:57912:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003e2b3831/0xe5129dc88483a55e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4605c57 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1787191341.015212:0:57912:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191341.015215:0:57912:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003e2b3831/0xe5129dc88483a55e lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4605c57 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191341.015222:0:57912:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003e2b3831/0xe5129dc88483a55e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4605c57 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:1.0:1787191341.015231:0:57912:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191341.015237:0:57912:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd2:0x0] updating i_size 5 i_blocks 0 00000020:00010000:1.0:1787191341.015241:0:57912:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c3abf0 (ffff936b47a17f38/0) at cl_lock_release():245 00000020:00010000:1.0:1787191341.015244:0:57912:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c3abf0 (ffff936b47a17f38/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191341.015246:0:57912:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7d330 (ffff936b465cc5a8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191341.015249:0:57912:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c3abf0 (ffff936b47a17f38/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191341.015251:0:57912:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7d330 (ffff936b47a17f38/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191341.015258:0:57912:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd2:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191341.015304:0:57912:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191341.015312:0:57912:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191341.015319:0:57912:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.015327:0:57912:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.015334:0:57912:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191341.015337:0:57912:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191341.015340:0:57912:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191341.015343:0:57912:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4220bc10 00010000:00010000:1.0:1787191341.015347:0:57912:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.015354:0:57912:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.015362:0:57912:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191341.015368:0:57912:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:1.0:1787191341.015372:0:57912:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191341.015377:0:57912:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:1.0:1787191341.015380:0:57912:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:1.0:1787191341.015385:0:57912:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:1.0:1787191341.015406:0:57912:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a557 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd2:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4605c50 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191341.015420:0:57912:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xd2:0x0]: losing layout lock 00010000:00010000:1.0:1787191341.015430:0:57912:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a56c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4605c7a expref: -99 pid: 57912 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191341.015438:0:57912:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xd2:0x0]: losing layout lock 00010000:00010000:1.0:1787191341.015444:0:57912:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a549 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4605c34 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.015488:0:57912:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a557 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xd2:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605c50 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191341.015496:0:57912:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a56c lrc: 1/0,0 mode: --/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605c7a expref: -99 pid: 57912 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191341.015502:0:57912:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a549 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4605c34 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.015508:0:57912:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:1.0:1787191341.015510:0:57912:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a557 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xd2:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605c50 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191341.015523:0:57912:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a56c lrc: 0/0,0 mode: --/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605c7a expref: -99 pid: 57912 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191341.015531:0:57912:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a549 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xd2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4605c34 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1787191341.015555:0:57912:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1787191341.015562:0:57912:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8380 x1874004626725248/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787191341.015585:0:57912:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57912:1874004626725248:192.168.202.101@tcp:36:rm.0 00000100:00100000:1.0:1787191341.015676:0:57912:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:1.0:1787191341.020322:0:57912:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57912:1874004626725248:192.168.202.101@tcp:36:rm.0 00000080:00200000:1.0:1787191341.020386:0:57912:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd2:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00020000:00200000:1.0:1787191341.020411:0:57912:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd2:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191341.020415:0:57912:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191341.020421:0:57912:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191341.020430:0:57912:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000008:00010000:1.0:1787191341.020449:0:57912:0:(osc_cache.c:1183:osc_extent_make_ready()) ### extent: 00000000588a850c ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003e2b3831/0xe5129dc88483a55e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4605c57 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1787191341.020479:0:57912:0:(osc_cache.c:917:osc_extent_finish()) ### extent: 00000000588a850c ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003e2b3831/0xe5129dc88483a55e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4605c57 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1787191341.020502:0:57912:0:(osc_cache.c:497:__osc_extent_remove()) ### extent: 00000000588a850c ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003e2b3831/0xe5129dc88483a55e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4605c57 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191341.020523:0:57912:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd2:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191341.020568:0:57912:0:(llite_lib.c:2066:ll_clear_inode()) VFS Op:inode=[0x200000405:0xd2:0x0](ffff936b5395a1c8) 00000008:00010000:1.0:1787191341.020598:0:57912:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 5 blocks 0 [cma]time 1787191340 1787191340 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003e2b3831/0xe5129dc88483a55e lrc: 1/0,0 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4605c57 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1787191341.020637:0:57912:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191340 1787191340 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc88483a565 lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4605c5e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000008:00010000:2.0:1787191341.025542:0:25580:0:(osc_cache.c:2029:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff936b46699600 00000008:00100000:2.0:1787191341.025672:0:25580:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff936b513bbb80 - object 0x280000401:448 offset 0<>5 00000100:00100000:2.0:1787191341.025719:0:2392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787191341.025741:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626725376:192.168.202.101@tcp:3:lfs.0 00000008:00010000:2.0:1787191341.028861:0:2392:0:(osc_cache.c:917:osc_extent_finish()) ### no dlm lock: extent: ffff936b46699600 00000020:00200000:2.0:1787191341.028873:0:2392:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:2.0:1787191341.028882:0:2392:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:2.0:1787191341.028896:0:2392:0:(osc_cache.c:497:__osc_extent_remove()) ### no dlm lock: extent: ffff936b46699600 00000100:00100000:2.0:1787191341.028920:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626725376:192.168.202.101@tcp:3:lfs.0 00000080:00200000:3.0:1787191341.029014:0:57909:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1787191341.029061:0:57909:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd0:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191341.029067:0:57909:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 1 io complete with rc: 0, result: 5, restart: 0 00000020:00200000:3.0:1787191341.029070:0:57909:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191341.029077:0:57909:0:(file.c:2324:ll_file_io_generic()) iot: 1, result: 5 00000080:00200080:3.0:1787191341.029108:0:57909:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8) cmd=400866b1 arg=0 00000080:00200080:3.0:1787191341.029212:0:57909:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8) cmd=400866b1 arg=2 00000080:00200008:3.0:1787191341.029219:0:57909:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xd0:0x0](ffff936b489880c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191341.029227:0:57909:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8),name=f70.sanity-flr 00000002:00010000:3.0:1787191341.029249:0:57909:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd0:0x0]) in obj [0x200000405:0xd0:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191341.029266:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a534 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605bf5 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191341.029279:0:57909:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a534 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605bf5 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787191341.029288:0:57909:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xd0:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191341.029297:0:57909:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) 00000080:00010000:3.0:1787191341.029301:0:57909:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) for lock 0xe5129dc88483a534 00000080:00010000:3.0:1787191341.029308:0:57909:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a534 from it ffffa3fb4223bcd8 00010000:00010000:3.0:1787191341.029313:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a534 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605bf5 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191341.029322:0:57909:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a534 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605bf5 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:3.0:1787191341.029345:0:57909:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd0:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:3.0:1787191341.029356:0:57909:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd0:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191341.029359:0:57909:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191341.029362:0:57909:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xd0:0x0] 00000008:00010000:3.0:1787191341.029380:0:57909:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191341.029384:0:57909:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667db0, osc lock ffff936b44f65c80, flags 0x400000400001002 00010000:00010000:3.0:1787191341.030237:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00010000:00010000:3.0:1787191341.030255:0:57909:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00000020:00200000:3.0:1787191341.030272:0:57909:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191341.030276:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00010000:00010000:3.0:1787191341.030285:0:57909:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 0 00000020:00200000:3.0:1787191341.030297:0:57909:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191341.030307:0:57909:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd0:0x0] updating i_size 5 i_blocks 8 00000020:00010000:3.0:1787191341.030310:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509b8940 (ffff936b47a17128/0) at cl_lock_release():245 00000020:00010000:3.0:1787191341.030314:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509b8940 (ffff936b47a17128/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191341.030318:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667db0 (ffff936b465cccf8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191341.030321:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509b8940 (ffff936b47a17128/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191341.030324:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667db0 (ffff936b47a17128/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191341.030336:0:57909:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd0:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191341.030360:0:57909:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xd0:0x0], ppos: 0, count: 4096 00000080:00200000:3.0:1787191341.030367:0:57909:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 4096 00000080:00200000:3.0:1787191341.030375:0:57909:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 2 00000020:00200000:3.0:1787191341.030382:0:57909:0:(cl_io.c:214:cl_io_rw_init()) header@00000000368c9109[0x110, 2, [0x200000405:0xd0:0x0] hash] 00000020:00200000:3.0:1787191341.030384:0:57909:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 4096) 2048 0 00000080:00200000:3.0:1787191341.030388:0:57909:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd0:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00000080:00200000:3.0:1787191341.030560:0:57909:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1787191341.030567:0:57909:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:3.0:1787191341.030572:0:57909:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x11 00000080:00200000:3.0:1787191341.030587:0:57909:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:3.0:1787191341.030599:0:57909:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:3.0:1787191341.030703:0:57909:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667db0, osc lock ffff936b44f65c80, flags 0x40000 00000080:00200000:3.0:1787191341.030715:0:57909:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 4096) append 0 append lockpos 0 00000002:00010000:3.0:1787191341.030747:0:57909:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xd0:0x0], intent: getxattr flags 0 00010000:00010000:3.0:1787191341.030791:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc88483a573 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.030799:0:57909:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc88483a573 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.030809:0:57909:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc88483a573 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191341.031214:0:57909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626725504:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191341.031302:0:57909:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c180 going to sleep for 11 seconds 00000100:00100000:2.0:1787191341.038183:0:57909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626725504:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191341.038211:0:57909:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc88483a573 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605cab expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.038227:0:57909:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc88483a573 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605cab expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.038240:0:57909:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc88483a573 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605cab expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191341.038254:0:57909:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b51d1c000 x1874004626725504/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1408 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191341.038265:0:57909:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc88483a573 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605cab expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.038276:0:57909:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/208 (0 0) 00000080:00200000:2.0:1787191341.038282:0:57909:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xd0:0x0] suppgids 0 -1: rc 0 00000080:00010000:2.0:1787191341.038305:0:57909:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) for lock 0xe5129dc88483a573 00000080:00010000:2.0:1787191341.038313:0:57909:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a573 from it ffffa3fb4223b8e8 00010000:00010000:2.0:1787191341.038318:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc88483a573 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605cab expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.038329:0:57909:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9aa00/0xe5129dc88483a573 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605cab expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191341.038369:0:57909:0:(rw26.c:362:ll_direct_IO()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8), size=4096 (max 536870912), offset=0=0x0, pages 1 (max 131072), lockless, parallel 00000020:00200000:2.0:1787191341.038449:0:57909:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1787191341.038452:0:57909:0:(rw26.c:544:ll_direct_IO()) result 0 tot_bytes 4096 count 4096 file_offset 4096 00000080:00200000:2.0:1787191341.038466:0:57909:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd0:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191341.038472:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894a88 (ffff936b47a17128/0) at cl_lock_release():245 00000020:00010000:2.0:1787191341.038475:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894a88 (ffff936b47a17128/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191341.038479:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667db0 (ffff936b465cccf8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191341.038482:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894a88 (ffff936b47a17128/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191341.038485:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667db0 (ffff936b47a17128/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191341.038493:0:57909:0:(vvp_io.c:533:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:2.0:1787191341.038501:0:57909:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1787191341.038519:0:25580:0:(osc_cache.c:2029:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff936b46699600 00000008:00100000:2.0:1787191341.038826:0:25580:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff936b513bbb80 - object 0x2c0000401:452 offset 0<>4096 00000100:00100000:2.0:1787191341.038906:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787191341.038923:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626725632:192.168.202.101@tcp:4:lfs.0 00000080:00200000:0.0:1787191341.049715:0:57913:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191341.049754:0:57913:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.049772:0:57913:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.049790:0:57913:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.049798:0:57913:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191341.049806:0:57913:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191341.049809:0:57913:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191341.049816:0:57913:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4224bb58 00010000:00010000:0.0:1787191341.049821:0:57913:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.050221:0:57913:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.050243:0:57913:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.050252:0:57913:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:0.0:1787191341.050258:0:57913:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.050271:0:57913:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:0.0:1787191341.050275:0:57913:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:0.0:1787191341.050289:0:57913:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:0.0:1787191341.050339:0:57913:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483a57a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.050348:0:57913:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483a57a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.050361:0:57913:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483a57a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.050387:0:57913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57913:1874004626725760:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191341.050743:0:57913:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787191341.053676:0:2391:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-ffff936b581fb000: committing for last_committed 17179870373 gen 1 00000008:00010000:2.0:1787191341.053752:0:2391:0:(osc_cache.c:917:osc_extent_finish()) ### no dlm lock: extent: ffff936b46699600 00000020:00200000:2.0:1787191341.053759:0:2391:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:2.0:1787191341.053768:0:2391:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:2.0:1787191341.053783:0:2391:0:(osc_cache.c:497:__osc_extent_remove()) ### no dlm lock: extent: ffff936b46699600 00000100:00100000:2.0:1787191341.053809:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626725632:192.168.202.101@tcp:4:lfs.0 00000080:00200000:3.0:1787191341.053949:0:57909:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1787191341.053964:0:57909:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd0:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191341.053969:0:57909:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:3.0:1787191341.053980:0:57909:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd0:0x0] updating i_size 5 i_blocks 8 00000020:00200000:3.0:1787191341.053984:0:57909:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191341.053992:0:57909:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200080:3.0:1787191341.054011:0:57909:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8) cmd=400866b1 arg=0 00000080:00200080:3.0:1787191341.054020:0:57909:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8) cmd=400866b1 arg=1 00000080:00200008:3.0:1787191341.054038:0:57909:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xd0:0x0](ffff936b489880c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191341.054046:0:57909:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8),name=f70.sanity-flr 00000002:00010000:3.0:1787191341.054068:0:57909:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd0:0x0]) in obj [0x200000405:0xd0:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191341.054084:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a534 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605bf5 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191341.054100:0:57909:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a534 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605bf5 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:3.0:1787191341.054108:0:57909:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xd0:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191341.054127:0:57909:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) 00000080:00010000:3.0:1787191341.054132:0:57909:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) for lock 0xe5129dc88483a534 00000080:00010000:3.0:1787191341.054138:0:57909:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a534 from it ffffa3fb4223bcd8 00010000:00010000:3.0:1787191341.054142:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a534 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605bf5 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191341.054150:0:57909:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a534 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605bf5 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00000080:00200000:3.0:1787191341.054172:0:57909:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd0:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:3.0:1787191341.054183:0:57909:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd0:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191341.054186:0:57909:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191341.054190:0:57909:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xd0:0x0] 00000008:00010000:3.0:1787191341.054210:0:57909:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191341.054213:0:57909:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667db0, osc lock ffff936b44f65b50, flags 0x400000400001002 00010000:00010000:3.0:1787191341.054231:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 0 00010000:00010000:3.0:1787191341.054244:0:57909:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 0 00000020:00200000:3.0:1787191341.054255:0:57909:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191341.054259:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 0 00010000:00010000:3.0:1787191341.054267:0:57909:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00000020:00200000:3.0:1787191341.054284:0:57909:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191341.054289:0:57909:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd0:0x0] updating i_size 5 i_blocks 8 00000020:00010000:3.0:1787191341.054293:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509b8940 (ffff936b47a17128/0) at cl_lock_release():245 00000020:00010000:3.0:1787191341.054297:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509b8940 (ffff936b47a17128/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191341.054300:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667db0 (ffff936b465cccf8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191341.054303:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509b8940 (ffff936b47a17128/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191341.054306:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667db0 (ffff936b47a17128/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191341.054315:0:57909:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd0:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191341.054326:0:57909:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xd0:0x0], offset: 5, type: SEEK_DATA 00000080:00200000:3.0:1787191341.054331:0:57909:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd0:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:3.0:1787191341.054336:0:57909:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd0:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191341.054338:0:57909:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191341.054343:0:57909:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191341.054349:0:57909:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1787191341.054362:0:57909:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd0:0x0] updating i_size 5 i_blocks 8 00000080:00200000:3.0:1787191341.054370:0:57909:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd0:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191341.054375:0:57909:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000080:00200000:3.0:1787191341.054377:0:57909:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd0:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:3.0:1787191341.054382:0:57909:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191341.054385:0:57909:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1787191341.054388:0:57909:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:3.0:1787191341.054407:0:57909:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:3.0:1787191341.054410:0:57909:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667db0, osc lock ffff936b44f65b50, flags 0x0 00010000:00010000:3.0:1787191341.054419:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:3.0:1787191341.054427:0:57909:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:3.0:1787191341.054436:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:3.0:1787191341.054444:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:3.0:1787191341.054451:0:57909:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00000080:00200000:3.0:1787191341.054461:0:57909:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd0:0x0] updating i_size 5 i_blocks 8 00000020:00010000:3.0:1787191341.054466:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894a88 (ffff936b47a17128/0) at cl_lock_release():245 00000020:00010000:3.0:1787191341.054468:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894a88 (ffff936b47a17128/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191341.054471:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667db0 (ffff936b465cccf8/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191341.054475:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:3.0:1787191341.054482:0:57909:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00000020:00010000:3.0:1787191341.054490:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894a88 (ffff936b47a17128/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191341.054493:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667db0 (ffff936b47a17128/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191341.054745:0:57909:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd0:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191341.054755:0:57909:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xd0:0x0], offset: 0, type: (null) 00000080:00200000:3.0:1787191341.054760:0:57909:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd0:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:3.0:1787191341.054765:0:57909:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd0:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191341.054769:0:57909:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191341.054771:0:57909:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xd0:0x0] 00000008:00010000:3.0:1787191341.054778:0:57909:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191341.054780:0:57909:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667db0, osc lock ffff936b44f65b50, flags 0x400000400001002 00010000:00010000:3.0:1787191341.054789:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00010000:00010000:3.0:1787191341.054799:0:57909:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00000020:00200000:3.0:1787191341.054806:0:57909:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191341.054809:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00010000:00010000:3.0:1787191341.054817:0:57909:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00000020:00200000:3.0:1787191341.054826:0:57909:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191341.055010:0:57909:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd0:0x0] updating i_size 5 i_blocks 8 00000020:00010000:3.0:1787191341.055014:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509b8940 (ffff936b47a17128/0) at cl_lock_release():245 00000020:00010000:3.0:1787191341.055017:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509b8940 (ffff936b47a17128/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191341.055020:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667db0 (ffff936b465cccf8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191341.055024:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509b8940 (ffff936b47a17128/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191341.055037:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667db0 (ffff936b47a17128/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191341.055044:0:57909:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd0:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191341.055052:0:57909:0:(file.c:5244:ll_file_seek()) COMPLETED file f70.sanity-flr:[0x200000405:0xd0:0x0], offset: 0, type: (null), rc = 5 00000080:00200080:3.0:1787191341.055058:0:57909:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8) cmd=400866b1 arg=0 00000100:00100000:1.0:1787191341.067585:0:57913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57913:1874004626725760:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191341.067683:0:57913:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483a57a lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.067699:0:57913:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483a57a lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.067706:0:57913:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483a57a lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.067714:0:57913:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483a57a lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.067723:0:57913:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483a57a lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.067729:0:57913:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b4150bc00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191341.067733:0:57913:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483a57a lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.067740:0:57913:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483a57a lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.067747:0:57913:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483a57a lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.067755:0:57913:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191341.067760:0:57913:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483a57a lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.067767:0:57913:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483a57a lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191341.067793:0:57913:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b6a476d80 x1874004626725760/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191341.067809:0:57913:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191341.068215:0:57913:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191341.068231:0:57913:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191341.068241:0:57913:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.068254:0:57913:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.068262:0:57913:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191341.068267:0:57913:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191341.068270:0:57913:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191341.068276:0:57913:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4224bbe8 00010000:00010000:1.0:1787191341.068279:0:57913:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.068288:0:57913:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.068308:0:57913:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191341.068315:0:57913:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000080:00200000:1.0:1787191341.068320:0:57913:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191341.068332:0:57913:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:1.0:1787191341.068336:0:57913:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191341.068347:0:57913:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191341.068389:0:57913:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a581 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.068397:0:57913:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a581 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.068407:0:57913:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a581 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191341.068428:0:57913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57913:1874004626725888:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191341.068632:0:57913:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000080:00200080:3.0:1787191341.069703:0:57909:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8) cmd=400866b1 arg=2 00000080:00200008:3.0:1787191341.069719:0:57909:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xd0:0x0](ffff936b489880c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191341.069727:0:57909:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8),name=f70.sanity-flr 00000002:00010000:3.0:1787191341.069742:0:57909:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd0:0x0]) in obj [0x200000405:0xd0:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191341.069754:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a534 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605bf5 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00010000:00010000:3.0:1787191341.069768:0:57909:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a534 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605bf5 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00000080:00200000:3.0:1787191341.069775:0:57909:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xd0:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191341.069782:0:57909:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) 00000080:00010000:3.0:1787191341.069785:0:57909:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) for lock 0xe5129dc88483a534 00000080:00010000:3.0:1787191341.069792:0:57909:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a534 from it ffffa3fb4223bcd8 00010000:00010000:3.0:1787191341.069796:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a534 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605bf5 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00010000:00010000:3.0:1787191341.069803:0:57909:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a534 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605bf5 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00000080:00200000:3.0:1787191341.069875:0:57909:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd0:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:3.0:1787191341.069888:0:57909:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd0:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191341.069892:0:57909:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191341.069895:0:57909:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xd0:0x0] 00000008:00010000:3.0:1787191341.069915:0:57909:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191341.069918:0:57909:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667db0, osc lock ffff936b44f65b50, flags 0x400000400001002 00010000:00010000:3.0:1787191341.070001:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00010000:00010000:3.0:1787191341.070020:0:57909:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00000020:00200000:3.0:1787191341.070042:0:57909:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191341.070046:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00010000:00010000:3.0:1787191341.070054:0:57909:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00000020:00200000:3.0:1787191341.070065:0:57909:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191341.070074:0:57909:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd0:0x0] updating i_size 5 i_blocks 8 00000020:00010000:3.0:1787191341.070077:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509b8940 (ffff936b47a17128/0) at cl_lock_release():245 00000020:00010000:3.0:1787191341.070080:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509b8940 (ffff936b47a17128/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191341.070084:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667db0 (ffff936b465cccf8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191341.070088:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509b8940 (ffff936b47a17128/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191341.070090:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667db0 (ffff936b47a17128/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191341.070101:0:57909:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd0:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191341.070249:0:57909:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xd0:0x0](ffff936b489880c8) current size 5, valid attrs 2068, mode 0, uid -1322410190, gid -1, new size 5, atime 1787191341.000000000, mtime 1787191341.000000000, ctime 1787191341.000000000 00010000:00010000:3.0:1787191341.070272:0:57909:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a534 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4605bf5 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00010000:00010000:3.0:1787191341.070288:0:57909:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a52d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605be7 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191341.070328:0:57909:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a534 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605bf5 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00010000:00010000:3.0:1787191341.070335:0:57909:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191341.070339:0:57909:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a534 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xd0:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605bf5 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00000020:00100000:3.0:1787191341.070355:0:57909:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1787191341.070366:0:57909:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1e680 x1874004626726144/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191341.070387:0:57909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1e680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626726144:192.168.202.101@tcp:36:lfs.0 00000100:00100000:3.0:1787191341.070449:0:57909:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c180 going to sleep for 11 seconds 00000100:00100000:1.0:1787191341.074297:0:57913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57913:1874004626725888:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191341.074317:0:57913:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a581 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.074329:0:57913:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a581 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.074335:0:57913:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a581 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.074341:0:57913:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a581 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.074350:0:57913:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a581 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.074356:0:57913:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191341.074360:0:57913:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a581 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191341.074369:0:57909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1e680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626726144:192.168.202.101@tcp:36:lfs.0 00010000:00010000:1.0:1787191341.074370:0:57913:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a581 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.074383:0:57913:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a581 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.074390:0:57913:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191341.074407:0:57913:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a581 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.074414:0:57913:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a581 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191341.074438:0:57913:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b453a9880 x1874004626725888/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191341.074453:0:57913:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191341.074471:0:57909:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 2 00000080:00200000:3.0:1787191341.074479:0:57909:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd0:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:3.0:1787191341.074498:0:57909:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x11 00000080:00200000:1.0:1787191341.074547:0:57913:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191341.074563:0:57913:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191341.074572:0:57913:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.074584:0:57913:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.074592:0:57913:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191341.074597:0:57913:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191341.074600:0:57913:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191341.074615:0:57913:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4224bb58 00010000:00010000:1.0:1787191341.074619:0:57913:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.074628:0:57913:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.074642:0:57913:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191341.074646:0:57909:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000080:00200000:1.0:1787191341.074650:0:57913:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:1.0:1787191341.074662:0:57913:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000008:00010000:3.0:1787191341.074662:0:57909:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:3.0:1787191341.074668:0:57909:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b5235c1b0, osc lock ffff936b44f65b50, flags 0x0 00000080:00200000:1.0:1787191341.074670:0:57913:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000008:00010000:3.0:1787191341.074675:0:57909:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:3.0:1787191341.074678:0:57909:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b5235c1f0, osc lock ffff936b44f65430, flags 0x0 00000002:00010000:1.0:1787191341.074683:0:57913:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191341.074691:0:57913:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 88 lru_type: 1 00010000:00010000:1.0:1787191341.074699:0:57913:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 88 lru_type: 1 00000002:00010000:1.0:1787191341.074708:0:57913:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191341.074731:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000eb2ebc95/0xe5129dc88483a588 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.074736:0:57913:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a58f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.074754:0:57913:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a58f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.074757:0:57909:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000eb2ebc95/0xe5129dc88483a588 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.074768:0:57913:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a58f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.074796:0:57909:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000eb2ebc95/0xe5129dc88483a588 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191341.074802:0:57913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57913:1874004626726400:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191341.074818:0:57909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626726272:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191341.074895:0:57913:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:3.0:1787191341.075138:0:57909:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c540 going to sleep for 11 seconds 00000100:00100000:1.0:1787191341.077382:0:57913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57913:1874004626726400:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191341.077383:0:57909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626726272:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191341.077411:0:57913:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a58f lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605cf8 expref: -99 pid: 57913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.077422:0:57909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000eb2ebc95/0xe5129dc88483a588 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605cea expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.077425:0:57913:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a58f lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605cf8 expref: -99 pid: 57913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.077449:0:57913:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a58f lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605cf8 expref: -99 pid: 57913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.077452:0:57909:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000eb2ebc95/0xe5129dc88483a588 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605cea expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.077465:0:57913:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a58f lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605cf8 expref: -99 pid: 57913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.077472:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000eb2ebc95/0xe5129dc88483a588 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605cea expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.077477:0:57913:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a58f lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605cf8 expref: -99 pid: 57913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.077492:0:57913:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a58f lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605cf8 expref: -99 pid: 57913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191341.077493:0:57909:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 4096, setting rss=4096; kms=4096, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000eb2ebc95/0xe5129dc88483a588 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605cea expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.077504:0:57913:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a58f lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605cf8 expref: -99 pid: 57913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.077533:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000eb2ebc95/0xe5129dc88483a588 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605cea expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191341.077536:0:57913:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b453a9880 x1874004626726400/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1787191341.077550:0:57909:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000eb2ebc95/0xe5129dc88483a588 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605cea expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191341.077559:0:57913:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a58f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605cf8 expref: -99 pid: 57913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.077575:0:57913:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:1.0:1787191341.077583:0:57913:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a58f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605cf8 expref: -99 pid: 57913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.077591:0:57913:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a58f lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605cf8 expref: -99 pid: 57913 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191341.077623:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc88483a596 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191341.077626:0:57913:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191341.077640:0:57909:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc88483a596 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.077644:0:57913:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 176 lru_type: 1 00010000:00010000:3.0:1787191341.077652:0:57909:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc88483a596 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.077658:0:57913:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 176 lru_type: 1 00010000:00010000:1.0:1787191341.077668:0:57913:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 176 lru_type: 1 00000100:00100000:3.0:1787191341.077673:0:57909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626726528:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191341.077684:0:57913:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 177 lru_type: 1 00000080:00200000:1.0:1787191341.077697:0:57913:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191341.077706:0:57913:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:1.0:1787191341.077711:0:57913:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:1.0:1787191341.077717:0:57913:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb4224bcb8 00010000:00010000:1.0:1787191341.077721:0:57913:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 88 lru_type: 1 00010000:00010000:1.0:1787191341.077729:0:57913:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 89 lru_type: 1 00000100:00100000:3.0:1787191341.077745:0:57909:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c540 going to sleep for 11 seconds 00000002:00010000:1.0:1787191341.077746:0:57913:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191341.077755:0:57913:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a58f lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605cf8 expref: -99 pid: 57913 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.077763:0:57913:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a58f lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605cf8 expref: -99 pid: 57913 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.077770:0:57913:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a58f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605cf8 expref: -99 pid: 57913 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.077778:0:57913:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a58f lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605cf8 expref: -99 pid: 57913 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:1.0:1787191341.077786:0:57913:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191341.077790:0:57913:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 177 lru_type: 1 00010000:00010000:1.0:1787191341.077797:0:57913:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 177 lru_type: 1 00010000:00010000:1.0:1787191341.077810:0:57913:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 177 lru_type: 1 00010000:00010000:1.0:1787191341.077817:0:57913:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 178 lru_type: 1 00000080:00200008:1.0:1787191341.078481:0:57913:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:1.0:1787191341.078488:0:57913:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191341.078503:0:57913:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191341.078512:0:57913:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.078522:0:57913:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.078530:0:57913:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191341.078535:0:57913:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191341.078538:0:57913:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191341.078542:0:57913:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4224bcb8 00010000:00010000:1.0:1787191341.078545:0:57913:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.078552:0:57913:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.078660:0:57913:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191341.078669:0:57913:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191341.078676:0:57913:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.078683:0:57913:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.078689:0:57913:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191341.078693:0:57913:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191341.078695:0:57913:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191341.078698:0:57913:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4224bb58 00010000:00010000:1.0:1787191341.078701:0:57913:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.078708:0:57913:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.078716:0:57913:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191341.078721:0:57913:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:1.0:1787191341.078727:0:57913:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191341.078737:0:57913:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:1.0:1787191341.078741:0:57913:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191341.078752:0:57913:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191341.078785:0:57913:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a59d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.078792:0:57913:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a59d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.078800:0:57913:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a59d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191341.078816:0:57913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57913:1874004626726656:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191341.078909:0:57913:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:3.0:1787191341.090699:0:57909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626726528:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191341.090733:0:57909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc88483a596 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605d14 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.090751:0:57909:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc88483a596 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605d14 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.090766:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc88483a596 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605d14 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191341.090779:0:57909:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc88483a596 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605d14 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.090795:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc88483a596 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605d14 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.090803:0:57909:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc88483a596 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605d14 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191341.090948:0:2392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787191341.090965:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626726784:192.168.202.101@tcp:10:lfs.0 00000100:00100000:3.0:1787191341.091091:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626726912:192.168.202.101@tcp:10:lfs.0 00000100:00100000:1.0:1787191341.091379:0:57913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57913:1874004626726656:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191341.091391:0:57913:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a59d lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.091402:0:57913:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a59d lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.091409:0:57913:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a59d lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.091415:0:57913:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a59d lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.091422:0:57913:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a59d lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.091427:0:57913:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030800 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191341.091431:0:57913:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a59d lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.091439:0:57913:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a59d lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.091445:0:57913:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a59d lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.091451:0:57913:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191341.091458:0:57913:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a59d lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.091464:0:57913:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a59d lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191341.091480:0:57913:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b453a9880 x1874004626726656/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191341.091494:0:57913:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1787191341.091521:0:57913:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a58f lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605cf8 expref: -99 pid: 57913 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191341.091531:0:57913:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a58f lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605cf8 expref: -99 pid: 57913 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:1.0:1787191341.091539:0:57913:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a58f from it ffffa3fb4224b930 00010000:00010000:1.0:1787191341.091543:0:57913:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a58f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605cf8 expref: -99 pid: 57913 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191341.091550:0:57913:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a58f lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605cf8 expref: -99 pid: 57913 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191341.091625:0:57913:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191341.091640:0:57913:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191341.091648:0:57913:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.091657:0:57913:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.091669:0:57913:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191341.091674:0:57913:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191341.091677:0:57913:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191341.091682:0:57913:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4224bbf8 00010000:00010000:1.0:1787191341.091685:0:57913:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.091692:0:57913:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.091701:0:57913:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191341.091709:0:57913:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191341.091715:0:57913:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191341.091721:0:57913:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:1.0:1787191341.091724:0:57913:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:1.0:1787191341.091729:0:57913:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b589fa480, open_flags a141, mode 81b6 opened 0 00000080:00200000:1.0:1787191341.091739:0:57913:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:1.0:1787191341.091758:0:57913:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xd4:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:1.0:1787191341.091768:0:57913:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a58f lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4605cf8 expref: -99 pid: 57913 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191341.091805:0:57913:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a58f lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4605cf8 expref: -99 pid: 57913 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191341.091813:0:57913:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191341.091816:0:57913:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a58f lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4605cf8 expref: -99 pid: 57913 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191341.091891:0:57913:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a5a4 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.091899:0:57913:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a5a4 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191341.091910:0:57913:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191341.091917:0:57913:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9880 x1874004626727168/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191341.091937:0:57913:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a5a4 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191341.091952:0:57913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57913:1874004626727168:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191341.092059:0:57913:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:3.0:1787191341.099233:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626726912:192.168.202.101@tcp:10:lfs.0 00000100:00100000:3.0:1787191341.099268:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626726784:192.168.202.101@tcp:10:lfs.0 00000080:00200000:2.0:1787191341.099355:0:57909:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd0:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191341.099363:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894a88 (ffff936b47a17128/0) at cl_lock_release():245 00000020:00010000:2.0:1787191341.099366:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894a88 (ffff936b47a17128/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191341.099370:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b5235c1b0 (ffff936b465cccf8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191341.099383:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000eb2ebc95/0xe5129dc88483a588 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605cea expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.099403:0:57909:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000eb2ebc95/0xe5129dc88483a588 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605cea expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191341.099420:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b5235c1f0 (ffff936b465cc008/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191341.099425:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc88483a596 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605d14 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.099432:0:57909:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc88483a596 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605d14 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191341.099440:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894a88 (ffff936b47a17128/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191341.099443:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b5235c1b0 (ffff936b47a17128/1) at cl_lock_fini():72 00000020:00010000:2.0:1787191341.099447:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b5235c1f0 (ffff936b47a17128/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191341.099465:0:57909:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd0:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191341.099498:0:57909:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xd0:0x0](ffff936b489880c8) current size 5, valid attrs 10002168, mode 0, uid -1322410190, gid -1, new size 5, atime 1787191341.000000000, mtime 1787191341.000000000, ctime 1787191341.000000000, rc 0 00000080:00200080:2.0:1787191341.099518:0:57909:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8) cmd=400866b1 arg=0 00000080:00200008:2.0:1787191341.099546:0:57909:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xd0:0x0](ffff936b489880c8) current size 5, valid attrs 101f0, mode a3fb, uid 1401186632, gid -27797, new size 18446624687721578696, atime 1787191340.000000000, mtime 1787191340.000000000, ctime 1787191341.000000000 00000020:00100000:2.0:1787191341.099598:0:57909:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 36, max 7 00000100:00100000:2.0:1787191341.099606:0:57909:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bbb80 x1874004626727424/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787191341.099627:0:57909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626727424:192.168.202.101@tcp:36:lfs.0 00000100:00100000:2.0:1787191341.099708:0:57909:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787191341.100100:0:57913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57913:1874004626727168:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191341.100115:0:57913:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a5a4 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605d30 expref: -99 pid: 57913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.100138:0:57913:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a5a4 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605d30 expref: -99 pid: 57913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.100146:0:57913:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a5a4 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605d30 expref: -99 pid: 57913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.100157:0:57913:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a5a4 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605d30 expref: -99 pid: 57913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.100172:0:57913:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a5a4 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605d30 expref: -99 pid: 57913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.100185:0:57913:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a5a4 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605d30 expref: -99 pid: 57913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.100193:0:57913:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a5a4 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605d30 expref: -99 pid: 57913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.100200:0:57913:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a5a4 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605d30 expref: -99 pid: 57913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191341.100210:0:57913:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b453a9880 x1874004626727168/t8589936952(8589936952) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191341.100222:0:57913:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9880 x1874004626727168/t8589936952(8589936952) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191341.100233:0:57913:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a5a4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605d30 expref: -99 pid: 57913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.100243:0:57913:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/212 (0 0) 00000080:00200000:1.0:1787191341.100248:0:57913:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191341.100257:0:57913:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:1.0:1787191341.100280:0:57913:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xd4:0x0](ffff936b5395a1c8) 00000080:00200000:1.0:1787191341.100286:0:57913:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xd4:0x0], updating i_size 0 00000080:00200000:1.0:1787191341.100316:0:57913:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd4:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:1.0:1787191341.100321:0:57913:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xd4:0x0](ffff936b5395a1c8) 00000080:00010000:1.0:1787191341.100324:0:57913:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd4:0x0](ffff936b5395a1c8) for lock 0xe5129dc88483a5a4 00000080:00010000:1.0:1787191341.100333:0:57913:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd4:0x0](ffff936b5395a1c8) 00000080:00200008:1.0:1787191341.100345:0:57913:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xd4:0x0](ffff936b5395a1c8), flags 120501 00000002:00100000:1.0:1787191341.100363:0:57913:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9880 x1874004626727168/t8589936952(8589936952) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191341.100395:0:57913:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a5a4 from it ffff936b5339fd80 00010000:00010000:1.0:1787191341.100400:0:57913:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a5a4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605d30 expref: -99 pid: 57913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.100409:0:57913:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a5a4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605d30 expref: -99 pid: 57913 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191341.100426:0:57913:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd4:0x0](ffff936b5395a1c8), inode mode 81a4 mask 40 00000080:00200000:1.0:1787191341.100472:0:57913:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd4:0x0](ffff936b5395a1c8), inode mode 81a4 mask 2 00000080:00200000:1.0:1787191341.100482:0:57913:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xd4:0x0](ffff936b5395a1c8), xattr lov 00000002:00010000:1.0:1787191341.100496:0:57913:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd4:0x0]) in obj [0x200000405:0xd4:0x0], intent: open flags 040000002 00010000:00010000:1.0:1787191341.100528:0:57913:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a5ab lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.100536:0:57913:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a5ab lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191341.100545:0:57913:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191341.100550:0:57913:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9500 x1874004626727680/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191341.100559:0:57913:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a5ab lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191341.100573:0:57913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57913:1874004626727680:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191341.100714:0:57913:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:3.0:1787191341.104317:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191341.104445:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634904192 00000100:00100000:2.0:1787191341.104455:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634904192 00000100:00100000:2.0:1787191341.104545:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1385 00000100:00100000:2.0:1787191341.104557:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634904192:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191341.104574:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a5a4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4605d30 expref: -99 pid: 57913 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.104657:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191341.104663:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634904192:12345-192.168.202.101@tcp:104: Request processed in 110us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191341.104670:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1385 00010000:00010000:1.0:1787191341.104716:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191341.104724:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a5a4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4605d30 expref: -99 pid: 57913 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.104733:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191341.104738:0:43384:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a5a4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4605d30 expref: -99 pid: 57913 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.104746:0:43384:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a5a4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4605d30 expref: -99 pid: 57913 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.104754:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a5a4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4605d30 expref: -99 pid: 57913 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191341.104776:0:43384:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xd4:0x0]: losing layout lock 00010000:00010000:1.0:1787191341.104823:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a5a4 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4605d30 expref: -99 pid: 57913 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.104871:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191341.104891:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a5a4 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4605d30 expref: -99 pid: 57913 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.104899:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a5a4 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4605d30 expref: -99 pid: 57913 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.104914:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191341.104916:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191341.104918:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191341.105014:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626727808:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191341.108789:0:57909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626727424:192.168.202.101@tcp:36:lfs.0 00000080:00200000:0.0:1787191341.108865:0:57909:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd0:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191341.108880:0:57909:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd0:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191341.108884:0:57909:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191341.108891:0:57909:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191341.108905:0:57909:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191341.108908:0:57909:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:0.0:1787191341.108936:0:57909:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:0.0:1787191341.108942:0:57909:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee6830, osc lock ffff936b50b637c0, flags 0x0 00010000:00010000:0.0:1787191341.108960:0:57909:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b52377800 type 11 mode 2 res 10737419265/448 (0 1048575) 00010000:00010000:0.0:1787191341.109008:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001798b3ab/0xe5129dc88483a5b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.109023:0:57909:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001798b3ab/0xe5129dc88483a5b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.109046:0:57909:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001798b3ab/0xe5129dc88483a5b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.109073:0:57909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626727936:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191341.109166:0:57909:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99000 going to sleep for 11 seconds 00000100:00100000:1.0:1787191341.114107:0:57913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57913:1874004626727680:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191341.114133:0:57913:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a5ab lrc: 4/1,0 mode: --/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.114148:0:57913:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a5ab lrc: 4/1,0 mode: --/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.114155:0:57913:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a5ab lrc: 4/1,0 mode: --/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.114162:0:57913:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a5ab lrc: 3/0,0 mode: --/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.114170:0:57913:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a5ab lrc: 4/0,0 mode: --/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.114176:0:57913:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191341.114181:0:57913:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a5ab lrc: 4/0,0 mode: --/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.114187:0:57913:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a5ab lrc: 4/0,0 mode: --/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.114194:0:57913:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a5ab lrc: 5/0,0 mode: --/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.114201:0:57913:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191341.114207:0:57913:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a5ab lrc: 3/0,0 mode: --/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.114213:0:57913:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a5ab lrc: 0/0,0 mode: --/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57913 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191341.114241:0:57913:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b453a9500 x1874004626727680/t8589936954(8589936954) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191341.114254:0:57913:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9500 x1874004626727680/t8589936954(8589936954) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191341.114269:0:57913:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xd4:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787191341.114318:0:57913:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd4:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1787191341.114326:0:57913:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191341.114376:0:57913:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xd4:0x0], updating i_size 0 00000002:00100000:1.0:1787191341.114395:0:57913:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9500 x1874004626727680/t8589936954(8589936954) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191341.114434:0:57913:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a9500 x1874004626727680/t8589936954(8589936954) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191341.114444:0:57913:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191341.114448:0:57913:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453aad80 x1874004626728192/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191341.114470:0:57913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57913:1874004626728192:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191341.114547:0:57913:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:3.0:1787191341.115203:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191341.115270:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634904320 00000100:00100000:2.0:1787191341.115278:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634904320 00000100:00100000:2.0:1787191341.115329:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1386 00000100:00100000:2.0:1787191341.115338:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30510:x1874004634904320:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191341.115351:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:2.0:1787191341.115407:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191341.115413:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30510:x1874004634904320:12345-192.168.202.101@tcp:104: Request processed in 77us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191341.115420:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1386 00010000:00010000:1.0:1787191341.115626:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191341.115632:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:1.0:1787191341.115641:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40031e00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191341.115646:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800428400000000 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00000080:00200000:1.0:1787191341.115661:0:40929:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd0:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1787191341.115672:0:40929:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd0:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1787191341.115706:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400000020 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:1.0:1787191341.115713:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191341.115731:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400000020 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:1.0:1787191341.115738:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003d4d0ce2/0xe5129dc88483a53b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400000020 nid: local remote: 0x7130d520e4605c03 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:1.0:1787191341.115753:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191341.115755:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191341.115756:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191341.117271:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626728320:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191341.117735:0:57909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626727936:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191341.117759:0:57909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001798b3ab/0xe5129dc88483a5b2 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000020000 nid: local remote: 0x7130d520e4605d5a expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.117773:0:57909:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001798b3ab/0xe5129dc88483a5b2 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e4605d5a expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.117782:0:57909:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001798b3ab/0xe5129dc88483a5b2 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e4605d5a expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.120684:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626727808:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191341.122465:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191341.125591:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634904448 00000100:00100000:3.0:1787191341.125606:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634904448 00000100:00100000:2.0:1787191341.127416:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1387 00000100:00100000:2.0:1787191341.127429:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30131:x1874004634904448:12345-192.168.202.101@tcp:105: 00010000:00010000:2.0:1787191341.127449:0:40922:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001798b3ab/0xe5129dc88483a5b2 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e4605d5a expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.127464:0:40922:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001798b3ab/0xe5129dc88483a5b2 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e4605d5a expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.127474:0:40922:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001798b3ab/0xe5129dc88483a5b2 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000020000 nid: local remote: 0x7130d520e4605d5a expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.127485:0:40922:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001798b3ab/0xe5129dc88483a5b2 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080000020000 nid: local remote: 0x7130d520e4605d5a expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.127494:0:40922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001798b3ab/0xe5129dc88483a5b2 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080000020000 nid: local remote: 0x7130d520e4605d5a expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.127505:0:40922:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001798b3ab/0xe5129dc88483a5b2 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000020000 nid: local remote: 0x7130d520e4605d5a expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.127536:0:40922:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b4150b800) 00010000:00010000:1.0:1787191341.127680:0:57909:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001798b3ab/0xe5129dc88483a5b2 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e4605d5a expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.127691:0:57909:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001798b3ab/0xe5129dc88483a5b2 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e4605d5a expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.127707:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001798b3ab/0xe5129dc88483a5b2 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000020000 nid: local remote: 0x7130d520e4605d5a expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191341.127719:0:57909:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 5, setting rss=5; kms=5, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001798b3ab/0xe5129dc88483a5b2 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000020000 nid: local remote: 0x7130d520e4605d5a expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.127731:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001798b3ab/0xe5129dc88483a5b2 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4605d5a expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.127740:0:57909:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001798b3ab/0xe5129dc88483a5b2 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4605d5a expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191341.127762:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30131:x1874004634904448:12345-192.168.202.101@tcp:105: Request processed in 335us (5305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191341.127769:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1387 00000100:00100000:0.0:1787191341.127849:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626728448:192.168.202.101@tcp:2:lfs.0 00000100:00100000:1.0:1787191341.128426:0:57913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57913:1874004626728192:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191341.128451:0:57913:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a9500 x1874004626727680/t8589936954(8589936954) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1787191341.128504:0:57913:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xd4:0x0](ffff936b5395a1c8), flags 100001 00000002:00100000:1.0:1787191341.128545:0:57913:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a9880 x1874004626727168/t8589936952(8589936952) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191357 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191341.128561:0:57913:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191341.128566:0:57913:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8a80 x1874004626728704/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191341.128579:0:57913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57913:1874004626728704:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191341.128620:0:57913:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:1.0:1787191341.130013:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626728320:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191341.131252:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626728448:192.168.202.101@tcp:2:lfs.0 00000020:00010000:1.0:1787191341.131507:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894f38 (ffff936b47a17488/0) at cl_lock_release():245 00000020:00010000:1.0:1787191341.131512:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894f38 (ffff936b47a17488/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191341.131518:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee6830 (ffff936b47a17998/1) at cl_lock_cancel():142 00010000:00010000:1.0:1787191341.131528:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001798b3ab/0xe5129dc88483a5b2 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4605d5a expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.131543:0:57909:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001798b3ab/0xe5129dc88483a5b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4605d5a expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1787191341.131558:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894f38 (ffff936b47a17488/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191341.131561:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee6830 (ffff936b47a17488/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191341.131578:0:57909:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd0:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1787191341.131591:0:57909:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xd0:0x0](ffff936b489880c8) current size 5, valid attrs 100101f0, mode a3fb, uid 1401186632, gid -27797, new size 18446624687721578696, atime 1787191340.000000000, mtime 1787191340.000000000, ctime 1787191341.000000000, rc 0 00000100:00100000:0.0:1787191341.131967:0:57913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57913:1874004626728704:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191341.131992:0:57913:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a9880 x1874004626727168/t8589936952(8589936952) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191341.133082:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191341.133105:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191341.133132:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191341.133145:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191341.133158:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191341.133165:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191341.133169:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191341.133176:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:3.0:1787191341.133180:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191341.133189:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191341.133202:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191341.133209:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191341.133215:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191341.133228:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:3.0:1787191341.133233:0:57570:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b464a9b00, open_flags 8241, mode 81b6 opened 0 00000080:00200000:3.0:1787191341.133241:0:57570:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:3.0:1787191341.133259:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xd5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0101102 00010000:00010000:3.0:1787191341.133304:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a5b9 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.133310:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a5b9 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191341.133320:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191341.133327:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1f480 x1874004626728960/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191341.133338:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a5b9 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191341.133353:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626728960:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191341.133475:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c540 going to sleep for 11 seconds 00000080:00200080:1.0:1787191341.137717:0:57909:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8) cmd=c00c66f3 arg=22402e0 00010000:00010000:1.0:1787191341.137796:0:57909:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a4fc lrc: 2/0,0 mode: PW/PW res: [0x200000405:0xd0:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81008000000000 nid: local remote: 0x7130d520e4605b4d expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.137823:0:57909:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a4fc lrc: 0/0,0 mode: --/PW res: [0x200000405:0xd0:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x85809400000000 nid: local remote: 0x7130d520e4605b4d expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.139016:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626728960:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191341.139052:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a5b9 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605d76 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.139079:0:57570:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a5b9 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605d76 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.139087:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a5b9 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605d76 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.139097:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a5b9 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605d76 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.139107:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a5b9 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605d76 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.139130:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a5b9 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605d76 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.139139:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a5b9 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605d76 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.139146:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a5b9 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605d76 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191341.139158:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x2b, status=0 req@ffff936b51d1f480 x1874004626728960/t8589936957(8589936957) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191341.139170:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1f480 x1874004626728960/t8589936957(8589936957) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191341.139183:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a5b9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605d76 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191341.139195:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a5b9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605d76 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.139204:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/212 (0 0) 00000080:00200000:0.0:1787191341.139210:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191341.139286:0:57570:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xd4:0x0](ffff936b5395a1c8): rc = 0 00000080:00200000:0.0:1787191341.139301:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd4:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:0.0:1787191341.139307:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd4:0x0](ffff936b5395a1c8) for lock 0xe5129dc88483a5b9 00000080:00010000:0.0:1787191341.139317:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd4:0x0](ffff936b5395a1c8) 00000080:00200008:0.0:1787191341.139331:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xd4:0x0](ffff936b5395a1c8), flags 101101 00000002:00100000:0.0:1787191341.139352:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1f480 x1874004626728960/t8589936957(8589936957) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191341.139390:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a5b9 from it ffff936b466f4cc0 00010000:00010000:0.0:1787191341.139402:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a5b9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605d76 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.139412:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a5b9 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605d76 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191341.139437:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd4:0x0](ffff936b5395a1c8), inode mode 81a4 mask 42 00000002:00010000:0.0:1787191341.139464:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xd4:0x0], intent: getxattr flags 0 00010000:00010000:0.0:1787191341.139497:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc88483a5c0 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.139505:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc88483a5c0 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.139515:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc88483a5c0 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.139535:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626729216:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191341.139621:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000002:00100000:1.0:1787191341.140187:0:57909:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a477b80 x1874004626720128/t8589936939(8589936939) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191341.140199:0:57909:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191341.140204:0:57909:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453aaa00 x1874004626729344/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191341.140519:0:57909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aaa00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626729344:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191341.140560:0:57909:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00000100:00100000:3.0:1787191341.145916:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191341.145996:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634904576 00000100:00100000:2.0:1787191341.146005:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634904576 00000100:00100000:2.0:1787191341.146071:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1388 00000100:00100000:2.0:1787191341.146081:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35858:x1874004634904576:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191341.146101:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a52d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4605be7 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191341.146185:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191341.146193:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35858:x1874004634904576:12345-192.168.202.101@tcp:104: Request processed in 114us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191341.146200:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1388 00010000:00010000:1.0:1787191341.146622:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191341.146629:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a52d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4605be7 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191341.146637:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cae400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191341.146642:0:57627:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a52d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4605be7 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191341.146649:0:57627:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a52d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4605be7 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191341.146657:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a52d lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4605be7 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1787191341.146678:0:57627:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xd0:0x0]: losing layout lock 00010000:00010000:1.0:1787191341.146716:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a52d lrc: 2/0,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4605be7 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191341.146728:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191341.146751:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a52d lrc: 1/0,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4605be7 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191341.146759:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a52d lrc: 0/0,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4605be7 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191341.146772:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191341.146774:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191341.146775:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191341.146789:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626729472:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191341.148866:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626729472:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191341.154070:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626729216:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191341.154100:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc88483a5c0 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605d92 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.154118:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc88483a5c0 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605d92 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.154130:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc88483a5c0 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605d92 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191341.154143:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b6a475180 x1874004626729216/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191341.154156:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc88483a5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605d92 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.154167:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/212 (0 0) 00000080:00200000:0.0:1787191341.154173:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xd4:0x0] suppgids 0 -1: rc 0 00000080:00010000:0.0:1787191341.154198:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd4:0x0](ffff936b5395a1c8) for lock 0xe5129dc88483a5c0 00000080:00010000:0.0:1787191341.154206:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a5c0 from it ffffa3fb41caba38 00010000:00010000:0.0:1787191341.154210:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc88483a5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605d92 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.154218:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc88483a5c0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605d92 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:0.0:1787191341.154268:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xd4:0x0](ffff936b5395a1c8) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191341.000000000, mtime 1787191341.000000000, ctime 1787191341.000000000 00010000:00010000:0.0:1787191341.154298:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a5b9 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4605d76 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191341.154318:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xd4:0x0]: losing layout lock 00010000:00010000:0.0:1787191341.154358:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a5b9 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605d76 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.154370:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191341.154374:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483a5b9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605d76 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1787191341.154404:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 36, max 7 00000100:00100000:0.0:1787191341.154411:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475180 x1874004626729728/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787191341.154431:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:0.0:1787191341.154437:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626729728:192.168.202.101@tcp:36:bash.0 00000100:00100000:0.0:1787191341.154518:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191341.154528:0:51131:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787191341.154541:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634905216 00000100:00100000:3.0:1787191341.154547:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634905216 00000100:00100000:3.0:1787191341.154593:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1389 00000100:00100000:3.0:1787191341.154602:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b50882c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:29543:x1874004634905216:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191341.154625:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc88483a565 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4605c5e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191341.154676:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191341.154684:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b50882c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:29543:x1874004634905216:12345-192.168.202.101@tcp:104: Request processed in 83us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191341.154691:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1389 00010000:00010000:1.0:1787191341.154816:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191341.154824:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc88483a565 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4605c5e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.154864:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b4150ac00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191341.154870:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc88483a565 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4605c5e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.154899:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc88483a565 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4605c5e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.154906:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191341.154929:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc88483a565 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4605c5e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.154937:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000d58d194c/0xe5129dc88483a565 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4605c5e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.154958:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191341.154961:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191341.154962:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191341.154972:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787191341.154983:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626729856:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191341.158776:0:57909:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589936958 gen 1 00000100:00100000:0.0:1787191341.158898:0:57909:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b51d1f480 x1874004626728960/t8589936957(8589936957) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787191341.158913:0:57909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aaa00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626729344:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191341.158939:0:57909:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a477b80 x1874004626720128/t8589936939(8589936939) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1787191341.158970:0:57909:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/208 (0 0) 00000080:00010000:0.0:1787191341.158982:0:57909:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xd0:0x0](ffff936b489880c8) 00000002:00010000:0.0:1787191341.158993:0:57909:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd0:0x0]) in obj [0x200000405:0xd0:0x0], intent: layout flags 0 00010000:00010000:0.0:1787191341.159051:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483a5c7 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.159060:0:57909:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483a5c7 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.159070:0:57909:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483a5c7 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.159088:0:57909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626729984:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191341.159163:0:57909:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00000100:00100000:2.0:1787191341.163318:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191341.163413:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634905728 00000100:00100000:3.0:1787191341.163422:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634905728 00000100:00100000:3.0:1787191341.163478:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1390 00000100:00100000:3.0:1787191341.163488:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8422:x1874004634905728:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191341.163506:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003e2b3831/0xe5129dc88483a55e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4605c57 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191341.163785:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191341.163794:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8422:x1874004634905728:12345-192.168.202.101@tcp:104: Request processed in 308us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191341.163801:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1390 00000100:00100000:3.0:1787191341.164807:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626729728:192.168.202.101@tcp:36:bash.0 00000080:00200000:3.0:1787191341.164886:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:3.0:1787191341.164893:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd4:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00010000:00010000:3.0:1787191341.164909:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/212 (0 0) 00000080:00010000:3.0:1787191341.164919:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xd4:0x0](ffff936b5395a1c8) 00000002:00010000:3.0:1787191341.164928:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd4:0x0]) in obj [0x200000405:0xd4:0x0], intent: layout flags 0 00010000:00010000:3.0:1787191341.164970:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a5ce lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.164979:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a5ce lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.164989:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a5ce lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191341.165007:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626730112:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191341.165074:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787191341.165366:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626729856:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191341.165402:0:57909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626729984:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191341.165419:0:57909:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483a5c7 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605dbc expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.165430:0:57909:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483a5c7 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605dbc expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191341.165442:0:57909:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b6a477b80 x1874004626729984/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191341.165452:0:57909:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483a5c7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605dbc expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191341.165464:0:57909:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483a5c7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605dbc expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.165471:0:57909:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/208 (0 0) 00000080:00200000:0.0:1787191341.165476:0:57909:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xd0:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191341.165488:0:57909:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd0:0x0](ffff936b489880c8) for lock 0xe5129dc88483a5c7 00000080:00010000:0.0:1787191341.165494:0:57909:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a5c7 from it ffffa3fb4223bbc8 00010000:00010000:0.0:1787191341.165498:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483a5c7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605dbc expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.165512:0:57909:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483a5c7 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605dbc expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.165529:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483a5c7 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605dbc expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.165538:0:57909:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483a5c7 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605dbc expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1787191341.165546:0:57909:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xd0:0x0](000000009457cdc2) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483a5c7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605dbc expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.165584:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483a5c7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605dbc expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.165592:0:57909:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483a5c7 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605dbc expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191341.165627:0:57909:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd0:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191341.165635:0:57909:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd0:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191341.165638:0:57909:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191341.165643:0:57909:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191341.165665:0:57909:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191341.165682:0:57909:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd0:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:0.0:1787191341.165694:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483a5c7 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605dbc expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.165708:0:57909:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483a5c7 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605dbc expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:0.0:1787191341.165714:0:57909:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xd0:0x0](000000009457cdc2) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483a5c7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605dbc expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191341.165731:0:57909:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd0:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191341.165735:0:57909:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd0:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191341.165737:0:57909:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191341.165739:0:57909:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191341.165758:0:57909:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191341.165764:0:57909:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd0:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:0.0:1787191341.165777:0:57909:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 5 blocks 8 [cma]time: 1787191340 1787191340 0 by oinfo size 5 blocks 8 [cma]time 1787191341 1787191340 1787191340 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001798b3ab/0xe5129dc88483a5b2 lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4605d5a expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000008:00010000:0.0:1787191341.165806:0:57909:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 4096 blocks 8 [cma]time: 1787191341 1787191341 0 by oinfo size 5 blocks 8 [cma]time 1787191341 1787191341 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000eb2ebc95/0xe5129dc88483a588 lrc: 1/0,0 mode: PW/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605cea expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000008:00010000:0.0:1787191341.165820:0:57909:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191341 1787191341 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc88483a596 lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x1c1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605d14 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191341.165906:0:57909:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd0:0x0]: layout version change: 4294967294 -> 6 00010000:00010000:0.0:1787191341.165910:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483a5c7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605dbc expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.165922:0:57909:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150bc00/0xe5129dc88483a5c7 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605dbc expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200008:0.0:1787191341.165955:0:57909:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xd0:0x0](ffff936b489880c8), flags 154002 00000002:00100000:0.0:1787191341.165989:0:57909:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1ed80 x1874004626719360/t8589936937(8589936937) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191341.166000:0:57909:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191341.166005:0:57909:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477b80 x1874004626730368/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191341.166018:0:57909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626730368:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191341.166073:0:57909:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00000100:00100000:3.0:1787191341.169650:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626730112:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191341.169677:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a5ce lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605dc3 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.169688:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a5ce lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605dc3 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191341.169699:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b51d1dc00 x1874004626730112/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191341.169708:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a5ce lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605dc3 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191341.169716:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a5ce lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605dc3 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.169724:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/212 (0 0) 00000080:00200000:3.0:1787191341.169728:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xd4:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1787191341.169742:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd4:0x0](ffff936b5395a1c8) for lock 0xe5129dc88483a5ce 00000080:00010000:3.0:1787191341.169748:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a5ce from it ffffa3fb41cab8c8 00010000:00010000:3.0:1787191341.169751:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a5ce lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605dc3 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.169758:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a5ce lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605dc3 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191341.169777:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a5ce lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605dc3 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191341.169788:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a5ce lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605dc3 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:3.0:1787191341.169795:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xd4:0x0](00000000cdc23562) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a5ce lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605dc3 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191341.169875:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd4:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:3.0:1787191341.169880:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a5ce lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605dc3 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191341.169886:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a5ce lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605dc3 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:3.0:1787191341.169897:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xd4:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:3.0:1787191341.169902:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd4:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191341.169904:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xd4:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:3.0:1787191341.169910:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xd4:0x0](ffff936b5395a1c8) 00000002:00010000:3.0:1787191341.169917:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd4:0x0]) in obj [0x200000405:0xd4:0x0], intent: layout flags 02 00010000:00010000:3.0:1787191341.169927:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a5ce lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4605dc3 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191341.169936:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xd4:0x0]: losing layout lock 00010000:00010000:3.0:1787191341.169956:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a5ce lrc: 1/0,0 mode: --/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605dc3 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191341.169961:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191341.169963:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a5ce lrc: 0/0,0 mode: --/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605dc3 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191341.169978:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a5d5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xd4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.169982:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a5d5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xd4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191341.169989:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:3.0:1787191341.169994:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1dc00 x1874004626730624/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191341.170002:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a5d5 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xd4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191341.170015:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626730624:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191341.170090:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787191341.170272:0:57909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626730368:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191341.170287:0:57909:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1ed80 x1874004626719360/t8589936937(8589936937) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191356 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191341.170321:0:57909:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd0:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191341.170327:0:57909:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd0:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191341.170330:0:57909:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191341.170333:0:57909:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191341.170341:0:57909:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191341.170355:0:57909:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd0:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191341.170359:0:57909:0:(llite_lib.c:2066:ll_clear_inode()) VFS Op:inode=[0x200000405:0xd0:0x0](ffff936b489880c8) 00000080:00200000:0.0:1787191341.170475:0:57909:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191341.170484:0:57909:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.170490:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.170497:0:57909:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.170502:0:57909:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191341.170505:0:57909:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191341.170508:0:57909:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191341.170511:0:57909:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4223bbf8 00010000:00010000:0.0:1787191341.170513:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.170518:0:57909:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.170524:0:57909:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.170529:0:57909:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191341.170533:0:57909:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.170542:0:57909:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b52231800, open_flags d900, mode 0 opened 0 00000080:00200000:0.0:1787191341.170546:0:57909:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:0.0:1787191341.170558:0:57909:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:0.0:1787191341.170580:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a5dc lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.170585:0:57909:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a5dc lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191341.170590:0:57909:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191341.170593:0:57909:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477b80 x1874004626730880/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191341.170989:0:57909:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a5dc lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.171005:0:57909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626730880:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191341.171169:0:57909:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00010000:00010000:1.0:1787191341.172426:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191341.172436:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003e2b3831/0xe5129dc88483a55e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4605c57 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191341.172448:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b4150a800 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191341.172455:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003e2b3831/0xe5129dc88483a55e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4605c57 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191341.172548:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003e2b3831/0xe5129dc88483a55e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4605c57 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191341.172554:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191341.172577:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003e2b3831/0xe5129dc88483a55e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4605c57 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191341.172582:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003e2b3831/0xe5129dc88483a55e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4605c57 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191341.172594:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191341.172596:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191341.172597:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191341.172692:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626731008:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191341.174551:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626731008:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191341.178179:0:57909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626730880:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191341.178198:0:57909:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a5dc lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.178208:0:57909:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a5dc lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.178213:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a5dc lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.178217:0:57909:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a5dc lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.178223:0:57909:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a5dc lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.178227:0:57909:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cae400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191341.178231:0:57909:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a5dc lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.178235:0:57909:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a5dc lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.178240:0:57909:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a5dc lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.178245:0:57909:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191341.178249:0:57909:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a5dc lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.178253:0:57909:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae400/0xe5129dc88483a5dc lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191341.178269:0:57909:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b6a477b80 x1874004626730880/t8589936963(8589936963) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191341.178278:0:57909:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477b80 x1874004626730880/t8589936963(8589936963) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191341.178290:0:57909:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191341.178329:0:57909:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd4:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191341.178336:0:57909:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd4:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191341.178339:0:57909:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191341.178343:0:57909:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191341.178351:0:57909:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191341.178367:0:57909:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191341.178446:0:57909:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xd4:0x0](ffff936b5395a1c8): rc = 0 00000080:00010000:0.0:1787191341.178452:0:57909:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd4:0x0](ffff936b5395a1c8) for lock 0x0 00000080:00200008:0.0:1787191341.178474:0:57909:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xd4:0x0](ffff936b5395a1c8), flags 154400 00000002:00100000:0.0:1787191341.178491:0:57909:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477b80 x1874004626730880/t8589936963(8589936963) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191341.178541:0:57909:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd4:0x0](ffff936b5395a1c8), inode mode 81a4 mask 44 00000080:00200000:0.0:1787191341.178593:0:57909:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd4:0x0](ffff936b5395a1c8), inode mode 81a4 mask 4 00000080:00200000:0.0:1787191341.178597:0:57909:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xd4:0x0](ffff936b5395a1c8), xattr lov 00000080:00200008:0.0:1787191341.178616:0:57909:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xd4:0x0](ffff936b5395a1c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191341.178620:0:57909:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xd4:0x0](ffff936b5395a1c8),name=f70.sanity-flr 00000002:00010000:0.0:1787191341.178630:0:57909:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd4:0x0]) in obj [0x200000405:0xd4:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.178638:0:57909:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 30 res 8589935621/212 (0 0) 00010000:00010000:0.0:1787191341.178667:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a5e3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.178672:0:57909:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a5e3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.178679:0:57909:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a5e3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.178693:0:57909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626731136:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191341.178757:0:57909:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00000100:00100000:2.0:1787191341.183544:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191341.183605:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191341.183639:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634906496 00000100:00100000:2.0:1787191341.183647:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634906496 00000100:00100000:2.0:1787191341.183688:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634906624 00000100:00100000:2.0:1787191341.183691:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634906624 00000100:00100000:2.0:1787191341.183707:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1391 00000100:00100000:2.0:1787191341.183715:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+5:8720:x1874004634906496:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191341.183733:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc88483a596 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4605d14 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1787191341.185115:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1392 00000100:00100000:3.0:1787191341.185133:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+5:37089:x1874004634906624:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191341.185146:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001798b3ab/0xe5129dc88483a5b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000030000 nid: local remote: 0x7130d520e4605d5a expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.185241:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787191341.185249:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+5:8720:x1874004634906496:12345-192.168.202.101@tcp:104: Request processed in 1534us (1716us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191341.185256:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1391 00010000:00010000:1.0:1787191341.185642:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787191341.185652:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc88483a596 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4605d14 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.185662:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9b600 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191341.185668:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc88483a596 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e4605d14 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.185716:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc88483a596 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4605d14 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.185724:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787191341.185782:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626731264:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787191341.185897:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc88483a596 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4605d14 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.185907:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000064ececf4/0xe5129dc88483a596 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4605d14 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.185928:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191341.185932:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001798b3ab/0xe5129dc88483a5b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000030000 nid: local remote: 0x7130d520e4605d5a expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.185939:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b4150b800 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191341.185942:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001798b3ab/0xe5129dc88483a5b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428400030000 nid: local remote: 0x7130d520e4605d5a expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.185964:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001798b3ab/0xe5129dc88483a5b2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e4605d5a expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.186240:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191341.186275:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191341.186311:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1787191341.186319:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:37089:x1874004634906624:12345-192.168.202.101@tcp:104: Request processed in 1193us (2713us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191341.186326:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1392 00000100:00100000:3.0:1787191341.186486:0:57570:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589936962 gen 1 00000100:00100000:3.0:1787191341.186505:0:57570:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff936b6a477b80 x1874004626730880/t8589936963(8589936963) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787191341.186593:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626730624:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191341.186611:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a5d5 lrc: 4/0,1 mode: --/EX res: [0x200000405:0xd4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605dd8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.186621:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a5d5 lrc: 4/0,1 mode: --/CR res: [0x200000405:0xd4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605dd8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.186637:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a5d5 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xd4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605dd8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.186648:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a5d5 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xd4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605dd8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.186659:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a5d5 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xd4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605dd8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.186667:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a5d5 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xd4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605dd8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.186674:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a5d5 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xd4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605dd8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191341.186683:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b51d1dc00 x1874004626730624/t8589936962(8589936962) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191341.186699:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a5d5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605dd8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191341.186709:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a5d5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605dd8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.186720:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/212 (0 0) 00000080:00200000:3.0:1787191341.186726:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xd4:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1787191341.186737:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd4:0x0](ffff936b5395a1c8) for lock 0xe5129dc88483a5d5 00000080:00010000:3.0:1787191341.186746:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a5d5 from it ffffa3fb41cab930 00010000:00010000:3.0:1787191341.186749:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a5d5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605dd8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.186757:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a5d5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605dd8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191341.186773:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:3.0:1787191341.186779:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd4:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:3.0:1787191341.186792:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a5d5 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd4:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605dd8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191341.186802:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a5d5 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605dd8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:3.0:1787191341.186810:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xd4:0x0](00000000cdc23562) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a5d5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605dd8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191341.186882:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd4:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:3.0:1787191341.186888:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a5d5 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605dd8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191341.186895:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a5d5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605dd8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:3.0:1787191341.186909:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xd4:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:3.0:1787191341.186914:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd4:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191341.186917:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191341.186925:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191341.186941:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1787191341.186944:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:3.0:1787191341.186956:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:3.0:1787191341.186960:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b5235cf30, osc lock ffff936b44f64980, flags 0x80000000 00000008:00010000:3.0:1787191341.186964:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:3.0:1787191341.186965:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b5235cf70, osc lock ffff936b44f65690, flags 0x80000000 00010000:00010000:3.0:1787191341.186998:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a5ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.187007:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a5ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.187015:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a5ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191341.187042:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626731520:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191341.187078:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191341.187579:0:57909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626731136:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191341.187588:0:57909:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a5e3 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605e17 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.187595:0:57909:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a5e3 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605e17 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.187608:0:57909:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a5e3 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605e17 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.187616:0:57909:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a5e3 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605e17 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.187624:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a5e3 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605e17 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.187637:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a5e3 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605e17 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.187645:0:57909:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a5e3 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605e17 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191341.187654:0:57909:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b6a477480 x1874004626731136/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/976 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191341.187663:0:57909:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a5e3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605e17 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.187668:0:57909:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/212 (0 0) 00000080:00200000:2.0:1787191341.187673:0:57909:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xd4:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1787191341.187701:0:57909:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd4:0x0](ffff936b5395a1c8) for lock 0xe5129dc88483a5e3 00000080:00010000:2.0:1787191341.187704:0:57909:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd4:0x0](ffff936b5395a1c8) 00000080:00010000:2.0:1787191341.187707:0:57909:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a5e3 from it ffffa3fb4223bcd8 00010000:00010000:2.0:1787191341.187709:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a5e3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605e17 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.187714:0:57909:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a5e3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605e17 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191341.187732:0:57909:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd4:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:2.0:1787191341.187736:0:57909:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd4:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191341.187738:0:57909:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191341.187740:0:57909:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xd4:0x0] 00000008:00010000:2.0:1787191341.187749:0:57909:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191341.187751:0:57909:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1530, osc lock ffff936b44e638f0, flags 0x400000400001002 00010000:00010000:2.0:1787191341.187756:0:57909:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b52377800 type 11 mode 6 res 10737419265/452 (0 1048575) 00010000:00010000:2.0:1787191341.187770:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba600a4c/0xe5129dc88483a5f1 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.187778:0:57909:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba600a4c/0xe5129dc88483a5f1 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.187787:0:57909:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b513b9880 x1874004626731648/t0(0) o101->lustre-OST0000-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:2.0:1787191341.187815:0:57909:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:2.0:1787191341.187825:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787191341.187846:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626731648:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191341.188009:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00010000:00010000:1.0:1787191341.188103:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001798b3ab/0xe5129dc88483a5b2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e4605d5a expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.188112:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001798b3ab/0xe5129dc88483a5b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e4605d5a expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.188138:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191341.188140:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191341.188141:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191341.188154:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626731392:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191341.188486:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191341.188789:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634907264 00000100:00100000:3.0:1787191341.188796:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634907264 00000100:00100000:3.0:1787191341.188888:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634907392 00000100:00100000:3.0:1787191341.188892:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634907392 00000100:00100000:2.0:1787191341.188931:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1393 00000100:00100000:2.0:1787191341.188941:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+5:8419:x1874004634907264:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191341.188952:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000eb2ebc95/0xe5129dc88483a588 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4605cea expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.189204:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191341.189211:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+5:8419:x1874004634907264:12345-192.168.202.101@tcp:104: Request processed in 273us (1202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191341.189218:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1393 00000100:00100000:2.0:1787191341.189237:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1394 00000100:00100000:2.0:1787191341.189243:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8420:x1874004634907392:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191341.189254:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000be88ce23/0xe5129dc88483a4e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4605b07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.189410:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787191341.189417:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000eb2ebc95/0xe5129dc88483a588 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4605cea expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.189425:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9a400 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191341.189430:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000eb2ebc95/0xe5129dc88483a588 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e4605cea expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.189466:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000eb2ebc95/0xe5129dc88483a588 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4605cea expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.189474:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191341.189500:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000eb2ebc95/0xe5129dc88483a588 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4605cea expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.189507:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000eb2ebc95/0xe5129dc88483a588 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4605cea expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.189523:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191341.189526:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000be88ce23/0xe5129dc88483a4e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4605b07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.189538:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40031800 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191341.189542:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000be88ce23/0xe5129dc88483a4e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4605b07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.189560:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000be88ce23/0xe5129dc88483a4e7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4605b07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.189567:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191341.189572:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000be88ce23/0xe5129dc88483a4e7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4605b07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.189579:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000be88ce23/0xe5129dc88483a4e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4605b07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.189591:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191341.189593:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191341.189595:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191341.189693:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626731776:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191341.189733:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787191341.189739:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626731904:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787191341.189882:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1787191341.189889:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8420:x1874004634907392:12345-192.168.202.101@tcp:104: Request processed in 647us (1404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191341.189896:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1394 00010000:00010000:0.0:1787191341.190324:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191341.193541:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191341.193644:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634907520 00000100:00100000:2.0:1787191341.193651:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634907520 00000100:00100000:2.0:1787191341.193692:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1395 00000100:00100000:2.0:1787191341.193700:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30510:x1874004634907520:12345-192.168.202.101@tcp:106: 00010000:00010000:2.0:1787191341.193713:0:51131:0:(ldlm_lockd.c:2541:ldlm_callback_handler()) ### glimpse ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a5ea lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.193723:0:51131:0:(ldlm_lockd.c:2123:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a5ea lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00010000:2.0:1787191341.193747:0:51131:0:(cl_object.c:322:cl_object_glimpse()) header@0000000017a04194[0x110, 1, [0x200000405:0xd4:0x0] hash] 00000020:00010000:2.0:1787191341.193750:0:51131:0:(cl_object.c:322:cl_object_glimpse()) size: 0 mtime: 1787191341 atime: 1787191341 ctime: 1787191341 blocks: 0 00000020:00010000:2.0:1787191341.193754:0:51131:0:(cl_object.c:322:cl_object_glimpse()) header@0000000049960bce[0x110, 2, [0x280000401:0x1c4:0x0] hash] 00000020:00010000:2.0:1787191341.193756:0:51131:0:(cl_object.c:322:cl_object_glimpse()) size: 0 mtime: 1787191341 atime: 1787191341 ctime: 1787191341 blocks: 0 00000100:00100000:2.0:1787191341.193824:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30510:x1874004634907520:12345-192.168.202.101@tcp:106: Request processed in 124us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191341.193858:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1395 00000100:00100000:0.0:1787191341.194125:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626731520:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191341.194144:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a5ea lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605e2c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.194160:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a5ea lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4605e2c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.194179:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a5ea lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4605e2c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.194193:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a5ea lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4605e2c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191341.194204:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a5ea lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4605e2c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.194212:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a5ea lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4605e2c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.194217:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a5ea lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4605e2c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.194271:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a5f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.194277:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a5f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.194283:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a5f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.194298:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626732032:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191341.194345:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191341.194524:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626731904:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191341.194538:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626731776:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191341.194548:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626731264:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191341.194632:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626731392:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787191341.196208:0:2391:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba600a4c/0xe5129dc88483a5f1 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.196226:0:2391:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba600a4c/0xe5129dc88483a5f1 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.196238:0:2391:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba600a4c/0xe5129dc88483a5f1 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.196246:0:2391:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba600a4c/0xe5129dc88483a5f1 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.196253:0:2391:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba600a4c/0xe5129dc88483a5f1 lrc: 5/1,0 mode: --/PR res: [0x280000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191341.196264:0:2391:0:(osc_lock.c:187:osc_lock_lvb_update()) ### no dlm lock: acquired size 0, setting rss=0; leaving kms=0, end=18446744073709551615 00000020:00200000:3.0:1787191341.196270:0:2391:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000100:00100000:0.0:1787191341.196325:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626732032:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191341.196338:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a5f8 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605e3a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.196348:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a5f8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4605e3a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.196356:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a5f8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4605e3a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.196363:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a5f8 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4605e3a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191341.196369:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a5f8 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4605e3a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.196376:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a5f8 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4605e3a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.196380:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a5f8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4605e3a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191341.196463:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626732160:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191341.196632:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1787191341.196637:0:2391:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba600a4c/0xe5129dc88483a5f1 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191341.196641:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626732288:192.168.202.101@tcp:10:bash.0 00010000:00010000:3.0:1787191341.196651:0:2391:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba600a4c/0xe5129dc88483a5f1 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.196665:0:2391:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba600a4c/0xe5129dc88483a5f1 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.196672:0:2391:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51185e00 already unused, calling callback (ffffffffc1208790) 00000080:00200000:2.0:1787191341.197023:0:57909:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd4:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191341.197040:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b516544a0 (ffff936b465cc008/0) at cl_lock_release():245 00000020:00010000:2.0:1787191341.197044:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b516544a0 (ffff936b465cc008/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191341.197049:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1530 (ffff936b465cccf8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191341.197052:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b516544a0 (ffff936b465cc008/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191341.197055:0:57909:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1530 (ffff936b465cc008/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191341.197068:0:57909:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd4:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:3.0:1787191341.197127:0:2391:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba600a4c/0xe5129dc88483a5f1 lrc: 5/0,0 mode: --/PR res: [0x280000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.197140:0:2391:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191341.197146:0:2391:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba600a4c/0xe5129dc88483a5f1 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.197155:0:2391:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000ba600a4c/0xe5129dc88483a5f1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 57909 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191341.197171:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626731648:192.168.202.101@tcp:101:lfs.0 00000080:00200008:2.0:1787191341.197929:0:57909:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xd4:0x0](ffff936b5395a1c8), flags 154000 00000002:00100000:2.0:1787191341.197988:0:57909:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a477b80 x1874004626730880/t8589936963(8589936963) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191341.197999:0:57909:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191341.198005:0:57909:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb100 x1874004626732544/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191341.198023:0:57909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626732544:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191341.198145:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626732160:192.168.202.101@tcp:10:bash.0 00000100:00100000:2.0:1787191341.198260:0:57909:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191341.199772:0:57909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626732544:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191341.199802:0:57909:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a477b80 x1874004626730880/t8589936963(8589936963) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191341.200063:0:57909:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191341.200084:0:57909:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.200099:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.200110:0:57909:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.200115:0:57909:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191341.200120:0:57909:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191341.200123:0:57909:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191341.200129:0:57909:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4223bbf8 00010000:00010000:0.0:1787191341.200132:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.200137:0:57909:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.200149:0:57909:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.200154:0:57909:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191341.200158:0:57909:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.200172:0:57909:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b52230000, open_flags d902, mode 0 opened 0 00000080:00200000:0.0:1787191341.200177:0:57909:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:0.0:1787191341.200188:0:57909:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154403 00010000:00010000:0.0:1787191341.200600:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a5ff lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.200608:0:57909:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a5ff lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191341.200619:0:57909:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191341.200626:0:57909:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477b80 x1874004626732800/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191341.200634:0:57909:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a5ff lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.200665:0:57909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626732800:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191341.200873:0:57909:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191341.201047:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626732288:192.168.202.101@tcp:10:bash.0 00000080:00200000:3.0:1787191341.201196:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd4:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1787191341.201203:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b53cc5c68 (ffff936b47a17a28/0) at cl_lock_release():245 00000020:00010000:3.0:1787191341.201206:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b53cc5c68 (ffff936b47a17a28/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191341.201210:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b5235cf30 (ffff936b465cc488/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191341.201218:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a5ea lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4605e2c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.201230:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a5ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4605e2c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1787191341.201243:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b5235cf70 (ffff936b465cce18/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191341.201248:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a5f8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4605e3a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.201256:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a5f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4605e3a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1787191341.201265:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b53cc5c68 (ffff936b47a17a28/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191341.201267:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b5235cf30 (ffff936b47a17a28/1) at cl_lock_fini():72 00000020:00010000:3.0:1787191341.201272:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b5235cf70 (ffff936b47a17a28/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191341.201289:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd4:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191341.201300:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xd4:0x0](ffff936b5395a1c8) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191341.000000000, mtime 1787191341.000000000, ctime 1787191341.000000000, rc 0 00000080:00200008:3.0:1787191341.201393:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xd4:0x0], ppos: 0, count: 5 00000080:00200000:3.0:1787191341.201473:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:3.0:1787191341.201479:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:3.0:1787191341.201484:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:3.0:1787191341.201488:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:3.0:1787191341.201493:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@0000000017a04194[0x110, 1, [0x200000405:0xd4:0x0] hash] 00000020:00200000:3.0:1787191341.201495:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:3.0:1787191341.201499:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd4:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:3.0:1787191341.201510:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xd4:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:3.0:1787191341.201514:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd4:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191341.201516:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:3.0:1787191341.201520:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1787191341.201526:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:3.0:1787191341.201529:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1787191341.201544:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:3.0:1787191341.201555:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:3.0:1787191341.201560:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667b30, osc lock ffff936b44f65690, flags 0x0 00010000:00010000:3.0:1787191341.201574:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a5ea lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4605e2c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191341.201586:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a5ea lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4605e2c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191341.201599:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a5ea lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4605e2c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191341.201606:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a5ea lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4605e2c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191341.201617:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a5ea lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4605e2c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191341.201628:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:3.0:1787191341.201636:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:3.0:1787191341.201677:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:3.0:1787191341.201685:0:57570:0:(rw26.c:927:ll_write_end()) page@00000000d0ae3f61[3 000000000e6d7102 2 1 00000000928f8980 0 0 0] 00000080:00200000:3.0:1787191341.201688:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @00000000eacb27d0 17ffffc0001001 3:0 ffff936b50842700 0 lru 00000080:00200000:3.0:1787191341.201696:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@00000000e50f37f8 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000a2a44f55 00000000a48fd6f2 > 3< 0 0 > 4< 0 0 8 403689472 - | - - - - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1787191341.201698:0:57570:0:(rw26.c:927:ll_write_end()) end page@00000000d0ae3f61 00000080:00200000:3.0:1787191341.201699:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1787191341.201704:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:3.0:1787191341.201722:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 00000000e2685b31 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a5ea lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4605e2c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191341.201740:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b5395a378, count 1, dirtied 1 00000080:00200000:3.0:1787191341.201744:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:3.0:1787191341.201746:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:3.0:1787191341.201760:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b53cc5c68 (ffff936b47a17a28/0) at cl_lock_release():245 00000020:00010000:3.0:1787191341.201763:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b53cc5c68 (ffff936b47a17a28/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191341.201765:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667b30 (ffff936b465cce18/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191341.201769:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a5ea lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4605e2c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191341.201777:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a5ea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4605e2c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:3.0:1787191341.201793:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b53cc5c68 (ffff936b47a17a28/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191341.201796:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667b30 (ffff936b47a17a28/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191341.201801:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:3.0:1787191341.201805:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1787191341.201810:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd4:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191341.201813:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:3.0:1787191341.201819:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd4:0x0] updating i_size 5 i_blocks 0 00000080:00200000:3.0:1787191341.201822:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:3.0:1787191341.201961:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xd4:0x0](ffff936b5395a1c8), flags 100001 00000002:00100000:3.0:1787191341.202010:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1f480 x1874004626728960/t8589936957(8589936957) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191341.202021:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:3.0:1787191341.202037:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1d180 x1874004626733056/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191341.202056:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626733056:192.168.202.101@tcp:35:bash.0 00010000:00010000:2.0:1787191341.202208:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191341.202652:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787191341.202803:0:57909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626732800:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191341.202820:0:57909:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a5ff lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605e56 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.203023:0:57909:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a5ff lrc: 4/1,0 mode: --/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605e56 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.203044:0:57909:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a5ff lrc: 4/1,0 mode: --/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605e56 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.203056:0:57909:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a5ff lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605e56 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.203072:0:57909:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a5ff lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605e56 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.203084:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a5ff lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605e56 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.203092:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a5ff lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605e56 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.203098:0:57909:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a5ff lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605e56 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191341.203108:0:57909:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b6a477b80 x1874004626732800/t8589936965(8589936965) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191341.203119:0:57909:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477b80 x1874004626732800/t8589936965(8589936965) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191341.203130:0:57909:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a5ff lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605e56 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191341.203141:0:57909:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a5ff lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605e56 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.203149:0:57909:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/212 (0 0) 00000080:00200000:0.0:1787191341.203155:0:57909:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191341.203197:0:57909:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xd4:0x0](ffff936b5395a1c8): rc = 0 00000080:00200000:0.0:1787191341.203212:0:57909:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd4:0x0]: layout version change: 4 -> 4 00000080:00010000:0.0:1787191341.203217:0:57909:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd4:0x0](ffff936b5395a1c8) for lock 0xe5129dc88483a5ff 00000080:00010000:0.0:1787191341.203233:0:57909:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd4:0x0](ffff936b5395a1c8) 00000080:00200008:0.0:1787191341.203245:0:57909:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xd4:0x0](ffff936b5395a1c8), flags 154402 00000002:00100000:0.0:1787191341.203265:0:57909:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477b80 x1874004626732800/t8589936965(8589936965) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191341.203333:0:57909:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a5ff from it ffff936b530f5000 00010000:00010000:0.0:1787191341.203338:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a5ff lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605e56 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.203346:0:57909:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a5ff lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605e56 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191341.203365:0:57909:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd4:0x0](ffff936b5395a1c8), inode mode 81a4 mask 46 00000080:00200080:0.0:1787191341.203415:0:57909:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xd4:0x0](ffff936b5395a1c8) cmd=800466af arg=7ffc02eca41c 00000080:00200080:0.0:1787191341.203431:0:57909:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xd4:0x0](ffff936b5395a1c8) cmd=80086601 arg=7ffc02eca3b8 00000100:00100000:0.0:1787191341.203463:0:57909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626733184:192.168.202.101@tcp:33:lfs.0 00000100:00100000:0.0:1787191341.203518:0:57909:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191341.204175:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626733056:192.168.202.101@tcp:35:bash.0 00000002:00100000:3.0:1787191341.204195:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1f480 x1874004626728960/t8589936957(8589936957) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787191341.207252:0:57909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626733184:192.168.202.101@tcp:33:lfs.0 00000080:00200080:1.0:1787191341.207292:0:57909:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xd4:0x0](ffff936b5395a1c8) cmd=c00c66f3 arg=7ffc02eca3a4 00000002:00010000:1.0:1787191341.207318:0:57909:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd4:0x0]) in obj [0x200000405:0xd4:0x0], intent: open flags 01004040000002 00010000:00010000:1.0:1787191341.207374:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a606 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x10000000000000 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.207384:0:57909:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a606 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x0 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191341.207396:0:57909:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191341.207475:0:57909:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453aa680 x1874004626733440/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191341.207486:0:57909:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a606 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x81000000000000 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191341.207505:0:57909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626733440:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191341.207718:0:57909:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893d80 going to sleep for 11 seconds 00000080:00200000:0.0:1787191341.208339:0:57914:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191341.208358:0:57914:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.208370:0:57914:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.208382:0:57914:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.208390:0:57914:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191341.208395:0:57914:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191341.208399:0:57914:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191341.208407:0:57914:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42253b58 00010000:00010000:0.0:1787191341.208412:0:57914:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.208420:0:57914:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.208433:0:57914:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.208439:0:57914:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:0.0:1787191341.208444:0:57914:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.208448:0:57914:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=8 00000080:00200008:0.0:1787191341.208454:0:57914:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xd4:0x0](ffff936b5395a1c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191341.208459:0:57914:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xd4:0x0](ffff936b5395a1c8),name=f70.sanity-flr 00000002:00010000:0.0:1787191341.208471:0:57914:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd4:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.208478:0:57914:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a5e3 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605e17 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.208485:0:57914:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a5e3 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605e17 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191341.208491:0:57914:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191341.208495:0:57914:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd4:0x0](ffff936b5395a1c8) 00000080:00010000:0.0:1787191341.208497:0:57914:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd4:0x0](ffff936b5395a1c8) for lock 0xe5129dc88483a5e3 00000080:00010000:0.0:1787191341.208501:0:57914:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a5e3 from it ffffa3fb42253cb8 00010000:00010000:0.0:1787191341.208503:0:57914:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a5e3 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605e17 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.208515:0:57914:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a5e3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605e17 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191341.208534:0:57914:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd4:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1787191341.208547:0:57914:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd4:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191341.208551:0:57914:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191341.208554:0:57914:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xd4:0x0] 00000008:00010000:0.0:1787191341.208572:0:57914:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191341.208576:0:57914:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee67b0, osc lock ffff936b50b63b50, flags 0x400000400001002 00010000:00010000:0.0:1787191341.208592:0:57914:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a5ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4605e2c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.208604:0:57914:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a5ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4605e2c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:0.0:1787191341.208616:0:57914:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191341.208620:0:57914:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a5ea lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4605e2c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.208628:0:57914:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a5ea lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4605e2c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:0.0:1787191341.208638:0:57914:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191341.208647:0:57914:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd4:0x0] updating i_size 5 i_blocks 0 00000020:00010000:0.0:1787191341.208654:0:57914:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509ba500 (ffff936b47a17ab8/0) at cl_lock_release():245 00000020:00010000:0.0:1787191341.208658:0:57914:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509ba500 (ffff936b47a17ab8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191341.208661:0:57914:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee67b0 (ffff936b47a17b48/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191341.208665:0:57914:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509ba500 (ffff936b47a17ab8/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191341.208667:0:57914:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee67b0 (ffff936b47a17ab8/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191341.208679:0:57914:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd4:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191341.208701:0:57914:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191341.208709:0:57914:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.208715:0:57914:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.208724:0:57914:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.208730:0:57914:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191341.208734:0:57914:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191341.208737:0:57914:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191341.208741:0:57914:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42253c10 00010000:00010000:0.0:1787191341.208744:0:57914:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.208751:0:57914:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.208760:0:57914:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.208764:0:57914:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:0.0:1787191341.208768:0:57914:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.208773:0:57914:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:0.0:1787191341.208777:0:57914:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:0.0:1787191341.208782:0:57914:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:0.0:1787191341.208805:0:57914:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a5d5 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd4:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4605dd8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191341.208819:0:57914:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xd4:0x0]: losing layout lock 00000100:00100000:1.0:1787191341.210414:0:57909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626733440:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191341.211060:0:57914:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a5ff lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4605e56 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.211060:0:57909:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a606 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4605e6b expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.211075:0:57909:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a606 lrc: 4/1,0 mode: --/PW res: [0x200000405:0xd4:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4605e6b expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.211085:0:57909:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a606 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0xd4:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4605e6b expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1787191341.211086:0:57914:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xd4:0x0]: losing layout lock 00010000:00010000:1.0:1787191341.211100:0:57909:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a606 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0xd4:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4605e6b expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.211104:0:57914:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a5e3 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4605e17 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.211113:0:57914:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc88483a5c0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4605d92 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.211170:0:57914:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a5d5 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xd4:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605dd8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.211178:0:57914:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a5ff lrc: 1/0,0 mode: --/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605e56 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.211181:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a606 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0xd4:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4605e6b expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.211192:0:57914:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a5e3 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4605e17 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191341.211192:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a606 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0xd4:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4605e6b expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.211200:0:57909:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a606 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0xd4:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4605e6b expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.211207:0:57914:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc88483a5c0 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4605d92 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.211212:0:57914:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 4 locks packed 00000002:00100000:1.0:1787191341.211214:0:57909:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x600002b, status=0 req@ffff936b453aa680 x1874004626733440/t8589936967(8589936967) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1787191341.211215:0:57914:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a5d5 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xd4:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605dd8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000002:00100000:1.0:1787191341.211227:0:57909:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453aa680 x1874004626733440/t8589936967(8589936967) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1787191341.211234:0:57914:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a5ff lrc: 0/0,0 mode: --/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605e56 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000002:00010000:1.0:1787191341.211240:0:57909:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a606 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xd4:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4605e6b expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.211244:0:57914:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a5e3 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4605e17 expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191341.211248:0:57909:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 2 res 8589935621/212 (0 0) 00010000:00010000:0.0:1787191341.211251:0:57914:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4150b400/0xe5129dc88483a5c0 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xd4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4605d92 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191341.211254:0:57909:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xd4:0x0] suppgids 0 0: rc 0 00000020:00100000:0.0:1787191341.211269:0:57914:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000002:00100000:1.0:1787191341.211272:0:57909:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453aa680 x1874004626733440/t8589936967(8589936967) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787191341.211275:0:57914:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a476680 x1874004626733696/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 512/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000080:00010000:1.0:1787191341.211281:0:57909:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd4:0x0](ffff936b5395a1c8) for lock 0xe5129dc88483a606 00000080:00010000:1.0:1787191341.211287:0:57909:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a606 from it ffffa3fb4223bcc0 00010000:00010000:1.0:1787191341.211291:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a606 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xd4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4605e6b expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.211297:0:57914:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476680 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57914:1874004626733696:192.168.202.101@tcp:36:rm.0 00010000:00010000:1.0:1787191341.211297:0:57909:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a606 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0xd4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4605e6b expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00200080:1.0:1787191341.211362:0:57909:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xd4:0x0](ffff936b5395a1c8) cmd=c00c66f3 arg=2240500 00010000:00010000:1.0:1787191341.211407:0:57909:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a606 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0xd4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x81008000000000 nid: local remote: 0x7130d520e4605e6b expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.211419:0:57909:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a606 lrc: 0/0,0 mode: --/PW res: [0x200000405:0xd4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x85809400000000 nid: local remote: 0x7130d520e4605e6b expref: -99 pid: 57909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.211435:0:57914:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99840 going to sleep for 11 seconds 00000002:00100000:1.0:1787191341.211437:0:57909:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453aa680 x1874004626733440/t8589936967(8589936967) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191341.211445:0:57909:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:1.0:1787191341.211448:0:57909:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453abb80 x1874004626733952/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191341.211461:0:57909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626733952:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191341.211485:0:57909:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787191341.216457:0:57909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626733952:192.168.202.101@tcp:35:lfs.0 00000080:00020000:1.0:1787191341.216478:0:57909:0:(file.c:251:ll_close_inode_openhandle()) lustre-clilmv-ffff936b581fb000: inode [0x200000405:0xd4:0x0] mdc close failed: rc = -1 00000002:00100000:1.0:1787191341.216496:0:57909:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453aa680 x1874004626733440/t8589936967(8589936967) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191341.216531:0:57909:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xd4:0x0](ffff936b5395a1c8) 00000002:00010000:1.0:1787191341.216543:0:57909:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd4:0x0]) in obj [0x200000405:0xd4:0x0], intent: layout flags 0 00010000:00010000:1.0:1787191341.216595:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a60d lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.216617:0:57909:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a60d lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.216628:0:57909:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a60d lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57909 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191341.216647:0:57909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626734080:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191341.216721:0:57909:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787191341.218366:0:57914:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476680 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57914:1874004626733696:192.168.202.101@tcp:36:rm.0 00000100:00100000:1.0:1787191341.219539:0:57909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626734080:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191341.219560:0:57909:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a60d lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605e95 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.219574:0:57909:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a60d lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605e95 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191341.219587:0:57909:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b453aa680 x1874004626734080/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191341.219597:0:57909:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a60d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605e95 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191341.219672:0:57909:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a60d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605e95 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.219682:0:57909:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/212 (0 0) 00000080:00200000:1.0:1787191341.219687:0:57909:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xd4:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191341.219702:0:57909:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd4:0x0](ffff936b5395a1c8) for lock 0xe5129dc88483a60d 00000080:00010000:1.0:1787191341.219709:0:57909:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a60d from it ffffa3fb4223bbc8 00010000:00010000:1.0:1787191341.219713:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a60d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605e95 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.219721:0:57909:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a60d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605e95 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.219744:0:57909:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a60d lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605e95 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.219755:0:57909:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a60d lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605e95 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:1.0:1787191341.219763:0:57909:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xd4:0x0](00000000cdc23562) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a60d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605e95 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191341.219801:0:57909:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd4:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:1.0:1787191341.219805:0:57909:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a60d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605e95 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.219812:0:57909:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031e00/0xe5129dc88483a60d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605e95 expref: -99 pid: 57909 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200008:1.0:1787191341.219958:0:57909:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xd4:0x0](ffff936b5395a1c8), flags 154002 00000002:00100000:1.0:1787191341.219993:0:57909:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a477b80 x1874004626732800/t8589936965(8589936965) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191341.220004:0:57909:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191341.220010:0:57909:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453aa680 x1874004626734336/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191341.220044:0:57909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626734336:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191341.220211:0:57909:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787191341.223681:0:57909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57909:1874004626734336:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191341.223717:0:57909:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a477b80 x1874004626732800/t8589936965(8589936965) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191341.223765:0:57909:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd4:0x0] ignore/verify layout 1/0, layout version 5 restore needed 0 00020000:00200000:1.0:1787191341.223777:0:57909:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd4:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191341.223780:0:57909:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191341.223785:0:57909:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191341.223794:0:57909:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000008:00010000:1.0:1787191341.223812:0:57909:0:(osc_cache.c:1183:osc_extent_make_ready()) ### extent: 00000000e2685b31 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a5ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4605e2c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1787191341.223865:0:57909:0:(osc_cache.c:917:osc_extent_finish()) ### extent: 00000000e2685b31 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a5ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4605e2c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1787191341.223889:0:57909:0:(osc_cache.c:497:__osc_extent_remove()) ### extent: 00000000e2685b31 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a5ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4605e2c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191341.223910:0:57909:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191341.223959:0:57909:0:(llite_lib.c:2066:ll_clear_inode()) VFS Op:inode=[0x200000405:0xd4:0x0](ffff936b5395a1c8) 00000008:00010000:1.0:1787191341.223989:0:57909:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 5 blocks 0 [cma]time 1787191341 1787191341 1787191341 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a5ea lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4605e2c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1787191341.224017:0:57909:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191341 1787191341 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a5f8 lrc: 1/0,0 mode: PW/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4605e3a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191341.234541:0:57916:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191341.234574:0:57916:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191341.234592:0:57916:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191341.234609:0:57916:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191341.234618:0:57916:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191341.234627:0:57916:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191341.234630:0:57916:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191341.234637:0:57916:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42263bf8 00010000:00010000:2.0:1787191341.234641:0:57916:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191341.234650:0:57916:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191341.234668:0:57916:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191341.234676:0:57916:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191341.234681:0:57916:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191341.234693:0:57916:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b52619200, open_flags d900, mode 0 opened 0 00000080:00200000:2.0:1787191341.234699:0:57916:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:2.0:1787191341.234715:0:57916:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:2.0:1787191341.234767:0:57916:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a614 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.234776:0:57916:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a614 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57916 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191341.234789:0:57916:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191341.234801:0:57916:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9180 x1874004626734592/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191341.234811:0:57916:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a614 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191341.236148:0:57916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57916:1874004626734592:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191341.237128:0:57916:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5ff00 going to sleep for 11 seconds 00000080:00200000:0.0:1787191341.237761:0:57915:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191341.237787:0:57915:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.237804:0:57915:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.237820:0:57915:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.237828:0:57915:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191341.238264:0:57915:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191341.238268:0:57915:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191341.238276:0:57915:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4225bb58 00010000:00010000:0.0:1787191341.238280:0:57915:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.238291:0:57915:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.238308:0:57915:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.238316:0:57915:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:0.0:1787191341.238322:0:57915:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:0.0:1787191341.243910:0:57916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57916:1874004626734592:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191341.243937:0:57916:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a614 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.243950:0:57916:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a614 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.243957:0:57916:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a614 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.243963:0:57916:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a614 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.243971:0:57916:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a614 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.243977:0:57916:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51185600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191341.243981:0:57916:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a614 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.243988:0:57916:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a614 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.243995:0:57916:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a614 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.244001:0:57916:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191341.244007:0:57916:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a614 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.244013:0:57916:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a614 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57916 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191341.244058:0:57916:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x7, status=0 req@ffff936b513b9180 x1874004626734592/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/608 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191341.244073:0:57916:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191341.244358:0:57916:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191341.244375:0:57916:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.244387:0:57916:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.244399:0:57916:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.244406:0:57916:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191341.244412:0:57916:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191341.244415:0:57916:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191341.244421:0:57916:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42263b58 00010000:00010000:0.0:1787191341.244424:0:57916:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.244431:0:57916:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.244445:0:57916:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.244452:0:57916:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191341.244457:0:57916:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.244469:0:57916:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=9 00000080:00200000:0.0:1787191341.244473:0:57916:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:0.0:1787191341.244485:0:57916:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:0.0:1787191341.244524:0:57916:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a61b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.244532:0:57916:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a61b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.244540:0:57916:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a61b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.244560:0:57916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57916:1874004626734720:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191341.244634:0:57916:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99840 going to sleep for 11 seconds 00000100:00100000:0.0:1787191341.253204:0:57916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57916:1874004626734720:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191341.253224:0:57916:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a61b lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.253234:0:57916:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a61b lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.253242:0:57916:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a61b lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.253246:0:57916:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a61b lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.253252:0:57916:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a61b lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.253255:0:57916:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cae200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191341.253259:0:57916:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a61b lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.253263:0:57916:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a61b lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.253267:0:57916:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a61b lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.253271:0:57916:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191341.253275:0:57916:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a61b lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.253280:0:57916:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a61b lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57916 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191341.253297:0:57916:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b6a477100 x1874004626734720/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191341.253308:0:57916:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191341.254440:0:57915:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:2.0:1787191341.254450:0:57915:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191341.254471:0:57915:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191341.254518:0:57915:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483a622 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.254525:0:57915:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483a622 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.254532:0:57915:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483a622 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191341.254549:0:57915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57915:1874004626734848:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191341.254622:0:57915:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f300 going to sleep for 11 seconds 00000100:00100000:2.0:1787191341.259160:0:57915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57915:1874004626734848:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191341.259184:0:57915:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483a622 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.259199:0:57915:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483a622 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.259207:0:57915:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483a622 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.259215:0:57915:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483a622 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.259225:0:57915:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483a622 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.259231:0:57915:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51184000 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191341.259236:0:57915:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483a622 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.259249:0:57915:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483a622 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.259256:0:57915:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483a622 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.259263:0:57915:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191341.259270:0:57915:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483a622 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.259277:0:57915:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483a622 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191341.259299:0:57915:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513bad80 x1874004626734848/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191341.259314:0:57915:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191341.259385:0:57915:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191341.259415:0:57915:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191341.259426:0:57915:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191341.259438:0:57915:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191341.259446:0:57915:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191341.259452:0:57915:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191341.259455:0:57915:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191341.259460:0:57915:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4225bbe8 00010000:00010000:2.0:1787191341.259464:0:57915:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191341.259472:0:57915:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191341.259487:0:57915:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191341.259494:0:57915:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000080:00200000:2.0:1787191341.259499:0:57915:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191341.259508:0:57915:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:2.0:1787191341.259512:0:57915:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191341.259524:0:57915:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191341.259563:0:57915:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a629 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.259571:0:57915:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a629 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.259580:0:57915:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a629 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191341.259599:0:57915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57915:1874004626734976:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191341.259692:0:57915:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f300 going to sleep for 11 seconds 00000080:00200000:0.0:1787191341.261807:0:57917:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191341.261909:0:57917:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.261923:0:57917:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.261938:0:57917:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.261945:0:57917:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191341.261952:0:57917:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191341.261955:0:57917:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191341.261962:0:57917:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4226bbf8 00010000:00010000:0.0:1787191341.261965:0:57917:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.261974:0:57917:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.261989:0:57917:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.261996:0:57917:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191341.262001:0:57917:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:2.0:1787191341.264794:0:57915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57915:1874004626734976:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191341.264817:0:57915:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a629 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.264991:0:57915:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a629 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.265004:0:57915:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a629 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.265010:0:57915:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a629 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.265020:0:57915:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a629 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.265085:0:57915:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51184800 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191341.265090:0:57915:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a629 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.265098:0:57915:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a629 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.265106:0:57915:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a629 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.265113:0:57915:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191341.265120:0:57915:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a629 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.265127:0:57915:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a629 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191341.265152:0:57915:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513bad80 x1874004626734976/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191341.265167:0:57915:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191341.265288:0:57915:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191341.265306:0:57915:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191341.265317:0:57915:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191341.265328:0:57915:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191341.265335:0:57915:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191341.265340:0:57915:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191341.265343:0:57915:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191341.265349:0:57915:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4225bb58 00010000:00010000:2.0:1787191341.265352:0:57915:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191341.265361:0:57915:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191341.265376:0:57915:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191341.265384:0:57915:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200000:0.0:1787191341.265518:0:57917:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b53067380, open_flags d900, mode 0 opened 0 00000080:00200000:0.0:1787191341.265526:0:57917:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:0.0:1787191341.265542:0:57917:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:0.0:1787191341.265592:0:57917:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a630 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.265600:0:57917:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a630 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57917 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191341.265616:0:57917:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191341.265624:0:57917:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477100 x1874004626735232/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191341.265633:0:57917:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a630 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57917 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.265654:0:57917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57917:1874004626735232:192.168.202.101@tcp:101:lfs.0 00000080:00200008:2.0:1787191341.266151:0:57915:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:2.0:1787191341.266159:0:57915:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:2.0:1787191341.266173:0:57915:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191341.266183:0:57915:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 89 lru_type: 1 00010000:00010000:2.0:1787191341.266192:0:57915:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 89 lru_type: 1 00000002:00010000:2.0:1787191341.266206:0:57915:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191341.266210:0:57915:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 30 res 8589937616/5 (0 0) 00010000:00010000:2.0:1787191341.266232:0:57915:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a637 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.266239:0:57915:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a637 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.266246:0:57915:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a637 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191341.266258:0:57915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57915:1874004626735360:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191341.266352:0:57917:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99840 going to sleep for 11 seconds 00000100:00100000:2.0:1787191341.266501:0:57915:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f300 going to sleep for 11 seconds 00000100:00100000:0.0:1787191341.272493:0:57917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57917:1874004626735232:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191341.272516:0:57917:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a630 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.272531:0:57917:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a630 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.272537:0:57917:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a630 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.272545:0:57917:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a630 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.272553:0:57917:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a630 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.272560:0:57917:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cae200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191341.272565:0:57917:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a630 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.272576:0:57917:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a630 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.272583:0:57917:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a630 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.272590:0:57917:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191341.272595:0:57917:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a630 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.272800:0:57917:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a630 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57917 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191341.272822:0:57917:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x7, status=0 req@ffff936b6a477100 x1874004626735232/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/608 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191341.272866:0:57917:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1787191341.272893:0:57917:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 30 res 8589937616/5 (0 0) 00000080:00200000:0.0:1787191341.273276:0:57917:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191341.273294:0:57917:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.273304:0:57917:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.273316:0:57917:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.273323:0:57917:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191341.273329:0:57917:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191341.273333:0:57917:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191341.273341:0:57917:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4226bb58 00010000:00010000:0.0:1787191341.273345:0:57917:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.273353:0:57917:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.273368:0:57917:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.273376:0:57917:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191341.273381:0:57917:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.273406:0:57917:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=9 00000080:00200000:0.0:1787191341.273410:0:57917:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:0.0:1787191341.273423:0:57917:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:0.0:1787191341.273462:0:57917:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a63e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.273469:0:57917:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a63e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.273478:0:57917:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a63e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57917 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.273499:0:57917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57917:1874004626735488:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191341.273596:0:57917:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99840 going to sleep for 11 seconds 00000100:00100000:0.0:1787191341.276561:0:57915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57915:1874004626735360:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191341.276587:0:57915:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a637 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605f13 expref: -99 pid: 57915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.276616:0:57915:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a637 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605f13 expref: -99 pid: 57915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.276629:0:57915:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a637 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605f13 expref: -99 pid: 57915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.276640:0:57915:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a637 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605f13 expref: -99 pid: 57915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.276654:0:57915:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a637 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605f13 expref: -99 pid: 57915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.276662:0:57915:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a637 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605f13 expref: -99 pid: 57915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.276669:0:57915:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a637 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605f13 expref: -99 pid: 57915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191341.276680:0:57915:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b513bad80 x1874004626735360/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191341.276694:0:57915:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a637 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605f13 expref: -99 pid: 57915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.276704:0:57915:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:0.0:1787191341.276711:0:57915:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a637 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605f13 expref: -99 pid: 57915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.276725:0:57915:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a637 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605f13 expref: -99 pid: 57915 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:0.0:1787191341.276754:0:57915:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.276766:0:57915:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 178 lru_type: 1 00010000:00010000:0.0:1787191341.276776:0:57915:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 178 lru_type: 1 00010000:00010000:0.0:1787191341.276784:0:57915:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 178 lru_type: 1 00010000:00010000:0.0:1787191341.276790:0:57915:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 179 lru_type: 1 00000080:00200000:0.0:1787191341.276802:0:57915:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191341.276811:0:57915:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:0.0:1787191341.276815:0:57915:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:0.0:1787191341.276822:0:57915:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb4225bcb8 00010000:00010000:0.0:1787191341.276825:0:57915:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 89 lru_type: 1 00010000:00010000:0.0:1787191341.276894:0:57915:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 90 lru_type: 1 00000002:00010000:0.0:1787191341.276912:0:57915:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.276919:0:57915:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a637 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605f13 expref: -99 pid: 57915 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.276942:0:57915:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a637 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605f13 expref: -99 pid: 57915 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.276951:0:57915:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a637 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605f13 expref: -99 pid: 57915 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.276957:0:57915:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a637 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605f13 expref: -99 pid: 57915 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:0.0:1787191341.276966:0:57915:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.276971:0:57915:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 179 lru_type: 1 00010000:00010000:0.0:1787191341.276979:0:57915:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 179 lru_type: 1 00010000:00010000:0.0:1787191341.276987:0:57915:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 179 lru_type: 1 00010000:00010000:0.0:1787191341.276994:0:57915:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 180 lru_type: 1 00000080:00200008:0.0:1787191341.278336:0:57915:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1787191341.278345:0:57915:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191341.278366:0:57915:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.278377:0:57915:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.278390:0:57915:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.278491:0:57915:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191341.278497:0:57915:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191341.278500:0:57915:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191341.278508:0:57915:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4225bcb8 00010000:00010000:0.0:1787191341.278512:0:57915:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.278519:0:57915:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.278730:0:57915:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191341.278739:0:57915:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.278746:0:57915:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.278755:0:57915:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.278762:0:57915:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191341.278767:0:57915:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191341.278769:0:57915:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191341.278772:0:57915:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4225bb58 00010000:00010000:0.0:1787191341.278775:0:57915:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.278782:0:57915:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.278791:0:57915:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.278797:0:57915:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:0.0:1787191341.278803:0:57915:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:1.0:1787191341.286226:0:57917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57917:1874004626735488:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191341.286251:0:57917:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a63e lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.286266:0:57917:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a63e lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.286273:0:57917:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a63e lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.286280:0:57917:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a63e lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.286290:0:57917:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a63e lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.286296:0:57917:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44caea00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191341.286301:0:57917:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a63e lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.286308:0:57917:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a63e lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.286315:0:57917:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a63e lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.286323:0:57917:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191341.286329:0:57917:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a63e lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57917 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.286335:0:57917:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a63e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57917 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191341.286353:0:57917:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b6a477100 x1874004626735488/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191341.286368:0:57917:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1787191341.286411:0:57917:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a637 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605f13 expref: -99 pid: 57915 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191341.286423:0:57917:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a637 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605f13 expref: -99 pid: 57915 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:1.0:1787191341.286431:0:57917:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a637 from it ffffa3fb4226b930 00010000:00010000:1.0:1787191341.286434:0:57917:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a637 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605f13 expref: -99 pid: 57915 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191341.286441:0:57917:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a637 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605f13 expref: -99 pid: 57915 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191341.287224:0:57915:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=8 00000080:00200000:0.0:1787191341.287272:0:57915:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191341.287289:0:57915:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.287299:0:57915:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.287310:0:57915:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.287317:0:57915:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191341.287322:0:57915:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191341.287325:0:57915:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191341.287330:0:57915:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4225bbf8 00010000:00010000:0.0:1787191341.287333:0:57915:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.287341:0:57915:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.287351:0:57915:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.287358:0:57915:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191341.287363:0:57915:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.287369:0:57915:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:0.0:1787191341.287373:0:57915:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:0.0:1787191341.287378:0:57915:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b53066c00, open_flags a141, mode 81b6 opened 0 00000080:00200000:0.0:1787191341.287387:0:57915:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:0.0:1787191341.287406:0:57915:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xd6:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:0.0:1787191341.287417:0:57915:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a637 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4605f13 expref: -99 pid: 57915 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.287465:0:57915:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a637 lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4605f13 expref: -99 pid: 57915 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.287472:0:57915:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191341.287475:0:57915:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a637 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4605f13 expref: -99 pid: 57915 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.287507:0:57915:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a645 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.287513:0:57915:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a645 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191341.287524:0:57915:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191341.287534:0:57915:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474380 x1874004626735744/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191341.287542:0:57915:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a645 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.287561:0:57915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57915:1874004626735744:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191341.287702:0:57915:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00000100:00100000:0.0:1787191341.291979:0:57915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57915:1874004626735744:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191341.292005:0:57915:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a645 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605f44 expref: -99 pid: 57915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.292043:0:57915:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a645 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605f44 expref: -99 pid: 57915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.292053:0:57915:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a645 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605f44 expref: -99 pid: 57915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.292065:0:57915:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a645 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605f44 expref: -99 pid: 57915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.292077:0:57915:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a645 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605f44 expref: -99 pid: 57915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.292090:0:57915:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a645 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605f44 expref: -99 pid: 57915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.292099:0:57915:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a645 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605f44 expref: -99 pid: 57915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.292106:0:57915:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a645 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605f44 expref: -99 pid: 57915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191341.292118:0:57915:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b6a474380 x1874004626735744/t8589936971(8589936971) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191341.292142:0:57915:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474380 x1874004626735744/t8589936971(8589936971) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191341.292154:0:57915:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a645 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605f44 expref: -99 pid: 57915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.292164:0:57915:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/214 (0 0) 00000080:00200000:0.0:1787191341.292171:0:57915:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191341.292185:0:57915:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:0.0:1787191341.292211:0:57915:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448) 00000080:00200000:0.0:1787191341.292218:0:57915:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xd6:0x0], updating i_size 0 00000080:00200000:0.0:1787191341.292253:0:57915:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd6:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1787191341.292257:0:57915:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) 00000080:00010000:0.0:1787191341.292260:0:57915:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) for lock 0xe5129dc88483a645 00000080:00010000:0.0:1787191341.292269:0:57915:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) 00000080:00200008:0.0:1787191341.292283:0:57915:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xd6:0x0](ffff936b5396f448), flags 120501 00000002:00100000:0.0:1787191341.292301:0:57915:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474380 x1874004626735744/t8589936971(8589936971) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191341.292332:0:57915:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a645 from it ffff936b530f5000 00010000:00010000:0.0:1787191341.292337:0:57915:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a645 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605f44 expref: -99 pid: 57915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.292346:0:57915:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a645 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605f44 expref: -99 pid: 57915 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191341.292368:0:57915:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448), inode mode 81a4 mask 40 00000080:00200000:0.0:1787191341.292415:0:57915:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448), inode mode 81a4 mask 2 00000080:00200000:0.0:1787191341.292425:0:57915:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448), xattr lov 00000002:00010000:0.0:1787191341.292442:0:57915:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd6:0x0]) in obj [0x200000405:0xd6:0x0], intent: open flags 040000002 00010000:00010000:0.0:1787191341.292486:0:57915:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a64c lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.292493:0:57915:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a64c lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191341.292503:0:57915:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191341.292509:0:57915:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475500 x1874004626736000/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191341.292518:0:57915:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a64c lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.292536:0:57915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57915:1874004626736000:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191341.292697:0:57915:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00000100:00100000:3.0:1787191341.301472:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191341.301531:0:40922:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787191341.301552:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634907648 00000100:00100000:2.0:1787191341.301561:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634907648 00000100:00100000:2.0:1787191341.301630:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1396 00000100:00100000:2.0:1787191341.301641:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51f65850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634907648:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191341.301660:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a645 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4605f44 expref: -99 pid: 57915 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.301740:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191341.301747:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51f65850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634907648:12345-192.168.202.101@tcp:104: Request processed in 108us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191341.301754:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1396 00010000:00010000:1.0:1787191341.301985:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191341.301993:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a645 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4605f44 expref: -99 pid: 57915 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.302002:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cafa00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191341.302007:0:40929:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a645 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4605f44 expref: -99 pid: 57915 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.302016:0:40929:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a645 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4605f44 expref: -99 pid: 57915 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.302034:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a645 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4605f44 expref: -99 pid: 57915 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191341.302058:0:40929:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xd6:0x0]: losing layout lock 00010000:00010000:1.0:1787191341.302105:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a645 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4605f44 expref: -99 pid: 57915 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.302113:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191341.302264:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a645 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4605f44 expref: -99 pid: 57915 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.302274:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafa00/0xe5129dc88483a645 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4605f44 expref: -99 pid: 57915 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.302288:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191341.302290:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191341.302292:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191341.306781:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626736128:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00200000:0.0:1787191341.310044:0:57918:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191341.310075:0:57918:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.310092:0:57918:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.310108:0:57918:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.310116:0:57918:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191341.310125:0:57918:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191341.310253:0:57918:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191341.310264:0:57918:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42273bf8 00010000:00010000:0.0:1787191341.310268:0:57918:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.310279:0:57918:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.310297:0:57918:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.310305:0:57918:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191341.310311:0:57918:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.310324:0:57918:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b52230f00, open_flags d900, mode 0 opened 0 00000080:00200000:0.0:1787191341.310331:0:57918:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:0.0:1787191341.310346:0:57918:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:0.0:1787191341.310406:0:57918:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a653 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.310415:0:57918:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a653 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57918 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191341.310426:0:57918:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:0.0:1787191341.310438:0:57918:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474700 x1874004626736384/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191341.310449:0:57918:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a653 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.310470:0:57918:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57918:1874004626736384:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191341.310637:0:57918:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99840 going to sleep for 11 seconds 00000100:00100000:1.0:1787191341.310894:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626736128:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191341.317584:0:57915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57915:1874004626736000:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191341.317607:0:57915:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a64c lrc: 4/1,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.317626:0:57915:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a64c lrc: 4/1,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.317633:0:57915:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a64c lrc: 4/1,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.317641:0:57915:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a64c lrc: 3/0,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.317716:0:57915:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a64c lrc: 4/0,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.317723:0:57915:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cae600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191341.317728:0:57915:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a64c lrc: 4/0,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.317735:0:57915:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a64c lrc: 4/0,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.317743:0:57915:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a64c lrc: 5/0,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.317749:0:57915:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191341.317756:0:57915:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a64c lrc: 3/0,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.317763:0:57915:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a64c lrc: 0/0,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57915 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191341.317789:0:57915:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b6a475500 x1874004626736000/t8589936972(8589936972) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191341.317809:0:57915:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475500 x1874004626736000/t8589936972(8589936972) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191341.317827:0:57915:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xd6:0x0] suppgids 0 0: rc 0 00000100:00100000:2.0:1787191341.318061:0:57918:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57918:1874004626736384:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191341.318075:0:57918:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a653 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605f7c expref: -99 pid: 57918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.318096:0:57918:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a653 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605f7c expref: -99 pid: 57918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.318104:0:57918:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a653 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605f7c expref: -99 pid: 57918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.318114:0:57918:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a653 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605f7c expref: -99 pid: 57918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.318125:0:57918:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a653 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605f7c expref: -99 pid: 57918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.318149:0:57918:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a653 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605f7c expref: -99 pid: 57918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.318156:0:57918:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a653 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605f7c expref: -99 pid: 57918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.318163:0:57918:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a653 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605f7c expref: -99 pid: 57918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191341.318172:0:57918:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b6a474700 x1874004626736384/t8589936973(8589936973) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191341.318181:0:57918:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474700 x1874004626736384/t8589936973(8589936973) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191341.318192:0:57918:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a653 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605f7c expref: -99 pid: 57918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191341.318203:0:57918:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a653 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605f7c expref: -99 pid: 57918 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.318213:0:57918:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/214 (0 0) 00000080:00200000:2.0:1787191341.318217:0:57918:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191341.318263:0:57918:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1787191341.318271:0:57918:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191341.318322:0:57918:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xd6:0x0](ffff936b5396f448): rc = 0 00000080:00200000:2.0:1787191341.318343:0:57918:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd6:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:2.0:1787191341.318349:0:57918:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) for lock 0xe5129dc88483a653 00000080:00010000:2.0:1787191341.318362:0:57918:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) 00000080:00200008:2.0:1787191341.318375:0:57918:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xd6:0x0](ffff936b5396f448), flags 154400 00000002:00100000:2.0:1787191341.318507:0:57918:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474700 x1874004626736384/t8589936973(8589936973) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1787191341.318559:0:57918:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a653 from it ffff936b530f5000 00010000:00010000:2.0:1787191341.318564:0:57918:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a653 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605f7c expref: -99 pid: 57918 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.318574:0:57918:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a653 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605f7c expref: -99 pid: 57918 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191341.318598:0:57918:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448), inode mode 81a4 mask 44 00000080:00200000:2.0:1787191341.318708:0:57918:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448), inode mode 81a4 mask 4 00000080:00200000:2.0:1787191341.318716:0:57918:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448), xattr lov 00000080:00200008:2.0:1787191341.318744:0:57918:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xd6:0x0](ffff936b5396f448), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191341.318751:0:57918:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448),name=f70.sanity-flr 00000002:00010000:2.0:1787191341.318770:0:57918:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd6:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191341.318780:0:57918:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a653 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605f7c expref: -99 pid: 57918 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.318791:0:57918:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a653 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605f7c expref: -99 pid: 57918 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191341.318798:0:57918:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191341.318803:0:57918:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) 00000080:00010000:2.0:1787191341.318806:0:57918:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) for lock 0xe5129dc88483a653 00000080:00010000:2.0:1787191341.318810:0:57918:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a653 from it ffffa3fb42273cd8 00010000:00010000:2.0:1787191341.318813:0:57918:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a653 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605f7c expref: -99 pid: 57918 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.318820:0:57918:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a653 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605f7c expref: -99 pid: 57918 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191341.319067:0:57918:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd6:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:2.0:1787191341.319078:0:57918:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd6:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191341.319081:0:57918:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191341.319085:0:57918:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xd6:0x0] 00000008:00010000:2.0:1787191341.319102:0:57918:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191341.319105:0:57918:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d10b0, osc lock ffff936b44e638f0, flags 0x400000400001002 00010000:00010000:2.0:1787191341.319282:0:57918:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483a65a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57918 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.319298:0:57918:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483a65a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57918 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.319308:0:57918:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b513bb800 x1874004626736512/t0(0) o101->lustre-OST0001-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:2.0:1787191341.319339:0:57918:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:3.0:1787191341.319371:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626736512:192.168.202.101@tcp:101:lfs.0 00000080:00200000:0.0:1787191341.319515:0:57915:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xd6:0x0], updating i_size 0 00000002:00100000:0.0:1787191341.319529:0:57915:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475500 x1874004626736000/t8589936972(8589936972) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191341.319556:0:57915:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a475500 x1874004626736000/t8589936972(8589936972) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191341.319564:0:57915:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191341.319569:0:57915:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a476a00 x1874004626736768/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191341.319585:0:57915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57915:1874004626736768:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191341.319621:0:57915:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00000100:00100000:0.0:1787191341.321451:0:57915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57915:1874004626736768:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191341.321482:0:57915:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a475500 x1874004626736000/t8589936972(8589936972) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1787191341.321535:0:57915:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xd6:0x0](ffff936b5396f448), flags 100001 00000002:00100000:0.0:1787191341.321579:0:57915:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a474380 x1874004626735744/t8589936971(8589936971) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191357 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191341.321589:0:57915:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191341.321592:0:57915:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477100 x1874004626737024/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191341.321608:0:57915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57915:1874004626737024:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191341.321679:0:57915:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00000100:00100000:0.0:1787191341.323309:0:57915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57915:1874004626737024:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191341.323336:0:57915:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a474380 x1874004626735744/t8589936971(8589936971) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1787191341.323372:0:2391:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483a65a lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57918 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.323388:0:2391:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483a65a lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605f8a expref: -99 pid: 57918 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.323549:0:2391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483a65a lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605f8a expref: -99 pid: 57918 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.323561:0:2391:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483a65a lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605f8a expref: -99 pid: 57918 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1787191341.323577:0:2391:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483a65a lrc: 5/2,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605f8a expref: -99 pid: 57918 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:2.0:1787191341.323589:0:2391:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:2.0:1787191341.323648:0:2391:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483a65a lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605f8a expref: -99 pid: 57918 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.323663:0:2391:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483a65a lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605f8a expref: -99 pid: 57918 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.323670:0:2391:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483a65a lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605f8a expref: -99 pid: 57918 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.323679:0:2391:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483a65a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605f8a expref: -99 pid: 57918 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:2.0:1787191341.323695:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626736512:192.168.202.101@tcp:101:lfs.0 00000080:00200000:0.0:1787191341.325544:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191341.325568:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.325583:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.325599:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.325607:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191341.325613:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191341.325616:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191341.325623:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:0.0:1787191341.325627:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.325635:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.325715:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.325724:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191341.325730:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.325736:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:0.0:1787191341.325741:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448), inode mode 81a4 mask 42 00000080:00200008:0.0:1787191341.325750:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xd6:0x0](ffff936b5396f448), flags 101101 00000002:00010000:0.0:1787191341.325764:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd6:0x0]) in obj [0x200000405:0xd6:0x0], intent: open|creat flags 04240101102 00010000:00010000:0.0:1787191341.325777:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a653 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4605f7c expref: -99 pid: 57918 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191341.325795:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xd6:0x0]: losing layout lock 00010000:00010000:0.0:1787191341.326075:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a653 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605f7c expref: -99 pid: 57918 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.326084:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191341.326088:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a653 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605f7c expref: -99 pid: 57918 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.326124:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a661 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.326192:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a661 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1787191341.326217:0:57918:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd6:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1787191341.326223:0:57918:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b516544a0 (ffff936b465cc008/0) at cl_lock_release():245 00000020:00010000:3.0:1787191341.326227:0:57918:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b516544a0 (ffff936b465cc008/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191341.326233:0:57918:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d10b0 (ffff936b465cccf8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191341.326238:0:57918:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b516544a0 (ffff936b465cc008/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191341.326240:0:57918:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d10b0 (ffff936b465cc008/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191341.326253:0:57918:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd6:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:3.0:1787191341.326263:0:57918:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/214 (0 0) 00000020:00100000:0.0:1787191341.326267:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000080:00010000:3.0:1787191341.326270:0:57918:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xd6:0x0](ffff936b5396f448) 00000002:00010000:3.0:1787191341.326274:0:57918:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd6:0x0]) in obj [0x200000405:0xd6:0x0], intent: layout flags 0 00000100:00100000:0.0:1787191341.326278:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477b80 x1874004626737280/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191341.326287:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a661 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.326294:0:57918:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a668 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.326300:0:57918:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a668 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.326306:0:57918:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a668 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.326307:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626737280:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191341.326316:0:57918:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57918:1874004626737408:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191341.326507:0:57918:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c840 going to sleep for 11 seconds 00000100:00100000:0.0:1787191341.328354:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00000100:00100000:3.0:1787191341.331718:0:57918:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57918:1874004626737408:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191341.331750:0:57918:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a668 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605f91 expref: -99 pid: 57918 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.331767:0:57918:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a668 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605f91 expref: -99 pid: 57918 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191341.331781:0:57918:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b51d1d180 x1874004626737408/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191341.331792:0:57918:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a668 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605f91 expref: -99 pid: 57918 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191341.331805:0:57918:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a668 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605f91 expref: -99 pid: 57918 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.331880:0:57918:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/214 (0 0) 00000080:00200000:3.0:1787191341.331887:0:57918:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xd6:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1787191341.331902:0:57918:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) for lock 0xe5129dc88483a668 00000080:00010000:3.0:1787191341.331910:0:57918:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a668 from it ffffa3fb42273bc8 00010000:00010000:3.0:1787191341.331914:0:57918:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a668 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605f91 expref: -99 pid: 57918 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.331924:0:57918:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a668 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605f91 expref: -99 pid: 57918 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191341.331948:0:57918:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a668 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605f91 expref: -99 pid: 57918 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191341.331959:0:57918:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a668 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605f91 expref: -99 pid: 57918 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:3.0:1787191341.331967:0:57918:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xd6:0x0](000000003f5f83f6) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a668 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605f91 expref: -99 pid: 57918 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191341.332010:0:57918:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd6:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:3.0:1787191341.332016:0:57918:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a668 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605f91 expref: -99 pid: 57918 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191341.332032:0:57918:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a668 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605f91 expref: -99 pid: 57918 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200008:3.0:1787191341.332100:0:57918:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xd6:0x0](ffff936b5396f448), flags 154000 00000002:00100000:3.0:1787191341.332313:0:57918:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a474700 x1874004626736384/t8589936973(8589936973) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191341.332324:0:57918:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:3.0:1787191341.332330:0:57918:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1d180 x1874004626737664/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191341.332351:0:57918:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57918:1874004626737664:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191341.332724:0:57918:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c840 going to sleep for 11 seconds 00000100:00100000:0.0:1787191341.335297:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626737280:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191341.335324:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a661 lrc: 4/0,1 mode: --/CW res: [0x200000405:0xd6:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605f9f expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.335341:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a661 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xd6:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605f9f expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.335352:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a661 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xd6:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605f9f expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191341.335368:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x200002b, status=0 req@ffff936b6a477b80 x1874004626737280/t8589936976(8589936976) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191341.335382:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477b80 x1874004626737280/t8589936976(8589936976) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191341.335396:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a661 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xd6:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605f9f expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191341.335656:0:57918:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57918:1874004626737664:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191341.335680:0:57918:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a474700 x1874004626736384/t8589936973(8589936973) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191341.335895:0:57918:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191341.335913:0:57918:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191341.335927:0:57918:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191341.335939:0:57918:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191341.335947:0:57918:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191341.335953:0:57918:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191341.335957:0:57918:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191341.335963:0:57918:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42273bf8 00010000:00010000:3.0:1787191341.335967:0:57918:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191341.335975:0:57918:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191341.335989:0:57918:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191341.335996:0:57918:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191341.336001:0:57918:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191341.336013:0:57918:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b464a9b00, open_flags d900, mode 0 opened 0 00000080:00200000:3.0:1787191341.336020:0:57918:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:3.0:1787191341.336046:0:57918:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:3.0:1787191341.336085:0:57918:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a66f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.336091:0:57918:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a66f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57918 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191341.336098:0:57918:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191341.336103:0:57918:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1d180 x1874004626737920/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191341.336109:0:57918:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a66f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191341.336124:0:57918:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57918:1874004626737920:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191341.336275:0:57918:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c840 going to sleep for 11 seconds 00000002:00010000:0.0:1787191341.338308:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a661 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xd6:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605f9f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.338321:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 8 res 8589935621/214 (0 0) 00000080:00200000:0.0:1787191341.338325:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000405:0xd6:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787191341.338386:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd6:0x0]: layout version change: 3 -> 3 00000080:00010000:0.0:1787191341.338390:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) for lock 0xe5129dc88483a661 00000080:00010000:0.0:1787191341.338952:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a661 from it ffffa3fb41cabbf0 00010000:00010000:0.0:1787191341.338958:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a661 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xd6:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605f9f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.338969:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a661 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xd6:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605f9f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000002:00100000:0.0:1787191341.339003:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477b80 x1874004626737280/t8589936976(8589936976) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191341.339073:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xd6:0x0], intent: getxattr flags 0 00010000:00010000:0.0:1787191341.339110:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a676 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.339118:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a676 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.339136:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a676 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.339157:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626738048:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191341.339230:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00000100:00100000:3.0:1787191341.340584:0:57918:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57918:1874004626737920:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191341.340607:0:57918:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a66f lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.340624:0:57918:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a66f lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.340630:0:57918:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a66f lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.340637:0:57918:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a66f lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.340654:0:57918:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a66f lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.340661:0:57918:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9a000 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191341.340666:0:57918:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a66f lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.340673:0:57918:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a66f lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.340679:0:57918:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a66f lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.340686:0:57918:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191341.340694:0:57918:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a66f lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.340700:0:57918:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a66f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57918 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191341.340722:0:57918:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b51d1d180 x1874004626737920/t8589936978(8589936978) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191341.340740:0:57918:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1d180 x1874004626737920/t8589936978(8589936978) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191341.340754:0:57918:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191341.340801:0:57918:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xd6:0x0](ffff936b5396f448): rc = 0 00000080:00010000:3.0:1787191341.340807:0:57918:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) for lock 0x0 00000080:00200008:3.0:1787191341.340873:0:57918:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xd6:0x0](ffff936b5396f448), flags 154400 00000002:00100000:3.0:1787191341.340904:0:57918:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1d180 x1874004626737920/t8589936978(8589936978) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191341.340956:0:57918:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448), inode mode 81a4 mask 44 00000080:00200000:3.0:1787191341.341014:0:57918:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448), inode mode 81a4 mask 4 00000080:00200000:3.0:1787191341.341019:0:57918:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448), xattr lov 00000080:00200008:3.0:1787191341.341058:0:57918:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xd6:0x0](ffff936b5396f448), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191341.341064:0:57918:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448),name=f70.sanity-flr 00000002:00010000:3.0:1787191341.341076:0:57918:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd6:0x0]) in obj [0x200000405:0xd6:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191341.341087:0:57918:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a661 lrc: 2/0,1 mode: CW/CW res: [0x200000405:0xd6:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605f9f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191341.341099:0:57918:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a661 lrc: 2/0,1 mode: CW/CW res: [0x200000405:0xd6:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605f9f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191341.341107:0:57918:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xd6:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191341.341122:0:57918:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) 00000080:00010000:3.0:1787191341.341126:0:57918:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) for lock 0xe5129dc88483a661 00000080:00010000:3.0:1787191341.341131:0:57918:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a661 from it ffffa3fb42273cd8 00010000:00010000:3.0:1787191341.341135:0:57918:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a661 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xd6:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4605f9f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191341.341143:0:57918:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a661 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xd6:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605f9f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191341.341168:0:57918:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd6:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00020000:00200000:3.0:1787191341.341179:0:57918:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd6:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191341.341182:0:57918:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191341.341186:0:57918:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xd6:0x0] 00000008:00010000:3.0:1787191341.341206:0:57918:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191341.341209:0:57918:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667b30, osc lock ffff936b44f65690, flags 0x400000400001002 00010000:00010000:3.0:1787191341.341225:0:57918:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483a65a lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605f8a expref: -99 pid: 57918 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191341.341236:0:57918:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483a65a lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605f8a expref: -99 pid: 57918 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:3.0:1787191341.341249:0:57918:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191341.341252:0:57918:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483a65a lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4605f8a expref: -99 pid: 57918 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191341.341260:0:57918:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483a65a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605f8a expref: -99 pid: 57918 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:3.0:1787191341.341270:0:57918:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191341.341279:0:57918:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd6:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1787191341.341283:0:57918:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b516544a0 (ffff936b465cc008/0) at cl_lock_release():245 00000020:00010000:3.0:1787191341.341286:0:57918:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b516544a0 (ffff936b465cc008/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191341.341290:0:57918:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667b30 (ffff936b465cccf8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191341.341294:0:57918:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b516544a0 (ffff936b465cc008/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191341.341297:0:57918:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667b30 (ffff936b465cc008/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191341.341306:0:57918:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd6:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191341.341335:0:57918:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xd6:0x0](ffff936b5396f448), flags 154000 00000002:00100000:3.0:1787191341.341370:0:57918:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1d180 x1874004626737920/t8589936978(8589936978) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191341.341377:0:57918:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191341.341381:0:57918:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1f480 x1874004626738304/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191341.341396:0:57918:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57918:1874004626738304:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191341.341474:0:57918:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c840 going to sleep for 11 seconds 00000100:00100000:0.0:1787191341.345223:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626738048:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191341.345251:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a676 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605fd7 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.345268:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a676 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605fd7 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.345281:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a676 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605fd7 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191341.345301:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b6a475880 x1874004626738048/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191341.345319:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a676 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605fd7 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.345330:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/214 (0 0) 00000080:00200000:0.0:1787191341.345336:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xd6:0x0] suppgids 0 -1: rc 0 00000080:00010000:0.0:1787191341.345361:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) for lock 0xe5129dc88483a676 00000080:00010000:0.0:1787191341.345369:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a676 from it ffffa3fb41caba38 00010000:00010000:0.0:1787191341.345373:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a676 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605fd7 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.345382:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a676 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605fd7 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1787191341.345394:0:57918:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57918:1874004626738304:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191341.345416:0:57918:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1d180 x1874004626737920/t8589936978(8589936978) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191341.345523:0:57918:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191341.345541:0:57918:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191341.345554:0:57918:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191341.345567:0:57918:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191341.345574:0:57918:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191341.345579:0:57918:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191341.345583:0:57918:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191341.345587:0:57918:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42273bf8 00010000:00010000:3.0:1787191341.345590:0:57918:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191341.345597:0:57918:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191341.345606:0:57918:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191341.345623:0:57918:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191341.345630:0:57918:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200008:0.0:1787191341.345683:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xd6:0x0](ffff936b5396f448) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191341.000000000, mtime 1787191341.000000000, ctime 1787191341.000000000 00010000:00010000:0.0:1787191341.345710:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a661 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xd6:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4605f9f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.345729:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a668 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4605f91 expref: -99 pid: 57918 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.345767:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a661 lrc: 1/0,0 mode: --/CW res: [0x200000405:0xd6:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605f9f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.345774:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191341.345777:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cafe00/0xe5129dc88483a661 lrc: 0/0,0 mode: --/CW res: [0x200000405:0xd6:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605f9f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191341.345784:0:57918:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b464a9080, open_flags d902, mode 0 opened 0 00000080:00200000:3.0:1787191341.345791:0:57918:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000020:00100000:0.0:1787191341.345800:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000002:00010000:3.0:1787191341.345806:0:57918:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154403 00000100:00100000:0.0:1787191341.345807:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475880 x1874004626738560/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787191341.345825:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626738560:192.168.202.101@tcp:36:bash.0 00010000:00010000:3.0:1787191341.345862:0:57918:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a67d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57918 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.345871:0:57918:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a67d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57918 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191341.345879:0:57918:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:3.0:1787191341.345884:0:57918:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1f480 x1874004626738816/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191341.345916:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00010000:00010000:3.0:1787191341.346776:0:57918:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a67d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57918 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191341.346795:0:57918:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57918:1874004626738816:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191341.349299:0:57918:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c840 going to sleep for 11 seconds 00000100:00100000:0.0:1787191341.350659:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626738560:192.168.202.101@tcp:36:bash.0 00000080:00200000:0.0:1787191341.350710:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:0.0:1787191341.350716:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd6:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:0.0:1787191341.350732:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xd6:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:0.0:1787191341.350737:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd6:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191341.350740:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xd6:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:0.0:1787191341.350749:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xd6:0x0](ffff936b5396f448) 00000002:00010000:0.0:1787191341.350761:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd6:0x0]) in obj [0x200000405:0xd6:0x0], intent: layout flags 02 00010000:00010000:0.0:1787191341.350781:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a668 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4605f91 expref: -99 pid: 57918 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191341.350800:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xd6:0x0]: losing layout lock 00010000:00010000:0.0:1787191341.351295:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a668 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605f91 expref: -99 pid: 57918 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.351305:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191341.351308:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a668 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4605f91 expref: -99 pid: 57918 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.351332:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a684 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.351340:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a684 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191341.351350:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191341.351358:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477480 x1874004626739072/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191341.351368:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a684 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.351388:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626739072:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191341.351701:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00000100:00100000:2.0:1787191341.355776:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191341.355807:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634907776 00000100:00100000:2.0:1787191341.355814:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634907776 00000100:00100000:0.0:1787191341.355922:0:57918:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57918:1874004626738816:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191341.355956:0:57918:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a67d lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605ffa expref: -99 pid: 57918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.355978:0:57918:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a67d lrc: 4/1,0 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605ffa expref: -99 pid: 57918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.355986:0:57918:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a67d lrc: 4/1,0 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605ffa expref: -99 pid: 57918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.355997:0:57918:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a67d lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605ffa expref: -99 pid: 57918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.356007:0:57918:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a67d lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605ffa expref: -99 pid: 57918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.356038:0:57918:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a67d lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605ffa expref: -99 pid: 57918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.356047:0:57918:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a67d lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605ffa expref: -99 pid: 57918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.356054:0:57918:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a67d lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4605ffa expref: -99 pid: 57918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191341.356066:0:57918:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b51d1f480 x1874004626738816/t8589936982(8589936982) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191341.356080:0:57918:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1f480 x1874004626738816/t8589936982(8589936982) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191341.356093:0:57918:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a67d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605ffa expref: -99 pid: 57918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191341.356107:0:57918:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a67d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4605ffa expref: -99 pid: 57918 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.356117:0:57918:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/214 (0 0) 00000080:00200000:0.0:1787191341.356124:0:57918:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191341.356277:0:57918:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xd6:0x0](ffff936b5396f448): rc = 0 00000080:00200000:0.0:1787191341.356293:0:57918:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd6:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:0.0:1787191341.356299:0:57918:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) for lock 0xe5129dc88483a67d 00000080:00010000:0.0:1787191341.356312:0:57918:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) 00000080:00200008:0.0:1787191341.356328:0:57918:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xd6:0x0](ffff936b5396f448), flags 154402 00000002:00100000:0.0:1787191341.356352:0:57918:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1f480 x1874004626738816/t8589936982(8589936982) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191341.356463:0:57918:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1f480 x1874004626738816/t8589936982(8589936982) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191341.356474:0:57918:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:0.0:1787191341.356479:0:57918:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475180 x1874004626739328/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191341.356501:0:57918:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57918:1874004626739328:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191341.356585:0:57918:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191341.356807:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1397 00000100:00100000:2.0:1787191341.356818:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634907776:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191341.356979:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a67d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4605ffa expref: -99 pid: 57918 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.357121:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191341.357137:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634907776:12345-192.168.202.101@tcp:104: Request processed in 313us (1363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191341.357145:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1397 00010000:00010000:1.0:1787191341.357314:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191341.357322:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a67d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4605ffa expref: -99 pid: 57918 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.357336:0:40930:0:(ldlm_lockd.c:1935:ldlm_handle_bl_callback()) Lock ffff936b44e9ba00 is referenced, will be cancelled later 00010000:00010000:1.0:1787191341.357339:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a67d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0xa rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4605ffa expref: -99 pid: 57918 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.357348:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191341.357350:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191341.357351:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191341.363599:0:57918:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57918:1874004626739328:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191341.363638:0:57918:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1f480 x1874004626738816/t8589936982(8589936982) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191341.363707:0:57918:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a67d from it ffff936b466f4660 00010000:00010000:0.0:1787191341.363716:0:57918:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a67d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0xa rrc: 4 type: IBT gid 0 flags: 0x10420400000000 nid: local remote: 0x7130d520e4605ffa expref: -99 pid: 57918 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.363727:0:57918:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a67d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0xa rrc: 4 type: IBT gid 0 flags: 0x10420400000000 nid: local remote: 0x7130d520e4605ffa expref: -99 pid: 57918 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.363758:0:57918:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000080:00200000:0.0:1787191341.363773:0:57918:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448), inode mode 81a4 mask 46 00000080:00200080:0.0:1787191341.363894:0:57918:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448) cmd=800466af arg=7fff1433de5c 00000080:00200080:0.0:1787191341.363911:0:57918:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448) cmd=80086601 arg=7fff1433ddf8 00000100:00100000:0.0:1787191341.363954:0:57918:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57918:1874004626739456:192.168.202.101@tcp:33:lfs.0 00000100:00100000:0.0:1787191341.364044:0:57918:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00010000:00010000:2.0:1787191341.364114:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787191341.364122:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a67d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0xa rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4605ffa expref: -99 pid: 57918 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.364469:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9ba00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191341.364474:0:43384:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a67d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4605ffa expref: -99 pid: 57918 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.364483:0:43384:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a67d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4605ffa expref: -99 pid: 57918 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.364491:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a67d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4605ffa expref: -99 pid: 57918 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000080:00200000:2.0:1787191341.364514:0:43384:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xd6:0x0]: losing layout lock 00010000:00010000:2.0:1787191341.364550:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a67d lrc: 2/0,0 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4605ffa expref: -99 pid: 57918 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.364556:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191341.364581:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a67d lrc: 1/0,0 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4605ffa expref: -99 pid: 57918 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.364589:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a67d lrc: 0/0,0 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4605ffa expref: -99 pid: 57918 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.364603:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191341.364605:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191341.364607:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191341.364619:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626739584:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191341.368706:0:57918:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57918:1874004626739456:192.168.202.101@tcp:33:lfs.0 00000080:00200080:0.0:1787191341.368751:0:57918:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448) cmd=c00c66f3 arg=7fff1433dde4 00000080:00200008:0.0:1787191341.368942:0:57918:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xd6:0x0](ffff936b5396f448), flags 154002 00000100:00100000:2.0:1787191341.375826:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626739584:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191341.379505:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191341.379547:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191341.379579:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634908928 00000100:00100000:3.0:1787191341.379589:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634908928 00000100:00100000:3.0:1787191341.379634:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634909056 00000100:00100000:3.0:1787191341.379637:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634909056 00000100:00100000:3.0:1787191341.379664:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1398 00000100:00100000:3.0:1787191341.379673:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:29543:x1874004634908928:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191341.379693:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a5ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4605e2c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191341.379779:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191341.379786:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:29543:x1874004634908928:12345-192.168.202.101@tcp:104: Request processed in 114us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191341.379792:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1398 00000100:00100000:3.0:1787191341.379806:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1399 00000100:00100000:3.0:1787191341.379812:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30510:x1874004634909056:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191341.379819:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a5f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4605e3a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191341.379863:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787191341.379869:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30510:x1874004634909056:12345-192.168.202.101@tcp:104: Request processed in 57us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191341.379876:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1399 00010000:00010000:0.0:1787191341.379878:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787191341.379885:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a5ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4605e2c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191341.379890:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191341.379895:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9bc00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191341.379895:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a5f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4605e3a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.379900:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a5ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4605e2c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191341.379909:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cae400 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191341.379912:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a5f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4605e3a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.379946:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a5ea lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4605e2c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.379953:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191341.379974:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a5ea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4605e2c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.379982:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483a5ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4605e2c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.380002:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191341.380005:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191341.380007:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191341.380021:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626739712:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787191341.380343:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a5f8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4605e3a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191341.380351:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191341.380364:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a5f8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4605e3a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191341.380372:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a5f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4605e3a expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191341.380388:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191341.380390:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191341.380391:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191341.380482:0:57570:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589936984 gen 1 00000100:00100000:0.0:1787191341.380570:0:57570:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b6a477b80 x1874004626737280/t8589936976(8589936976) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787191341.380587:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626739072:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191341.380604:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a684 lrc: 4/0,1 mode: --/EX res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460600f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.380615:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a684 lrc: 4/0,1 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460600f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191341.380619:0:2392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1787191341.380627:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a684 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460600f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191341.380631:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626739840:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787191341.380639:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a684 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460600f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.380651:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a684 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460600f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.380659:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a684 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460600f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.380667:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a684 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460600f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191341.380678:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b6a477480 x1874004626739072/t8589936984(8589936984) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191341.380695:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a684 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460600f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191341.380707:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a684 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460600f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.380717:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/214 (0 0) 00000080:00200000:0.0:1787191341.380724:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xd6:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191341.380737:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) for lock 0xe5129dc88483a684 00000080:00010000:0.0:1787191341.380745:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a684 from it ffffa3fb41cab930 00010000:00010000:0.0:1787191341.380749:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a684 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460600f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.380758:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a684 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460600f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191341.380773:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:0.0:1787191341.380779:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd6:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:0.0:1787191341.380794:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a684 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460600f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.380804:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a684 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460600f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1787191341.380813:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xd6:0x0](000000003f5f83f6) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a684 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460600f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.380889:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a684 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460600f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.380898:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a684 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460600f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191341.380912:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191341.380922:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd6:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191341.380925:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191341.380931:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191341.380943:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191341.380963:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:0.0:1787191341.380976:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a684 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460600f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.380984:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a684 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460600f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:0.0:1787191341.380991:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xd6:0x0](000000003f5f83f6) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a684 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460600f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191341.381008:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191341.381013:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd6:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191341.381015:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191341.381018:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191341.381055:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191341.381062:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:0.0:1787191341.381076:0:57570:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483a65a lrc: 1/0,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4605f8a expref: -99 pid: 57918 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191341.381166:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd6:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:0.0:1787191341.381171:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a684 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460600f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.381179:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a684 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460600f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00020000:00200000:0.0:1787191341.381192:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xd6:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:0.0:1787191341.381195:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd6:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191341.381198:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191341.381203:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191341.381213:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191341.381216:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:0.0:1787191341.381227:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:0.0:1787191341.381231:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f994b0, osc lock ffff936b50b63b50, flags 0x80000000 00000008:00010000:0.0:1787191341.381235:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:0.0:1787191341.381237:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f994f0, osc lock ffff936b50b62980, flags 0x80000000 00010000:00010000:0.0:1787191341.381246:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b52373000 type 11 mode 2 res 11811161089/457 (0 1048575) 00010000:00010000:0.0:1787191341.381273:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.381282:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.381292:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.381309:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626739968:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191341.381341:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00000080:00200000:1.0:1787191341.383142:0:57919:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191341.383174:0:57919:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191341.383188:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.383202:0:57919:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.383209:0:57919:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191341.383216:0:57919:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191341.383220:0:57919:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191341.383227:0:57919:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4227bbf8 00010000:00010000:1.0:1787191341.383232:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.383240:0:57919:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.383257:0:57919:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191341.383265:0:57919:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191341.383272:0:57919:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191341.383286:0:57919:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b62b07980, open_flags d900, mode 0 opened 0 00000080:00200000:1.0:1787191341.383292:0:57919:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:1.0:1787191341.383308:0:57919:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:1.0:1787191341.383355:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a692 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.383363:0:57919:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a692 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57919 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191341.383374:0:57919:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191341.383386:0:57919:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453aa680 x1874004626740224/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191341.383396:0:57919:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a692 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57919 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191341.383414:0:57919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626740224:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191341.383597:0:57919:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787191341.387258:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626739840:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191341.387507:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626739712:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191341.392570:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191341.393137:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634909184 00000100:00100000:2.0:1787191341.393148:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634909184 00000100:00100000:2.0:1787191341.393211:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1400 00000100:00100000:2.0:1787191341.393221:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8720:x1874004634909184:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191341.393240:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483a65a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4605f8a expref: -99 pid: 57918 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191341.393319:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191341.393326:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8720:x1874004634909184:12345-192.168.202.101@tcp:104: Request processed in 107us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191341.393334:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1400 00010000:00010000:1.0:1787191341.393461:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191341.393470:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483a65a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4605f8a expref: -99 pid: 57918 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191341.393479:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51184800 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191341.393497:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483a65a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e4605f8a expref: -99 pid: 57918 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000100:00100000:0.0:1787191341.393531:0:57919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626740224:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191341.393552:0:57919:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a692 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460604e expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.393553:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483a65a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4605f8a expref: -99 pid: 57918 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191341.393574:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191341.393585:0:57919:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a692 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460604e expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.393598:0:57919:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a692 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460604e expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.393599:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483a65a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4605f8a expref: -99 pid: 57918 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191341.393621:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483a65a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4605f8a expref: -99 pid: 57918 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.393624:0:57919:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a692 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460604e expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.393640:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191341.393642:0:57919:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a692 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460604e expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.393643:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191341.393646:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191341.393661:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626740352:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787191341.393668:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a692 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460604e expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.393678:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a692 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460604e expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.393685:0:57919:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a692 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460604e expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191341.393702:0:57919:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b453aa680 x1874004626740224/t8589936985(8589936985) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191341.393717:0:57919:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453aa680 x1874004626740224/t8589936985(8589936985) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191341.393729:0:57919:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a692 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460604e expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191341.393741:0:57919:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a692 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460604e expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.393751:0:57919:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/214 (0 0) 00000080:00200000:0.0:1787191341.393758:0:57919:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191341.393804:0:57919:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xd6:0x0](ffff936b5396f448): rc = 0 00000080:00200000:0.0:1787191341.393819:0:57919:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd6:0x0]: layout version change: 4 -> 4 00000080:00010000:0.0:1787191341.393823:0:57919:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) for lock 0xe5129dc88483a692 00000080:00010000:0.0:1787191341.393902:0:57919:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) 00000080:00200008:0.0:1787191341.393914:0:57919:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xd6:0x0](ffff936b5396f448), flags 154400 00000002:00100000:0.0:1787191341.393945:0:57919:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453aa680 x1874004626740224/t8589936985(8589936985) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191341.393989:0:57919:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a692 from it ffff936b5339f840 00010000:00010000:0.0:1787191341.393992:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a692 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460604e expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.393998:0:57919:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a692 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460604e expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191341.394016:0:57919:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448), inode mode 81a4 mask 44 00000080:00200000:0.0:1787191341.394123:0:57919:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448), inode mode 81a4 mask 4 00000080:00200000:0.0:1787191341.394131:0:57919:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448), xattr lov 00000080:00200008:0.0:1787191341.394158:0:57919:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xd6:0x0](ffff936b5396f448), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191341.394165:0:57919:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448),name=f70.sanity-flr 00000002:00010000:0.0:1787191341.394185:0:57919:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd6:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.394195:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a692 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460604e expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.394204:0:57919:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a692 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460604e expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191341.394211:0:57919:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191341.394216:0:57919:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) 00000080:00010000:0.0:1787191341.394219:0:57919:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) for lock 0xe5129dc88483a692 00000080:00010000:0.0:1787191341.394223:0:57919:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a692 from it ffffa3fb4227bcd8 00010000:00010000:0.0:1787191341.394226:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a692 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460604e expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.394233:0:57919:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a692 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460604e expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191341.394249:0:57919:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd6:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1787191341.394259:0:57919:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd6:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191341.394263:0:57919:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191341.394267:0:57919:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xd6:0x0] 00000008:00010000:0.0:1787191341.394284:0:57919:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191341.394288:0:57919:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee6430, osc lock ffff936b50b63c80, flags 0x400000400001002 00010000:00010000:0.0:1787191341.394299:0:57919:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b52373000 type 11 mode 6 res 11811161089/457 (0 1048575) 00010000:00010000:0.0:1787191341.394321:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a699 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.394331:0:57919:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a699 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.394342:0:57919:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b6a475880 x1874004626740480/t0(0) o101->lustre-OST0001-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:0.0:1787191341.394377:0:57919:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:1.0:1787191341.394530:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787191341.394542:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626740480:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191341.398042:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626739968:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191341.398079:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.398093:0:57570:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.398102:0:57570:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191341.399208:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191341.399263:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191341.399288:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634909312 00000100:00100000:2.0:1787191341.399297:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634909312 00000100:00100000:2.0:1787191341.399336:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634909440 00000100:00100000:2.0:1787191341.399339:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634909440 00000100:00100000:2.0:1787191341.399351:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1401 00000100:00100000:2.0:1787191341.399359:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+5:6491:x1874004634909312:12345-192.168.202.101@tcp:105: 00010000:00010000:2.0:1787191341.399387:0:40922:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.399400:0:40922:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.399409:0:40922:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.399417:0:40922:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080080020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.399425:0:40922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080080020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.399434:0:40922:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80080020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.399456:0:40922:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b44cafe00) 00000100:00100000:2.0:1787191341.399504:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+5:6491:x1874004634909312:12345-192.168.202.101@tcp:105: Request processed in 145us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191341.399511:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1401 00000100:00100000:2.0:1787191341.399528:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1402 00000100:00100000:2.0:1787191341.399534:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8420:x1874004634909440:12345-192.168.202.101@tcp:106: 00010000:00010000:2.0:1787191341.399541:0:40922:0:(ldlm_lockd.c:2541:ldlm_callback_handler()) ### glimpse ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.399549:0:40922:0:(ldlm_lockd.c:2123:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00010000:2.0:1787191341.399574:0:40922:0:(cl_object.c:322:cl_object_glimpse()) header@00000000ed098224[0x110, 1, [0x200000405:0xd6:0x0] hash] 00000020:00010000:2.0:1787191341.399577:0:40922:0:(cl_object.c:322:cl_object_glimpse()) size: 0 mtime: 1787191341 atime: 1787191341 ctime: 1787191341 blocks: 0 00000020:00010000:2.0:1787191341.399581:0:40922:0:(cl_object.c:322:cl_object_glimpse()) header@00000000d6254bde[0x110, 2, [0x2c0000401:0x1c9:0x0] hash] 00000020:00010000:2.0:1787191341.399582:0:40922:0:(cl_object.c:322:cl_object_glimpse()) size: 0 mtime: 1787191341 atime: 1787191341 ctime: 1787191341 blocks: 0 00000100:00100000:2.0:1787191341.399603:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8420:x1874004634909440:12345-192.168.202.101@tcp:106: Request processed in 69us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191341.399620:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1402 00010000:00010000:0.0:1787191341.400908:0:57570:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.400926:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.400943:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191341.400956:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.400968:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.400976:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.401063:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a6a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.401071:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a6a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.401083:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a6a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.401107:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626740608:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191341.401197:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00000100:00100000:1.0:1787191341.408137:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626740352:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787191341.412317:0:2389:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a699 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.412337:0:2389:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a699 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.412350:0:2389:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a699 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.412359:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a699 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.412367:0:2389:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a699 lrc: 5/1,0 mode: --/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191341.412381:0:2389:0:(osc_lock.c:187:osc_lock_lvb_update()) ### no dlm lock: acquired size 0, setting rss=0; leaving kms=0, end=18446744073709551615 00000020:00200000:1.0:1787191341.412387:0:2389:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1787191341.412411:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a699 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.412418:0:2389:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a699 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.412427:0:2389:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a699 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.412435:0:2389:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44caf000 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191341.412440:0:2389:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a699 lrc: 5/0,0 mode: --/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.412451:0:2389:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191341.412457:0:2389:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a699 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.412465:0:2389:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000090c16dc/0xe5129dc88483a699 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191341.412485:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626740480:192.168.202.101@tcp:101:lfs.0 00000080:00200000:2.0:1787191341.412594:0:57919:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd6:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191341.412607:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509bb2e0 (ffff936b47a17e18/0) at cl_lock_release():245 00000020:00010000:2.0:1787191341.412611:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509bb2e0 (ffff936b47a17e18/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191341.412616:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee6430 (ffff936b47a171b8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191341.412619:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509bb2e0 (ffff936b47a17e18/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191341.412623:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee6430 (ffff936b47a17e18/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191341.412635:0:57919:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd6:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191341.412691:0:57919:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xd6:0x0](ffff936b5396f448), flags 154000 00000002:00100000:2.0:1787191341.412748:0:57919:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453aa680 x1874004626740224/t8589936985(8589936985) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191341.412759:0:57919:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191341.412764:0:57919:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9f80 x1874004626740864/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191341.412785:0:57919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626740864:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191341.412899:0:57919:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191341.413113:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626740608:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191341.413130:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a6a0 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606063 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.413146:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a6a0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4606063 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.413159:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a6a0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4606063 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.413170:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a6a0 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4606063 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191341.413180:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a6a0 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4606063 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.413190:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a6a0 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606063 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.413197:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a6a0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606063 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191341.413429:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626741120:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191341.413470:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787191341.413477:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626740992:192.168.202.101@tcp:10:bash.0 00000100:00100000:2.0:1787191341.419532:0:57919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626740864:192.168.202.101@tcp:35:lfs.0 00000002:00100000:2.0:1787191341.419572:0:57919:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453aa680 x1874004626740224/t8589936985(8589936985) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787191341.419922:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626740992:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191341.419947:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626741120:192.168.202.101@tcp:10:bash.0 00000080:00200000:0.0:1787191341.420051:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd6:0x0] updating i_size 0 i_blocks 0 00000020:00010000:0.0:1787191341.420058:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b628946c8 (ffff936b47a17ab8/0) at cl_lock_release():245 00000020:00010000:0.0:1787191341.420062:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b628946c8 (ffff936b47a17ab8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191341.420066:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f994b0 (ffff936b47a17b48/1) at cl_lock_cancel():142 00010000:00010000:0.0:1787191341.420077:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.420095:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:0.0:1787191341.420120:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f994f0 (ffff936b47a17128/1) at cl_lock_cancel():142 00010000:00010000:0.0:1787191341.420126:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a6a0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606063 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.420136:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a6a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606063 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:0.0:1787191341.420145:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b628946c8 (ffff936b47a17ab8/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191341.420148:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f994b0 (ffff936b47a17ab8/1) at cl_lock_fini():72 00000020:00010000:0.0:1787191341.420152:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f994f0 (ffff936b47a17ab8/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191341.420171:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd6:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1787191341.420182:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xd6:0x0](ffff936b5396f448) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191341.000000000, mtime 1787191341.000000000, ctime 1787191341.000000000, rc 0 00000080:00200000:2.0:1787191341.420208:0:57919:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191341.420226:0:57919:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191341.420243:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191341.420256:0:57919:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200008:0.0:1787191341.420262:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xd6:0x0], ppos: 0, count: 5 00000080:00200000:2.0:1787191341.420263:0:57919:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191341.420268:0:57919:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191341.420272:0:57919:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00200000:0.0:1787191341.420275:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00010000:2.0:1787191341.420277:0:57919:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4227bb58 00010000:00010000:2.0:1787191341.420280:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.420281:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:0.0:1787191341.420286:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00010000:00010000:2.0:1787191341.420287:0:57919:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.420291:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:0.0:1787191341.420297:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@00000000ed098224[0x110, 1, [0x200000405:0xd6:0x0] hash] 00000080:00200000:2.0:1787191341.420298:0:57919:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000020:00200000:0.0:1787191341.420299:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:0.0:1787191341.420304:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd6:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00000080:00200000:2.0:1787191341.420305:0:57919:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191341.420311:0:57919:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191341.420314:0:57919:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=9 00020000:00200000:0.0:1787191341.420318:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xd6:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00000080:00200008:2.0:1787191341.420321:0:57919:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xd6:0x0](ffff936b5396f448), request_mask 2047, flags 0, foreign 0 00020000:00200000:0.0:1787191341.420322:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd6:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191341.420325:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1787191341.420325:0:57919:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448),name=f70.sanity-flr 00000080:00200000:0.0:1787191341.420330:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00000002:00010000:2.0:1787191341.420336:0:57919:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd6:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00020000:00200000:0.0:1787191341.420337:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:0.0:1787191341.420341:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00010000:00010000:2.0:1787191341.420344:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a692 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460604e expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191341.420351:0:57919:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a692 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460604e expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191341.420358:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000080:00200000:2.0:1787191341.420358:0:57919:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191341.420361:0:57919:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) 00000080:00010000:2.0:1787191341.420363:0:57919:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) for lock 0xe5129dc88483a692 00000080:00010000:2.0:1787191341.420367:0:57919:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a692 from it ffffa3fb4227bcb8 00010000:00010000:2.0:1787191341.420370:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a692 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460604e expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000008:00010000:0.0:1787191341.420371:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00010000:00010000:2.0:1787191341.420377:0:57919:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a692 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460604e expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1787191341.420387:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee6930, osc lock ffff936b50b62980, flags 0x0 00000080:00200000:2.0:1787191341.420392:0:57919:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd6:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:2.0:1787191341.420397:0:57919:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd6:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191341.420400:0:57919:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00010000:00010000:0.0:1787191341.420402:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000001:00010000:2.0:1787191341.420402:0:57919:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xd6:0x0] 00000008:00010000:2.0:1787191341.420410:0:57919:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00010000:00010000:0.0:1787191341.420411:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000008:00010000:2.0:1787191341.420412:0:57919:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d15b0, osc lock ffff936b44e63300, flags 0x400000400001002 00010000:00010000:2.0:1787191341.420419:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 3/0,2 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.420427:0:57919:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.420429:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 7/0,3 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.420438:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 7/0,3 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.420445:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 7/0,2 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191341.420461:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:0.0:1787191341.420470:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:0.0:1787191341.420507:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:0.0:1787191341.420516:0:57570:0:(rw26.c:927:ll_write_end()) page@00000000d042e8de[3 00000000eaddb250 2 1 00000000dd89a48e 0 0 0] 00000080:00200000:0.0:1787191341.420519:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @000000003bb076ce 17ffffc0001001 3:0 ffff936b522c40e0 0 lru 00000080:00200000:0.0:1787191341.420527:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@00000000ebe22f7f 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000ef00a996 00000000280494ef > 3< 0 0 > 4< 0 0 8 478318592 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1787191341.420529:0:57570:0:(rw26.c:927:ll_write_end()) end page@00000000d042e8de 00000080:00200000:0.0:1787191341.420531:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:0.0:1787191341.420536:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:0.0:1787191341.420557:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 0000000049d5cbc5 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191341.420576:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b5396f5f8, count 1, dirtied 1 00000080:00200000:0.0:1787191341.420581:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:0.0:1787191341.420584:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00200000:2.0:1787191341.420736:0:57919:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191341.420741:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 8/0,2 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.420750:0:57919:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 7/0,1 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:2.0:1787191341.420757:0:57919:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191341.420764:0:57919:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd6:0x0] updating i_size 5 i_blocks 0 00000020:00010000:2.0:1787191341.420768:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509bb2e0 (ffff936b47a17e18/0) at cl_lock_release():245 00000020:00010000:2.0:1787191341.420770:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509bb2e0 (ffff936b47a17e18/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191341.420773:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d15b0 (ffff936b47a171b8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191341.420777:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509bb2e0 (ffff936b47a17e18/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191341.420779:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d15b0 (ffff936b47a17e18/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191341.420788:0:57919:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd6:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191341.420817:0:57919:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191341.420825:0:57919:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191341.420858:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191341.420867:0:57919:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191341.420874:0:57919:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191341.420878:0:57919:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191341.420881:0:57919:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191341.420886:0:57919:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4227bbf8 00010000:00010000:2.0:1787191341.420889:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191341.420898:0:57919:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191341.420908:0:57919:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191341.420913:0:57919:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191341.420916:0:57919:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191341.420920:0:57919:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000020:00010000:0.0:1787191341.420976:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b628946c8 (ffff936b47a17ab8/0) at cl_lock_release():245 00000020:00010000:0.0:1787191341.420981:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b628946c8 (ffff936b47a17ab8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191341.420984:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee6930 (ffff936b47a17128/1) at cl_lock_cancel():142 00010000:00010000:0.0:1787191341.420989:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.420998:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:0.0:1787191341.421008:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b628946c8 (ffff936b47a17ab8/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191341.421010:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee6930 (ffff936b47a17ab8/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191341.421017:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:0.0:1787191341.421022:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:0.0:1787191341.421038:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd6:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191341.421041:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:0.0:1787191341.421045:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd6:0x0] updating i_size 5 i_blocks 0 00000080:00200000:0.0:1787191341.421048:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:0.0:1787191341.421067:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xd6:0x0](ffff936b5396f448), flags 100001 00000002:00100000:0.0:1787191341.421123:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a477b80 x1874004626737280/t8589936976(8589936976) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191341.421135:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191341.421141:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a476a00 x1874004626741376/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191341.421161:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626741376:192.168.202.101@tcp:35:bash.0 00000100:00100000:0.0:1787191341.421249:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00000080:00200000:2.0:1787191341.421484:0:57919:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448), inode mode 81a4 mask 46 00000080:00200008:2.0:1787191341.421493:0:57919:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xd6:0x0](ffff936b5396f448), flags 154402 00000002:00010000:2.0:1787191341.421509:0:57919:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd6:0x0]) in obj [0x200000405:0xd6:0x0], intent: open flags 0104240114403 00010000:00010000:2.0:1787191341.421550:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184c00/0xe5129dc88483a6a7 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.421558:0:57919:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184c00/0xe5129dc88483a6a7 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57919 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191341.421567:0:57919:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:2.0:1787191341.421573:0:57919:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9f80 x1874004626741632/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191341.421581:0:57919:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184c00/0xe5129dc88483a6a7 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57919 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191341.421592:0:57919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626741632:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191341.421781:0:57919:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191341.424103:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626741376:192.168.202.101@tcp:35:bash.0 00000002:00100000:0.0:1787191341.424138:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a477b80 x1874004626737280/t8589936976(8589936976) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787191341.427305:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191341.427458:0:40922:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787191341.427477:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634909568 00000100:00100000:3.0:1787191341.427486:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634909568 00000100:00100000:3.0:1787191341.427618:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1403 00000100:00100000:3.0:1787191341.427629:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b50881c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634909568:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191341.427648:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a692 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e460604e expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191341.427767:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191341.427774:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b50881c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634909568:12345-192.168.202.101@tcp:104: Request processed in 148us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191341.427781:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1403 00010000:00010000:0.0:1787191341.428099:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191341.428106:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a692 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e460604e expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.428114:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40031800 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191341.428119:0:43384:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a692 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e460604e expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.428127:0:43384:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a692 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e460604e expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.428136:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a692 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e460604e expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.428160:0:43384:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a684 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460600f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191341.428201:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a692 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e460604e expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.428213:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191341.428237:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a692 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e460604e expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.428244:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a692 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e460604e expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.428257:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191341.428259:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191341.428260:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191341.428275:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626741760:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00200000:1.0:1787191341.429518:0:57920:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191341.429545:0:57920:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191341.429559:0:57920:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.429572:0:57920:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.429579:0:57920:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191341.429586:0:57920:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191341.429589:0:57920:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191341.429596:0:57920:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42163b58 00010000:00010000:1.0:1787191341.429600:0:57920:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.429609:0:57920:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.429629:0:57920:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191341.429637:0:57920:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:1.0:1787191341.429754:0:57920:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191341.429769:0:57920:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:1.0:1787191341.429773:0:57920:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191341.429787:0:57920:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191341.429868:0:57920:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a6ae lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.429876:0:57920:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a6ae lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.429886:0:57920:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a6ae lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191341.429908:0:57920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57920:1874004626741888:192.168.202.101@tcp:101:rm.0 00000100:00100000:1.0:1787191341.430277:0:57920:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893900 going to sleep for 11 seconds 00000100:00100000:2.0:1787191341.437443:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191341.437511:0:57919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626741632:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191341.437538:0:57919:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CW ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184c00/0xe5129dc88483a6a7 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606071 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.437551:0:57919:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184c00/0xe5129dc88483a6a7 lrc: 4/1,0 mode: --/CW res: [0x200000405:0xd6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606071 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.437563:0:57919:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184c00/0xe5129dc88483a6a7 lrc: 4/1,0 mode: CW/CW res: [0x200000405:0xd6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606071 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.437574:0:57919:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184c00/0xe5129dc88483a6a7 lrc: 4/1,0 mode: CW/CW res: [0x200000405:0xd6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606071 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.437587:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184c00/0xe5129dc88483a6a7 lrc: 5/1,1 mode: CW/CW res: [0x200000405:0xd6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606071 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.437596:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184c00/0xe5129dc88483a6a7 lrc: 5/1,1 mode: CW/CW res: [0x200000405:0xd6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606071 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.437604:0:57919:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184c00/0xe5129dc88483a6a7 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xd6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606071 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191341.437615:0:57919:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x200002b, status=0 req@ffff936b513b9f80 x1874004626741632/t8589936988(8589936988) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191341.437629:0:57919:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9f80 x1874004626741632/t8589936988(8589936988) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191341.437661:0:57919:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184c00/0xe5129dc88483a6a7 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xd6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606071 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.437673:0:57919:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 8 res 8589935621/214 (0 0) 00000080:00200000:2.0:1787191341.437679:0:57919:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xd6:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1787191341.437729:0:57919:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) for lock 0xe5129dc88483a6a7 00000080:00010000:2.0:1787191341.437736:0:57919:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a6a7 from it ffffa3fb4227bbf0 00010000:00010000:2.0:1787191341.437740:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184c00/0xe5129dc88483a6a7 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xd6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606071 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.437749:0:57919:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184c00/0xe5129dc88483a6a7 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xd6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606071 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00100000:2.0:1787191341.437774:0:57919:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9f80 x1874004626741632/t8589936988(8589936988) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191341.437993:0:57919:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448), inode mode 81a4 mask 4 00000080:00200000:2.0:1787191341.438003:0:57919:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448), xattr lov 00000080:00200008:2.0:1787191341.438037:0:57919:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xd6:0x0](ffff936b5396f448), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191341.438045:0:57919:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448),name=f70.sanity-flr 00000002:00010000:2.0:1787191341.438060:0:57919:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd6:0x0]) in obj [0x200000405:0xd6:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191341.438067:0:57919:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 30 res 8589935621/214 (0 0) 00010000:00010000:2.0:1787191341.438107:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a6b5 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.438114:0:57919:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a6b5 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.438128:0:57919:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a6b5 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57919 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191341.438146:0:57919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626742016:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191341.438284:0:57919:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191341.438698:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626741760:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191341.439012:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634909696 00000100:00100000:3.0:1787191341.439021:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634909696 00000100:00100000:3.0:1787191341.439075:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1404 00000100:00100000:3.0:1787191341.439085:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634909696:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191341.439097:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184c00/0xe5129dc88483a6a7 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xd6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e4606071 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191341.439244:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191341.439250:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634909696:12345-192.168.202.101@tcp:104: Request processed in 167us (1819us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191341.439258:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1404 00010000:00010000:1.0:1787191341.439313:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191341.439320:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184c00/0xe5129dc88483a6a7 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xd6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e4606071 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.439328:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51184c00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191341.439333:0:57627:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184c00/0xe5129dc88483a6a7 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xd6:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4606071 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.439342:0:57627:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184c00/0xe5129dc88483a6a7 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xd6:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4606071 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.439352:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184c00/0xe5129dc88483a6a7 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0xd6:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x7130d520e4606071 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.439397:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184c00/0xe5129dc88483a6a7 lrc: 2/0,0 mode: --/CW res: [0x200000405:0xd6:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e4606071 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.439403:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191341.439425:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184c00/0xe5129dc88483a6a7 lrc: 1/0,0 mode: --/CW res: [0x200000405:0xd6:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e4606071 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.439432:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184c00/0xe5129dc88483a6a7 lrc: 0/0,0 mode: --/CW res: [0x200000405:0xd6:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e4606071 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.439446:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191341.439447:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191341.439449:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191341.439454:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787191341.439464:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626742144:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191341.443160:0:57919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626742016:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191341.443186:0:57919:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a6b5 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46060a2 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.443199:0:57919:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a6b5 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46060a2 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.443213:0:57919:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a6b5 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46060a2 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.443229:0:57919:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a6b5 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46060a2 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.443241:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a6b5 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46060a2 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.443249:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a6b5 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46060a2 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.443256:0:57919:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a6b5 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46060a2 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191341.443266:0:57919:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b513b9c00 x1874004626742016/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/976 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191341.443280:0:57919:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a6b5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46060a2 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191341.443293:0:57919:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a6b5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46060a2 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.443304:0:57919:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/214 (0 0) 00000080:00200000:3.0:1787191341.443311:0:57919:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xd6:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1787191341.443381:0:57919:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd6:0x0]: layout version change: 4 -> 4 00000080:00010000:3.0:1787191341.443386:0:57919:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) for lock 0xe5129dc88483a6b5 00000080:00010000:3.0:1787191341.443403:0:57919:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) 00000080:00010000:3.0:1787191341.443407:0:57919:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a6b5 from it ffffa3fb4227bcd8 00010000:00010000:3.0:1787191341.443412:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a6b5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46060a2 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.443421:0:57919:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a6b5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46060a2 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191341.443454:0:57919:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd6:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00020000:00200000:3.0:1787191341.443465:0:57919:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd6:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191341.443469:0:57919:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191341.443473:0:57919:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xd6:0x0] 00000008:00010000:3.0:1787191341.443490:0:57919:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191341.443494:0:57919:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667730, osc lock ffff936b44f65690, flags 0x400000400001002 00010000:00010000:3.0:1787191341.443510:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191341.443525:0:57919:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:3.0:1787191341.443536:0:57919:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191341.443540:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191341.443548:0:57919:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:3.0:1787191341.443558:0:57919:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191341.443568:0:57919:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd6:0x0] updating i_size 5 i_blocks 0 00000020:00010000:3.0:1787191341.443574:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b516544a0 (ffff936b465cc008/0) at cl_lock_release():245 00000020:00010000:3.0:1787191341.443578:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b516544a0 (ffff936b465cc008/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191341.443581:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667730 (ffff936b465cccf8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191341.443585:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b516544a0 (ffff936b465cc008/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191341.443588:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667730 (ffff936b465cc008/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191341.443611:0:57919:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd6:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200080:3.0:1787191341.443729:0:57919:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448) cmd=c00c66f3 arg=1e702e0 00000002:00010000:3.0:1787191341.443753:0:57919:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd6:0x0]) in obj [0x200000405:0xd6:0x0], intent: open flags 05004040000002 00010000:00010000:3.0:1787191341.443796:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483a6bc lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.443804:0:57919:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483a6bc lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57919 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191341.443815:0:57919:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191341.443822:0:57919:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1d180 x1874004626742400/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191341.443862:0:57919:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483a6bc lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x81000000000000 pid: 57919 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191341.443884:0:57919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626742400:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191341.444084:0:57919:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787191341.444877:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626742144:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191341.445200:0:57920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57920:1874004626741888:192.168.202.101@tcp:101:rm.0 00010000:00010000:0.0:1787191341.445217:0:57920:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a6ae lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606094 expref: -99 pid: 57920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.445241:0:57920:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a6ae lrc: 4/1,0 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606094 expref: -99 pid: 57920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.445249:0:57920:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a6ae lrc: 4/1,0 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606094 expref: -99 pid: 57920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.445260:0:57920:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a6ae lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606094 expref: -99 pid: 57920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.445272:0:57920:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a6ae lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606094 expref: -99 pid: 57920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.445287:0:57920:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a6ae lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606094 expref: -99 pid: 57920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.445295:0:57920:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a6ae lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606094 expref: -99 pid: 57920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.445302:0:57920:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a6ae lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606094 expref: -99 pid: 57920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191341.445312:0:57920:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b453ab480 x1874004626741888/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/976 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191341.445322:0:57920:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a6ae lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606094 expref: -99 pid: 57920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191341.445334:0:57920:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a6ae lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606094 expref: -99 pid: 57920 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.445344:0:57920:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a6b5 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46060a2 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.445354:0:57920:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a6b5 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46060a2 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.445362:0:57920:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a6ae lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606094 expref: -99 pid: 57920 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.445368:0:57920:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a6ae lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x7130d520e4606094 expref: -99 pid: 57920 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.445375:0:57920:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a6ae lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x7130d520e4606094 expref: -99 pid: 57920 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.445449:0:57920:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000080:00200000:0.0:1787191341.445457:0:57920:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191341.445500:0:57920:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xd6:0x0](ffff936b5396f448): rc = 0 00000080:00200000:0.0:1787191341.445514:0:57920:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd6:0x0]: layout version change: 4 -> 4 00000080:00010000:0.0:1787191341.445519:0:57920:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) for lock 0xe5129dc88483a6b5 00000080:00010000:0.0:1787191341.445532:0:57920:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) 00000080:00010000:0.0:1787191341.445535:0:57920:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a6b5 from it ffffa3fb42163b20 00010000:00010000:0.0:1787191341.445538:0:57920:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a6b5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46060a2 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.445546:0:57920:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a6b5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46060a2 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200008:0.0:1787191341.445581:0:57920:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xd6:0x0](ffff936b5396f448), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191341.445587:0:57920:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448),name=f70.sanity-flr 00000002:00010000:0.0:1787191341.445616:0:57920:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd6:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.445624:0:57920:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a6b5 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46060a2 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.445633:0:57920:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a6b5 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46060a2 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191341.445640:0:57920:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191341.445652:0:57920:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) 00000080:00010000:0.0:1787191341.445656:0:57920:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) for lock 0xe5129dc88483a6b5 00000080:00010000:0.0:1787191341.445660:0:57920:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a6b5 from it ffffa3fb42163cb8 00010000:00010000:0.0:1787191341.445663:0:57920:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a6b5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46060a2 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.445669:0:57920:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a6b5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46060a2 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191341.445684:0:57920:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd6:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:0.0:1787191341.445695:0:57920:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd6:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191341.445698:0:57920:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191341.445701:0:57920:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xd6:0x0] 00000008:00010000:0.0:1787191341.445717:0:57920:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191341.445720:0:57920:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee6930, osc lock ffff936b50b62980, flags 0x400000400001002 00010000:00010000:0.0:1787191341.445734:0:57920:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.445745:0:57920:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:0.0:1787191341.445756:0:57920:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191341.445760:0:57920:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.445769:0:57920:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:0.0:1787191341.445784:0:57920:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191341.445792:0:57920:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd6:0x0] updating i_size 5 i_blocks 0 00000020:00010000:0.0:1787191341.445797:0:57920:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509ba500 (ffff936b47a17ab8/0) at cl_lock_release():245 00000020:00010000:0.0:1787191341.445800:0:57920:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509ba500 (ffff936b47a17ab8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191341.445802:0:57920:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee6930 (ffff936b47a17128/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191341.445806:0:57920:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509ba500 (ffff936b47a17ab8/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191341.445808:0:57920:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee6930 (ffff936b47a17ab8/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191341.445817:0:57920:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd6:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191341.445892:0:57920:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191341.445902:0:57920:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.445910:0:57920:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.445918:0:57920:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.445991:0:57920:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191341.445996:0:57920:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191341.445999:0:57920:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191341.446004:0:57920:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42163c10 00010000:00010000:0.0:1787191341.446007:0:57920:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.446014:0:57920:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.446037:0:57920:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.446044:0:57920:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:0.0:1787191341.446049:0:57920:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.446055:0:57920:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:0.0:1787191341.446059:0:57920:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:0.0:1787191341.446063:0:57920:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:0.0:1787191341.446087:0:57920:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a684 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e460600f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1787191341.446099:0:57920:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xd6:0x0]: losing layout lock 00010000:00010000:0.0:1787191341.446119:0:57920:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a6ae lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4606094 expref: -99 pid: 57920 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1787191341.446128:0:57920:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xd6:0x0]: losing layout lock 00010000:00010000:0.0:1787191341.446135:0:57920:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a6b5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46060a2 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191341.446142:0:57920:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xd6:0x0]: losing layout lock 00010000:00010000:0.0:1787191341.446146:0:57920:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a676 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4605fd7 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.446182:0:57920:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a684 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460600f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191341.446189:0:57920:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a6ae lrc: 2/0,0 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4606094 expref: -99 pid: 57920 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.446194:0:57920:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a6b5 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46060a2 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.446201:0:57920:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a676 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4605fd7 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.446206:0:57920:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 4 locks packed 00010000:00010000:0.0:1787191341.446209:0:57920:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a684 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460600f expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191341.446220:0:57920:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a6b5 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46060a2 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.446229:0:57920:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a676 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4605fd7 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1787191341.446248:0:57920:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 36, max 7 00000100:00100000:0.0:1787191341.446256:0:57920:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477b80 x1874004626742656/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 512/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787191341.446276:0:57920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57920:1874004626742656:192.168.202.101@tcp:36:rm.0 00000100:00100000:0.0:1787191341.446349:0:57920:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00010000:00010000:3.0:1787191341.447324:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191341.447332:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a6ae lrc: 1/0,0 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4606094 expref: -99 pid: 57920 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.447343:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191341.447347:0:40929:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a6ae lrc: 1/0,0 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4606094 expref: -99 pid: 57920 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.447360:0:40929:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a6ae lrc: 1/0,0 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4606094 expref: -99 pid: 57920 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.447367:0:40929:0:(ldlm_request.c:1774:ldlm_cli_cancel()) ### lock is already being destroyed 00010000:00010000:3.0:1787191341.447370:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a6ae lrc: 1/0,0 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4606094 expref: -99 pid: 57920 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.447376:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a6ae lrc: 0/0,0 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4606094 expref: -99 pid: 57920 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.447388:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191341.447389:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191341.447391:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191341.447550:0:57919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626742400:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191341.447563:0:57919:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483a6bc lrc: 4/1,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e46060b0 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.447572:0:57919:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483a6bc lrc: 4/1,0 mode: --/PW res: [0x200000405:0xd6:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e46060b0 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.447582:0:57919:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483a6bc lrc: 4/1,0 mode: PW/PW res: [0x200000405:0xd6:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e46060b0 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.447590:0:57919:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483a6bc lrc: 4/1,0 mode: PW/PW res: [0x200000405:0xd6:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e46060b0 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.447605:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483a6bc lrc: 5/1,1 mode: PW/PW res: [0x200000405:0xd6:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e46060b0 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.447622:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483a6bc lrc: 5/1,1 mode: PW/PW res: [0x200000405:0xd6:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e46060b0 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.447629:0:57919:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483a6bc lrc: 4/0,1 mode: PW/PW res: [0x200000405:0xd6:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e46060b0 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191341.447639:0:57919:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x600002b, status=0 req@ffff936b51d1d180 x1874004626742400/t8589936989(8589936989) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191341.447657:0:57919:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1d180 x1874004626742400/t8589936989(8589936989) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191341.447671:0:57919:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483a6bc lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xd6:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e46060b0 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.447679:0:57919:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 2 res 8589935621/214 (0 0) 00000080:00200000:3.0:1787191341.447685:0:57919:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xd6:0x0] suppgids 0 0: rc 0 00000002:00100000:3.0:1787191341.447700:0:57919:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1d180 x1874004626742400/t8589936989(8589936989) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1787191341.447708:0:57919:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) for lock 0xe5129dc88483a6bc 00000080:00010000:3.0:1787191341.447713:0:57919:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a6bc from it ffffa3fb4227bcc0 00010000:00010000:3.0:1787191341.447716:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483a6bc lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xd6:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e46060b0 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.447728:0:57919:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483a6bc lrc: 2/0,0 mode: PW/PW res: [0x200000405:0xd6:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e46060b0 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1787191341.447784:0:57919:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd6:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00010000:00010000:3.0:1787191341.447792:0:57919:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/214 (0 0) 00000080:00010000:3.0:1787191341.447797:0:57919:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xd6:0x0](ffff936b5396f448) 00000002:00010000:3.0:1787191341.447804:0:57919:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd6:0x0]) in obj [0x200000405:0xd6:0x0], intent: layout flags 0 00010000:00010000:3.0:1787191341.447864:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6c3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.447871:0:57919:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6c3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.447880:0:57919:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6c3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57919 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191341.447893:0:57919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626742784:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191341.448173:0:57919:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787191341.449574:0:57919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626742784:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191341.449594:0:57919:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6c3 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46060d3 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.449613:0:57919:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6c3 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46060d3 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191341.449622:0:57919:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b51d1c000 x1874004626742784/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191341.449630:0:57919:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6c3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46060d3 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191341.449637:0:57919:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6c3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46060d3 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.449648:0:57919:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/214 (0 0) 00000080:00200000:3.0:1787191341.449653:0:57919:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xd6:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1787191341.449664:0:57919:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) for lock 0xe5129dc88483a6c3 00000080:00010000:3.0:1787191341.449670:0:57919:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a6c3 from it ffffa3fb4227bb70 00010000:00010000:3.0:1787191341.449672:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6c3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46060d3 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.449679:0:57919:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6c3 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46060d3 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191341.449695:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6c3 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46060d3 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191341.449701:0:57919:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6c3 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46060d3 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:3.0:1787191341.449707:0:57919:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xd6:0x0](000000003f5f83f6) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6c3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46060d3 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191341.449747:0:57919:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd6:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:3.0:1787191341.449750:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6c3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46060d3 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191341.449756:0:57919:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6c3 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46060d3 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:3.0:1787191341.449768:0:57919:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd6:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191341.449770:0:57919:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191341.449777:0:57919:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191341.449785:0:57919:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000100:00100000:0.0:1787191341.450006:0:57920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57920:1874004626742656:192.168.202.101@tcp:36:rm.0 00000100:00100000:2.0:1787191341.450478:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626742912:192.168.202.101@tcp:1:lfs.0 00000100:00100000:3.0:1787191341.453813:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191341.453875:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634909824 00000100:00100000:3.0:1787191341.453884:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634909824 00000100:00100000:3.0:1787191341.454061:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1405 00000100:00100000:3.0:1787191341.454072:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:29543:x1874004634909824:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191341.454092:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420080020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191341.454184:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191341.454191:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:29543:x1874004634909824:12345-192.168.202.101@tcp:104: Request processed in 121us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191341.454199:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1405 00010000:00010000:1.0:1787191341.455118:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191341.455130:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420080020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191341.455142:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cafe00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191341.455148:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800428480020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000008:00010000:1.0:1787191341.455179:0:40930:0:(osc_cache.c:2029:try_to_add_extent_for_io()) ### extent: 0000000049d5cbc5 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800429480020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000008:00010000:1.0:1787191341.455194:0:40930:0:(osc_cache.c:1183:osc_extent_make_ready()) ### extent: 0000000049d5cbc5 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800429480020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191341.455242:0:40930:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800429480020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000008:00100000:1.0:1787191341.455318:0:40930:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff936b453a8e00 - object 0x2c0000401:457 offset 0<>5 00000100:00100000:1.0:1787191341.455368:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626743040:192.168.202.101@tcp:4:bash.0 00000080:00200000:2.0:1787191341.458607:0:57921:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191341.458640:0:57921:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191341.458659:0:57921:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191341.458676:0:57921:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191341.458684:0:57921:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191341.458691:0:57921:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191341.458694:0:57921:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191341.458703:0:57921:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4220bb58 00010000:00010000:2.0:1787191341.458706:0:57921:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191341.458712:0:57921:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191341.458727:0:57921:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191341.458733:0:57921:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:2.0:1787191341.458738:0:57921:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191341.458745:0:57921:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:2.0:1787191341.458749:0:57921:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191341.458759:0:57921:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191341.458798:0:57921:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483a6ca lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.458803:0:57921:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483a6ca lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.458811:0:57921:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483a6ca lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191341.458932:0:2389:0:(osc_cache.c:917:osc_extent_finish()) ### extent: 0000000049d5cbc5 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800429480020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000008:00010000:1.0:1787191341.458974:0:2389:0:(osc_cache.c:497:__osc_extent_remove()) ### extent: 0000000049d5cbc5 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800429480020000 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000100:00100000:1.0:1787191341.458998:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626743040:192.168.202.101@tcp:4:bash.0 00000100:00100000:2.0:1787191341.459069:0:57921:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57921:1874004626743168:192.168.202.101@tcp:101:lfs.0 00000080:00200000:0.0:1787191341.459087:0:40930:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1787191341.459132:0:40930:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00000100:00100000:2.0:1787191341.459159:0:57921:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5fa80 going to sleep for 11 seconds 00010000:00010000:0.0:1787191341.459165:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69480020020 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191341.459173:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787191341.459216:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626743296:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787191341.459267:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69480020020 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191341.459276:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a68b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69480020020 nid: local remote: 0x7130d520e4606032 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191341.459295:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191341.459297:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191341.459299:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191341.460657:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626743296:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191341.461886:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626742912:192.168.202.101@tcp:1:lfs.0 00010000:00010000:3.0:1787191341.462117:0:57919:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6c3 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46060d3 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191341.462140:0:57919:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xd6:0x0]: losing layout lock 00010000:00010000:3.0:1787191341.462182:0:57919:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6c3 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46060d3 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191341.462188:0:57919:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191341.462192:0:57919:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6c3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46060d3 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000020:00100000:3.0:1787191341.462208:0:57919:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1787191341.462216:0:57919:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1c000 x1874004626743552/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 472/440 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191341.462235:0:57919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626743552:192.168.202.101@tcp:36:lfs.0 00000100:00100000:3.0:1787191341.462416:0:57919:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787191341.462512:0:57921:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57921:1874004626743168:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191341.462524:0:57921:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483a6ca lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.462535:0:57921:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483a6ca lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.462541:0:57921:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483a6ca lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.462548:0:57921:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483a6ca lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.462556:0:57921:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483a6ca lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.462562:0:57921:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51185a00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191341.462566:0:57921:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483a6ca lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.462572:0:57921:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483a6ca lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.462579:0:57921:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483a6ca lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.462585:0:57921:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191341.462589:0:57921:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483a6ca lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.462596:0:57921:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483a6ca lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191341.462613:0:57921:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513b8a80 x1874004626743168/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191341.462633:0:57921:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191341.462711:0:57921:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191341.462728:0:57921:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191341.462737:0:57921:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.462747:0:57921:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.462754:0:57921:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191341.462760:0:57921:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191341.462763:0:57921:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191341.462768:0:57921:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4220bbe8 00010000:00010000:1.0:1787191341.462772:0:57921:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.462777:0:57921:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.462787:0:57921:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191341.462793:0:57921:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000080:00200000:1.0:1787191341.462797:0:57921:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191341.462806:0:57921:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:1.0:1787191341.462808:0:57921:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191341.462817:0:57921:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191341.462881:0:57921:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a6d1 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.462893:0:57921:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a6d1 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.462903:0:57921:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a6d1 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191341.462913:0:57921:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57921:1874004626743680:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191341.462953:0:57921:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628933c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191341.464883:0:57921:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57921:1874004626743680:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191341.464901:0:57921:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a6d1 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.464913:0:57921:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a6d1 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.464920:0:57921:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a6d1 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.464926:0:57921:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a6d1 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.464934:0:57921:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a6d1 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.464940:0:57921:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191341.464944:0:57921:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a6d1 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.464951:0:57921:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a6d1 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.464959:0:57921:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a6d1 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.464965:0:57921:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191341.464971:0:57921:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a6d1 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.464978:0:57921:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a6d1 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191341.464998:0:57921:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b453a9f80 x1874004626743680/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191341.465011:0:57921:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191341.465105:0:57921:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191341.465118:0:57921:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191341.465129:0:57921:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.465139:0:57921:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.465146:0:57921:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191341.465152:0:57921:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191341.465155:0:57921:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191341.465161:0:57921:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4220bb58 00010000:00010000:1.0:1787191341.465164:0:57921:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.465173:0:57921:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.465184:0:57921:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191341.465189:0:57921:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:1.0:1787191341.465196:0:57921:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:1.0:1787191341.465199:0:57921:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:1.0:1787191341.465207:0:57921:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191341.465213:0:57921:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 90 lru_type: 1 00010000:00010000:1.0:1787191341.465218:0:57921:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 90 lru_type: 1 00000002:00010000:1.0:1787191341.465223:0:57921:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191341.465250:0:57921:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a6d8 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.465255:0:57921:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a6d8 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.465260:0:57921:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a6d8 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191341.465272:0:57921:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57921:1874004626743808:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191341.465331:0:57921:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628933c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191341.466824:0:57921:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57921:1874004626743808:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191341.466967:0:57921:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a6d8 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606119 expref: -99 pid: 57921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.466979:0:57921:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a6d8 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606119 expref: -99 pid: 57921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.466991:0:57921:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a6d8 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606119 expref: -99 pid: 57921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.467002:0:57921:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a6d8 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606119 expref: -99 pid: 57921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.467012:0:57921:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a6d8 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606119 expref: -99 pid: 57921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.467018:0:57921:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a6d8 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606119 expref: -99 pid: 57921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.467034:0:57921:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a6d8 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606119 expref: -99 pid: 57921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191341.467049:0:57921:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b453a9f80 x1874004626743808/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191341.467062:0:57921:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a6d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606119 expref: -99 pid: 57921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.467071:0:57921:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:1.0:1787191341.467079:0:57921:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a6d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606119 expref: -99 pid: 57921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.467087:0:57921:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a6d8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606119 expref: -99 pid: 57921 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:1.0:1787191341.467107:0:57921:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191341.467117:0:57921:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 180 lru_type: 1 00010000:00010000:1.0:1787191341.467128:0:57921:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 180 lru_type: 1 00010000:00010000:1.0:1787191341.467136:0:57921:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 180 lru_type: 1 00010000:00010000:1.0:1787191341.467143:0:57921:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 181 lru_type: 1 00000080:00200000:1.0:1787191341.467156:0:57921:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191341.467163:0:57921:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:1.0:1787191341.467166:0:57921:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:1.0:1787191341.467171:0:57921:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb4220bcb8 00010000:00010000:1.0:1787191341.467174:0:57921:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 90 lru_type: 1 00010000:00010000:1.0:1787191341.467179:0:57921:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 91 lru_type: 1 00000002:00010000:1.0:1787191341.467188:0:57921:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191341.467193:0:57921:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a6d8 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606119 expref: -99 pid: 57921 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.467198:0:57921:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a6d8 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606119 expref: -99 pid: 57921 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.467203:0:57921:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a6d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606119 expref: -99 pid: 57921 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.467207:0:57921:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a6d8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606119 expref: -99 pid: 57921 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:1.0:1787191341.467211:0:57921:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191341.467214:0:57921:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 181 lru_type: 1 00010000:00010000:1.0:1787191341.467218:0:57921:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 181 lru_type: 1 00010000:00010000:1.0:1787191341.467222:0:57921:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 181 lru_type: 1 00010000:00010000:1.0:1787191341.467226:0:57921:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 182 lru_type: 1 00000080:00200008:1.0:1787191341.467942:0:57921:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:1.0:1787191341.467949:0:57921:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191341.467964:0:57921:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191341.467973:0:57921:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.467984:0:57921:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.467990:0:57921:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191341.467994:0:57921:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191341.467997:0:57921:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191341.468002:0:57921:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4220bcb8 00010000:00010000:1.0:1787191341.468005:0:57921:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.468013:0:57921:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.468121:0:57921:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191341.468131:0:57921:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191341.468137:0:57921:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.468146:0:57921:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.468152:0:57921:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191341.468156:0:57921:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191341.468158:0:57921:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191341.468162:0:57921:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4220bb58 00010000:00010000:1.0:1787191341.468171:0:57921:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.468176:0:57921:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.468183:0:57921:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191341.468187:0:57921:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:1.0:1787191341.468191:0:57921:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191341.468197:0:57921:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:1.0:1787191341.468199:0:57921:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191341.468208:0:57921:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191341.468238:0:57921:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a6df lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.468243:0:57921:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a6df lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.468250:0:57921:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a6df lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191341.468264:0:57921:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57921:1874004626743936:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191341.468330:0:57921:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628933c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191341.471413:0:57921:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57921:1874004626743936:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191341.471436:0:57921:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a6df lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.471450:0:57921:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a6df lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.471460:0:57921:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a6df lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.471474:0:57921:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a6df lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.471480:0:57921:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a6df lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.471484:0:57921:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030000 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191341.471488:0:57921:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a6df lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.471493:0:57921:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a6df lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.471497:0:57921:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a6df lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.471501:0:57921:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191341.471506:0:57921:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a6df lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.471510:0:57921:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a6df lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191341.471524:0:57921:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b453a9f80 x1874004626743936/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191341.471535:0:57921:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1787191341.471557:0:57921:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a6d8 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606119 expref: -99 pid: 57921 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191341.471567:0:57921:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a6d8 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606119 expref: -99 pid: 57921 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:1.0:1787191341.471573:0:57921:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a6d8 from it ffffa3fb4220b930 00010000:00010000:1.0:1787191341.471576:0:57921:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a6d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606119 expref: -99 pid: 57921 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191341.471581:0:57921:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a6d8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606119 expref: -99 pid: 57921 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191341.471652:0:57921:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191341.471665:0:57921:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191341.471671:0:57921:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.471676:0:57921:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.471680:0:57921:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191341.471684:0:57921:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191341.471686:0:57921:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191341.471690:0:57921:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4220bbf8 00010000:00010000:1.0:1787191341.471692:0:57921:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.471696:0:57921:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.471705:0:57921:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191341.471710:0:57921:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191341.471714:0:57921:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191341.471719:0:57921:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:1.0:1787191341.471721:0:57921:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:1.0:1787191341.471724:0:57921:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b53d88300, open_flags a141, mode 81b6 opened 0 00000080:00200000:1.0:1787191341.471732:0:57921:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:1.0:1787191341.471746:0:57921:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xd7:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:1.0:1787191341.471754:0:57921:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a6d8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4606119 expref: -99 pid: 57921 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191341.471788:0:57921:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a6d8 lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4606119 expref: -99 pid: 57921 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191341.471792:0:57921:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191341.471794:0:57921:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a6d8 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4606119 expref: -99 pid: 57921 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191341.471817:0:57921:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a6e6 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.471821:0:57921:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a6e6 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191341.471828:0:57921:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:1.0:1787191341.471878:0:57921:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9f80 x1874004626744192/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191341.471893:0:57921:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a6e6 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191341.471912:0:57921:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57921:1874004626744192:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191341.472046:0:57921:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628933c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191341.476602:0:57921:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589936991 gen 1 00000100:00100000:1.0:1787191341.476623:0:57921:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b513b9f80 x1874004626741632/t8589936988(8589936988) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787191341.476635:0:57921:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b51d1d180 x1874004626742400/t8589936989(8589936989) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787191341.476658:0:57921:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff936b453a9f80 x1874004626744192/t8589936992(8589936992) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191357 ref 3 fl Rpc:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787191341.476670:0:57921:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57921:1874004626744192:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191341.476691:0:57921:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a6e6 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460614a expref: -99 pid: 57921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.476722:0:57921:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a6e6 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460614a expref: -99 pid: 57921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.476731:0:57921:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a6e6 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460614a expref: -99 pid: 57921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.476741:0:57921:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a6e6 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460614a expref: -99 pid: 57921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.476759:0:57921:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a6e6 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460614a expref: -99 pid: 57921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.476772:0:57921:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a6e6 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460614a expref: -99 pid: 57921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.476780:0:57921:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a6e6 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460614a expref: -99 pid: 57921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191341.476782:0:57919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626743552:192.168.202.101@tcp:36:lfs.0 00010000:00010000:1.0:1787191341.476788:0:57921:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a6e6 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460614a expref: -99 pid: 57921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191341.476797:0:57921:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b453a9f80 x1874004626744192/t8589936992(8589936992) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191341.476807:0:57921:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9f80 x1874004626744192/t8589936992(8589936992) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1787191341.476812:0:57919:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/214 (0 0) 00000002:00010000:1.0:1787191341.476819:0:57921:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a6e6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460614a expref: -99 pid: 57921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00010000:3.0:1787191341.476822:0:57919:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xd6:0x0](ffff936b5396f448) 00010000:00010000:1.0:1787191341.476827:0:57921:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/215 (0 0) 00000002:00010000:3.0:1787191341.476853:0:57919:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd6:0x0]) in obj [0x200000405:0xd6:0x0], intent: layout flags 0 00000080:00200000:1.0:1787191341.476863:0:57921:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191341.476873:0:57921:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00010000:00010000:3.0:1787191341.476893:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6ed lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57919 initiator: MDT0 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1787191341.476901:0:57921:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xd7:0x0](ffff936b5395a1c8) 00010000:00010000:3.0:1787191341.476901:0:57919:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6ed lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57919 initiator: MDT0 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1787191341.476907:0:57921:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xd7:0x0], updating i_size 0 00010000:00010000:3.0:1787191341.476910:0:57919:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6ed lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57919 initiator: MDT0 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1787191341.476941:0:57921:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd7:0x0]: layout version change: 4294967294 -> 4294967295 00000100:00100000:3.0:1787191341.476941:0:57919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626744320:192.168.202.101@tcp:101:lfs.0 00000080:00010000:1.0:1787191341.476945:0:57921:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xd7:0x0](ffff936b5395a1c8) 00000080:00010000:1.0:1787191341.476949:0:57921:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd7:0x0](ffff936b5395a1c8) for lock 0xe5129dc88483a6e6 00000080:00010000:1.0:1787191341.476959:0:57921:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd7:0x0](ffff936b5395a1c8) 00000080:00200008:1.0:1787191341.476973:0:57921:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xd7:0x0](ffff936b5395a1c8), flags 120501 00000002:00100000:1.0:1787191341.476990:0:57921:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9f80 x1874004626744192/t8589936992(8589936992) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787191341.477018:0:57919:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cd80 going to sleep for 11 seconds 00000080:00010000:1.0:1787191341.477035:0:57921:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a6e6 from it ffff936b5339fea0 00010000:00010000:1.0:1787191341.477041:0:57921:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a6e6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460614a expref: -99 pid: 57921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.477050:0:57921:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a6e6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460614a expref: -99 pid: 57921 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191341.477070:0:57921:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd7:0x0](ffff936b5395a1c8), inode mode 81a4 mask 40 00000080:00200000:1.0:1787191341.477130:0:57921:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd7:0x0](ffff936b5395a1c8), inode mode 81a4 mask 2 00000080:00200000:1.0:1787191341.477140:0:57921:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xd7:0x0](ffff936b5395a1c8), xattr lov 00000002:00010000:1.0:1787191341.477154:0:57921:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd7:0x0]) in obj [0x200000405:0xd7:0x0], intent: open flags 040000002 00010000:00010000:1.0:1787191341.477182:0:57921:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a6f4 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.477189:0:57921:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a6f4 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191341.477199:0:57921:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191341.477205:0:57921:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453aaa00 x1874004626744576/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191341.477214:0:57921:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a6f4 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191341.477225:0:57921:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aaa00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57921:1874004626744576:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191341.477358:0:57921:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628933c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191341.479491:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191341.479522:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634910464 00000100:00100000:2.0:1787191341.479530:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634910464 00000100:00100000:2.0:1787191341.479580:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1406 00000100:00100000:2.0:1787191341.479590:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634910464:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191341.479605:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a6e6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e460614a expref: -99 pid: 57921 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.479661:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191341.479667:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634910464:12345-192.168.202.101@tcp:104: Request processed in 80us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191341.479674:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1406 00010000:00010000:0.0:1787191341.479691:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191341.479700:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a6e6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e460614a expref: -99 pid: 57921 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.479708:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40031a00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191341.479714:0:43384:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a6e6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e460614a expref: -99 pid: 57921 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.479723:0:43384:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a6e6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e460614a expref: -99 pid: 57921 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.479730:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a6e6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e460614a expref: -99 pid: 57921 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191341.479754:0:43384:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xd7:0x0]: losing layout lock 00010000:00010000:0.0:1787191341.479795:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a6e6 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e460614a expref: -99 pid: 57921 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.479802:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787191341.479905:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626744704:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787191341.480345:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a6e6 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e460614a expref: -99 pid: 57921 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.480354:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a6e6 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e460614a expref: -99 pid: 57921 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.480368:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191341.480369:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191341.480371:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191341.481656:0:57919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626744320:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191341.481687:0:57919:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6ed lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606158 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.481707:0:57919:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6ed lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606158 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191341.481722:0:57919:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b51d1c000 x1874004626744320/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191341.481732:0:57919:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6ed lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606158 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191341.481746:0:57919:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6ed lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606158 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.481755:0:57919:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/214 (0 0) 00000080:00200000:3.0:1787191341.481762:0:57919:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xd6:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1787191341.481777:0:57919:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) for lock 0xe5129dc88483a6ed 00000080:00010000:3.0:1787191341.481785:0:57919:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a6ed from it ffffa3fb4227bc70 00010000:00010000:3.0:1787191341.481789:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6ed lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606158 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.481799:0:57919:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6ed lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606158 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191341.481822:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6ed lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606158 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191341.481863:0:57919:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6ed lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606158 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:3.0:1787191341.481878:0:57919:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xd6:0x0](000000003f5f83f6) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6ed lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606158 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191341.481924:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6ed lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606158 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191341.481933:0:57919:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6ed lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606158 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191341.481948:0:57919:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd6:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00020000:00200000:3.0:1787191341.482155:0:57919:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd6:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191341.482160:0:57919:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191341.482166:0:57919:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191341.482178:0:57919:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1787191341.482196:0:57919:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:3.0:1787191341.482210:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6ed lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606158 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191341.482220:0:57919:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6ed lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606158 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:3.0:1787191341.482227:0:57919:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xd6:0x0](000000003f5f83f6) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6ed lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606158 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191341.482246:0:57919:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd6:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00020000:00200000:3.0:1787191341.482251:0:57919:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd6:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191341.482253:0:57919:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191341.482256:0:57919:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191341.482260:0:57919:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1787191341.482266:0:57919:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:3.0:1787191341.482289:0:57919:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191341 1787191341 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a6a0 lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x1c6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606063 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191341.482336:0:57919:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd6:0x0]: layout version change: 4294967294 -> 5 00010000:00010000:3.0:1787191341.482339:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6ed lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606158 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191341.482344:0:57919:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6ed lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606158 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200080:3.0:1787191341.482362:0:57919:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448) cmd=66f4 arg=1e702e0 00000080:00200008:3.0:1787191341.482371:0:57919:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xd6:0x0](ffff936b5396f448), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191341.482377:0:57919:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448),name=f70.sanity-flr 00000002:00010000:3.0:1787191341.482388:0:57919:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd6:0x0]) in obj [0x200000405:0xd6:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191341.482392:0:57919:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 30 res 8589935621/214 (0 0) 00010000:00010000:3.0:1787191341.482428:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a6fb lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.482436:0:57919:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a6fb lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.482445:0:57919:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a6fb lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57919 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191341.482476:0:57919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626744832:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191341.482912:0:57921:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aaa00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57921:1874004626744576:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191341.482921:0:57921:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a6f4 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xd7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.482930:0:57921:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a6f4 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xd7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.482936:0:57921:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a6f4 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xd7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.482941:0:57921:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a6f4 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xd7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.482948:0:57921:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a6f4 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xd7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.482953:0:57921:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191341.482958:0:57921:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a6f4 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xd7:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.482964:0:57921:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a6f4 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xd7:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.482976:0:57921:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a6f4 lrc: 5/0,0 mode: --/CR res: [0x200000405:0xd7:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.482982:0:57921:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191341.482987:0:57921:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a6f4 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xd7:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.482992:0:57921:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a6f4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xd7:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57921 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191341.483007:0:57921:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b453aaa00 x1874004626744576/t8589936993(8589936993) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191341.483014:0:57921:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453aaa00 x1874004626744576/t8589936993(8589936993) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191341.483037:0:57921:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xd7:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787191341.483069:0:57921:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd7:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00000080:00200000:0.0:1787191341.483074:0:57921:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd7:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:3.0:1787191341.483088:0:57919:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cd80 going to sleep for 11 seconds 00000080:00200000:0.0:1787191341.483108:0:57921:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xd7:0x0], updating i_size 0 00000002:00100000:0.0:1787191341.483123:0:57921:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453aaa00 x1874004626744576/t8589936993(8589936993) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191341.483151:0:57921:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453aaa00 x1874004626744576/t8589936993(8589936993) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191341.483160:0:57921:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191341.483166:0:57921:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a476680 x1874004626745088/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191341.483186:0:57921:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57921:1874004626745088:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191341.483212:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626744704:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191341.483218:0:57921:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00000100:00100000:1.0:1787191341.486511:0:57921:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57921:1874004626745088:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191341.486554:0:57921:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453aaa00 x1874004626744576/t8589936993(8589936993) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1787191341.486626:0:57921:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xd7:0x0](ffff936b5395a1c8), flags 100001 00000002:00100000:1.0:1787191341.486671:0:57921:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a9f80 x1874004626744192/t8589936992(8589936992) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191357 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191341.486681:0:57921:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191341.486686:0:57921:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8a80 x1874004626745344/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191341.486707:0:57921:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57921:1874004626745344:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191341.486877:0:57919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626744832:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191341.486894:0:57919:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a6fb lrc: 4/1,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460617b expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.486904:0:57919:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a6fb lrc: 4/1,0 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460617b expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.486917:0:57919:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a6fb lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460617b expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.486927:0:57919:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a6fb lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460617b expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.486940:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a6fb lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460617b expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.486948:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a6fb lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460617b expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.486955:0:57919:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a6fb lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460617b expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191341.486963:0:57919:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b51d1c000 x1874004626744832/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/976 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191341.486972:0:57919:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a6fb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460617b expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191341.486991:0:57919:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a6fb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460617b expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.487001:0:57919:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/214 (0 0) 00000080:00200000:0.0:1787191341.487007:0:57919:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xd6:0x0] suppgids 0 0: rc 0 00000100:00100000:1.0:1787191341.487017:0:57921:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893000 going to sleep for 11 seconds 00000080:00200000:0.0:1787191341.487069:0:57919:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd6:0x0]: layout version change: 5 -> 5 00000080:00010000:0.0:1787191341.487075:0:57919:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) for lock 0xe5129dc88483a6fb 00000080:00010000:0.0:1787191341.487081:0:57919:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) 00000080:00010000:0.0:1787191341.487083:0:57919:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a6fb from it ffffa3fb4227bcd8 00010000:00010000:0.0:1787191341.487086:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a6fb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460617b expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.487094:0:57919:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a6fb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460617b expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191341.487124:0:57919:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd6:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1787191341.487135:0:57919:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd6:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191341.487139:0:57919:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191341.487142:0:57919:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xd6:0x0] 00000008:00010000:0.0:1787191341.487160:0:57919:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191341.487163:0:57919:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee64b0, osc lock ffff936b50b62980, flags 0x400000400001002 00010000:00010000:0.0:1787191341.487201:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.487212:0:57919:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.487227:0:57919:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b6a476d80 x1874004626745472/t0(0) o101->lustre-OST0001-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:0.0:1787191341.487266:0:57919:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:0.0:1787191341.487277:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787191341.487289:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626745472:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191341.488598:0:57921:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57921:1874004626745344:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191341.488622:0:57921:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a9f80 x1874004626744192/t8589936992(8589936992) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1787191341.490870:0:2389:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.490897:0:2389:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.490914:0:2389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.490926:0:2389:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191341.490943:0:2389:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 5, setting rss=5; kms=5, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 5/2,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1787191341.490954:0:2389:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1787191341.490968:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.490975:0:2389:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.490984:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.490993:0:2389:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1787191341.491014:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626745472:192.168.202.101@tcp:101:lfs.0 00000080:00200000:3.0:1787191341.491146:0:57919:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd6:0x0] updating i_size 5 i_blocks 8 00000020:00010000:3.0:1787191341.491152:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509bb530 (ffff936b47a17488/0) at cl_lock_release():245 00000020:00010000:3.0:1787191341.491156:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509bb530 (ffff936b47a17488/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191341.491162:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee64b0 (ffff936b47a17998/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191341.491165:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509bb530 (ffff936b47a17488/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191341.491168:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee64b0 (ffff936b47a17488/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191341.491182:0:57919:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd6:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191341.493591:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191341.493685:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191341.493703:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191341.493716:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191341.493724:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191341.493734:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191341.493738:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191341.493746:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:2.0:1787191341.493750:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191341.493758:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191341.493774:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191341.493781:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191341.493788:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191341.493803:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:2.0:1787191341.493808:0:57570:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b464afc80, open_flags 8241, mode 81b6 opened 0 00000080:00200000:2.0:1787191341.493816:0:57570:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:2.0:1787191341.494499:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xd8:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0101102 00010000:00010000:2.0:1787191341.494568:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a709 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.494584:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a709 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191341.494669:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191341.494684:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8e00 x1874004626745728/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191341.494695:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a709 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191341.494716:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626745728:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191341.494992:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f300 going to sleep for 11 seconds 00000100:00100000:1.0:1787191341.498899:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626745728:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191341.498940:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a709 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460619e expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.498975:0:57570:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a709 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460619e expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.498984:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a709 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460619e expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.498996:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a709 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460619e expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.499008:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a709 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460619e expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.499020:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a709 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460619e expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.499039:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a709 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460619e expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.499047:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a709 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460619e expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191341.499058:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x2b, status=0 req@ffff936b513b8e00 x1874004626745728/t8589936996(8589936996) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191341.499070:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b8e00 x1874004626745728/t8589936996(8589936996) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191341.499083:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a709 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460619e expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191341.499096:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a709 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460619e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.499105:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/215 (0 0) 00000080:00200000:1.0:1787191341.499110:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191341.499157:0:57570:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xd7:0x0](ffff936b5395a1c8): rc = 0 00000080:00200000:1.0:1787191341.499171:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd7:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:1.0:1787191341.499175:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd7:0x0](ffff936b5395a1c8) for lock 0xe5129dc88483a709 00000080:00010000:1.0:1787191341.499185:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd7:0x0](ffff936b5395a1c8) 00000080:00200008:1.0:1787191341.499199:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xd7:0x0](ffff936b5395a1c8), flags 101101 00000002:00100000:1.0:1787191341.499219:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b8e00 x1874004626745728/t8589936996(8589936996) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191341.499246:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a709 from it ffff936b60dc4ba0 00010000:00010000:1.0:1787191341.499250:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a709 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460619e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.499259:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a709 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460619e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191341.499281:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd7:0x0](ffff936b5395a1c8), inode mode 81a4 mask 42 00000002:00010000:1.0:1787191341.499310:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xd7:0x0], intent: getxattr flags 0 00010000:00010000:1.0:1787191341.499350:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a710 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.499357:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a710 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.499366:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a710 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191341.499391:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626745856:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191341.499489:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893000 going to sleep for 11 seconds 00000100:00100000:1.0:1787191341.502282:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626745856:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191341.502309:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a710 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46061b3 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.502324:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a710 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46061b3 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.502335:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a710 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46061b3 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191341.502349:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b453aad80 x1874004626745856/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191341.502361:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a710 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46061b3 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.502371:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/215 (0 0) 00000080:00200000:1.0:1787191341.502378:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xd7:0x0] suppgids 0 -1: rc 0 00000080:00010000:1.0:1787191341.502401:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd7:0x0](ffff936b5395a1c8) for lock 0xe5129dc88483a710 00000080:00010000:1.0:1787191341.502410:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a710 from it ffffa3fb41caba38 00010000:00010000:1.0:1787191341.502414:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a710 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46061b3 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.502424:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a710 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46061b3 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:1.0:1787191341.502459:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xd7:0x0](ffff936b5395a1c8) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191341.000000000, mtime 1787191341.000000000, ctime 1787191341.000000000 00010000:00010000:1.0:1787191341.502486:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a709 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e460619e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191341.502503:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xd7:0x0]: losing layout lock 00010000:00010000:1.0:1787191341.502541:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a709 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460619e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.502548:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191341.502551:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a709 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460619e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1787191341.502570:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1787191341.502576:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453aad80 x1874004626746112/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787191341.502596:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626746112:192.168.202.101@tcp:36:bash.0 00000100:00100000:1.0:1787191341.502717:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893000 going to sleep for 11 seconds 00000100:00100000:1.0:1787191341.512050:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626746112:192.168.202.101@tcp:36:bash.0 00000080:00200000:1.0:1787191341.512172:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:1.0:1787191341.512180:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd7:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00010000:00010000:1.0:1787191341.512202:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/215 (0 0) 00000080:00010000:1.0:1787191341.512215:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xd7:0x0](ffff936b5395a1c8) 00000002:00010000:1.0:1787191341.512226:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd7:0x0]) in obj [0x200000405:0xd7:0x0], intent: layout flags 0 00010000:00010000:1.0:1787191341.512276:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a717 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.512286:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a717 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.512296:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a717 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191341.512315:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626746240:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191341.513269:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893000 going to sleep for 11 seconds 00000100:00100000:1.0:1787191341.515421:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626746240:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191341.515456:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a717 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xd7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46061c1 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.515474:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a717 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xd7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46061c1 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191341.515540:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b453a9500 x1874004626746240/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191341.515553:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a717 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46061c1 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191341.515566:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a717 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46061c1 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.515576:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/215 (0 0) 00000080:00200000:1.0:1787191341.515583:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xd7:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191341.515600:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd7:0x0](ffff936b5395a1c8) for lock 0xe5129dc88483a717 00000080:00010000:1.0:1787191341.515610:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a717 from it ffffa3fb41cab8c8 00010000:00010000:1.0:1787191341.515614:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a717 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46061c1 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.515624:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a717 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46061c1 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.515650:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a717 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46061c1 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.515662:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a717 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46061c1 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:1.0:1787191341.515670:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xd7:0x0](00000000cdc23562) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a717 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46061c1 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191341.515723:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd7:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:1.0:1787191341.515729:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a717 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46061c1 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.515736:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a717 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46061c1 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:1.0:1787191341.515753:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xd7:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:1.0:1787191341.515761:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd7:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191341.515765:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xd7:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:1.0:1787191341.515773:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xd7:0x0](ffff936b5395a1c8) 00000002:00010000:1.0:1787191341.515784:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd7:0x0]) in obj [0x200000405:0xd7:0x0], intent: layout flags 02 00010000:00010000:1.0:1787191341.515799:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a717 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46061c1 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191341.515812:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xd7:0x0]: losing layout lock 00010000:00010000:1.0:1787191341.516064:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a717 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xd7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46061c1 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191341.516073:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191341.516076:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a717 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xd7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46061c1 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191341.516103:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a71e lrc: 3/0,1 mode: --/EX res: [0x200000405:0xd7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.516184:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a71e lrc: 3/0,1 mode: --/EX res: [0x200000405:0xd7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191341.516197:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191341.516206:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9500 x1874004626746496/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191341.516216:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a71e lrc: 3/0,1 mode: --/EX res: [0x200000405:0xd7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191341.516238:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626746496:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191341.516325:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893000 going to sleep for 11 seconds 00000100:00100000:1.0:1787191341.526043:0:57570:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589936999 gen 1 00000100:00100000:1.0:1787191341.526143:0:57570:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b513b8e00 x1874004626745728/t8589936996(8589936996) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787191341.526163:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626746496:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191341.526186:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a71e lrc: 4/0,1 mode: --/EX res: [0x200000405:0xd7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46061cf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.526199:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a71e lrc: 4/0,1 mode: --/CR res: [0x200000405:0xd7:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46061cf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.526211:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a71e lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xd7:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46061cf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.526223:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a71e lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xd7:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46061cf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.526237:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a71e lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xd7:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46061cf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.526247:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a71e lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xd7:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46061cf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.526254:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a71e lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xd7:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46061cf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191341.526264:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b453a9500 x1874004626746496/t8589936999(8589936999) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191341.526283:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a71e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd7:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46061cf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191341.526294:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a71e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd7:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46061cf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.526307:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/215 (0 0) 00000080:00200000:1.0:1787191341.526314:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xd7:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191341.526326:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd7:0x0](ffff936b5395a1c8) for lock 0xe5129dc88483a71e 00000080:00010000:1.0:1787191341.526335:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a71e from it ffffa3fb41cab930 00010000:00010000:1.0:1787191341.526339:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a71e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd7:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46061cf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.526347:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a71e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd7:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46061cf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191341.526366:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:1.0:1787191341.526373:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd7:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:1.0:1787191341.526387:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a71e lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd7:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46061cf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.526397:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a71e lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd7:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46061cf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:1.0:1787191341.526405:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xd7:0x0](00000000cdc23562) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a71e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd7:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46061cf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.526445:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a71e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd7:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46061cf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.526454:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a71e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd7:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46061cf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191341.526472:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd7:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1787191341.526482:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd7:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191341.526486:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191341.526493:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191341.526534:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191341.526554:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd7:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:1.0:1787191341.526570:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a71e lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd7:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46061cf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191341.526579:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a71e lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd7:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46061cf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:1.0:1787191341.526587:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xd7:0x0](00000000cdc23562) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a71e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd7:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46061cf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191341.526603:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd7:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1787191341.526607:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd7:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191341.526610:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191341.526612:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191341.526632:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191341.526638:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd7:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191341.526718:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd7:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:1.0:1787191341.526724:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a71e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd7:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46061cf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191341.526732:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a71e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd7:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46061cf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00020000:00200000:1.0:1787191341.526751:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xd7:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:1.0:1787191341.526755:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd7:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191341.526757:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191341.526762:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191341.526773:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191341.526777:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:1.0:1787191341.526789:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:1.0:1787191341.526792:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b62893030, osc lock ffff936b46837690, flags 0x80000000 00000008:00010000:1.0:1787191341.526797:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:1.0:1787191341.526798:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b62893070, osc lock ffff936b46836980, flags 0x80000000 00010000:00010000:1.0:1787191341.526874:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a725 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.526883:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a725 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.526894:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a725 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191341.526915:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626746624:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191341.527018:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893180 going to sleep for 11 seconds 00000100:00100000:1.0:1787191341.529453:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626746624:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191341.529483:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a725 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46061d6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.529503:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a725 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e46061d6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.529516:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a725 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e46061d6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.529531:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a725 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e46061d6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191341.529546:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a725 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e46061d6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.529559:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a725 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46061d6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.529567:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a725 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46061d6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.529635:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a72c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.529645:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a72c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.529654:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a72c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191341.529674:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626746752:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191341.529740:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893180 going to sleep for 11 seconds 00000100:00100000:1.0:1787191341.533256:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626746752:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191341.533285:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a72c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46061dd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.533303:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a72c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e46061dd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.533315:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a72c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e46061dd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.533328:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a72c lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e46061dd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191341.533340:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a72c lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e46061dd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.533351:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a72c lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46061dd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.533360:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a72c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46061dd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191341.533455:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787191341.533470:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626746880:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191341.533574:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626747008:192.168.202.101@tcp:10:bash.0 00000080:00200080:2.0:1787191341.534701:0:57919:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448) cmd=400866b1 arg=1 00000080:00200008:2.0:1787191341.534718:0:57919:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xd6:0x0](ffff936b5396f448), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191341.534726:0:57919:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448),name=f70.sanity-flr 00000002:00010000:2.0:1787191341.534748:0:57919:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd6:0x0]) in obj [0x200000405:0xd6:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191341.534763:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a6fb lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460617b expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.534777:0:57919:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a6fb lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460617b expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191341.534785:0:57919:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xd6:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191341.534794:0:57919:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) 00000080:00010000:2.0:1787191341.534798:0:57919:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) for lock 0xe5129dc88483a6fb 00000080:00010000:2.0:1787191341.534806:0:57919:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a6fb from it ffffa3fb4227bcd8 00010000:00010000:2.0:1787191341.534809:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a6fb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460617b expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.534818:0:57919:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a6fb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460617b expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191341.535018:0:57919:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd6:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:2.0:1787191341.535040:0:57919:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd6:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191341.535044:0:57919:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191341.535047:0:57919:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xd6:0x0] 00000008:00010000:2.0:1787191341.535065:0:57919:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191341.535069:0:57919:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1d30, osc lock ffff936b44e63300, flags 0x400000400001002 00010000:00010000:2.0:1787191341.535085:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.535096:0:57919:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:2.0:1787191341.535106:0:57919:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191341.535110:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.535118:0:57919:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:2.0:1787191341.535127:0:57919:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191341.535135:0:57919:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd6:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191341.535139:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509bb2e0 (ffff936b47a17e18/0) at cl_lock_release():245 00000020:00010000:2.0:1787191341.535142:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509bb2e0 (ffff936b47a17e18/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191341.535146:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1d30 (ffff936b47a171b8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191341.535150:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509bb2e0 (ffff936b47a17e18/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191341.535152:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1d30 (ffff936b47a17e18/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191341.535165:0:57919:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd6:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191341.535181:0:57919:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xd6:0x0], offset: 0, type: SEEK_DATA 00000080:00200000:2.0:1787191341.535187:0:57919:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd6:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:2.0:1787191341.535191:0:57919:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd6:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191341.535194:0:57919:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191341.535198:0:57919:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191341.535203:0:57919:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191341.535218:0:57919:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd6:0x0] updating i_size 5 i_blocks 8 00000080:00200000:2.0:1787191341.535226:0:57919:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd6:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191341.535231:0:57919:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000080:00200000:2.0:1787191341.535233:0:57919:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd6:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191341.535237:0:57919:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191341.535240:0:57919:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191341.535243:0:57919:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:2.0:1787191341.535249:0:57919:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:2.0:1787191341.535251:0:57919:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1d30, osc lock ffff936b44e63300, flags 0x0 00010000:00010000:2.0:1787191341.535259:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191341.535268:0:57919:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191341.535277:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191341.535285:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191341.535293:0:57919:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191341.535301:0:57919:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd6:0x0] updating i_size 5 i_blocks 8 00000100:00100000:3.0:1787191341.535401:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626747136:192.168.202.101@tcp:23:lfs.0 00000100:00100000:1.0:1787191341.536297:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626746880:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191341.536317:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626747008:192.168.202.101@tcp:10:bash.0 00000080:00200000:2.0:1787191341.536367:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd7:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191341.536373:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b53cc58a8 (ffff936b47a17f38/0) at cl_lock_release():245 00000020:00010000:2.0:1787191341.536376:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b53cc58a8 (ffff936b47a17f38/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191341.536379:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62893030 (ffff936b465cc5a8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191341.536387:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a725 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46061d6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.536398:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a725 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46061d6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191341.536412:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62893070 (ffff936b465cc2d8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191341.536416:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a72c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46061dd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.536423:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a72c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46061dd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191341.536431:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b53cc58a8 (ffff936b47a17f38/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191341.536434:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62893030 (ffff936b47a17f38/1) at cl_lock_fini():72 00000020:00010000:2.0:1787191341.536438:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62893070 (ffff936b47a17f38/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191341.536451:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd7:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191341.536482:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xd7:0x0](ffff936b5395a1c8) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191341.000000000, mtime 1787191341.000000000, ctime 1787191341.000000000, rc 0 00000080:00200008:2.0:1787191341.536567:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xd7:0x0], ppos: 0, count: 5 00000080:00200000:2.0:1787191341.536580:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191341.536586:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:2.0:1787191341.536591:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:2.0:1787191341.536595:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1787191341.536601:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@0000000017a04194[0x110, 1, [0x200000405:0xd7:0x0] hash] 00000020:00200000:2.0:1787191341.536603:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:2.0:1787191341.536607:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd7:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191341.536618:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xd7:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:2.0:1787191341.536623:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd7:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191341.536625:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1787191341.536630:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1787191341.536637:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:2.0:1787191341.536639:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1787191341.536650:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:2.0:1787191341.536660:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1787191341.536664:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1f30, osc lock ffff936b44e62260, flags 0x0 00010000:00010000:2.0:1787191341.536677:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a725 lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46061d6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.536688:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a725 lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46061d6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.536697:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a725 lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46061d6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.536705:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a725 lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46061d6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.536718:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a725 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46061d6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191341.536728:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:2.0:1787191341.536736:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191341.536776:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:2.0:1787191341.536785:0:57570:0:(rw26.c:927:ll_write_end()) page@000000004e3c4999[3 000000000e6d7102 2 1 000000001aac01d1 0 0 0] 00000080:00200000:2.0:1787191341.536788:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @00000000767b1a0d 17ffffc0001001 3:0 ffff936b43a1e8c0 0 lru 00000080:00200000:2.0:1787191341.536795:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@000000005104a24f 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000a2a44f55 00000000f5ddd5d2 > 3< 0 0 > 4< 0 0 8 403660800 - | - - - - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1787191341.536801:0:57570:0:(rw26.c:927:ll_write_end()) end page@000000004e3c4999 00000080:00200000:2.0:1787191341.536802:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:2.0:1787191341.536807:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:2.0:1787191341.536823:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 00000000a1af3917 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a725 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46061d6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191341.537276:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b5395a378, count 1, dirtied 1 00000080:00200000:2.0:1787191341.537281:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:2.0:1787191341.537284:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:2.0:1787191341.537297:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b497c95d8 (ffff936b465cc2d8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191341.537300:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b497c95d8 (ffff936b465cc2d8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191341.537303:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1f30 (ffff936b465cc5a8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191341.537308:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a725 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46061d6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.537318:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a725 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46061d6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:2.0:1787191341.537336:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b497c95d8 (ffff936b465cc2d8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191341.537338:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1f30 (ffff936b465cc2d8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191341.537344:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:2.0:1787191341.537348:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1787191341.537353:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd7:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191341.537357:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:2.0:1787191341.537363:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd7:0x0] updating i_size 5 i_blocks 0 00000080:00200000:2.0:1787191341.537366:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:2.0:1787191341.537385:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xd7:0x0](ffff936b5395a1c8), flags 100001 00000002:00100000:2.0:1787191341.537435:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513b8e00 x1874004626745728/t8589936996(8589936996) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191341.537447:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191341.537453:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb480 x1874004626747392/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191341.537474:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626747392:192.168.202.101@tcp:35:bash.0 00000100:00100000:2.0:1787191341.537594:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f300 going to sleep for 11 seconds 00000100:00100000:2.0:1787191341.539969:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626747136:192.168.202.101@tcp:23:lfs.0 00000020:00010000:0.0:1787191341.540017:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894218 (ffff936b47a17e18/0) at cl_lock_release():245 00000020:00010000:0.0:1787191341.540031:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894218 (ffff936b47a17e18/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191341.540037:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1d30 (ffff936b47a171b8/1) at cl_lock_cancel():142 00010000:00010000:0.0:1787191341.540046:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.540070:0:57919:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00010000:0.0:1787191341.540088:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894218 (ffff936b47a17e18/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191341.540095:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1d30 (ffff936b47a17e18/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191341.540117:0:57919:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd6:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1787191341.540130:0:57919:0:(file.c:5244:ll_file_seek()) COMPLETED file f70.sanity-flr:[0x200000405:0xd6:0x0], offset: 0, type: SEEK_DATA, rc = 0 00000080:00200008:0.0:1787191341.540147:0:57919:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xd6:0x0], offset: 0, type: SEEK_HOLE 00000080:00200000:0.0:1787191341.540155:0:57919:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd6:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:0.0:1787191341.540164:0:57919:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd6:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191341.540167:0:57919:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191341.540173:0:57919:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191341.540180:0:57919:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191341.540196:0:57919:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd6:0x0] updating i_size 5 i_blocks 8 00000080:00200000:0.0:1787191341.540207:0:57919:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd6:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191341.540213:0:57919:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000080:00200000:0.0:1787191341.540216:0:57919:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd6:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191341.540221:0:57919:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191341.540224:0:57919:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191341.540227:0:57919:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:0.0:1787191341.540238:0:57919:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:0.0:1787191341.540241:0:57919:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee6430, osc lock ffff936b50b63b50, flags 0x0 00010000:00010000:0.0:1787191341.540261:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.540275:0:57919:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.540287:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.540296:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.540304:0:57919:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191341.540315:0:57919:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd6:0x0] updating i_size 5 i_blocks 8 00000100:00100000:0.0:1787191341.540362:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626747520:192.168.202.101@tcp:23:lfs.0 00000100:00100000:2.0:1787191341.541470:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626747392:192.168.202.101@tcp:35:bash.0 00000002:00100000:2.0:1787191341.541500:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513b8e00 x1874004626745728/t8589936996(8589936996) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787191341.545009:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626747520:192.168.202.101@tcp:23:lfs.0 00000020:00010000:2.0:1787191341.545246:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894218 (ffff936b47a17e18/0) at cl_lock_release():245 00000020:00010000:2.0:1787191341.545251:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894218 (ffff936b47a17e18/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191341.545257:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee6430 (ffff936b47a171b8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191341.545267:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191341.545283:0:57919:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00010000:2.0:1787191341.545299:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894218 (ffff936b47a17e18/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191341.545302:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee6430 (ffff936b47a17e18/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191341.545344:0:57919:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd6:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191341.545363:0:57919:0:(file.c:5244:ll_file_seek()) COMPLETED file f70.sanity-flr:[0x200000405:0xd6:0x0], offset: 0, type: SEEK_HOLE, rc = 5 00000080:00200080:2.0:1787191341.545377:0:57919:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448) cmd=400866b1 arg=0 00000080:00200080:2.0:1787191341.545385:0:57919:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448) cmd=400866b1 arg=1 00000080:00200008:2.0:1787191341.545391:0:57919:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xd6:0x0](ffff936b5396f448), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191341.545399:0:57919:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448),name=f70.sanity-flr 00000002:00010000:2.0:1787191341.545420:0:57919:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd6:0x0]) in obj [0x200000405:0xd6:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191341.545435:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a6fb lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460617b expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191341.545448:0:57919:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a6fb lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460617b expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191341.545455:0:57919:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xd6:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191341.545463:0:57919:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) 00000080:00010000:2.0:1787191341.545466:0:57919:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) for lock 0xe5129dc88483a6fb 00000080:00010000:2.0:1787191341.545472:0:57919:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a6fb from it ffffa3fb4227bcd8 00010000:00010000:2.0:1787191341.545475:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a6fb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460617b expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191341.545488:0:57919:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a6fb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460617b expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191341.545509:0:57919:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd6:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:2.0:1787191341.545518:0:57919:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd6:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191341.545521:0:57919:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191341.545524:0:57919:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xd6:0x0] 00000008:00010000:2.0:1787191341.545538:0:57919:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191341.545541:0:57919:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1f30, osc lock ffff936b44e62260, flags 0x400000400001002 00010000:00010000:2.0:1787191341.545554:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191341.545563:0:57919:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:2.0:1787191341.545575:0:57919:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191341.545579:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191341.545586:0:57919:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 1 00000020:00200000:2.0:1787191341.545594:0:57919:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191341.545602:0:57919:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd6:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191341.545604:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51655030 (ffff936b465cc2d8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191341.545606:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51655030 (ffff936b465cc2d8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191341.545610:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1f30 (ffff936b465cc5a8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191341.545613:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51655030 (ffff936b465cc2d8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191341.545615:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1f30 (ffff936b465cc2d8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191341.545621:0:57919:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd6:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191341.545643:0:57919:0:(file.c:2483:do_file_read_iter()) START file f70.sanity-flr:[0x200000405:0xd6:0x0], ppos: 0, count: 4096 00000080:00200000:2.0:1787191341.545652:0:57919:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: read ppos: 0, bytes: 4096 00000080:00200000:2.0:1787191341.545659:0:57919:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000020:00200000:2.0:1787191341.545665:0:57919:0:(cl_io.c:214:cl_io_rw_init()) header@00000000ed098224[0x110, 2, [0x200000405:0xd6:0x0] hash] 00000020:00200000:2.0:1787191341.545667:0:57919:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 4096) 2048 0 00000080:00200000:2.0:1787191341.545670:0:57919:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd6:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00000080:00200000:2.0:1787191341.545679:0:57919:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1787191341.545685:0:57919:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:2.0:1787191341.545689:0:57919:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1787191341.545701:0:57919:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:2.0:1787191341.545708:0:57919:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:2.0:1787191341.545711:0:57919:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1f30, osc lock ffff936b44e62260, flags 0x40000 00000080:00200000:2.0:1787191341.545717:0:57919:0:(vvp_io.c:835:vvp_io_read_start()) f70.sanity-flr: read [0, 4096) 00000001:00010000:2.0:1787191341.545723:0:57919:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xd6:0x0] 00000008:00010000:2.0:1787191341.545727:0:57919:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191341.545729:0:57919:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1d30, osc lock ffff936b44e62390, flags 0x400001002 00010000:00010000:2.0:1787191341.545737:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 1 00010000:00010000:2.0:1787191341.545746:0:57919:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 1 00000020:00200000:2.0:1787191341.545755:0:57919:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191341.545758:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 1 00010000:00010000:2.0:1787191341.545771:0:57919:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 1 00000020:00200000:2.0:1787191341.545779:0:57919:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191341.545783:0:57919:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd6:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191341.545785:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51655030 (ffff936b465cc2d8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191341.545787:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51655030 (ffff936b465cc2d8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191341.545790:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1d30 (ffff936b465cc5a8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191341.545792:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51655030 (ffff936b465cc2d8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191341.545794:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1d30 (ffff936b465cc2d8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191341.545800:0:57919:0:(vvp_io.c:893:vvp_io_read_start()) count:4096 iocb pos:0 00000080:00200000:2.0:1787191341.545805:0:57919:0:(rw26.c:362:ll_direct_IO()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448), size=4096 (max 536870912), offset=0=0x0, pages 1 (max 131072), lockless, parallel 00000020:00200000:2.0:1787191341.546266:0:57919:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1787191341.546270:0:57919:0:(rw26.c:544:ll_direct_IO()) result 0 tot_bytes 5 count 5 file_offset 5 00000020:00010000:2.0:1787191341.546276:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b497c95d8 (ffff936b465cc2d8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191341.546279:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b497c95d8 (ffff936b465cc2d8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191341.546282:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1f30 (ffff936b465cc5a8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191341.546285:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b497c95d8 (ffff936b465cc2d8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191341.546287:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1f30 (ffff936b465cc2d8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191341.546292:0:57919:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000020:00200000:2.0:1787191341.546297:0:57919:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1787191341.546316:0:25580:0:(osc_cache.c:2029:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff936b46699180 00000008:00100000:2.0:1787191341.546355:0:25580:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff936b513bb480 - object 0x2c0000401:457 offset 0<>5 00000100:00100000:2.0:1787191341.547293:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787191341.547313:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626747648:192.168.202.101@tcp:3:lfs.0 00000080:00200000:1.0:1787191341.552647:0:57922:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191341.552678:0:57922:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191341.552695:0:57922:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.552713:0:57922:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.552721:0:57922:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191341.552728:0:57922:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191341.552732:0:57922:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191341.552739:0:57922:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4225bb58 00010000:00010000:1.0:1787191341.552743:0:57922:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.552753:0:57922:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.552912:0:57922:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191341.552922:0:57922:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:1.0:1787191341.552928:0:57922:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191341.552938:0:57922:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:1.0:1787191341.552943:0:57922:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191341.552957:0:57922:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191341.553008:0:57922:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a733 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.553017:0:57922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a733 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57922 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.553038:0:57922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a733 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57922 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191341.553069:0:57922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57922:1874004626747776:192.168.202.101@tcp:101:rm.0 00000100:00100000:1.0:1787191341.553283:0:57922:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893180 going to sleep for 11 seconds 00000008:00010000:2.0:1787191341.553516:0:2391:0:(osc_cache.c:917:osc_extent_finish()) ### no dlm lock: extent: ffff936b46699180 00000020:00200000:2.0:1787191341.553524:0:2391:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:2.0:1787191341.553532:0:2391:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:2.0:1787191341.553543:0:2391:0:(osc_cache.c:497:__osc_extent_remove()) ### no dlm lock: extent: ffff936b46699180 00000100:00100000:2.0:1787191341.553564:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626747648:192.168.202.101@tcp:3:lfs.0 00000080:00200000:0.0:1787191341.553606:0:57919:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:0.0:1787191341.553619:0:57919:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd6:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191341.553623:0:57919:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 1 io complete with rc: 0, result: 5, restart: 0 00000020:00200000:0.0:1787191341.553626:0:57919:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191341.553633:0:57919:0:(file.c:2324:ll_file_io_generic()) iot: 1, result: 5 00000080:00200080:0.0:1787191341.553647:0:57919:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448) cmd=400866b1 arg=0 00000080:00200080:0.0:1787191341.553657:0:57919:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448) cmd=400866b1 arg=2 00000080:00200008:0.0:1787191341.553662:0:57919:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xd6:0x0](ffff936b5396f448), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191341.553667:0:57919:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448),name=f70.sanity-flr 00000002:00010000:0.0:1787191341.553676:0:57919:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd6:0x0]) in obj [0x200000405:0xd6:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.553684:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a6fb lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460617b expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.553691:0:57919:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a6fb lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460617b expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191341.553696:0:57919:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xd6:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191341.553699:0:57919:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) 00000080:00010000:0.0:1787191341.553701:0:57919:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) for lock 0xe5129dc88483a6fb 00000080:00010000:0.0:1787191341.553705:0:57919:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a6fb from it ffffa3fb4227bcd8 00010000:00010000:0.0:1787191341.553708:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a6fb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460617b expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.553713:0:57919:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a6fb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460617b expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1787191341.553727:0:57919:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd6:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:0.0:1787191341.553734:0:57919:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd6:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191341.553737:0:57919:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191341.553740:0:57919:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xd6:0x0] 00000008:00010000:0.0:1787191341.553753:0:57919:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191341.553755:0:57919:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee67b0, osc lock ffff936b50b63b50, flags 0x400000400001002 00010000:00010000:0.0:1787191341.553768:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 1 00010000:00010000:0.0:1787191341.553780:0:57919:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 1 00000020:00200000:0.0:1787191341.553790:0:57919:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191341.553793:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 1 00010000:00010000:0.0:1787191341.553800:0:57919:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 1 00000020:00200000:0.0:1787191341.553810:0:57919:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191341.553819:0:57919:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd6:0x0] updating i_size 5 i_blocks 8 00000020:00010000:0.0:1787191341.553822:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51655030 (ffff936b465cc2d8/0) at cl_lock_release():245 00000020:00010000:0.0:1787191341.553825:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51655030 (ffff936b465cc2d8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191341.553828:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee67b0 (ffff936b465cc5a8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191341.553856:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51655030 (ffff936b465cc2d8/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191341.553860:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee67b0 (ffff936b465cc2d8/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191341.553868:0:57919:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd6:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1787191341.553887:0:57919:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xd6:0x0], ppos: 0, count: 4096 00000080:00200000:0.0:1787191341.553893:0:57919:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 4096 00000080:00200000:0.0:1787191341.553901:0:57919:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 2 00000020:00200000:0.0:1787191341.553907:0:57919:0:(cl_io.c:214:cl_io_rw_init()) header@00000000ed098224[0x110, 2, [0x200000405:0xd6:0x0] hash] 00000020:00200000:0.0:1787191341.553909:0:57919:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 4096) 2048 0 00000080:00200000:0.0:1787191341.553912:0:57919:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd6:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00000080:00200000:0.0:1787191341.553929:0:57919:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:0.0:1787191341.553935:0:57919:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:0.0:1787191341.553938:0:57919:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x11 00000080:00200000:0.0:1787191341.553949:0:57919:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:0.0:1787191341.553955:0:57919:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:0.0:1787191341.553958:0:57919:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee67b0, osc lock ffff936b50b63b50, flags 0x40000 00000080:00200000:0.0:1787191341.553964:0:57919:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 4096) append 0 append lockpos 0 00000002:00010000:0.0:1787191341.553980:0:57919:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xd6:0x0], intent: getxattr flags 0 00010000:00010000:0.0:1787191341.554002:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a73a lrc: 3/1,0 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.554007:0:57919:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a73a lrc: 3/1,0 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.554012:0:57919:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a73a lrc: 3/1,0 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57919 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.554032:0:57919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626747904:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191341.554132:0:57919:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191341.555531:0:57922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57922:1874004626747776:192.168.202.101@tcp:101:rm.0 00010000:00010000:1.0:1787191341.555550:0:57922:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a733 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606200 expref: -99 pid: 57922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.555570:0:57922:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a733 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606200 expref: -99 pid: 57922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.555579:0:57922:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a733 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606200 expref: -99 pid: 57922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.555591:0:57922:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a733 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606200 expref: -99 pid: 57922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.555863:0:57922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a733 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606200 expref: -99 pid: 57922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.555882:0:57922:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a733 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606200 expref: -99 pid: 57922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.555889:0:57922:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a733 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606200 expref: -99 pid: 57922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.555896:0:57922:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a733 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606200 expref: -99 pid: 57922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191341.555906:0:57922:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b453a8a80 x1874004626747776/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/976 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191341.555916:0:57922:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a733 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606200 expref: -99 pid: 57922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191341.556013:0:57922:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a733 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606200 expref: -99 pid: 57922 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.556032:0:57922:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/215 (0 0) 00000080:00200000:0.0:1787191341.556038:0:57922:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191341.556087:0:57922:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xd7:0x0](ffff936b5395a1c8): rc = 0 00000080:00200000:0.0:1787191341.556102:0:57922:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd7:0x0]: layout version change: 4 -> 4 00000080:00010000:0.0:1787191341.556107:0:57922:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd7:0x0](ffff936b5395a1c8) for lock 0xe5129dc88483a733 00000080:00010000:0.0:1787191341.556117:0:57922:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd7:0x0](ffff936b5395a1c8) 00000080:00010000:0.0:1787191341.556121:0:57922:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a733 from it ffffa3fb4225bb20 00010000:00010000:0.0:1787191341.556125:0:57922:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a733 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606200 expref: -99 pid: 57922 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.556133:0:57922:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a733 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606200 expref: -99 pid: 57922 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200008:0.0:1787191341.556167:0:57922:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xd7:0x0](ffff936b5395a1c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191341.556173:0:57922:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xd7:0x0](ffff936b5395a1c8),name=f70.sanity-flr 00000002:00010000:0.0:1787191341.556193:0:57922:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd7:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.556200:0:57922:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a733 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606200 expref: -99 pid: 57922 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.556210:0:57922:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a733 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606200 expref: -99 pid: 57922 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191341.556217:0:57922:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191341.556222:0:57922:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd7:0x0](ffff936b5395a1c8) 00000080:00010000:0.0:1787191341.556225:0:57922:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd7:0x0](ffff936b5395a1c8) for lock 0xe5129dc88483a733 00000080:00010000:0.0:1787191341.556229:0:57922:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a733 from it ffffa3fb4225bcb8 00010000:00010000:0.0:1787191341.556231:0:57922:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a733 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606200 expref: -99 pid: 57922 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.556239:0:57922:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a733 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606200 expref: -99 pid: 57922 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191341.556256:0:57922:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd7:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1787191341.556266:0:57922:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd7:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191341.556269:0:57922:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191341.556272:0:57922:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xd7:0x0] 00000008:00010000:0.0:1787191341.556288:0:57922:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191341.556291:0:57922:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee6830, osc lock ffff936b50b62980, flags 0x400000400001002 00010000:00010000:0.0:1787191341.556304:0:57922:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a725 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46061d6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.556315:0:57922:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a725 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46061d6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:0.0:1787191341.556325:0:57922:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191341.556329:0:57922:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a725 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46061d6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.556338:0:57922:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a725 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46061d6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:0.0:1787191341.556348:0:57922:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191341.556356:0:57922:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd7:0x0] updating i_size 5 i_blocks 0 00000020:00010000:0.0:1787191341.556361:0:57922:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509ba500 (ffff936b47a17ab8/0) at cl_lock_release():245 00000020:00010000:0.0:1787191341.556364:0:57922:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509ba500 (ffff936b47a17ab8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191341.556367:0:57922:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee6830 (ffff936b47a17128/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191341.556371:0:57922:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509ba500 (ffff936b47a17ab8/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191341.556374:0:57922:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee6830 (ffff936b47a17ab8/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191341.556382:0:57922:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd7:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191341.556423:0:57922:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191341.556432:0:57922:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.556439:0:57922:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.556448:0:57922:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.556455:0:57922:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191341.556459:0:57922:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191341.556462:0:57922:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191341.556466:0:57922:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4225bc10 00010000:00010000:0.0:1787191341.556469:0:57922:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.556476:0:57922:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.556485:0:57922:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.556491:0:57922:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:0.0:1787191341.556495:0:57922:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.556500:0:57922:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:0.0:1787191341.556503:0:57922:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:0.0:1787191341.556507:0:57922:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:0.0:1787191341.556528:0:57922:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a71e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd7:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46061cf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191341.556541:0:57922:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xd7:0x0]: losing layout lock 00010000:00010000:0.0:1787191341.556552:0:57922:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a733 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4606200 expref: -99 pid: 57922 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191341.556560:0:57922:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xd7:0x0]: losing layout lock 00010000:00010000:0.0:1787191341.556567:0:57922:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a710 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e46061b3 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.556605:0:57922:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a71e lrc: 1/0,0 mode: --/CR res: [0x200000405:0xd7:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46061cf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.556612:0:57922:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a733 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606200 expref: -99 pid: 57922 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.556617:0:57922:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a710 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46061b3 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.556622:0:57922:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:0.0:1787191341.556625:0:57922:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a71e lrc: 0/0,0 mode: --/CR res: [0x200000405:0xd7:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46061cf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.556638:0:57922:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a733 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606200 expref: -99 pid: 57922 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.556646:0:57922:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a710 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xd7:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46061b3 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1787191341.556664:0:57922:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1787191341.556671:0:57922:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a476680 x1874004626748160/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787191341.556690:0:57922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476680 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57922:1874004626748160:192.168.202.101@tcp:36:rm.0 00000100:00100000:0.0:1787191341.556903:0:57922:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99000 going to sleep for 11 seconds 00000100:00100000:0.0:1787191341.560783:0:57919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626747904:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191341.560811:0:57919:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a73a lrc: 4/1,0 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460620e expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.560827:0:57919:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a73a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460620e expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.560860:0:57919:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a73a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460620e expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191341.560876:0:57919:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b6a476d80 x1874004626747904/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1408 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191341.560884:0:57919:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a73a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460620e expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.560891:0:57919:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/214 (0 0) 00000080:00200000:0.0:1787191341.560896:0:57919:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xd6:0x0] suppgids 0 -1: rc 0 00000080:00010000:0.0:1787191341.560913:0:57919:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) for lock 0xe5129dc88483a73a 00000080:00010000:0.0:1787191341.560928:0:57919:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a73a from it ffffa3fb4227b8e8 00010000:00010000:0.0:1787191341.560931:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a73a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460620e expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.560938:0:57919:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae600/0xe5129dc88483a73a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460620e expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191341.560969:0:57919:0:(rw26.c:362:ll_direct_IO()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448), size=4096 (max 536870912), offset=0=0x0, pages 1 (max 131072), lockless, parallel 00000020:00200000:0.0:1787191341.561021:0:57919:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:0.0:1787191341.561033:0:57919:0:(rw26.c:544:ll_direct_IO()) result 0 tot_bytes 4096 count 4096 file_offset 4096 00000080:00200000:0.0:1787191341.561047:0:57919:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd6:0x0] updating i_size 5 i_blocks 8 00000020:00010000:0.0:1787191341.561052:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b497c95d8 (ffff936b465cc2d8/0) at cl_lock_release():245 00000020:00010000:0.0:1787191341.561055:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b497c95d8 (ffff936b465cc2d8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191341.561059:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee67b0 (ffff936b465cc5a8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191341.561071:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b497c95d8 (ffff936b465cc2d8/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191341.561074:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee67b0 (ffff936b465cc2d8/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191341.561082:0:57919:0:(vvp_io.c:533:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:0.0:1787191341.561089:0:57919:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:0.0:1787191341.561113:0:31426:0:(osc_cache.c:2029:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff936b532d5300 00000008:00100000:0.0:1787191341.561192:0:31426:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff936b6a476d80 - object 0x280000401:455 offset 0<>4096 00000100:00100000:0.0:1787191341.561237:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787191341.561255:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626748288:192.168.202.101@tcp:4:lfs.0 00000100:00100000:0.0:1787191341.561988:0:57922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476680 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57922:1874004626748160:192.168.202.101@tcp:36:rm.0 00000080:00200000:0.0:1787191341.562039:0:57922:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd7:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00020000:00200000:0.0:1787191341.562050:0:57922:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd7:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191341.562053:0:57922:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191341.562059:0:57922:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191341.562473:0:57922:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000008:00010000:0.0:1787191341.562490:0:57922:0:(osc_cache.c:1183:osc_extent_make_ready()) ### extent: 00000000a1af3917 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a725 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46061d6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1787191341.562517:0:57922:0:(osc_cache.c:917:osc_extent_finish()) ### extent: 00000000a1af3917 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a725 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46061d6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1787191341.562534:0:57922:0:(osc_cache.c:497:__osc_extent_remove()) ### extent: 00000000a1af3917 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a725 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46061d6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191341.562549:0:57922:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd7:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191341.562578:0:57922:0:(llite_lib.c:2066:ll_clear_inode()) VFS Op:inode=[0x200000405:0xd7:0x0](ffff936b5395a1c8) 00000008:00010000:0.0:1787191341.562599:0:57922:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 5 blocks 0 [cma]time 1787191341 1787191341 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a725 lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46061d6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1787191341.562617:0:57922:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191341 1787191341 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a72c lrc: 1/0,0 mode: PW/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46061dd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1787191341.566114:0:2389:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-ffff936b581fb000: committing for last_committed 21474837624 gen 2 00000008:00010000:0.0:1787191341.566201:0:2389:0:(osc_cache.c:917:osc_extent_finish()) ### no dlm lock: extent: ffff936b532d5300 00000020:00200000:0.0:1787191341.566208:0:2389:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:0.0:1787191341.566215:0:2389:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:0.0:1787191341.566240:0:2389:0:(osc_cache.c:497:__osc_extent_remove()) ### no dlm lock: extent: ffff936b532d5300 00000100:00100000:0.0:1787191341.566267:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626748288:192.168.202.101@tcp:4:lfs.0 00000080:00200000:1.0:1787191341.566288:0:57919:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:1.0:1787191341.566300:0:57919:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd6:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191341.566306:0:57919:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:1.0:1787191341.566316:0:57919:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd6:0x0] updating i_size 5 i_blocks 8 00000020:00200000:1.0:1787191341.566319:0:57919:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191341.566326:0:57919:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200080:1.0:1787191341.566343:0:57919:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448) cmd=400866b1 arg=0 00000080:00200080:1.0:1787191341.566351:0:57919:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448) cmd=400866b1 arg=1 00000080:00200008:1.0:1787191341.566357:0:57919:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xd6:0x0](ffff936b5396f448), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191341.566364:0:57919:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448),name=f70.sanity-flr 00000002:00010000:1.0:1787191341.566384:0:57919:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd6:0x0]) in obj [0x200000405:0xd6:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191341.566399:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a6fb lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460617b expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191341.566414:0:57919:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a6fb lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460617b expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1787191341.566423:0:57919:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xd6:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191341.566431:0:57919:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) 00000080:00010000:1.0:1787191341.566434:0:57919:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) for lock 0xe5129dc88483a6fb 00000080:00010000:1.0:1787191341.566442:0:57919:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a6fb from it ffffa3fb4227bcd8 00010000:00010000:1.0:1787191341.566446:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a6fb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460617b expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191341.566467:0:57919:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a6fb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460617b expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00000080:00200000:1.0:1787191341.566597:0:57919:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd6:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:1.0:1787191341.566608:0:57919:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd6:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191341.566611:0:57919:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191341.566614:0:57919:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xd6:0x0] 00000008:00010000:1.0:1787191341.566633:0:57919:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191341.566636:0:57919:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b47d7df30, osc lock ffff936b468370a0, flags 0x400000400001002 00010000:00010000:1.0:1787191341.566652:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 1 00010000:00010000:1.0:1787191341.566664:0:57919:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 1 00000020:00200000:1.0:1787191341.566675:0:57919:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191341.566678:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 1 00010000:00010000:1.0:1787191341.566686:0:57919:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00000020:00200000:1.0:1787191341.566696:0:57919:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191341.566701:0:57919:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd6:0x0] updating i_size 5 i_blocks 8 00000020:00010000:1.0:1787191341.566704:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51655030 (ffff936b465cc2d8/0) at cl_lock_release():245 00000020:00010000:1.0:1787191341.566707:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51655030 (ffff936b465cc2d8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191341.566710:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7df30 (ffff936b465cc5a8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191341.566714:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51655030 (ffff936b465cc2d8/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191341.566716:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7df30 (ffff936b465cc2d8/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191341.566724:0:57919:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd6:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1787191341.566733:0:57919:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xd6:0x0], offset: 5, type: SEEK_DATA 00000080:00200000:1.0:1787191341.566738:0:57919:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd6:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:1.0:1787191341.566742:0:57919:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd6:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191341.566744:0:57919:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191341.566748:0:57919:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191341.566753:0:57919:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191341.566764:0:57919:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd6:0x0] updating i_size 5 i_blocks 8 00000080:00200000:1.0:1787191341.566829:0:57919:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd6:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191341.566851:0:57919:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000080:00200000:1.0:1787191341.566853:0:57919:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd6:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:1.0:1787191341.566858:0:57919:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191341.566862:0:57919:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191341.566864:0:57919:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:1.0:1787191341.566870:0:57919:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:1.0:1787191341.566872:0:57919:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b47d7df30, osc lock ffff936b468370a0, flags 0x0 00010000:00010000:1.0:1787191341.566882:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:1.0:1787191341.566891:0:57919:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:1.0:1787191341.566901:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:1.0:1787191341.566908:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:1.0:1787191341.566915:0:57919:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00000080:00200000:1.0:1787191341.566924:0:57919:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd6:0x0] updating i_size 5 i_blocks 8 00000020:00010000:1.0:1787191341.566928:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b497c95d8 (ffff936b465cc2d8/0) at cl_lock_release():245 00000020:00010000:1.0:1787191341.566931:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b497c95d8 (ffff936b465cc2d8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191341.566933:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7df30 (ffff936b465cc5a8/1) at cl_lock_cancel():142 00010000:00010000:1.0:1787191341.566937:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:1.0:1787191341.566944:0:57919:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00000020:00010000:1.0:1787191341.566952:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b497c95d8 (ffff936b465cc2d8/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191341.566955:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7df30 (ffff936b465cc2d8/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191341.566961:0:57919:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd6:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1787191341.566967:0:57919:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xd6:0x0], offset: 0, type: (null) 00000080:00200000:1.0:1787191341.566970:0:57919:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd6:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:1.0:1787191341.566974:0:57919:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd6:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191341.566977:0:57919:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191341.566979:0:57919:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xd6:0x0] 00000008:00010000:1.0:1787191341.566984:0:57919:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191341.566986:0:57919:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b47d7df30, osc lock ffff936b468370a0, flags 0x400000400001002 00010000:00010000:1.0:1787191341.566992:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1787191341.567001:0:57919:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00000020:00200000:1.0:1787191341.567008:0:57919:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191341.567010:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1787191341.567017:0:57919:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00000020:00200000:1.0:1787191341.567037:0:57919:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191341.567041:0:57919:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd6:0x0] updating i_size 5 i_blocks 8 00000020:00010000:1.0:1787191341.567043:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51655030 (ffff936b465cc2d8/0) at cl_lock_release():245 00000020:00010000:1.0:1787191341.567045:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51655030 (ffff936b465cc2d8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191341.567048:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7df30 (ffff936b465cc5a8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191341.567051:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51655030 (ffff936b465cc2d8/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191341.567053:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7df30 (ffff936b465cc2d8/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191341.567058:0:57919:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd6:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1787191341.567064:0:57919:0:(file.c:5244:ll_file_seek()) COMPLETED file f70.sanity-flr:[0x200000405:0xd6:0x0], offset: 0, type: (null), rc = 5 00000080:00200080:1.0:1787191341.567069:0:57919:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448) cmd=400866b1 arg=0 00000080:00200000:2.0:1787191341.574571:0:57923:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191341.574602:0:57923:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191341.574618:0:57923:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191341.574634:0:57923:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191341.574641:0:57923:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191341.574649:0:57923:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191341.574652:0:57923:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191341.574659:0:57923:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42283b58 00010000:00010000:2.0:1787191341.574663:0:57923:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191341.574671:0:57923:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191341.574686:0:57923:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191341.574693:0:57923:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:2.0:1787191341.574699:0:57923:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191341.574709:0:57923:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:2.0:1787191341.574713:0:57923:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191341.574724:0:57923:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191341.574861:0:57923:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a741 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.574871:0:57923:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a741 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.574881:0:57923:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a741 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191341.574906:0:57923:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57923:1874004626748416:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191341.575236:0:57923:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f300 going to sleep for 11 seconds 00000100:00100000:2.0:1787191341.577215:0:57923:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57923:1874004626748416:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191341.577234:0:57923:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a741 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.577247:0:57923:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a741 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.577253:0:57923:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a741 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.577260:0:57923:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a741 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.577269:0:57923:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a741 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.577274:0:57923:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51185200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191341.577280:0:57923:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a741 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.577292:0:57923:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a741 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.577298:0:57923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a741 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.577305:0:57923:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191341.577311:0:57923:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a741 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.577318:0:57923:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a741 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191341.577339:0:57923:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513bb480 x1874004626748416/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191341.577353:0:57923:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191341.577432:0:57923:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191341.577446:0:57923:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191341.577455:0:57923:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191341.577466:0:57923:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191341.577473:0:57923:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191341.577478:0:57923:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191341.577481:0:57923:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191341.577486:0:57923:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42283be8 00010000:00010000:2.0:1787191341.577491:0:57923:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191341.577499:0:57923:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191341.577513:0:57923:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191341.577519:0:57923:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000080:00200000:2.0:1787191341.577524:0:57923:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191341.577534:0:57923:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:2.0:1787191341.577538:0:57923:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191341.577548:0:57923:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191341.577583:0:57923:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a748 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.577589:0:57923:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a748 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.577597:0:57923:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a748 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191341.577614:0:57923:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57923:1874004626748544:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191341.577674:0:57923:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f300 going to sleep for 11 seconds 00000080:00200080:0.0:1787191341.577724:0:57919:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448) cmd=400866b1 arg=2 00000080:00200008:0.0:1787191341.577735:0:57919:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xd6:0x0](ffff936b5396f448), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191341.577740:0:57919:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448),name=f70.sanity-flr 00000002:00010000:0.0:1787191341.577749:0:57919:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd6:0x0]) in obj [0x200000405:0xd6:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.577758:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a6fb lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460617b expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00010000:00010000:0.0:1787191341.577777:0:57919:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a6fb lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460617b expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00000080:00200000:0.0:1787191341.577784:0:57919:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xd6:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191341.577789:0:57919:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) 00000080:00010000:0.0:1787191341.577791:0:57919:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) for lock 0xe5129dc88483a6fb 00000080:00010000:0.0:1787191341.577796:0:57919:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a6fb from it ffffa3fb4227bcd8 00010000:00010000:0.0:1787191341.577799:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a6fb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460617b expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00010000:00010000:0.0:1787191341.577807:0:57919:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a6fb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460617b expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00000080:00200000:0.0:1787191341.577828:0:57919:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd6:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1787191341.578016:0:57919:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd6:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191341.578020:0:57919:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191341.578031:0:57919:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xd6:0x0] 00000008:00010000:0.0:1787191341.578054:0:57919:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191341.578058:0:57919:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee67b0, osc lock ffff936b50b63b50, flags 0x400000400001002 00010000:00010000:0.0:1787191341.578074:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00010000:00010000:0.0:1787191341.578086:0:57919:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00000020:00200000:0.0:1787191341.578098:0:57919:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191341.578102:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00010000:00010000:0.0:1787191341.578109:0:57919:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00000020:00200000:0.0:1787191341.578120:0:57919:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191341.578128:0:57919:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd6:0x0] updating i_size 5 i_blocks 8 00000020:00010000:0.0:1787191341.578133:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509ba500 (ffff936b47a17ab8/0) at cl_lock_release():245 00000020:00010000:0.0:1787191341.578136:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509ba500 (ffff936b47a17ab8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191341.578139:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee67b0 (ffff936b47a17128/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191341.578142:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509ba500 (ffff936b47a17ab8/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191341.578145:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee67b0 (ffff936b47a17ab8/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191341.578155:0:57919:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd6:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1787191341.578180:0:57919:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xd6:0x0](ffff936b5396f448) current size 5, valid attrs 2068, mode 0, uid -1322410190, gid -1, new size 5, atime 1787191341.000000000, mtime 1787191341.000000000, ctime 1787191341.000000000 00010000:00010000:0.0:1787191341.578200:0:57919:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a6fb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e460617b expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00010000:00010000:0.0:1787191341.578215:0:57919:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6ed lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606158 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191341.578240:0:57919:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a6fb lrc: 1/0,0 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460617b expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00010000:00010000:0.0:1787191341.578247:0:57919:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191341.578250:0:57919:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483a6fb lrc: 0/0,0 mode: --/PR res: [0x200000405:0xd6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460617b expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00000020:00100000:0.0:1787191341.578266:0:57919:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1787191341.578273:0:57919:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a476d80 x1874004626748800/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787191341.578288:0:57919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626748800:192.168.202.101@tcp:36:lfs.0 00000100:00100000:0.0:1787191341.578327:0:57919:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99000 going to sleep for 11 seconds 00000100:00100000:2.0:1787191341.579353:0:57923:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57923:1874004626748544:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191341.579367:0:57923:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a748 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.579374:0:57923:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a748 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.579386:0:57923:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a748 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.579392:0:57923:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a748 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.579398:0:57923:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a748 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.579403:0:57923:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51185600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191341.579407:0:57923:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a748 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.579412:0:57923:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a748 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.579417:0:57923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a748 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.579420:0:57923:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191341.579424:0:57923:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a748 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.579428:0:57923:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a748 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191341.579444:0:57923:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513bb480 x1874004626748544/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191341.579455:0:57923:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191341.579528:0:57923:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191341.579538:0:57923:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191341.579545:0:57923:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191341.579552:0:57923:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191341.579559:0:57923:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191341.579563:0:57923:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191341.579566:0:57923:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191341.579570:0:57923:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42283b58 00010000:00010000:2.0:1787191341.579572:0:57923:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191341.579578:0:57923:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191341.579589:0:57923:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191341.579595:0:57923:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:2.0:1787191341.579602:0:57923:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:2.0:1787191341.579606:0:57923:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:2.0:1787191341.579615:0:57923:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191341.579623:0:57923:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 91 lru_type: 1 00010000:00010000:2.0:1787191341.579631:0:57923:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 91 lru_type: 1 00000002:00010000:2.0:1787191341.579646:0:57923:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191341.579676:0:57923:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483a74f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.579683:0:57923:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483a74f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.579691:0:57923:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483a74f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191341.579707:0:57923:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57923:1874004626748928:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191341.579759:0:57923:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f300 going to sleep for 11 seconds 00000100:00100000:0.0:1787191341.579934:0:57919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626748800:192.168.202.101@tcp:36:lfs.0 00000080:00200000:0.0:1787191341.579961:0:57919:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 2 00000080:00200000:0.0:1787191341.579966:0:57919:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd6:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:0.0:1787191341.579981:0:57919:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x11 00000080:00200000:0.0:1787191341.579998:0:57919:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:0.0:1787191341.580012:0:57919:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:0.0:1787191341.580016:0:57919:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f99030, osc lock ffff936b50b63b50, flags 0x0 00000008:00010000:0.0:1787191341.580019:0:57919:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:0.0:1787191341.580021:0:57919:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f99070, osc lock ffff936b50b62980, flags 0x0 00010000:00010000:0.0:1787191341.583168:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a756 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.583191:0:57919:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a756 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.583207:0:57919:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a756 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.583240:0:57919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626749056:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191341.583333:0:57919:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787191341.586218:0:57919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626749056:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191341.586259:0:57919:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a756 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606277 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.586284:0:57919:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a756 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606277 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.586298:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a756 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606277 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191341.586326:0:57919:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 4096, setting rss=4096; kms=4096, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a756 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606277 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.586355:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a756 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606277 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.586375:0:57919:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a756 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606277 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.586482:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000be88ce23/0xe5129dc88483a75d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.586506:0:57919:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000be88ce23/0xe5129dc88483a75d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.586527:0:57919:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000be88ce23/0xe5129dc88483a75d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191341.586559:0:57919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aaa00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626749184:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191341.586683:0:57919:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893180 going to sleep for 11 seconds 00000100:00100000:0.0:1787191341.588303:0:57923:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57923:1874004626748928:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191341.588349:0:57923:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483a74f lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606270 expref: -99 pid: 57923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.588375:0:57923:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483a74f lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606270 expref: -99 pid: 57923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.588386:0:57923:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483a74f lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606270 expref: -99 pid: 57923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.588411:0:57923:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483a74f lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606270 expref: -99 pid: 57923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.588432:0:57923:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483a74f lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606270 expref: -99 pid: 57923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.588441:0:57923:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483a74f lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606270 expref: -99 pid: 57923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.588575:0:57923:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483a74f lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606270 expref: -99 pid: 57923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191341.588589:0:57923:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b513bb480 x1874004626748928/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191341.588696:0:57923:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483a74f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606270 expref: -99 pid: 57923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.588706:0:57923:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:0.0:1787191341.588713:0:57923:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483a74f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606270 expref: -99 pid: 57923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.588737:0:57923:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483a74f lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606270 expref: -99 pid: 57923 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:0.0:1787191341.589261:0:57923:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.589274:0:57923:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 182 lru_type: 1 00010000:00010000:0.0:1787191341.589288:0:57923:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 182 lru_type: 1 00010000:00010000:0.0:1787191341.589296:0:57923:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 182 lru_type: 1 00010000:00010000:0.0:1787191341.589303:0:57923:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 183 lru_type: 1 00000080:00200000:0.0:1787191341.589317:0:57923:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191341.589326:0:57923:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:0.0:1787191341.589331:0:57923:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:0.0:1787191341.589337:0:57923:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb42283cb8 00010000:00010000:0.0:1787191341.589341:0:57923:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 91 lru_type: 1 00010000:00010000:0.0:1787191341.589349:0:57923:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 92 lru_type: 1 00000002:00010000:0.0:1787191341.589365:0:57923:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.589372:0:57923:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483a74f lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606270 expref: -99 pid: 57923 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.589380:0:57923:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483a74f lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606270 expref: -99 pid: 57923 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.589389:0:57923:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483a74f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606270 expref: -99 pid: 57923 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.589395:0:57923:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483a74f lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606270 expref: -99 pid: 57923 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:0.0:1787191341.589403:0:57923:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.589408:0:57923:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 183 lru_type: 1 00010000:00010000:0.0:1787191341.589414:0:57923:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 183 lru_type: 1 00010000:00010000:0.0:1787191341.589422:0:57923:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 183 lru_type: 1 00010000:00010000:0.0:1787191341.589429:0:57923:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 184 lru_type: 1 00000100:00100000:1.0:1787191341.589515:0:57919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aaa00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626749184:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191341.589534:0:57919:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000be88ce23/0xe5129dc88483a75d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460627e expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.589547:0:57919:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000be88ce23/0xe5129dc88483a75d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e460627e expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.589559:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000be88ce23/0xe5129dc88483a75d lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460627e expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191341.589572:0:57919:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000be88ce23/0xe5129dc88483a75d lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460627e expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.589584:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000be88ce23/0xe5129dc88483a75d lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460627e expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.589597:0:57919:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000be88ce23/0xe5129dc88483a75d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460627e expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191341.589686:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626749312:192.168.202.101@tcp:10:lfs.0 00000100:00100000:1.0:1787191341.589822:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626749440:192.168.202.101@tcp:10:lfs.0 00000080:00200008:0.0:1787191341.592281:0:57923:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1787191341.592291:0:57923:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191341.592312:0:57923:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.592328:0:57923:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.592349:0:57923:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.592357:0:57923:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191341.592365:0:57923:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191341.592369:0:57923:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191341.592376:0:57923:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42283cb8 00010000:00010000:0.0:1787191341.592379:0:57923:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.592388:0:57923:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000100:00100000:1.0:1787191341.592821:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626749440:192.168.202.101@tcp:10:lfs.0 00000100:00100000:1.0:1787191341.592890:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626749312:192.168.202.101@tcp:10:lfs.0 00000080:00200000:2.0:1787191341.592947:0:57919:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd6:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191341.592955:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b628946c8 (ffff936b47a17ab8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191341.592959:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b628946c8 (ffff936b47a17ab8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191341.592964:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99030 (ffff936b47a17128/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191341.592972:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a756 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606277 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.592984:0:57919:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a756 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606277 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191341.593000:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99070 (ffff936b47a17b48/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191341.593005:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000be88ce23/0xe5129dc88483a75d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460627e expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.593013:0:57919:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000be88ce23/0xe5129dc88483a75d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460627e expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191341.593036:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b628946c8 (ffff936b47a17ab8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191341.593040:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99030 (ffff936b47a17ab8/1) at cl_lock_fini():72 00000020:00010000:2.0:1787191341.593045:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99070 (ffff936b47a17ab8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191341.593061:0:57919:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd6:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191341.593092:0:57919:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xd6:0x0](ffff936b5396f448) current size 5, valid attrs 10002168, mode 0, uid -1322410190, gid -1, new size 5, atime 1787191341.000000000, mtime 1787191341.000000000, ctime 1787191341.000000000, rc 0 00000080:00200080:2.0:1787191341.593109:0:57919:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448) cmd=400866b1 arg=0 00000080:00200008:2.0:1787191341.593208:0:57919:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xd6:0x0](ffff936b5396f448) current size 5, valid attrs 101f0, mode a3fb, uid 1628898792, gid -27797, new size 18446624687906026568, atime 1787191341.000000000, mtime 1787191341.000000000, ctime 1787191341.000000000 00000020:00100000:2.0:1787191341.593257:0:57919:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1787191341.593264:0:57919:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8e00 x1874004626749696/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787191341.593282:0:57919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626749696:192.168.202.101@tcp:36:lfs.0 00000080:00200000:0.0:1787191341.593319:0:57923:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191341.593332:0:57923:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.593339:0:57923:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.593350:0:57923:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.593357:0:57923:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191341.593362:0:57923:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191341.593364:0:57923:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191341.593368:0:57923:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42283b58 00010000:00010000:0.0:1787191341.593371:0:57923:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.593379:0:57923:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.593389:0:57923:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.593397:0:57923:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:0.0:1787191341.593402:0:57923:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.593413:0:57923:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:0.0:1787191341.593418:0:57923:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:0.0:1787191341.593431:0:57923:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00000100:00100000:2.0:1787191341.593471:0:57919:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5ff00 going to sleep for 11 seconds 00010000:00010000:0.0:1787191341.593476:0:57923:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a764 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.593485:0:57923:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a764 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.593496:0:57923:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a764 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.593509:0:57923:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57923:1874004626749824:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191341.593541:0:57923:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787191341.598422:0:57919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626749696:192.168.202.101@tcp:36:lfs.0 00000080:00200000:1.0:1787191341.598493:0:57919:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd6:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:1.0:1787191341.598507:0:57919:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd6:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191341.598511:0:57919:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191341.598519:0:57919:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191341.598532:0:57919:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000100:00100000:1.0:1787191341.598609:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787191341.598626:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626749952:192.168.202.101@tcp:2:lfs.0 00000100:00100000:0.0:1787191341.603618:0:57923:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57923:1874004626749824:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191341.603641:0:57923:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a764 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.603656:0:57923:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a764 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.603664:0:57923:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a764 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.603672:0:57923:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a764 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.603693:0:57923:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a764 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.603704:0:57923:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44caea00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191341.603710:0:57923:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a764 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.603717:0:57923:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a764 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.603724:0:57923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a764 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.603731:0:57923:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191341.603738:0:57923:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a764 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.603745:0:57923:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a764 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191341.603764:0:57923:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b6a474000 x1874004626749824/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191341.603780:0:57923:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1787191341.603811:0:57923:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483a74f lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606270 expref: -99 pid: 57923 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.603824:0:57923:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483a74f lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606270 expref: -99 pid: 57923 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:0.0:1787191341.603887:0:57923:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a74f from it ffffa3fb42283930 00010000:00010000:0.0:1787191341.603891:0:57923:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483a74f lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606270 expref: -99 pid: 57923 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.603905:0:57923:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483a74f lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606270 expref: -99 pid: 57923 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191341.603990:0:57923:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191341.604008:0:57923:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.604017:0:57923:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.604038:0:57923:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.604044:0:57923:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000100:00100000:1.0:1787191341.604049:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626749952:192.168.202.101@tcp:2:lfs.0 00000080:00010000:0.0:1787191341.604051:0:57923:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191341.604057:0:57923:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191341.604063:0:57923:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42283bf8 00010000:00010000:0.0:1787191341.604067:0:57923:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.604074:0:57923:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.604083:0:57923:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.604091:0:57923:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191341.604095:0:57923:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.604101:0:57923:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:0.0:1787191341.604104:0:57923:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:0.0:1787191341.604109:0:57923:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b52230f00, open_flags a141, mode 81b6 opened 0 00000080:00200000:0.0:1787191341.604120:0:57923:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:0.0:1787191341.604137:0:57923:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xd9:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:0.0:1787191341.604148:0:57923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483a74f lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4606270 expref: -99 pid: 57923 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191341.604170:0:57919:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd6:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191341.604193:0:57919:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xd6:0x0](ffff936b5396f448) current size 5, valid attrs 100101f0, mode a3fb, uid 1628898792, gid -27797, new size 18446624687906026568, atime 1787191341.000000000, mtime 1787191341.000000000, ctime 1787191341.000000000, rc 0 00010000:00010000:0.0:1787191341.604206:0:57923:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483a74f lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4606270 expref: -99 pid: 57923 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.604214:0:57923:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000080:00200080:2.0:1787191341.604215:0:57919:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448) cmd=c00c66f3 arg=1e702e0 00010000:00010000:0.0:1787191341.604217:0:57923:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483a74f lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4606270 expref: -99 pid: 57923 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191341.604251:0:57919:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483a6bc lrc: 2/0,0 mode: PW/PW res: [0x200000405:0xd6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81008000000000 nid: local remote: 0x7130d520e46060b0 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.604256:0:57923:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a76b lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.604267:0:57923:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a76b lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.604268:0:57919:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483a6bc lrc: 0/0,0 mode: --/PW res: [0x200000405:0xd6:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x85809400000000 nid: local remote: 0x7130d520e46060b0 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191341.604287:0:57923:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191341.604297:0:57923:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474000 x1874004626750336/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000002:00100000:2.0:1787191341.604298:0:57919:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1d180 x1874004626742400/t8589936989(8589936989) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191341.604324:0:57919:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00010000:00010000:0.0:1787191341.604325:0:57923:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a76b lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191341.604333:0:57919:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9500 x1874004626750464/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191341.604351:0:57923:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57923:1874004626750336:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191341.604353:0:57919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626750464:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191341.604440:0:57919:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787191341.604451:0:57923:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787191341.608054:0:57923:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57923:1874004626750336:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191341.608083:0:57923:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a76b lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46062b6 expref: -99 pid: 57923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.608115:0:57923:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a76b lrc: 4/0,1 mode: --/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46062b6 expref: -99 pid: 57923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.608124:0:57923:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a76b lrc: 4/0,1 mode: --/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46062b6 expref: -99 pid: 57923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.608134:0:57923:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a76b lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46062b6 expref: -99 pid: 57923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.608146:0:57923:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a76b lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46062b6 expref: -99 pid: 57923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.608160:0:57923:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a76b lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46062b6 expref: -99 pid: 57923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.608234:0:57923:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a76b lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46062b6 expref: -99 pid: 57923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.608243:0:57923:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a76b lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46062b6 expref: -99 pid: 57923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191341.608257:0:57923:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b6a474000 x1874004626750336/t8589937004(8589937004) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191341.608270:0:57923:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474000 x1874004626750336/t8589937004(8589937004) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191341.608282:0:57923:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a76b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46062b6 expref: -99 pid: 57923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.608292:0:57923:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/217 (0 0) 00000080:00200000:0.0:1787191341.608361:0:57923:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191341.608374:0:57923:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:0.0:1787191341.608401:0:57923:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xd9:0x0](ffff936b539680c8) 00000080:00200000:0.0:1787191341.608408:0:57923:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xd9:0x0], updating i_size 0 00000080:00200000:0.0:1787191341.608529:0:57923:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd9:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1787191341.608534:0:57923:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xd9:0x0](ffff936b539680c8) 00000080:00010000:0.0:1787191341.608548:0:57923:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd9:0x0](ffff936b539680c8) for lock 0xe5129dc88483a76b 00000080:00010000:0.0:1787191341.608558:0:57923:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd9:0x0](ffff936b539680c8) 00000080:00200008:0.0:1787191341.608574:0:57923:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xd9:0x0](ffff936b539680c8), flags 120501 00000002:00100000:0.0:1787191341.608594:0:57923:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474000 x1874004626750336/t8589937004(8589937004) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191341.608632:0:57923:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a76b from it ffff936b530f5360 00010000:00010000:0.0:1787191341.608637:0:57923:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a76b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46062b6 expref: -99 pid: 57923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.608647:0:57923:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a76b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46062b6 expref: -99 pid: 57923 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191341.608668:0:57923:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd9:0x0](ffff936b539680c8), inode mode 81a4 mask 40 00000080:00200000:0.0:1787191341.608731:0:57923:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd9:0x0](ffff936b539680c8), inode mode 81a4 mask 2 00000080:00200000:0.0:1787191341.608740:0:57923:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xd9:0x0](ffff936b539680c8), xattr lov 00000002:00010000:0.0:1787191341.608756:0:57923:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd9:0x0]) in obj [0x200000405:0xd9:0x0], intent: open flags 040000002 00010000:00010000:0.0:1787191341.608797:0:57923:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a772 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.608808:0:57923:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a772 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191341.608820:0:57923:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191341.608885:0:57923:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475c00 x1874004626750720/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191341.608896:0:57923:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a772 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.608915:0:57923:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57923:1874004626750720:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191341.609194:0:57923:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787191341.610790:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191341.611068:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634911104 00000100:00100000:3.0:1787191341.611076:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634911104 00000100:00100000:3.0:1787191341.611285:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1407 00000100:00100000:3.0:1787191341.611296:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:15323:x1874004634911104:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191341.611313:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6ed lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4606158 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191341.611621:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191341.611629:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:15323:x1874004634911104:12345-192.168.202.101@tcp:104: Request processed in 335us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191341.611636:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1407 00010000:00010000:1.0:1787191341.611825:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191341.611859:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6ed lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4606158 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191341.611869:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9a600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191341.611875:0:57627:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6ed lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4606158 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191341.611883:0:57627:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6ed lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4606158 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191341.611893:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6ed lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4606158 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1787191341.611913:0:57627:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xd6:0x0]: losing layout lock 00010000:00010000:1.0:1787191341.611954:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6ed lrc: 2/0,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4606158 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191341.611961:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787191341.612015:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626750848:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787191341.612974:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6ed lrc: 1/0,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4606158 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191341.612986:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483a6ed lrc: 0/0,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4606158 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191341.613002:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191341.613004:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191341.613006:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191341.613421:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191341.613793:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634911232 00000100:00100000:3.0:1787191341.613801:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634911232 00000100:00100000:0.0:1787191341.614708:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626750848:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191341.615227:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1408 00000100:00100000:2.0:1787191341.615239:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634911232:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191341.615255:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a76b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46062b6 expref: -99 pid: 57923 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.615373:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191341.615381:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634911232:12345-192.168.202.101@tcp:104: Request processed in 146us (1961us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191341.615389:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1408 00010000:00010000:1.0:1787191341.615456:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191341.615464:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a76b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46062b6 expref: -99 pid: 57923 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.615473:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cae200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191341.615477:0:40929:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a76b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46062b6 expref: -99 pid: 57923 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.615486:0:40929:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a76b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46062b6 expref: -99 pid: 57923 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.615494:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a76b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e46062b6 expref: -99 pid: 57923 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191341.615513:0:40929:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xd9:0x0]: losing layout lock 00010000:00010000:1.0:1787191341.615565:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a76b lrc: 2/0,0 mode: --/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46062b6 expref: -99 pid: 57923 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.615572:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191341.615593:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a76b lrc: 1/0,0 mode: --/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46062b6 expref: -99 pid: 57923 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.615601:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a76b lrc: 0/0,0 mode: --/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46062b6 expref: -99 pid: 57923 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1787191341.615622:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626750976:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787191341.615623:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191341.615627:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191341.615630:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191341.618334:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626750976:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191341.623659:0:57923:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57923:1874004626750720:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191341.623685:0:57923:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a772 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xd9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.623699:0:57923:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a772 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xd9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.623707:0:57923:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a772 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xd9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.623716:0:57923:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a772 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xd9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.623724:0:57923:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a772 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xd9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.623732:0:57923:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44caf000 already unused, calling callback (ffffffffc1b143c0) 00000100:00100000:3.0:1787191341.623734:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00010000:00010000:1.0:1787191341.623751:0:57923:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a772 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xd9:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.623761:0:57923:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a772 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xd9:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.623769:0:57923:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a772 lrc: 5/0,0 mode: --/CR res: [0x200000405:0xd9:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191341.623769:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634911872 00000100:00100000:3.0:1787191341.623778:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634911872 00010000:00010000:1.0:1787191341.623780:0:57923:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191341.623788:0:57923:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a772 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xd9:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.623795:0:57923:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a772 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xd9:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57923 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191341.623825:0:57923:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b6a475c00 x1874004626750720/t8589937006(8589937006) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191341.623886:0:57923:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475c00 x1874004626750720/t8589937006(8589937006) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787191341.623925:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1409 00000100:00100000:3.0:1787191341.623938:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8720:x1874004634911872:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191341.623953:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a72c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e46061dd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:2.0:1787191341.623975:0:57919:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589937005 gen 1 00000100:00100000:2.0:1787191341.623997:0:57919:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b6a474000 x1874004626750336/t8589937004(8589937004) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191357 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787191341.624003:0:57919:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff936b6a475c00 x1874004626750720/t8589937006(8589937006) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787191341.624013:0:57919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626750464:192.168.202.101@tcp:35:lfs.0 00010000:00010000:3.0:1787191341.624050:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191341.624058:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8720:x1874004634911872:12345-192.168.202.101@tcp:104: Request processed in 123us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191341.624066:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1409 00010000:00010000:3.0:1787191341.624090:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191341.624097:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a72c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e46061dd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191341.624107:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030400 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191341.624112:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a72c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e46061dd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191341.624152:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a72c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e46061dd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191341.624159:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191341.624181:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a72c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e46061dd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191341.624188:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a72c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e46061dd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191341.624204:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191341.624205:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191341.624207:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191341.624221:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626751104:192.168.202.101@tcp:103:ldlm_bl.0 00000002:00100000:2.0:1787191341.624421:0:57919:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1d180 x1874004626742400/t8589936989(8589936989) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1787191341.624453:0:57919:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/214 (0 0) 00000080:00010000:2.0:1787191341.624463:0:57919:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xd6:0x0](ffff936b5396f448) 00000002:00010000:2.0:1787191341.624472:0:57919:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd6:0x0]) in obj [0x200000405:0xd6:0x0], intent: layout flags 0 00010000:00010000:2.0:1787191341.624498:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184c00/0xe5129dc88483a779 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.624506:0:57919:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184c00/0xe5129dc88483a779 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.624515:0:57919:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184c00/0xe5129dc88483a779 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57919 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191341.624530:0:57919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626751232:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191341.624559:0:57919:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5fa80 going to sleep for 11 seconds 00000080:00200000:1.0:1787191341.624976:0:57923:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xd9:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787191341.625053:0:57923:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd9:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1787191341.625062:0:57923:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd9:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191341.625099:0:57923:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xd9:0x0], updating i_size 0 00000002:00100000:1.0:1787191341.625120:0:57923:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475c00 x1874004626750720/t8589937006(8589937006) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191341.625150:0:57923:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a475c00 x1874004626750720/t8589937006(8589937006) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191341.625159:0:57923:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191341.625164:0:57923:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453ab100 x1874004626751488/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191341.625179:0:57923:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57923:1874004626751488:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191341.625212:0:57923:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893180 going to sleep for 11 seconds 00000100:00100000:2.0:1787191341.625555:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191341.625651:0:40922:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787191341.625661:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634912512 00000100:00100000:2.0:1787191341.625666:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634912512 00000100:00100000:2.0:1787191341.625696:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1410 00000100:00100000:2.0:1787191341.625702:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51f66c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:37089:x1874004634912512:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191341.625710:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a725 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e46061d6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191341.625757:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191341.625762:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51f66c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:37089:x1874004634912512:12345-192.168.202.101@tcp:104: Request processed in 61us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191341.625767:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1410 00010000:00010000:0.0:1787191341.625984:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191341.625991:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a725 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e46061d6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.625999:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40031a00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191341.626005:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a725 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e46061d6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.626047:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a725 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e46061d6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.626055:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191341.626079:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a725 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e46061d6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.626086:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483a725 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e46061d6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.626103:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191341.626112:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191341.626114:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191341.626120:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787191341.626405:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626751616:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191341.629493:0:57919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626751232:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191341.629522:0:57919:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184c00/0xe5129dc88483a779 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46062fc expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.629537:0:57919:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184c00/0xe5129dc88483a779 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46062fc expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191341.629545:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626751104:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191341.629590:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626751616:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191341.629722:0:57923:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57923:1874004626751488:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191341.629748:0:57923:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a475c00 x1874004626750720/t8589937006(8589937006) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191341.629781:0:57919:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b513b9500 x1874004626751232/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191341.629794:0:57919:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184c00/0xe5129dc88483a779 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46062fc expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191341.629807:0:57919:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184c00/0xe5129dc88483a779 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46062fc expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.629818:0:57919:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/214 (0 0) 00000080:00200008:1.0:1787191341.629822:0:57923:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xd9:0x0](ffff936b539680c8), flags 100001 00000080:00200000:2.0:1787191341.629824:0:57919:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xd6:0x0] suppgids 0 0: rc 0 00000002:00100000:1.0:1787191341.629975:0:57923:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a474000 x1874004626750336/t8589937004(8589937004) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191357 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191341.629986:0:57923:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191341.629994:0:57923:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8380 x1874004626751872/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000080:00010000:2.0:1787191341.629997:0:57919:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd6:0x0](ffff936b5396f448) for lock 0xe5129dc88483a779 00000080:00010000:2.0:1787191341.630009:0:57919:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a779 from it ffffa3fb4227bbc8 00010000:00010000:2.0:1787191341.630016:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184c00/0xe5129dc88483a779 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46062fc expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.630043:0:57919:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184c00/0xe5129dc88483a779 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46062fc expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.630063:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184c00/0xe5129dc88483a779 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46062fc expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.630075:0:57919:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184c00/0xe5129dc88483a779 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46062fc expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:2.0:1787191341.630084:0:57919:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xd6:0x0](000000003f5f83f6) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184c00/0xe5129dc88483a779 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46062fc expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1787191341.630135:0:57923:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57923:1874004626751872:192.168.202.101@tcp:35:lfs.0 00010000:00010000:2.0:1787191341.630209:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184c00/0xe5129dc88483a779 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46062fc expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1787191341.630215:0:57923:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893180 going to sleep for 11 seconds 00010000:00010000:2.0:1787191341.630216:0:57919:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184c00/0xe5129dc88483a779 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46062fc expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191341.630232:0:57919:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191341.630240:0:57919:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd6:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191341.630243:0:57919:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191341.630247:0:57919:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191341.630255:0:57919:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191341.630270:0:57919:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:2.0:1787191341.630280:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184c00/0xe5129dc88483a779 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46062fc expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191341.630672:0:57919:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184c00/0xe5129dc88483a779 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46062fc expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:2.0:1787191341.630683:0:57919:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xd6:0x0](000000003f5f83f6) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184c00/0xe5129dc88483a779 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46062fc expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191341.630704:0:57919:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191341.630710:0:57919:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd6:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191341.630712:0:57919:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191341.630714:0:57919:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191341.630718:0:57919:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191341.630725:0:57919:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:2.0:1787191341.630737:0:57919:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 5 blocks 8 [cma]time: 1787191341 1787191341 1787191341 by oinfo size 5 blocks 8 [cma]time 1787191341 1787191341 1787191341 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 1/0,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00000008:00010000:2.0:1787191341.630768:0:57919:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 4096 blocks 8 [cma]time: 1787191341 1787191341 0 by oinfo size 5 blocks 8 [cma]time 1787191341 1787191341 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a756 lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x1c7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606277 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000008:00010000:2.0:1787191341.630782:0:57919:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191341 1787191341 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000be88ce23/0xe5129dc88483a75d lrc: 1/0,0 mode: PW/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460627e expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191341.631080:0:57919:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd6:0x0]: layout version change: 4294967294 -> 6 00010000:00010000:2.0:1787191341.631087:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184c00/0xe5129dc88483a779 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46062fc expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191341.631101:0:57919:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184c00/0xe5129dc88483a779 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46062fc expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200008:2.0:1787191341.631240:0:57919:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xd6:0x0](ffff936b5396f448), flags 154002 00000002:00100000:2.0:1787191341.631277:0:57919:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513b9f80 x1874004626741632/t8589936988(8589936988) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191341.631286:0:57919:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:2.0:1787191341.631493:0:57919:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9500 x1874004626752128/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191341.631512:0:57919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626752128:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191341.631994:0:57919:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787191341.633999:0:57923:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57923:1874004626751872:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191341.634380:0:57923:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a474000 x1874004626750336/t8589937004(8589937004) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787191341.638492:0:57919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626752128:192.168.202.101@tcp:35:lfs.0 00000002:00100000:2.0:1787191341.638530:0:57919:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513b9f80 x1874004626741632/t8589936988(8589936988) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191341.638582:0:57919:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191341.638593:0:57919:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd6:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191341.638597:0:57919:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191341.638603:0:57919:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191341.638615:0:57919:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191341.638632:0:57919:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191341.638650:0:57919:0:(llite_lib.c:2066:ll_clear_inode()) VFS Op:inode=[0x200000405:0xd6:0x0](ffff936b5396f448) 00000080:00200000:2.0:1787191341.638770:0:57919:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191341.638788:0:57919:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191341.638802:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191341.638817:0:57919:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191341.638825:0:57919:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191341.638863:0:57919:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191341.638867:0:57919:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191341.638875:0:57919:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4227bbf8 00010000:00010000:2.0:1787191341.638878:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191341.638887:0:57919:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191341.638903:0:57919:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191341.638910:0:57919:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191341.638915:0:57919:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191341.638925:0:57919:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b484c5c80, open_flags d900, mode 0 opened 0 00000080:00200000:2.0:1787191341.638931:0:57919:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:2.0:1787191341.638944:0:57919:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:2.0:1787191341.638988:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483a780 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.638997:0:57919:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483a780 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57919 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191341.639006:0:57919:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191341.639012:0:57919:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9500 x1874004626752384/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191341.639141:0:57919:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483a780 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57919 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191341.639162:0:57919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626752384:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191341.640798:0:57919:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5fa80 going to sleep for 11 seconds 00000080:00200000:0.0:1787191341.641581:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191341.641605:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.641620:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.641636:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.641643:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191341.641651:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191341.641655:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191341.641661:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:0.0:1787191341.641666:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.641674:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.641688:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.641695:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191341.641701:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:2.0:1787191341.644477:0:57919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626752384:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191341.644505:0:57919:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483a780 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460631f expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.644533:0:57919:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483a780 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460631f expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.644542:0:57919:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483a780 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460631f expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.644554:0:57919:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483a780 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460631f expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.644565:0:57919:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483a780 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460631f expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.644578:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483a780 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460631f expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.644585:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483a780 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460631f expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.644598:0:57919:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483a780 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460631f expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191341.644610:0:57919:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b513b9500 x1874004626752384/t8589937010(8589937010) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191341.644623:0:57919:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9500 x1874004626752384/t8589937010(8589937010) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191341.644636:0:57919:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483a780 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460631f expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191341.644661:0:57919:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483a780 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460631f expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.644669:0:57919:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/217 (0 0) 00000080:00200000:2.0:1787191341.644675:0:57919:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191341.644726:0:57919:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xd9:0x0](ffff936b539680c8): rc = 0 00000080:00200000:2.0:1787191341.644741:0:57919:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd9:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:2.0:1787191341.644746:0:57919:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd9:0x0](ffff936b539680c8) for lock 0xe5129dc88483a780 00000080:00010000:2.0:1787191341.644758:0:57919:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd9:0x0](ffff936b539680c8) 00000080:00200008:2.0:1787191341.644770:0:57919:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xd9:0x0](ffff936b539680c8), flags 154400 00000002:00100000:2.0:1787191341.644792:0:57919:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9500 x1874004626752384/t8589937010(8589937010) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1787191341.644881:0:57919:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a780 from it ffff936b60dc4900 00010000:00010000:2.0:1787191341.644887:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483a780 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460631f expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.644902:0:57919:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483a780 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460631f expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191341.644927:0:57919:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd9:0x0](ffff936b539680c8), inode mode 81a4 mask 44 00000080:00200000:0.0:1787191341.644977:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:0.0:1787191341.644986:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd9:0x0](ffff936b539680c8), inode mode 81a4 mask 42 00000080:00200008:0.0:1787191341.644992:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xd9:0x0](ffff936b539680c8), flags 101101 00000080:00200000:2.0:1787191341.645002:0:57919:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd9:0x0](ffff936b539680c8), inode mode 81a4 mask 4 00000080:00200000:2.0:1787191341.645010:0:57919:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xd9:0x0](ffff936b539680c8), xattr lov 00000002:00010000:0.0:1787191341.645012:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd9:0x0]) in obj [0x200000405:0xd9:0x0], intent: open|creat flags 04240101102 00010000:00010000:0.0:1787191341.645039:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483a780 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e460631f expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191341.645055:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xd9:0x0]: losing layout lock 00000080:00200008:2.0:1787191341.645058:0:57919:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xd9:0x0](ffff936b539680c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191341.645065:0:57919:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xd9:0x0](ffff936b539680c8),name=f70.sanity-flr 00000002:00010000:2.0:1787191341.645075:0:57919:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd9:0x0]) in obj [0x200000405:0xd9:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191341.645082:0:57919:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 30 res 8589935621/217 (0 0) 00010000:00010000:0.0:1787191341.645094:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483a780 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460631f expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.645102:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191341.645106:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483a780 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460631f expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.645123:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a787 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.645132:0:57919:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a787 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.645140:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a78e lrc: 3/0,1 mode: --/CW res: [0x200000405:0xd9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.645143:0:57919:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a787 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.645159:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a78e lrc: 3/0,1 mode: --/CW res: [0x200000405:0xd9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191341.645176:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191341.645176:0:57919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626752640:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191341.645187:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477800 x1874004626752768/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191341.645197:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a78e lrc: 3/0,1 mode: --/CW res: [0x200000405:0xd9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.645210:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626752768:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191341.645256:0:57919:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787191341.645314:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787191341.649972:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191341.650011:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634912640 00000100:00100000:3.0:1787191341.650020:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634912640 00000100:00100000:3.0:1787191341.650088:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1411 00000100:00100000:3.0:1787191341.650098:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634912640:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191341.650123:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a787 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xd9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e4606334 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.650200:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191341.650208:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634912640:12345-192.168.202.101@tcp:104: Request processed in 111us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191341.650214:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1411 00010000:00010000:0.0:1787191341.650476:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191341.650484:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a787 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xd9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e4606334 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.650492:0:57627:0:(ldlm_lockd.c:1935:ldlm_handle_bl_callback()) Lock ffff936b51185e00 is referenced, will be cancelled later 00010000:00010000:0.0:1787191341.650495:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a787 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xd9:0x0].0x0 bits 0x2/0x5 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4606334 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.650504:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191341.650505:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191341.650507:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191341.650799:0:57919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626752640:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191341.650814:0:57919:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a787 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xd9:0x0].0x0 bits 0x2/0x5 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4606334 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.650825:0:57919:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a787 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x5 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4606334 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.650860:0:57919:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a787 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x5 rrc: 3 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e4606334 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.650870:0:57919:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a787 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x5 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4606334 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.650881:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a787 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x5 rrc: 3 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e4606334 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.650888:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a787 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x5 rrc: 3 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e4606334 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.650895:0:57919:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a787 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x5 rrc: 3 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e4606334 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191341.650905:0:57919:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b513b9f80 x1874004626752640/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/976 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191341.650919:0:57919:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a787 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x5 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4606334 expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191341.650932:0:57919:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a787 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x5 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4606334 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.650942:0:57919:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/217 (0 0) 00000080:00200000:1.0:1787191341.650949:0:57919:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xd9:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787191341.651011:0:57919:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd9:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:1.0:1787191341.651017:0:57919:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd9:0x0](ffff936b539680c8) for lock 0xe5129dc88483a787 00000080:00010000:1.0:1787191341.651035:0:57919:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd9:0x0](ffff936b539680c8) 00000080:00010000:1.0:1787191341.651039:0:57919:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a787 from it ffffa3fb4227bcd8 00010000:00010000:1.0:1787191341.651042:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a787 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x5 rrc: 3 type: IBT gid 0 flags: 0x10420400000000 nid: local remote: 0x7130d520e4606334 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.651049:0:57919:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a787 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x5 rrc: 3 type: IBT gid 0 flags: 0x10420400000000 nid: local remote: 0x7130d520e4606334 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.651070:0:57919:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000080:00200000:1.0:1787191341.651099:0:57919:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd9:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:1.0:1787191341.651120:0:57919:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd9:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191341.651124:0:57919:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191341.651127:0:57919:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xd9:0x0] 00000008:00010000:1.0:1787191341.651150:0:57919:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191341.651154:0:57919:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b628939f0, osc lock ffff936b468370a0, flags 0x400000400001002 00000008:00010000:1.0:1787191341.651160:0:57919:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191341.651162:0:57919:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b62893a30, osc lock ffff936b46836390, flags 0x400000400001002 00010000:00010000:1.0:1787191341.651218:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a795 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.651229:0:57919:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a795 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.651240:0:57919:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b453a9500 x1874004626752896/t0(0) o101->lustre-OST0000-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191341.651290:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787191341.651306:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626752896:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191341.651413:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a79c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.651421:0:57919:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a79c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.651430:0:57919:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b453ab800 x1874004626753024/t0(0) o101->lustre-OST0001-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:1.0:1787191341.651446:0:57919:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 2 items remaining. 00000100:00100000:1.0:1787191341.651458:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626753024:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191341.652554:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787191341.652564:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a787 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x5 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4606334 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.652574:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51185e00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191341.652578:0:40929:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a787 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4606334 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.652591:0:40929:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a787 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4606334 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.652600:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a787 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4606334 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000080:00200000:2.0:1787191341.652619:0:40929:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xd9:0x0]: losing layout lock 00010000:00010000:2.0:1787191341.652662:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a787 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4606334 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.652668:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191341.652688:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a787 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4606334 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.652696:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a787 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4606334 expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.652710:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191341.652711:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191341.652713:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191341.652720:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787191341.652732:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626753152:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787191341.656463:0:2390:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a79c lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.656489:0:2390:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a79c lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606350 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.656509:0:2390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a79c lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606350 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.656694:0:2390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a79c lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606350 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191341.656713:0:2390:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a79c lrc: 5/2,0 mode: PR/PR res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606350 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1787191341.656724:0:2390:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191341.656729:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a79c lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606350 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.656736:0:2390:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a79c lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606350 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.656743:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a79c lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606350 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.656752:0:2390:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a79c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606350 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1787191341.656773:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626753024:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191341.656797:0:2390:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a795 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.656807:0:2390:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a795 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606349 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.656816:0:2390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a795 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606349 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.656825:0:2390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a795 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606349 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191341.656864:0:2390:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a795 lrc: 5/2,0 mode: PR/PR res: [0x280000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606349 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1787191341.656872:0:2390:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1787191341.656885:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a795 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606349 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.656892:0:2390:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a795 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606349 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.656900:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a795 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606349 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.656914:0:2390:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a795 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606349 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1787191341.656925:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626752896:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191341.657268:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626753152:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00200000:2.0:1787191341.657304:0:57919:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd9:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191341.657310:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b516546f0 (ffff936b465cc098/0) at cl_lock_release():245 00000020:00010000:2.0:1787191341.657313:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b516546f0 (ffff936b465cc098/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191341.657319:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b628939f0 (ffff936b465ccab8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191341.657324:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62893a30 (ffff936b465ccea8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191341.657326:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b516546f0 (ffff936b465cc098/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191341.657329:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b628939f0 (ffff936b465cc098/1) at cl_lock_fini():72 00000020:00010000:2.0:1787191341.657334:0:57919:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62893a30 (ffff936b465cc098/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191341.657388:0:57919:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd9:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:2.0:1787191341.657408:0:57919:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/217 (0 0) 00000080:00010000:2.0:1787191341.657418:0:57919:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xd9:0x0](ffff936b539680c8) 00000002:00010000:2.0:1787191341.657428:0:57919:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd9:0x0]) in obj [0x200000405:0xd9:0x0], intent: layout flags 0 00010000:00010000:2.0:1787191341.657466:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483a7a3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.657474:0:57919:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483a7a3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.657482:0:57919:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483a7a3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xd9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57919 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191341.657500:0:57919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626753280:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191341.657568:0:57919:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f300 going to sleep for 11 seconds 00000100:00100000:0.0:1787191341.658141:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626752768:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191341.658156:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a78e lrc: 4/0,1 mode: --/CW res: [0x200000405:0xd9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606342 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.658166:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a78e lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xd9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606342 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.658179:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a78e lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xd9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606342 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191341.658191:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x200002b, status=0 req@ffff936b6a477800 x1874004626752768/t8589937011(8589937011) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191341.658204:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477800 x1874004626752768/t8589937011(8589937011) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191341.658217:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a78e lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xd9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606342 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.658225:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 8 res 8589935621/217 (0 0) 00000080:00200000:0.0:1787191341.658231:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000405:0xd9:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191341.658272:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd9:0x0](ffff936b539680c8) for lock 0xe5129dc88483a78e 00000080:00010000:0.0:1787191341.658278:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a78e from it ffffa3fb41cabbf0 00010000:00010000:0.0:1787191341.658282:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a78e lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xd9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606342 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.658291:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a78e lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xd9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606342 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00100000:0.0:1787191341.658311:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477800 x1874004626752768/t8589937011(8589937011) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191341.658365:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xd9:0x0], intent: getxattr flags 0 00010000:00010000:0.0:1787191341.658393:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a7aa lrc: 3/1,0 mode: --/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.658404:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a7aa lrc: 3/1,0 mode: --/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.658412:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a7aa lrc: 3/1,0 mode: --/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.658425:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626753408:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191341.658814:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787191341.659286:0:57919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626753280:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191341.659301:0:57919:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483a7a3 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xd9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460635e expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.659310:0:57919:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483a7a3 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xd9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460635e expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191341.659320:0:57919:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b513ba680 x1874004626753280/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191341.659330:0:57919:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483a7a3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460635e expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191341.659340:0:57919:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483a7a3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460635e expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.659349:0:57919:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/217 (0 0) 00000080:00200000:2.0:1787191341.659354:0:57919:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xd9:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1787191341.659366:0:57919:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd9:0x0](ffff936b539680c8) for lock 0xe5129dc88483a7a3 00000080:00010000:2.0:1787191341.659371:0:57919:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a7a3 from it ffffa3fb4227bbc8 00010000:00010000:2.0:1787191341.659374:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483a7a3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460635e expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.659382:0:57919:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483a7a3 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460635e expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.659399:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483a7a3 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460635e expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.659409:0:57919:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483a7a3 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460635e expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:2.0:1787191341.659417:0:57919:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xd9:0x0](0000000005f8fa7b) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483a7a3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460635e expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191341.659448:0:57919:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd9:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:2.0:1787191341.659453:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483a7a3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460635e expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.659460:0:57919:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483a7a3 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460635e expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200008:2.0:1787191341.659631:0:57919:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xd9:0x0](ffff936b539680c8), flags 154000 00000002:00100000:2.0:1787191341.659729:0:57919:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513b9500 x1874004626752384/t8589937010(8589937010) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191341.659740:0:57919:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191341.659745:0:57919:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513ba680 x1874004626753664/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191341.659762:0:57919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626753664:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191341.659813:0:57919:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f300 going to sleep for 11 seconds 00000100:00100000:0.0:1787191341.660452:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626753408:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191341.660467:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a7aa lrc: 4/1,0 mode: --/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460636c expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.660477:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a7aa lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460636c expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.660485:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a7aa lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460636c expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191341.660495:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b6a475f80 x1874004626753408/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191341.660504:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a7aa lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460636c expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.660512:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/217 (0 0) 00000080:00200000:0.0:1787191341.660517:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xd9:0x0] suppgids 0 -1: rc 0 00000080:00010000:0.0:1787191341.660725:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd9:0x0](ffff936b539680c8) for lock 0xe5129dc88483a7aa 00000080:00010000:0.0:1787191341.660733:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a7aa from it ffffa3fb41caba38 00010000:00010000:0.0:1787191341.660737:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a7aa lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460636c expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.660745:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a7aa lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460636c expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:0.0:1787191341.660775:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xd9:0x0](ffff936b539680c8) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191341.000000000, mtime 1787191341.000000000, ctime 1787191341.000000000 00000020:00100000:0.0:1787191341.660811:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 36, max 7 00000100:00100000:0.0:1787191341.660817:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475f80 x1874004626753920/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787191341.660860:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626753920:192.168.202.101@tcp:36:bash.0 00000100:00100000:0.0:1787191341.660941:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787191341.663144:0:57919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626753664:192.168.202.101@tcp:35:lfs.0 00000002:00100000:2.0:1787191341.663174:0:57919:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513b9500 x1874004626752384/t8589937010(8589937010) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191341.663249:0:57919:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191341.663267:0:57919:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191341.663282:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191341.663293:0:57919:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191341.663301:0:57919:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191341.663305:0:57919:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191341.663309:0:57919:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191341.663315:0:57919:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4227bbf8 00010000:00010000:2.0:1787191341.663319:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191341.663328:0:57919:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191341.663341:0:57919:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191341.663347:0:57919:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191341.663353:0:57919:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191341.663366:0:57919:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b484c5200, open_flags d902, mode 0 opened 0 00000080:00200000:2.0:1787191341.663372:0:57919:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:2.0:1787191341.663385:0:57919:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154403 00010000:00010000:2.0:1787191341.663427:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a7b1 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.663435:0:57919:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a7b1 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57919 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191341.663445:0:57919:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191341.663451:0:57919:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513ba680 x1874004626754176/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191341.663459:0:57919:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a7b1 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57919 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191341.663478:0:57919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626754176:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191341.663664:0:57919:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f300 going to sleep for 11 seconds 00000100:00100000:0.0:1787191341.664562:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626753920:192.168.202.101@tcp:36:bash.0 00000080:00200000:0.0:1787191341.664596:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:0.0:1787191341.664602:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd9:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191341.664612:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xd9:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:0.0:1787191341.664619:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd9:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191341.664622:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xd9:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:0.0:1787191341.664630:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xd9:0x0](ffff936b539680c8) 00000002:00010000:0.0:1787191341.664649:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd9:0x0]) in obj [0x200000405:0xd9:0x0], intent: layout flags 02 00010000:00010000:0.0:1787191341.664665:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483a7a3 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e460635e expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191341.664706:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xd9:0x0]: losing layout lock 00010000:00010000:0.0:1787191341.664735:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483a7a3 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xd9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460635e expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.664742:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191341.664745:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483a7a3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xd9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460635e expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.664764:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a7b8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xd9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.664771:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a7b8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xd9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191341.664779:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:0.0:1787191341.664786:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474a80 x1874004626754432/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191341.664793:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a7b8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xd9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.664806:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626754432:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191341.664879:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787191341.671111:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191341.671146:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634912768 00000100:00100000:2.0:1787191341.671154:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634912768 00000100:00100000:2.0:1787191341.671194:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1412 00000100:00100000:2.0:1787191341.671204:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634912768:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191341.671228:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a7b1 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e460638f expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.671299:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191341.671307:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634912768:12345-192.168.202.101@tcp:104: Request processed in 105us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191341.671316:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1412 00010000:00010000:0.0:1787191341.671442:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191341.671450:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a7b1 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e460638f expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.671460:0:40930:0:(ldlm_lockd.c:1935:ldlm_handle_bl_callback()) Lock ffff936b51185e00 is referenced, will be cancelled later 00010000:00010000:0.0:1787191341.671462:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a7b1 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e460638f expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.671470:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191341.671473:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191341.671474:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191341.672384:0:57919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626754176:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191341.672407:0:57919:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a7b1 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e460638f expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.672499:0:57919:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a7b1 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e460638f expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.672510:0:57919:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a7b1 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e460638f expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.672523:0:57919:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a7b1 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e460638f expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.672534:0:57919:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a7b1 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e460638f expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.672547:0:57919:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a7b1 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e460638f expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.672556:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a7b1 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e460638f expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.672563:0:57919:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a7b1 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e460638f expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191341.672575:0:57919:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b513ba680 x1874004626754176/t8589937015(8589937015) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191341.672588:0:57919:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513ba680 x1874004626754176/t8589937015(8589937015) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191341.672601:0:57919:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a7b1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e460638f expref: -99 pid: 57919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191341.672615:0:57919:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a7b1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e460638f expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.672626:0:57919:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/217 (0 0) 00000080:00200000:1.0:1787191341.672632:0:57919:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191341.672701:0:57919:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xd9:0x0](ffff936b539680c8): rc = 0 00000080:00200000:1.0:1787191341.672716:0:57919:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd9:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:1.0:1787191341.672722:0:57919:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd9:0x0](ffff936b539680c8) for lock 0xe5129dc88483a7b1 00000080:00010000:1.0:1787191341.672735:0:57919:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd9:0x0](ffff936b539680c8) 00000080:00200008:1.0:1787191341.672748:0:57919:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xd9:0x0](ffff936b539680c8), flags 154402 00000002:00100000:1.0:1787191341.672769:0:57919:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513ba680 x1874004626754176/t8589937015(8589937015) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191341.672805:0:57919:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513ba680 x1874004626754176/t8589937015(8589937015) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191341.672821:0:57919:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191341.672826:0:57919:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9500 x1874004626754688/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191341.672877:0:57919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626754688:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191341.672956:0:57919:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191341.674700:0:57919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626754688:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191341.674728:0:57919:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513ba680 x1874004626754176/t8589937015(8589937015) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191341.674793:0:57919:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a7b1 from it ffff936b60dc4360 00010000:00010000:1.0:1787191341.674801:0:57919:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a7b1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10420400000000 nid: local remote: 0x7130d520e460638f expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.674811:0:57919:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a7b1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10420400000000 nid: local remote: 0x7130d520e460638f expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.674855:0:57919:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1787191341.674868:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000080:00200000:1.0:1787191341.674868:0:57919:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd9:0x0](ffff936b539680c8), inode mode 81a4 mask 46 00010000:00010000:0.0:1787191341.674878:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a7b1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e460638f expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.674888:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51185e00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191341.674894:0:43384:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a7b1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x1a rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e460638f expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.674904:0:43384:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a7b1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x1a rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e460638f expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.674913:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a7b1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x1a rrc: 5 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e460638f expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000080:00200080:1.0:1787191341.674930:0:57919:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xd9:0x0](ffff936b539680c8) cmd=800466af arg=7ffda7115f8c 00000080:00200000:0.0:1787191341.674934:0:43384:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xd9:0x0]: losing layout lock 00000080:00200080:1.0:1787191341.674947:0:57919:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xd9:0x0](ffff936b539680c8) cmd=80086601 arg=7ffda7115f28 00010000:00010000:0.0:1787191341.674973:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a7b1 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x1a rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e460638f expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.674981:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787191341.674987:0:57919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626754816:192.168.202.101@tcp:33:lfs.0 00010000:00010000:0.0:1787191341.675008:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a7b1 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x1a rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e460638f expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.675017:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483a7b1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x1a rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e460638f expref: -99 pid: 57919 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191341.675071:0:57919:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1787191341.675719:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191341.675721:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191341.675725:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191341.675734:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787191341.675748:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626754944:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191341.682630:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626754944:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191341.689228:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191341.689276:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191341.689960:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634913408 00000100:00100000:1.0:1787191341.689961:0:57919:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589937017 gen 1 00000100:00100000:2.0:1787191341.689968:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634913408 00000100:00100000:1.0:1787191341.690040:0:57919:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b6a477800 x1874004626752768/t8589937011(8589937011) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787191341.690066:0:57919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57919:1874004626754816:192.168.202.101@tcp:33:lfs.0 00000080:00200080:1.0:1787191341.690099:0:57919:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xd9:0x0](ffff936b539680c8) cmd=c00c66f3 arg=7ffda7115f14 00000100:00100000:2.0:1787191341.690147:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634913536 00000100:00100000:2.0:1787191341.690152:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634913536 00000100:00100000:2.0:1787191341.690171:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1413 00000100:00100000:2.0:1787191341.690180:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+5:8422:x1874004634913408:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191341.690195:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a756 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4606277 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.690265:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191341.690273:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+5:8422:x1874004634913408:12345-192.168.202.101@tcp:104: Request processed in 92us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191341.690280:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1413 00000100:00100000:2.0:1787191341.690297:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1414 00000100:00100000:2.0:1787191341.690303:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30511:x1874004634913536:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191341.690313:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a6a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4606063 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.690341:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787191341.690346:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30511:x1874004634913536:12345-192.168.202.101@tcp:104: Request processed in 44us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191341.690351:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1414 00010000:00010000:2.0:1787191341.690367:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000080:00200008:1.0:1787191341.690369:0:57919:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xd9:0x0](ffff936b539680c8), flags 154002 00010000:00010000:2.0:1787191341.690373:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a756 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4606277 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.690384:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cafa00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:2.0:1787191341.690390:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a756 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e4606277 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.690399:0:57919:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a78e lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xd9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606342 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191341.690430:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a756 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4606277 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.690438:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191341.690455:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a756 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4606277 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.690463:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000b3741ec8/0xe5129dc88483a756 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4606277 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.690479:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787191341.690482:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a6a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4606063 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.690488:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cae400 already unused, calling callback (ffffffffc1208790) 00010000:00010000:2.0:1787191341.690491:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a6a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4606063 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.690504:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a6a0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4606063 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.690510:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191341.690515:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a6a0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4606063 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1787191341.690968:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626754432:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191341.690985:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a7b8 lrc: 4/0,1 mode: --/EX res: [0x200000405:0xd9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46063a4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.690994:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a7b8 lrc: 4/0,1 mode: --/CR res: [0x200000405:0xd9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46063a4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.691007:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a7b8 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xd9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46063a4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.691017:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a7b8 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xd9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46063a4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.691044:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a7b8 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xd9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46063a4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.691052:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a7b8 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xd9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46063a4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.691059:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a7b8 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xd9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46063a4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191341.691069:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b6a474a80 x1874004626754432/t8589937017(8589937017) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191341.691086:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a7b8 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46063a4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191341.691097:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a7b8 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46063a4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.691111:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/217 (0 0) 00000080:00200000:0.0:1787191341.691117:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xd9:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191341.691130:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd9:0x0](ffff936b539680c8) for lock 0xe5129dc88483a7b8 00000080:00010000:0.0:1787191341.691136:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a7b8 from it ffffa3fb41cab930 00010000:00010000:0.0:1787191341.691139:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a7b8 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46063a4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.691147:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a7b8 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46063a4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191341.691164:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:0.0:1787191341.691171:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd9:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:0.0:1787191341.691182:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a7b8 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46063a4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.691190:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a7b8 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46063a4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1787191341.691197:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xd9:0x0](0000000005f8fa7b) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a7b8 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46063a4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.691239:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a7b8 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46063a4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.691246:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a7b8 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46063a4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191341.691311:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd9:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191341.691321:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd9:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191341.691324:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191341.691330:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:0.0:1787191341.691390:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd9:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:0.0:1787191341.691404:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a7b8 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46063a4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.691413:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a7b8 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xd9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46063a4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:0.0:1787191341.691420:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xd9:0x0](0000000005f8fa7b) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a7b8 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46063a4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191341.691439:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd9:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191341.691444:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd9:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191341.691447:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191341.691449:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:0.0:1787191341.691477:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd9:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:0.0:1787191341.691504:0:57570:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a795 lrc: 1/0,0 mode: PR/PR res: [0x280000401:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606349 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000008:00010000:0.0:1787191341.691518:0:57570:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a79c lrc: 1/0,0 mode: PR/PR res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606350 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.691892:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191341.692752:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000342aad37/0xe5129dc88483a6a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4606063 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.692778:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191341.692780:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191341.692782:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191341.693296:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626755072:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191341.693399:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787191341.693407:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626755200:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00200000:0.0:1787191341.693794:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd9:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:0.0:1787191341.693803:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a7b8 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xd9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46063a4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.693813:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a7b8 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46063a4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00020000:00200000:0.0:1787191341.693857:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xd9:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:0.0:1787191341.693862:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd9:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191341.693865:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191341.693873:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191341.693887:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191341.693891:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:0.0:1787191341.693901:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:0.0:1787191341.693905:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f99db0, osc lock ffff936b50b63c80, flags 0x80000000 00000008:00010000:0.0:1787191341.693908:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:0.0:1787191341.693910:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f99df0, osc lock ffff936b50b637c0, flags 0x80000000 00010000:00010000:0.0:1787191341.693955:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.693964:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.693978:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.693995:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626755328:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191341.694986:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99000 going to sleep for 11 seconds 00000100:00100000:2.0:1787191341.697419:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191341.697451:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634914304 00000100:00100000:2.0:1787191341.697460:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634914304 00000100:00100000:2.0:1787191341.697507:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1415 00000100:00100000:2.0:1787191341.697517:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8420:x1874004634914304:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191341.697904:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000be88ce23/0xe5129dc88483a75d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e460627e expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.697980:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191341.697988:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8420:x1874004634914304:12345-192.168.202.101@tcp:104: Request processed in 472us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191341.697995:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1415 00010000:00010000:0.0:1787191341.698177:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191341.698185:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000be88ce23/0xe5129dc88483a75d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e460627e expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.698194:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40031800 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191341.698200:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000be88ce23/0xe5129dc88483a75d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e460627e expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.698244:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000be88ce23/0xe5129dc88483a75d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e460627e expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.698252:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191341.698282:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000be88ce23/0xe5129dc88483a75d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e460627e expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.698291:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000be88ce23/0xe5129dc88483a75d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e460627e expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.698312:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191341.698313:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191341.698316:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191341.698324:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787191341.698339:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626755456:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191341.699691:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191341.700550:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634914176 00000100:00100000:3.0:1787191341.700558:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634914176 00000100:00100000:3.0:1787191341.700613:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1416 00000100:00100000:3.0:1787191341.700624:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30510:x1874004634914176:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191341.700649:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:3.0:1787191341.700715:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191341.700723:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30510:x1874004634914176:12345-192.168.202.101@tcp:104: Request processed in 100us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191341.700731:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1416 00010000:00010000:0.0:1787191341.701380:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191341.701388:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:0.0:1787191341.701398:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44cafe00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191341.701404:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:0.0:1787191341.701449:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:0.0:1787191341.701457:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191341.701480:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:0.0:1787191341.701489:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000308c00ac/0xe5129dc88483a702 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4606182 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:0.0:1787191341.701513:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191341.701515:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191341.701517:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191341.701588:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787191341.701709:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626755584:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191341.705771:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626755328:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191341.705801:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46063c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.705822:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e46063c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.705855:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e46063c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.705870:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e46063c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191341.705883:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e46063c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.705895:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46063c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.705903:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46063c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.705964:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003b2ea1d7/0xe5129dc88483a7c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.705973:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003b2ea1d7/0xe5129dc88483a7c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.705989:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003b2ea1d7/0xe5129dc88483a7c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.706007:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626755712:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191341.708319:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626755072:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191341.708625:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626755200:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00200000:1.0:1787191341.714916:0:57924:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191341.714947:0:57924:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191341.714963:0:57924:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.714978:0:57924:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.714985:0:57924:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191341.714992:0:57924:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191341.714995:0:57924:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191341.715002:0:57924:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4228bbf8 00010000:00010000:1.0:1787191341.715005:0:57924:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.715016:0:57924:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.715042:0:57924:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191341.715050:0:57924:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191341.715056:0:57924:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191341.715069:0:57924:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b522db500, open_flags d900, mode 0 opened 0 00000080:00200000:1.0:1787191341.715074:0:57924:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:1.0:1787191341.715088:0:57924:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:1.0:1787191341.715142:0:57924:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a7cd lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.715150:0:57924:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a7cd lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57924 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191341.715161:0:57924:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191341.715185:0:57924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9500 x1874004626755968/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191341.715195:0:57924:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a7cd lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191341.715217:0:57924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57924:1874004626755968:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191341.716586:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626755456:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191341.716627:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626755584:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191341.717505:0:57924:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191341.717524:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99000 going to sleep for 11 seconds 00000100:00100000:2.0:1787191341.718932:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626755712:192.168.202.101@tcp:101:bash.0 00010000:00010000:2.0:1787191341.718957:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003b2ea1d7/0xe5129dc88483a7c6 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46063e3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.718977:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003b2ea1d7/0xe5129dc88483a7c6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e46063e3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.718990:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003b2ea1d7/0xe5129dc88483a7c6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e46063e3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.719005:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003b2ea1d7/0xe5129dc88483a7c6 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e46063e3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1787191341.719018:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003b2ea1d7/0xe5129dc88483a7c6 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e46063e3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.719128:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003b2ea1d7/0xe5129dc88483a7c6 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46063e3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.719136:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003b2ea1d7/0xe5129dc88483a7c6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46063e3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191341.719298:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626756096:192.168.202.101@tcp:10:bash.0 00000100:00100000:3.0:1787191341.719929:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787191341.719937:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626756224:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191341.730622:0:57924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57924:1874004626755968:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191341.730659:0:57924:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a7cd lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46063ea expref: -99 pid: 57924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.730684:0:57924:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a7cd lrc: 4/1,0 mode: --/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46063ea expref: -99 pid: 57924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.730693:0:57924:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a7cd lrc: 4/1,0 mode: --/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46063ea expref: -99 pid: 57924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.730710:0:57924:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a7cd lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46063ea expref: -99 pid: 57924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.730720:0:57924:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a7cd lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46063ea expref: -99 pid: 57924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.730733:0:57924:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a7cd lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46063ea expref: -99 pid: 57924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.730740:0:57924:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a7cd lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46063ea expref: -99 pid: 57924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.730747:0:57924:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a7cd lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46063ea expref: -99 pid: 57924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191341.730758:0:57924:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b453a9500 x1874004626755968/t8589937018(8589937018) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191341.730771:0:57924:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9500 x1874004626755968/t8589937018(8589937018) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191341.730782:0:57924:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a7cd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46063ea expref: -99 pid: 57924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191341.730794:0:57924:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a7cd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46063ea expref: -99 pid: 57924 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.730803:0:57924:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/217 (0 0) 00000080:00200000:1.0:1787191341.730811:0:57924:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191341.730901:0:57924:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xd9:0x0](ffff936b539680c8): rc = 0 00000080:00200000:1.0:1787191341.730919:0:57924:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd9:0x0]: layout version change: 4 -> 4 00000080:00010000:1.0:1787191341.730924:0:57924:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd9:0x0](ffff936b539680c8) for lock 0xe5129dc88483a7cd 00000080:00010000:1.0:1787191341.730936:0:57924:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd9:0x0](ffff936b539680c8) 00000080:00200008:1.0:1787191341.730949:0:57924:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xd9:0x0](ffff936b539680c8), flags 154400 00000002:00100000:1.0:1787191341.730970:0:57924:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9500 x1874004626755968/t8589937018(8589937018) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191341.731020:0:57924:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a7cd from it ffff936b5339f780 00010000:00010000:1.0:1787191341.731166:0:57924:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a7cd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46063ea expref: -99 pid: 57924 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.731176:0:57924:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a7cd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46063ea expref: -99 pid: 57924 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191341.731208:0:57924:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd9:0x0](ffff936b539680c8), inode mode 81a4 mask 44 00000080:00200000:1.0:1787191341.731306:0:57924:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xd9:0x0](ffff936b539680c8), inode mode 81a4 mask 4 00000080:00200000:1.0:1787191341.731313:0:57924:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xd9:0x0](ffff936b539680c8), xattr lov 00000080:00200008:1.0:1787191341.731340:0:57924:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xd9:0x0](ffff936b539680c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191341.731346:0:57924:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xd9:0x0](ffff936b539680c8),name=f70.sanity-flr 00000002:00010000:1.0:1787191341.731358:0:57924:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd9:0x0]) in obj [0x200000405:0xd9:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191341.731366:0:57924:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a7cd lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46063ea expref: -99 pid: 57924 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.731377:0:57924:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a7cd lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46063ea expref: -99 pid: 57924 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191341.731390:0:57924:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xd9:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191341.731395:0:57924:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd9:0x0](ffff936b539680c8) 00000080:00010000:1.0:1787191341.731398:0:57924:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd9:0x0](ffff936b539680c8) for lock 0xe5129dc88483a7cd 00000080:00010000:1.0:1787191341.731403:0:57924:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a7cd from it ffffa3fb4228bcd8 00010000:00010000:1.0:1787191341.731406:0:57924:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a7cd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46063ea expref: -99 pid: 57924 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.731413:0:57924:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a7cd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46063ea expref: -99 pid: 57924 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191341.731432:0:57924:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd9:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:1.0:1787191341.731441:0:57924:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd9:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191341.731444:0:57924:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191341.731447:0:57924:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xd9:0x0] 00000008:00010000:1.0:1787191341.731495:0:57924:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191341.731499:0:57924:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b47d7dab0, osc lock ffff936b46836be0, flags 0x400000400001002 00010000:00010000:1.0:1787191341.731514:0:57924:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46063c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.731525:0:57924:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46063c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1787191341.731537:0:57924:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191341.731540:0:57924:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 7/0,2 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46063c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.731554:0:57924:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46063c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1787191341.731561:0:57924:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191341.731572:0:57924:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd9:0x0] updating i_size 0 i_blocks 0 00000020:00010000:1.0:1787191341.731576:0:57924:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51654b90 (ffff936b465cca28/0) at cl_lock_release():245 00000020:00010000:1.0:1787191341.731579:0:57924:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51654b90 (ffff936b465cca28/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191341.731581:0:57924:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7dab0 (ffff936b465cc908/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191341.731585:0:57924:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51654b90 (ffff936b465cca28/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191341.731588:0:57924:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7dab0 (ffff936b465cca28/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191341.731598:0:57924:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd9:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1787191341.731636:0:57924:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xd9:0x0](ffff936b539680c8), flags 154000 00000002:00100000:1.0:1787191341.731679:0:57924:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a9500 x1874004626755968/t8589937018(8589937018) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191341.731690:0:57924:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191341.731695:0:57924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8380 x1874004626756480/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191341.731717:0:57924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57924:1874004626756480:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191341.731788:0:57924:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191341.732884:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626756224:192.168.202.101@tcp:10:bash.0 00000100:00100000:2.0:1787191341.732964:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626756096:192.168.202.101@tcp:10:bash.0 00000080:00200000:2.0:1787191341.733491:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd9:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191341.733498:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894128 (ffff936b47a17908/0) at cl_lock_release():245 00000020:00010000:2.0:1787191341.733502:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894128 (ffff936b47a17908/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191341.733506:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99db0 (ffff936b47a17ea8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191341.733515:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46063c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.733716:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46063c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191341.733734:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99df0 (ffff936b47a17008/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191341.733739:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003b2ea1d7/0xe5129dc88483a7c6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46063e3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.733748:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003b2ea1d7/0xe5129dc88483a7c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46063e3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191341.733758:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894128 (ffff936b47a17908/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191341.733760:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99db0 (ffff936b47a17908/1) at cl_lock_fini():72 00000020:00010000:2.0:1787191341.733765:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99df0 (ffff936b47a17908/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191341.733812:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd9:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191341.733943:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xd9:0x0](ffff936b539680c8) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191341.000000000, mtime 1787191341.000000000, ctime 1787191341.000000000, rc 0 00000080:00200008:2.0:1787191341.734148:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xd9:0x0], ppos: 0, count: 5 00000080:00200000:2.0:1787191341.734161:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191341.734167:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:2.0:1787191341.734172:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:2.0:1787191341.734177:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1787191341.734182:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@0000000062999b9a[0x110, 1, [0x200000405:0xd9:0x0] hash] 00000020:00200000:2.0:1787191341.734184:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:2.0:1787191341.734189:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd9:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191341.734271:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xd9:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:2.0:1787191341.734277:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd9:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191341.734281:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1787191341.734286:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1787191341.734294:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:2.0:1787191341.734297:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1787191341.734314:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:2.0:1787191341.734328:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1787191341.734333:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1a30, osc lock ffff936b44e62260, flags 0x0 00010000:00010000:2.0:1787191341.734349:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46063c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.734361:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46063c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.734377:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46063c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.734384:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46063c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.734392:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46063c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191341.734403:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:2.0:1787191341.734411:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191341.734455:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:2.0:1787191341.734462:0:57570:0:(rw26.c:927:ll_write_end()) page@0000000022612a2c[3 0000000083f0256f 2 1 0000000043179c71 0 0 0] 00000080:00200000:2.0:1787191341.734466:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @00000000c00c80d0 17ffffc0001001 3:0 ffff936b43a1ec40 0 lru 00000080:00200000:2.0:1787191341.734473:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@0000000085606277 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000ef00a996 00000000280494ef > 3< 0 0 > 4< 0 0 8 484638720 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1787191341.734475:0:57570:0:(rw26.c:927:ll_write_end()) end page@0000000022612a2c 00000080:00200000:2.0:1787191341.734476:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:2.0:1787191341.734481:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:2.0:1787191341.734498:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 0000000089ad0d4e ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46063c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191341.734516:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b53968278, count 1, dirtied 1 00000080:00200000:2.0:1787191341.734520:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:2.0:1787191341.734636:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:2.0:1787191341.734710:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894308 (ffff936b47a17b48/0) at cl_lock_release():245 00000020:00010000:2.0:1787191341.734714:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894308 (ffff936b47a17b48/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191341.734716:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1a30 (ffff936b47a17128/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191341.734722:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46063c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.734731:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46063c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:2.0:1787191341.734742:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894308 (ffff936b47a17b48/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191341.734744:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1a30 (ffff936b47a17b48/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191341.734750:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:2.0:1787191341.734755:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1787191341.734760:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd9:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191341.734763:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:2.0:1787191341.734770:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd9:0x0] updating i_size 5 i_blocks 0 00000080:00200000:2.0:1787191341.734773:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:2.0:1787191341.734793:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xd9:0x0](ffff936b539680c8), flags 100001 00010000:00010000:2.0:1787191341.734815:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a78e lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xd9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606342 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000100:00100000:1.0:1787191341.736317:0:57924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57924:1874004626756480:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191341.736349:0:57924:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a9500 x1874004626755968/t8589937018(8589937018) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191341.736582:0:57924:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191341.736608:0:57924:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191341.736620:0:57924:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.736632:0:57924:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.736647:0:57924:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191341.736653:0:57924:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191341.736657:0:57924:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191341.736663:0:57924:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4228bb58 00010000:00010000:1.0:1787191341.736666:0:57924:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.736675:0:57924:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.736687:0:57924:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191341.736693:0:57924:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191341.736699:0:57924:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191341.736709:0:57924:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=9 00000080:00200000:1.0:1787191341.736714:0:57924:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191341.736725:0:57924:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191341.736765:0:57924:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a7d4 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.736772:0:57924:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a7d4 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.736785:0:57924:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a7d4 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191341.736802:0:57924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57924:1874004626756608:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191341.736927:0:57924:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191341.741222:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191341.741267:0:51131:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787191341.741285:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634914432 00000100:00100000:3.0:1787191341.741294:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634914432 00000100:00100000:3.0:1787191341.741353:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1417 00000100:00100000:3.0:1787191341.741442:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b50883c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634914432:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191341.741462:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a78e lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xd9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e4606342 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191341.741539:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191341.741548:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b50883c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634914432:12345-192.168.202.101@tcp:104: Request processed in 186us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191341.741556:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1417 00010000:00010000:1.0:1787191341.742295:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191341.742307:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a78e lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xd9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e4606342 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191341.742317:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44caea00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191341.742323:0:57627:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a78e lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xd9:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4606342 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191341.742332:0:57627:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a78e lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xd9:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4606342 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191341.742341:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a78e lrc: 3/0,0 mode: CW/CW res: [0x200000405:0xd9:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x7130d520e4606342 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000002:00100000:1.0:1787191341.742397:0:57627:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a477800 x1874004626752768/t8589937011(8589937011) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191341.742408:0:57627:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191341.742413:0:57627:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9500 x1874004626756864/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191341.742434:0:57627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_bl_04:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57627:1874004626756864:192.168.202.101@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787191341.742495:0:57627:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893480 going to sleep for 11 seconds 00000080:00200000:1.0:1787191341.747153:0:57925:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191341.747185:0:57925:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191341.747294:0:57925:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.747311:0:57925:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.747320:0:57925:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191341.747327:0:57925:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191341.747331:0:57925:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191341.747338:0:57925:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42293b58 00010000:00010000:1.0:1787191341.747343:0:57925:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.747351:0:57925:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.747366:0:57925:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191341.747374:0:57925:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:1.0:1787191341.747379:0:57925:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:0.0:1787191341.747479:0:57627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_bl_04:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57627:1874004626756864:192.168.202.101@tcp:35:ldlm_bl.0 00000002:00100000:0.0:1787191341.747505:0:57627:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a477800 x1874004626752768/t8589937011(8589937011) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1787191341.747628:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a78e lrc: 2/0,0 mode: --/CW res: [0x200000405:0xd9:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e4606342 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.747635:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787191341.747751:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626756992:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787191341.747946:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a78e lrc: 1/0,0 mode: --/CW res: [0x200000405:0xd9:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e4606342 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.747955:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caea00/0xe5129dc88483a78e lrc: 0/0,0 mode: --/CW res: [0x200000405:0xd9:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e4606342 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.747970:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191341.747972:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191341.747975:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191341.750518:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626756992:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191341.751450:0:57924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57924:1874004626756608:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191341.751472:0:57924:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a7d4 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460640d expref: -99 pid: 57924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.751499:0:57924:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a7d4 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460640d expref: -99 pid: 57924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.751508:0:57924:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a7d4 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460640d expref: -99 pid: 57924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.751519:0:57924:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a7d4 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460640d expref: -99 pid: 57924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.751539:0:57924:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a7d4 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460640d expref: -99 pid: 57924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.751551:0:57924:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a7d4 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460640d expref: -99 pid: 57924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.751558:0:57924:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a7d4 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460640d expref: -99 pid: 57924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.751564:0:57924:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a7d4 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460640d expref: -99 pid: 57924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191341.751575:0:57924:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b453a8380 x1874004626756608/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/976 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191341.751585:0:57924:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a7d4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460640d expref: -99 pid: 57924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191341.751601:0:57924:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a7d4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460640d expref: -99 pid: 57924 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.751611:0:57924:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/217 (0 0) 00000080:00200000:1.0:1787191341.751617:0:57924:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191341.751676:0:57924:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xd9:0x0](ffff936b539680c8): rc = 0 00000080:00200000:1.0:1787191341.751691:0:57924:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xd9:0x0]: layout version change: 4 -> 4 00000080:00010000:1.0:1787191341.751697:0:57924:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd9:0x0](ffff936b539680c8) for lock 0xe5129dc88483a7d4 00000080:00010000:1.0:1787191341.751722:0:57924:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd9:0x0](ffff936b539680c8) 00000080:00010000:1.0:1787191341.751726:0:57924:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a7d4 from it ffffa3fb4228bb20 00010000:00010000:1.0:1787191341.751731:0:57924:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a7d4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460640d expref: -99 pid: 57924 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.751740:0:57924:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a7d4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460640d expref: -99 pid: 57924 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200008:1.0:1787191341.751773:0:57924:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xd9:0x0](ffff936b539680c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191341.751779:0:57924:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xd9:0x0](ffff936b539680c8),name=f70.sanity-flr 00000002:00010000:1.0:1787191341.751802:0:57924:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd9:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191341.751809:0:57924:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a7cd lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46063ea expref: -99 pid: 57924 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191341.751819:0:57924:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a7cd lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46063ea expref: -99 pid: 57924 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191341.751825:0:57924:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00200000:2.0:1787191341.752061:0:57925:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=8 00000080:00200008:2.0:1787191341.752070:0:57925:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xd9:0x0](ffff936b539680c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191341.752075:0:57925:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xd9:0x0](ffff936b539680c8),name=f70.sanity-flr 00000002:00010000:2.0:1787191341.752085:0:57925:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xd9:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191341.752093:0:57925:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a7cd lrc: 3/2,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46063ea expref: -99 pid: 57924 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191341.752101:0:57925:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a7cd lrc: 3/2,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46063ea expref: -99 pid: 57924 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191341.752119:0:57925:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191341.752125:0:57925:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd9:0x0](ffff936b539680c8) 00000080:00010000:2.0:1787191341.752128:0:57925:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd9:0x0](ffff936b539680c8) for lock 0xe5129dc88483a7cd 00000080:00010000:2.0:1787191341.752132:0:57925:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a7cd from it ffffa3fb42293cb8 00010000:00010000:2.0:1787191341.752135:0:57925:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a7cd lrc: 4/2,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46063ea expref: -99 pid: 57924 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191341.752142:0:57925:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a7cd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46063ea expref: -99 pid: 57924 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191341.752158:0:57925:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd9:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:2.0:1787191341.752167:0:57925:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd9:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191341.752170:0:57925:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191341.752173:0:57925:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xd9:0x0] 00000008:00010000:2.0:1787191341.752192:0:57925:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191341.752195:0:57925:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1a30, osc lock ffff936b44e62260, flags 0x400000400001002 00010000:00010000:2.0:1787191341.752445:0:57925:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46063c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191341.752457:0:57925:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46063c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:2.0:1787191341.752468:0:57925:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191341.752471:0:57925:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46063c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191341.752478:0:57925:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46063c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:2.0:1787191341.752494:0:57925:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191341.752502:0:57925:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd9:0x0] updating i_size 5 i_blocks 0 00000020:00010000:2.0:1787191341.752508:0:57925:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509b9e10 (ffff936b47a17b48/0) at cl_lock_release():245 00000020:00010000:2.0:1787191341.752511:0:57925:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509b9e10 (ffff936b47a17b48/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191341.752515:0:57925:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1a30 (ffff936b47a17128/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191341.752518:0:57925:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509b9e10 (ffff936b47a17b48/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191341.752531:0:57925:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1a30 (ffff936b47a17b48/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191341.752542:0:57925:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd9:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191341.752582:0:57925:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191341.752590:0:57925:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191341.752598:0:57925:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191341.752605:0:57925:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191341.752611:0:57925:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191341.752615:0:57925:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191341.752618:0:57925:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191341.752621:0:57925:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42293c10 00010000:00010000:2.0:1787191341.752625:0:57925:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191341.752632:0:57925:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191341.752656:0:57925:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191341.752661:0:57925:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191341.752664:0:57925:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191341.752670:0:57925:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:2.0:1787191341.752673:0:57925:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:2.0:1787191341.752677:0:57925:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:2.0:1787191341.752698:0:57925:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a7b8 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xd9:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46063a4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191341.752711:0:57925:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a7cd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46063ea expref: -99 pid: 57924 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191341.752722:0:57925:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a7d4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e460640d expref: -99 pid: 57924 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.752729:0:57925:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a7cd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46063ea expref: -99 pid: 57924 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191341.752738:0:57925:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a7aa lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e460636c expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.752775:0:57925:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a7b8 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xd9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46063a4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191341.752782:0:57925:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a7d4 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460640d expref: -99 pid: 57924 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.752788:0:57925:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a7aa lrc: 1/0,0 mode: --/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e460636c expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.752794:0:57925:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:2.0:1787191341.752797:0:57925:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44cae200/0xe5129dc88483a7b8 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xd9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46063a4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191341.752811:0:57925:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a7d4 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460640d expref: -99 pid: 57924 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.752821:0:57925:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44caf000/0xe5129dc88483a7aa lrc: 0/0,0 mode: --/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e460636c expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00010000:1.0:1787191341.752920:0:57924:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xd9:0x0](ffff936b539680c8) 00000080:00010000:1.0:1787191341.752924:0:57924:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xd9:0x0](ffff936b539680c8) for lock 0xe5129dc88483a7cd 00000080:00010000:1.0:1787191341.752929:0:57924:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a7cd from it ffffa3fb4228bcb8 00010000:00010000:1.0:1787191341.752932:0:57924:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a7cd lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46063ea expref: -99 pid: 57924 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191341.752940:0:57924:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a7cd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46063ea expref: -99 pid: 57924 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191341.752954:0:57924:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd9:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:1.0:1787191341.752959:0:57924:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd9:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191341.752962:0:57924:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191341.752964:0:57924:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xd9:0x0] 00000008:00010000:1.0:1787191341.752974:0:57924:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191341.752976:0:57924:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b47d7dab0, osc lock ffff936b46836be0, flags 0x400000400001002 00010000:00010000:1.0:1787191341.752985:0:57924:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46063c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191341.752994:0:57924:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46063c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:1.0:1787191341.753002:0:57924:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191341.753005:0:57924:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46063c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191341.753013:0:57924:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46063c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:1.0:1787191341.753423:0:57924:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191341.753430:0:57924:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xd9:0x0] updating i_size 5 i_blocks 0 00000020:00010000:1.0:1787191341.753434:0:57924:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51654b90 (ffff936b465cca28/0) at cl_lock_release():245 00000020:00010000:1.0:1787191341.753436:0:57924:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51654b90 (ffff936b465cca28/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191341.753440:0:57924:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7dab0 (ffff936b465cc908/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191341.753443:0:57924:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51654b90 (ffff936b465cca28/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191341.753445:0:57924:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7dab0 (ffff936b465cca28/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191341.753454:0:57924:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd9:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191341.753486:0:57924:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191341.753498:0:57924:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191341.753505:0:57924:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.753513:0:57924:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.753578:0:57924:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191341.753583:0:57924:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191341.753585:0:57924:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191341.753590:0:57924:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4228bbf8 00010000:00010000:1.0:1787191341.753593:0:57924:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.753601:0:57924:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.753615:0:57924:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191341.753619:0:57924:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191341.753623:0:57924:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000020:00100000:2.0:1787191341.753717:0:57925:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1787191341.753730:0:57925:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8a80 x1874004626757248/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787191341.753756:0:57925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8a80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57925:1874004626757248:192.168.202.101@tcp:36:rm.0 00000100:00100000:2.0:1787191341.754002:0:57925:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787191341.757232:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191341.758306:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634914560 00000100:00100000:2.0:1787191341.758319:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634914560 00000100:00100000:2.0:1787191341.758411:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1418 00000100:00100000:2.0:1787191341.758421:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634914560:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191341.758440:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a7cd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46063ea expref: -99 pid: 57924 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191341.758519:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191341.758532:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634914560:12345-192.168.202.101@tcp:104: Request processed in 112us (1308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191341.758543:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1418 00010000:00010000:0.0:1787191341.758581:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191341.758589:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a7cd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46063ea expref: -99 pid: 57924 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.758599:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40031800 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191341.758605:0:40929:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a7cd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x1a rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46063ea expref: -99 pid: 57924 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.758614:0:40929:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a7cd lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x1a rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46063ea expref: -99 pid: 57924 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.758623:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a7cd lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x1a rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e46063ea expref: -99 pid: 57924 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191341.758653:0:40929:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xd9:0x0]: losing layout lock 00010000:00010000:0.0:1787191341.758697:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a7cd lrc: 2/0,0 mode: --/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x1a rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46063ea expref: -99 pid: 57924 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.758704:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191341.758734:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a7cd lrc: 1/0,0 mode: --/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x1a rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46063ea expref: -99 pid: 57924 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.758742:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a7cd lrc: 0/0,0 mode: --/PR res: [0x200000405:0xd9:0x0].0x0 bits 0x1a/0x1a rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46063ea expref: -99 pid: 57924 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.758763:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191341.758765:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191341.758766:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191341.758775:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787191341.758788:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626757376:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191341.762087:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626757376:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191341.762983:0:57925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8a80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57925:1874004626757248:192.168.202.101@tcp:36:rm.0 00000080:00200000:1.0:1787191341.763059:0:57925:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xd9:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00020000:00200000:1.0:1787191341.763071:0:57925:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xd9:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191341.763074:0:57925:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191341.763081:0:57925:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191341.763091:0:57925:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000008:00010000:1.0:1787191341.763122:0:57925:0:(osc_cache.c:1183:osc_extent_make_ready()) ### extent: 0000000089ad0d4e ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46063c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000008:00010000:1.0:1787191341.763151:0:57925:0:(osc_cache.c:917:osc_extent_finish()) ### extent: 0000000089ad0d4e ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46063c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000008:00010000:1.0:1787191341.763175:0:57925:0:(osc_cache.c:497:__osc_extent_remove()) ### extent: 0000000089ad0d4e ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46063c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1787191341.763197:0:57925:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xd9:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191341.763243:0:57925:0:(llite_lib.c:2066:ll_clear_inode()) VFS Op:inode=[0x200000405:0xd9:0x0](ffff936b539680c8) 00000008:00010000:1.0:1787191341.763273:0:57925:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 5 blocks 0 [cma]time 1787191341 1787191341 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 1/0,0 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46063c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000008:00010000:1.0:1787191341.763300:0:57925:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191341 1787191341 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003b2ea1d7/0xe5129dc88483a7c6 lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46063e3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191341.765361:0:57924:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b522db500, open_flags d902, mode 0 opened 0 00000080:00200000:3.0:1787191341.765375:0:57924:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:3.0:1787191341.765401:0:57924:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154403 00010000:00010000:3.0:1787191341.765466:0:57924:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a7db lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.765477:0:57924:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a7db lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57924 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191341.765489:0:57924:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191341.765501:0:57924:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1ea00 x1874004626757632/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191341.765511:0:57924:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a7db lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57924 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191341.765546:0:57924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57924:1874004626757632:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191341.765858:0:57924:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c9c0 going to sleep for 11 seconds 00000080:00200000:3.0:1787191341.777496:0:57926:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191341.777529:0:57926:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191341.777546:0:57926:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191341.777563:0:57926:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191341.777572:0:57926:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191341.777580:0:57926:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191341.777584:0:57926:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191341.777591:0:57926:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4229bb58 00010000:00010000:3.0:1787191341.777596:0:57926:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191341.777604:0:57926:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191341.777620:0:57926:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191341.777628:0:57926:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:3.0:1787191341.777633:0:57926:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:3.0:1787191341.778814:0:57924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57924:1874004626757632:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191341.779195:0:57924:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a7db lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.779208:0:57924:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a7db lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.779214:0:57924:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a7db lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.779221:0:57924:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a7db lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.779229:0:57924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a7db lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.779234:0:57924:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9ba00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191341.779238:0:57924:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a7db lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.779245:0:57924:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a7db lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.779252:0:57924:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a7db lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.779259:0:57924:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191341.779264:0:57924:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a7db lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57924 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.779275:0:57924:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a7db lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57924 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191341.779298:0:57924:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x7, status=0 req@ffff936b51d1ea00 x1874004626757632/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/608 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191341.779312:0:57924:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191341.780145:0:57926:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:2.0:1787191341.780153:0:57926:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191341.780177:0:57926:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191341.780239:0:57926:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a7e2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.780248:0:57926:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a7e2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.780258:0:57926:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a7e2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191341.780282:0:57926:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57926:1874004626757760:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191341.780366:0:57926:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5ff00 going to sleep for 11 seconds 00000080:00200000:3.0:1787191341.793388:0:57927:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191341.793416:0:57927:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191341.793433:0:57927:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191341.793448:0:57927:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191341.793456:0:57927:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191341.793463:0:57927:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191341.793467:0:57927:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191341.793474:0:57927:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422a3bf8 00010000:00010000:3.0:1787191341.793478:0:57927:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191341.793487:0:57927:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191341.793502:0:57927:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191341.793509:0:57927:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191341.793514:0:57927:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:0.0:1787191341.794188:0:57926:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57926:1874004626757760:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191341.794204:0:57926:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a7e2 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.794216:0:57926:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a7e2 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.794222:0:57926:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a7e2 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.794228:0:57926:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a7e2 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.794235:0:57926:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a7e2 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.794240:0:57926:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51185600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191341.794244:0:57926:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a7e2 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.794250:0:57926:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a7e2 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.794257:0:57926:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a7e2 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.794264:0:57926:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191341.794269:0:57926:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a7e2 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.794275:0:57926:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a7e2 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191341.794298:0:57926:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513b9c00 x1874004626757760/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191341.794313:0:57926:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191341.794405:0:57927:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b51c6a780, open_flags d900, mode 0 opened 0 00000080:00200000:3.0:1787191341.794414:0:57927:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:3.0:1787191341.794429:0:57927:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:3.0:1787191341.794474:0:57927:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a7e9 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.794481:0:57927:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a7e9 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57927 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191341.794491:0:57927:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191341.794497:0:57927:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1ea00 x1874004626758016/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191341.794506:0:57927:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a7e9 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57927 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191341.794581:0:57927:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57927:1874004626758016:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191341.795282:0:57927:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c9c0 going to sleep for 11 seconds 00000080:00200000:0.0:1787191341.795384:0:57926:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191341.795402:0:57926:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.795414:0:57926:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.795426:0:57926:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.795432:0:57926:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191341.795438:0:57926:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191341.795441:0:57926:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191341.795447:0:57926:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4229bbe8 00010000:00010000:0.0:1787191341.795450:0:57926:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.795458:0:57926:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.795471:0:57926:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.795477:0:57926:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000080:00200000:0.0:1787191341.795481:0:57926:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:3.0:1787191341.799430:0:57927:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57927:1874004626758016:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191341.799457:0:57927:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a7e9 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.799470:0:57927:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a7e9 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.799478:0:57927:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a7e9 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.799484:0:57927:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a7e9 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.799498:0:57927:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a7e9 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.799504:0:57927:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9bc00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191341.799510:0:57927:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a7e9 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.799517:0:57927:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a7e9 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.799541:0:57927:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a7e9 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.799548:0:57927:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191341.799556:0:57927:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a7e9 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.799562:0:57927:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a7e9 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57927 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191341.799584:0:57927:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x7, status=0 req@ffff936b51d1ea00 x1874004626758016/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/608 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191341.799604:0:57927:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191341.799909:0:57927:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191341.799927:0:57927:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191341.799938:0:57927:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191341.799950:0:57927:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191341.799958:0:57927:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191341.799962:0:57927:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191341.799966:0:57927:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191341.799971:0:57927:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422a3b58 00010000:00010000:3.0:1787191341.799974:0:57927:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191341.799983:0:57927:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191341.799999:0:57927:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191341.800006:0:57927:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191341.800011:0:57927:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191341.800036:0:57927:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=9 00000080:00200000:3.0:1787191341.800041:0:57927:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:3.0:1787191341.800055:0:57927:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1787191341.800097:0:57927:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a7f0 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.800105:0:57927:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a7f0 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.800125:0:57927:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a7f0 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57927 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191341.800145:0:57927:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57927:1874004626758144:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191341.800219:0:57927:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191341.803629:0:57927:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57927:1874004626758144:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191341.803660:0:57927:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a7f0 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.803675:0:57927:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a7f0 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.803682:0:57927:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a7f0 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.803689:0:57927:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a7f0 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.803697:0:57927:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a7f0 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.803703:0:57927:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9ba00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191341.803707:0:57927:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a7f0 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.803714:0:57927:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a7f0 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.803722:0:57927:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a7f0 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.803729:0:57927:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191341.803734:0:57927:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a7f0 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57927 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.803740:0:57927:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a7f0 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57927 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191341.803766:0:57927:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b51d1ea00 x1874004626758144/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191341.803781:0:57927:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191341.806201:0:57926:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:0.0:1787191341.806213:0:57926:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:0.0:1787191341.806237:0:57926:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:0.0:1787191341.806295:0:57926:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a7f7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.806305:0:57926:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a7f7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.806315:0:57926:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a7f7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.806339:0:57926:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57926:1874004626758272:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191341.806428:0:57926:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99b40 going to sleep for 11 seconds 00000080:00200000:2.0:1787191341.820590:0:57928:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191341.820999:0:57928:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191341.821015:0:57928:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191341.821043:0:57928:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191341.821052:0:57928:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191341.821065:0:57928:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191341.821068:0:57928:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191341.821075:0:57928:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422abbf8 00010000:00010000:2.0:1787191341.821079:0:57928:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191341.821089:0:57928:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191341.821114:0:57928:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191341.821123:0:57928:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191341.821129:0:57928:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:0.0:1787191341.825256:0:57926:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57926:1874004626758272:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191341.825277:0:57926:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a7f7 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.825289:0:57926:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a7f7 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.825294:0:57926:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a7f7 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.825299:0:57926:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a7f7 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.825305:0:57926:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a7f7 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.825309:0:57926:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b6a608200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191341.825312:0:57926:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a7f7 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.825318:0:57926:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a7f7 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.825322:0:57926:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a7f7 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.825326:0:57926:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191341.825332:0:57926:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a7f7 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.825335:0:57926:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a7f7 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191341.825352:0:57926:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b6a476300 x1874004626758272/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191341.825363:0:57926:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191341.825463:0:57928:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b484c5680, open_flags d900, mode 0 opened 0 00000080:00200000:2.0:1787191341.825470:0:57928:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:2.0:1787191341.825487:0:57928:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:2.0:1787191341.825538:0:57928:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a7fe lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.825544:0:57928:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a7fe lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57928 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191341.825552:0:57928:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191341.825557:0:57928:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb800 x1874004626758528/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191341.825563:0:57928:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a7fe lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57928 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191341.825579:0:57928:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57928:1874004626758528:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191341.825744:0:57928:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5fa80 going to sleep for 11 seconds 00000080:00200000:0.0:1787191341.826265:0:57926:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191341.826282:0:57926:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.826294:0:57926:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.826305:0:57926:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.826312:0:57926:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191341.826318:0:57926:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191341.826321:0:57926:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191341.826327:0:57926:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4229bb58 00010000:00010000:0.0:1787191341.826331:0:57926:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.826339:0:57926:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.826353:0:57926:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.826360:0:57926:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:0.0:1787191341.826370:0:57926:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1787191341.826375:0:57926:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:0.0:1787191341.826386:0:57926:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.826394:0:57926:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 92 lru_type: 1 00010000:00010000:0.0:1787191341.826402:0:57926:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 92 lru_type: 1 00000002:00010000:0.0:1787191341.826411:0:57926:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.826415:0:57926:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 30 res 8589937616/5 (0 0) 00010000:00010000:0.0:1787191341.826441:0:57926:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a805 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.826448:0:57926:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a805 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.826455:0:57926:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a805 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.826469:0:57926:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57926:1874004626758656:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191341.826607:0:57926:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787191341.829211:0:57926:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57926:1874004626758656:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191341.829236:0:57926:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a805 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46064b5 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.829248:0:57926:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a805 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46064b5 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.829260:0:57926:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a805 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46064b5 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.829270:0:57926:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a805 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46064b5 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.829283:0:57926:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a805 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46064b5 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.829291:0:57926:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a805 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46064b5 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.829299:0:57926:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a805 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46064b5 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191341.829314:0:57926:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b6a476300 x1874004626758656/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191341.829324:0:57926:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a805 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46064b5 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.829332:0:57926:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:1.0:1787191341.829337:0:57926:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a805 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46064b5 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.829343:0:57926:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a805 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46064b5 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:1.0:1787191341.829365:0:57926:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191341.829372:0:57926:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 184 lru_type: 1 00010000:00010000:1.0:1787191341.829380:0:57926:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 184 lru_type: 1 00010000:00010000:1.0:1787191341.829385:0:57926:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 184 lru_type: 1 00010000:00010000:1.0:1787191341.829389:0:57926:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 185 lru_type: 1 00000080:00200000:1.0:1787191341.829408:0:57926:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191341.829417:0:57926:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:1.0:1787191341.829421:0:57926:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:1.0:1787191341.829427:0:57926:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb4229bcb8 00010000:00010000:1.0:1787191341.829430:0:57926:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 92 lru_type: 1 00010000:00010000:1.0:1787191341.829437:0:57926:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 93 lru_type: 1 00000002:00010000:1.0:1787191341.829451:0:57926:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191341.829457:0:57926:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a805 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46064b5 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.829465:0:57926:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a805 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46064b5 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.829470:0:57926:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a805 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46064b5 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.829475:0:57926:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a805 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46064b5 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:1.0:1787191341.829480:0:57926:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191341.829483:0:57926:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 185 lru_type: 1 00010000:00010000:1.0:1787191341.829487:0:57926:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 185 lru_type: 1 00010000:00010000:1.0:1787191341.829495:0:57926:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 185 lru_type: 1 00010000:00010000:1.0:1787191341.829499:0:57926:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 186 lru_type: 1 00000080:00200008:1.0:1787191341.830044:0:57926:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:1.0:1787191341.830051:0:57926:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191341.830066:0:57926:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191341.830074:0:57926:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.830083:0:57926:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.830090:0:57926:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191341.830094:0:57926:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191341.830097:0:57926:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191341.830102:0:57926:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4229bcb8 00010000:00010000:1.0:1787191341.830105:0:57926:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.830113:0:57926:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.830220:0:57926:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191341.830229:0:57926:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191341.830236:0:57926:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.830244:0:57926:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.830251:0:57926:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191341.830255:0:57926:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191341.830257:0:57926:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191341.830261:0:57926:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4229bb58 00010000:00010000:1.0:1787191341.830263:0:57926:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.830268:0:57926:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.830274:0:57926:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191341.830278:0:57926:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:1.0:1787191341.830282:0:57926:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:0.0:1787191341.830707:0:57928:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57928:1874004626758528:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191341.830718:0:57928:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a7fe lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.830724:0:57928:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a7fe lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.830728:0:57928:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a7fe lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.830732:0:57928:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a7fe lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.830737:0:57928:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a7fe lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.830741:0:57928:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51185600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191341.830744:0:57928:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a7fe lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.830749:0:57928:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a7fe lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.830753:0:57928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a7fe lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.830757:0:57928:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191341.830761:0:57928:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a7fe lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.830769:0:57928:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a7fe lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57928 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191341.830780:0:57928:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x7, status=0 req@ffff936b513bb800 x1874004626758528/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/608 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191341.830787:0:57928:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1787191341.830813:0:57928:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a805 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46064b5 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.830822:0:57928:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a805 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46064b5 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:0.0:1787191341.830844:0:57928:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a805 from it ffffa3fb422ab9a0 00010000:00010000:0.0:1787191341.830848:0:57928:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a805 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46064b5 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.830856:0:57928:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a805 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46064b5 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191341.830863:0:57926:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=8 00000080:00200000:1.0:1787191341.830886:0:57926:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191341.830894:0:57926:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191341.830900:0:57926:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.830908:0:57926:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.830914:0:57926:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191341.830918:0:57926:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191341.830920:0:57926:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191341.830925:0:57926:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4229bbf8 00010000:00010000:1.0:1787191341.830928:0:57926:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.830935:0:57926:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.830943:0:57926:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191341.830948:0:57926:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191341.830952:0:57926:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191341.830957:0:57926:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:1.0:1787191341.830960:0:57926:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:1.0:1787191341.830965:0:57926:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b522dbe00, open_flags a141, mode 81b6 opened 0 00000080:00200000:1.0:1787191341.830974:0:57926:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:1.0:1787191341.830991:0:57926:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xda:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:1.0:1787191341.831002:0:57926:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a805 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e46064b5 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191341.831066:0:57926:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a805 lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46064b5 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191341.831073:0:57926:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191341.831076:0:57926:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a805 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46064b5 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191341.831109:0:57928:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191341.831119:0:57928:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191341.831123:0:57926:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a80c lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.831124:0:57928:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.831131:0:57926:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a80c lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.831133:0:57928:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000020:00100000:1.0:1787191341.831141:0:57926:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000080:00200000:0.0:1787191341.831144:0:57928:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191341.831148:0:57928:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000100:00100000:1.0:1787191341.831148:0:57926:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8380 x1874004626758912/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000080:00010000:0.0:1787191341.831151:0:57928:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191341.831155:0:57928:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422abb58 00010000:00010000:0.0:1787191341.831157:0:57928:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.831158:0:57926:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a80c lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.831165:0:57928:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.831173:0:57928:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.831176:0:57928:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000100:00100000:1.0:1787191341.831177:0:57926:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57926:1874004626758912:192.168.202.101@tcp:101:lfs.0 00000080:00200000:0.0:1787191341.831180:0:57928:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:1.0:1787191341.831288:0:57926:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191341.834589:0:57926:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57926:1874004626758912:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191341.834614:0:57926:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a80c lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46064d1 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.834643:0:57926:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a80c lrc: 4/0,1 mode: --/PR res: [0x200000405:0xda:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46064d1 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.834651:0:57926:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a80c lrc: 4/0,1 mode: --/PR res: [0x200000405:0xda:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46064d1 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.834663:0:57926:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a80c lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46064d1 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.834673:0:57926:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a80c lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46064d1 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.834692:0:57926:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a80c lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46064d1 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.834700:0:57926:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a80c lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46064d1 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.834708:0:57926:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a80c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46064d1 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191341.834720:0:57926:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b453a8380 x1874004626758912/t8589937022(8589937022) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191341.834732:0:57926:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8380 x1874004626758912/t8589937022(8589937022) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191341.834742:0:57926:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a80c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46064d1 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.834749:0:57926:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/218 (0 0) 00000080:00200000:1.0:1787191341.834753:0:57926:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191341.834763:0:57926:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:1.0:1787191341.834789:0:57926:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xda:0x0](ffff936b5395d348) 00000080:00200000:1.0:1787191341.834795:0:57926:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xda:0x0], updating i_size 0 00000080:00200000:1.0:1787191341.834862:0:57926:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xda:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:1.0:1787191341.834867:0:57926:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xda:0x0](ffff936b5395d348) 00000080:00010000:1.0:1787191341.834870:0:57926:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xda:0x0](ffff936b5395d348) for lock 0xe5129dc88483a80c 00000080:00010000:1.0:1787191341.834880:0:57926:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xda:0x0](ffff936b5395d348) 00000080:00200008:1.0:1787191341.834896:0:57926:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xda:0x0](ffff936b5395d348), flags 120501 00000002:00100000:1.0:1787191341.834921:0:57926:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8380 x1874004626758912/t8589937022(8589937022) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191341.834960:0:57926:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a80c from it ffff936b5339fba0 00010000:00010000:1.0:1787191341.834965:0:57926:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a80c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46064d1 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.834974:0:57926:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a80c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46064d1 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191341.834998:0:57926:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xda:0x0](ffff936b5395d348), inode mode 81a4 mask 40 00000080:00200000:0.0:1787191341.835065:0:57928:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=9 00000080:00200000:1.0:1787191341.835076:0:57926:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xda:0x0](ffff936b5395d348), inode mode 81a4 mask 2 00000080:00200008:0.0:1787191341.835077:0:57928:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xda:0x0](ffff936b5395d348), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191341.835083:0:57928:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xda:0x0](ffff936b5395d348),name=f70.sanity-flr 00000080:00200000:1.0:1787191341.835097:0:57926:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xda:0x0](ffff936b5395d348), xattr lov 00000002:00010000:0.0:1787191341.835101:0:57928:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xda:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.835110:0:57928:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a80c lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46064d1 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:1.0:1787191341.835114:0:57926:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xda:0x0]) in obj [0x200000405:0xda:0x0], intent: open flags 040000002 00010000:00010000:0.0:1787191341.835122:0:57928:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a80c lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46064d1 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191341.835129:0:57928:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191341.835134:0:57928:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xda:0x0](ffff936b5395d348) 00000080:00010000:0.0:1787191341.835137:0:57928:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xda:0x0](ffff936b5395d348) for lock 0xe5129dc88483a80c 00000080:00010000:0.0:1787191341.835141:0:57928:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a80c from it ffffa3fb422abcb8 00010000:00010000:0.0:1787191341.835143:0:57928:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a80c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46064d1 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.835150:0:57928:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a80c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46064d1 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191341.835155:0:57926:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a813 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xda:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.835161:0:57926:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a813 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xda:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191341.835171:0:57926:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191341.835177:0:57926:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453ab100 x1874004626759168/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191341.835186:0:57926:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a813 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xda:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191341.835203:0:57926:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57926:1874004626759168:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191341.835364:0:57926:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191341.837741:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191341.837918:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634914688 00000100:00100000:3.0:1787191341.837928:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634914688 00000100:00100000:3.0:1787191341.837992:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1419 00000100:00100000:3.0:1787191341.838003:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634914688:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191341.838034:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a80c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46064d1 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191341.838126:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191341.838133:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634914688:12345-192.168.202.101@tcp:104: Request processed in 133us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191341.838141:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1419 00010000:00010000:0.0:1787191341.838153:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191341.838160:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a80c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46064d1 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.838168:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191341.838173:0:40930:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a80c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46064d1 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.838181:0:40930:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a80c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46064d1 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.838190:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a80c lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e46064d1 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191341.838212:0:40930:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xda:0x0]: losing layout lock 00010000:00010000:0.0:1787191341.838260:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a80c lrc: 2/0,0 mode: --/PR res: [0x200000405:0xda:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46064d1 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.838267:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191341.838298:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a80c lrc: 1/0,0 mode: --/PR res: [0x200000405:0xda:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46064d1 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.838312:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a80c lrc: 0/0,0 mode: --/PR res: [0x200000405:0xda:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46064d1 expref: -99 pid: 57926 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.838326:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191341.838328:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191341.838329:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191341.838488:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626759296:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191341.842199:0:57926:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57926:1874004626759168:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191341.842221:0:57926:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a813 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xda:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.842235:0:57926:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a813 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xda:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.842242:0:57926:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a813 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xda:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.842249:0:57926:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a813 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xda:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.842258:0:57926:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a813 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xda:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.842264:0:57926:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030800 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191341.842269:0:57926:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a813 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xda:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.842276:0:57926:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a813 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xda:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.842288:0:57926:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a813 lrc: 5/0,0 mode: --/CR res: [0x200000405:0xda:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.842295:0:57926:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191341.842301:0:57926:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a813 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xda:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.842308:0:57926:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483a813 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xda:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57926 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191341.842332:0:57926:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b453ab100 x1874004626759168/t8589937023(8589937023) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191341.842346:0:57926:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453ab100 x1874004626759168/t8589937023(8589937023) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191341.842362:0:57926:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xda:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787191341.842426:0:57926:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xda:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1787191341.842434:0:57926:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xda:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191341.842484:0:57926:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xda:0x0], updating i_size 0 00000002:00100000:0.0:1787191341.842503:0:57926:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453ab100 x1874004626759168/t8589937023(8589937023) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191341.842554:0:57926:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453ab100 x1874004626759168/t8589937023(8589937023) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191341.842564:0:57926:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191341.842569:0:57926:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475500 x1874004626759552/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191341.842589:0:57926:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57926:1874004626759552:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191341.842730:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626759296:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191341.843272:0:57926:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191341.847498:0:57926:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57926:1874004626759552:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191341.847538:0:57926:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453ab100 x1874004626759168/t8589937023(8589937023) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1787191341.847624:0:57926:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xda:0x0](ffff936b5395d348), flags 100001 00000002:00100000:0.0:1787191341.847683:0:57926:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a8380 x1874004626758912/t8589937022(8589937022) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191357 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191341.847693:0:57926:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191341.847699:0:57926:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a476a00 x1874004626759808/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191341.847720:0:57926:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57926:1874004626759808:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191341.847801:0:57926:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000080:00200000:2.0:1787191341.847912:0:57928:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191341.847928:0:57928:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191341.847944:0:57928:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191341.847956:0:57928:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191341.847964:0:57928:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191341.847970:0:57928:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191341.847974:0:57928:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191341.847982:0:57928:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422abbf8 00010000:00010000:2.0:1787191341.847986:0:57928:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191341.847996:0:57928:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191341.848010:0:57928:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191341.848016:0:57928:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191341.848041:0:57928:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191341.848057:0:57928:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b484c5c80, open_flags d902, mode 0 opened 0 00000080:00200000:2.0:1787191341.848063:0:57928:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:2.0:1787191341.848079:0:57928:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154403 00010000:00010000:2.0:1787191341.848130:0:57928:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a81a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.848138:0:57928:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a81a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57928 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191341.848148:0:57928:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:2.0:1787191341.848154:0:57928:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bbb80 x1874004626760064/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191341.848163:0:57928:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a81a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57928 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191341.848176:0:57928:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57928:1874004626760064:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191341.848430:0:57928:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191341.850873:0:57926:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57926:1874004626759808:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191341.850910:0:57926:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a8380 x1874004626758912/t8589937022(8589937022) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787191341.855157:0:57928:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57928:1874004626760064:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191341.855183:0:57928:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a81a lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606509 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.855213:0:57928:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a81a lrc: 4/1,0 mode: --/PR res: [0x200000405:0xda:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606509 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.855221:0:57928:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a81a lrc: 4/1,0 mode: --/PR res: [0x200000405:0xda:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606509 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.855231:0:57928:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a81a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606509 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.855241:0:57928:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a81a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606509 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.855253:0:57928:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a81a lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606509 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.855262:0:57928:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a81a lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606509 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.855274:0:57928:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a81a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606509 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191341.855287:0:57928:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b513bbb80 x1874004626760064/t8589937026(8589937026) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191341.855299:0:57928:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bbb80 x1874004626760064/t8589937026(8589937026) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191341.855311:0:57928:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a81a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606509 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191341.855323:0:57928:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a81a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606509 expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.855333:0:57928:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/218 (0 0) 00000080:00200000:2.0:1787191341.855339:0:57928:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191341.855387:0:57928:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xda:0x0](ffff936b5395d348): rc = 0 00000080:00200000:2.0:1787191341.855416:0:57928:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xda:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:2.0:1787191341.855423:0:57928:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xda:0x0](ffff936b5395d348) for lock 0xe5129dc88483a81a 00000080:00010000:2.0:1787191341.855433:0:57928:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xda:0x0](ffff936b5395d348) 00000080:00200008:2.0:1787191341.855452:0:57928:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xda:0x0](ffff936b5395d348), flags 154402 00000002:00100000:2.0:1787191341.855474:0:57928:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bbb80 x1874004626760064/t8589937026(8589937026) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1787191341.855518:0:57928:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a81a from it ffff936b60dc4000 00010000:00010000:2.0:1787191341.855523:0:57928:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a81a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606509 expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.855537:0:57928:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a81a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606509 expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191341.855559:0:57928:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xda:0x0](ffff936b5395d348), inode mode 81a4 mask 46 00000080:00200000:2.0:1787191341.855669:0:57928:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xda:0x0](ffff936b5395d348), inode mode 81a4 mask 4 00000080:00200000:2.0:1787191341.855676:0:57928:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xda:0x0](ffff936b5395d348), xattr lov 00000080:00200008:2.0:1787191341.855702:0:57928:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xda:0x0](ffff936b5395d348), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191341.855707:0:57928:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xda:0x0](ffff936b5395d348),name=f70.sanity-flr 00000002:00010000:2.0:1787191341.855725:0:57928:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xda:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191341.855733:0:57928:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a81a lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606509 expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.855744:0:57928:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a81a lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606509 expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191341.855749:0:57928:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191341.855754:0:57928:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xda:0x0](ffff936b5395d348) 00000080:00010000:2.0:1787191341.855757:0:57928:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xda:0x0](ffff936b5395d348) for lock 0xe5129dc88483a81a 00000080:00010000:2.0:1787191341.855761:0:57928:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a81a from it ffffa3fb422abcd8 00010000:00010000:2.0:1787191341.855764:0:57928:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a81a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606509 expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.855771:0:57928:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a81a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606509 expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191341.855786:0:57928:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xda:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:2.0:1787191341.855797:0:57928:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xda:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191341.855800:0:57928:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191341.855802:0:57928:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xda:0x0] 00000008:00010000:2.0:1787191341.855818:0:57928:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191341.855821:0:57928:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b62b5f9f0, osc lock ffff936b44e62260, flags 0x400000400001002 00000008:00010000:2.0:1787191341.855827:0:57928:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191341.855868:0:57928:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b62b5fa30, osc lock ffff936b44e62390, flags 0x400000400001002 00010000:00010000:2.0:1787191341.855917:0:57928:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483a821 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.855928:0:57928:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483a821 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.855938:0:57928:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b513bad80 x1874004626760192/t0(0) o101->lustre-OST0001-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191341.855985:0:57928:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c6e8a95c/0xe5129dc88483a828 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.855993:0:57928:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c6e8a95c/0xe5129dc88483a828 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.856002:0:57928:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b513b9180 x1874004626760320/t0(0) o101->lustre-OST0000-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:2.0:1787191341.856014:0:57928:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 2 items remaining. 00000100:00100000:3.0:1787191341.856439:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626760192:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191341.856552:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787191341.856560:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626760320:192.168.202.101@tcp:101:lfs.0 00000080:00200000:3.0:1787191341.860569:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191341.860671:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191341.860690:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191341.860707:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191341.860722:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191341.860731:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191341.860735:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191341.860744:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:3.0:1787191341.860749:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191341.860759:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191341.860779:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191341.860787:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191341.860793:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191341.860801:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:3.0:1787191341.860808:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xda:0x0](ffff936b5395d348), inode mode 81a4 mask 42 00000080:00200008:3.0:1787191341.860816:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xda:0x0](ffff936b5395d348), flags 101101 00000002:00010000:3.0:1787191341.860976:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xda:0x0], intent: getxattr flags 0 00010000:00010000:3.0:1787191341.861096:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a82f lrc: 3/1,0 mode: --/PR res: [0x200000405:0xda:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.861106:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a82f lrc: 3/1,0 mode: --/PR res: [0x200000405:0xda:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.861119:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a82f lrc: 3/1,0 mode: --/PR res: [0x200000405:0xda:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191341.861145:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626760448:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191341.861458:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ce40 going to sleep for 11 seconds 00010000:00010000:3.0:1787191341.864158:0:2391:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483a821 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.864185:0:2391:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483a821 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606517 expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.864200:0:2391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483a821 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606517 expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.864213:0:2391:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483a821 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606517 expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191341.864229:0:2391:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483a821 lrc: 5/2,0 mode: PR/PR res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606517 expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1787191341.864241:0:2391:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191341.864246:0:2391:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483a821 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606517 expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.864254:0:2391:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483a821 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606517 expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.864260:0:2391:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483a821 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606517 expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.864276:0:2391:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483a821 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606517 expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1787191341.864295:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626760192:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191341.867484:0:2391:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c6e8a95c/0xe5129dc88483a828 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.867506:0:2391:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c6e8a95c/0xe5129dc88483a828 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e460652c expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.867516:0:2391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c6e8a95c/0xe5129dc88483a828 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460652c expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.867527:0:2391:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c6e8a95c/0xe5129dc88483a828 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e460652c expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191341.867541:0:2391:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c6e8a95c/0xe5129dc88483a828 lrc: 5/2,0 mode: PR/PR res: [0x280000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460652c expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1787191341.867551:0:2391:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1787191341.867566:0:2391:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c6e8a95c/0xe5129dc88483a828 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460652c expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.867580:0:2391:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c6e8a95c/0xe5129dc88483a828 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460652c expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.867588:0:2391:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c6e8a95c/0xe5129dc88483a828 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460652c expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.867604:0:2391:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c6e8a95c/0xe5129dc88483a828 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460652c expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1787191341.867622:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626760320:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191341.867956:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626760448:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191341.867970:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a82f lrc: 4/1,0 mode: --/PR res: [0x200000405:0xda:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606525 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.867978:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a82f lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606525 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.867984:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a82f lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606525 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191341.867995:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b51d1ea00 x1874004626760448/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191341.868004:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a82f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606525 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.868012:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/218 (0 0) 00000080:00200000:0.0:1787191341.868016:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xda:0x0] suppgids 0 -1: rc 0 00000080:00010000:0.0:1787191341.868061:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xda:0x0](ffff936b5395d348) for lock 0xe5129dc88483a82f 00000080:00010000:0.0:1787191341.868068:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a82f from it ffffa3fb41caba38 00010000:00010000:0.0:1787191341.868071:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a82f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606525 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.868077:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a82f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606525 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:0.0:1787191341.868099:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xda:0x0](ffff936b5395d348) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191341.000000000, mtime 1787191341.000000000, ctime 1787191341.000000000 00010000:00010000:0.0:1787191341.868130:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a81a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4606509 expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191341.868145:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xda:0x0]: losing layout lock 00010000:00010000:0.0:1787191341.868174:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a81a lrc: 1/0,0 mode: --/PR res: [0x200000405:0xda:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606509 expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.868178:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191341.868180:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a81a lrc: 0/0,0 mode: --/PR res: [0x200000405:0xda:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606509 expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000020:00100000:0.0:1787191341.868196:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1787191341.868201:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475880 x1874004626760704/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787191341.868217:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626760704:192.168.202.101@tcp:36:bash.0 00000100:00100000:0.0:1787191341.868287:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000080:00200000:1.0:1787191341.868773:0:57928:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xda:0x0] updating i_size 0 i_blocks 0 00000020:00010000:1.0:1787191341.868779:0:57928:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509b9e10 (ffff936b47a17b48/0) at cl_lock_release():245 00000020:00010000:1.0:1787191341.868783:0:57928:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509b9e10 (ffff936b47a17b48/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191341.868788:0:57928:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62b5f9f0 (ffff936b47a17128/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191341.868792:0:57928:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62b5fa30 (ffff936b465cc998/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191341.868795:0:57928:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509b9e10 (ffff936b47a17b48/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191341.868798:0:57928:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62b5f9f0 (ffff936b47a17b48/1) at cl_lock_fini():72 00000020:00010000:1.0:1787191341.868801:0:57928:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62b5fa30 (ffff936b47a17b48/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191341.868813:0:57928:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xda:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:1.0:1787191341.868823:0:57928:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/218 (0 0) 00000080:00010000:1.0:1787191341.868864:0:57928:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xda:0x0](ffff936b5395d348) 00000002:00010000:1.0:1787191341.868876:0:57928:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xda:0x0]) in obj [0x200000405:0xda:0x0], intent: layout flags 0 00010000:00010000:1.0:1787191341.868908:0:57928:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a836 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xda:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.868916:0:57928:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a836 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xda:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.868927:0:57928:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a836 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xda:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57928 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191341.868941:0:57928:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57928:1874004626760832:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191341.869106:0:57928:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893780 going to sleep for 11 seconds 00000100:00100000:0.0:1787191341.871466:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626760704:192.168.202.101@tcp:36:bash.0 00000080:00200000:0.0:1787191341.871508:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:0.0:1787191341.871515:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xda:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000100:00100000:1.0:1787191341.873507:0:57928:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57928:1874004626760832:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191341.873537:0:57928:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a836 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460653a expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.873551:0:57928:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a836 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460653a expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191341.873564:0:57928:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b453ab800 x1874004626760832/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191341.873574:0:57928:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a836 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460653a expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191341.873598:0:57928:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a836 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460653a expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.873609:0:57928:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/218 (0 0) 00000080:00200000:1.0:1787191341.873615:0:57928:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xda:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191341.873632:0:57928:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xda:0x0](ffff936b5395d348) for lock 0xe5129dc88483a836 00000080:00010000:1.0:1787191341.873639:0:57928:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a836 from it ffffa3fb422abbc8 00010000:00010000:1.0:1787191341.873643:0:57928:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a836 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460653a expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.873653:0:57928:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a836 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460653a expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.873675:0:57928:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a836 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460653a expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.873687:0:57928:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a836 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460653a expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:1.0:1787191341.873696:0:57928:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xda:0x0](000000001d24cd79) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a836 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460653a expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191341.873741:0:57928:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xda:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:1.0:1787191341.873746:0:57928:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a836 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460653a expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.873755:0:57928:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a836 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460653a expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.873807:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a836 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460653a expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.873818:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a836 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460653a expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:0.0:1787191341.873827:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xda:0x0](000000001d24cd79) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a836 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460653a expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.873855:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a836 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460653a expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.873863:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a836 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460653a expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00020000:00200000:0.0:1787191341.873879:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xda:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:0.0:1787191341.873886:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xda:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191341.873890:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xda:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:0.0:1787191341.873898:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xda:0x0](ffff936b5395d348) 00000002:00010000:0.0:1787191341.873908:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xda:0x0]) in obj [0x200000405:0xda:0x0], intent: layout flags 02 00010000:00010000:0.0:1787191341.873924:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a836 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e460653a expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191341.873939:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xda:0x0]: losing layout lock 00010000:00010000:0.0:1787191341.873968:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a836 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xda:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460653a expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.873975:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191341.873978:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a836 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xda:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460653a expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.874000:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a83d lrc: 3/0,1 mode: --/EX res: [0x200000405:0xda:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.874007:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a83d lrc: 3/0,1 mode: --/EX res: [0x200000405:0xda:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191341.874018:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191341.874037:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475180 x1874004626761088/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191341.874044:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a83d lrc: 3/0,1 mode: --/EX res: [0x200000405:0xda:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.874060:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626761088:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191341.874187:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000080:00200000:1.0:1787191341.876271:0:57928:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191341.876306:0:57928:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191341.876322:0:57928:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.876338:0:57928:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.876346:0:57928:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191341.876355:0:57928:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191341.876360:0:57928:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191341.876368:0:57928:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422abb58 00010000:00010000:1.0:1787191341.876372:0:57928:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.876381:0:57928:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.876399:0:57928:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191341.876407:0:57928:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191341.876413:0:57928:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191341.876428:0:57928:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=9 00000080:00200000:1.0:1787191341.876433:0:57928:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191341.876446:0:57928:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191341.876499:0:57928:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a844 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.876507:0:57928:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a844 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.876517:0:57928:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a844 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57928 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191341.876544:0:57928:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57928:1874004626761216:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191341.876633:0:57928:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893780 going to sleep for 11 seconds 00000100:00100000:3.0:1787191341.883441:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191341.883479:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191341.883494:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191341.883517:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191341.883541:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634915840 00000100:00100000:3.0:1787191341.883551:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634915840 00000100:00100000:3.0:1787191341.883588:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634915968 00000100:00100000:3.0:1787191341.883591:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634915968 00000100:00100000:3.0:1787191341.883602:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634916096 00000100:00100000:3.0:1787191341.883604:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634916096 00000100:00100000:3.0:1787191341.883614:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634916224 00000100:00100000:3.0:1787191341.883616:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634916224 00000100:00100000:3.0:1787191341.883629:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1420 00000100:00100000:3.0:1787191341.883712:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+5:37089:x1874004634915840:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191341.883735:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a79c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4606350 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191341.883823:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191341.883871:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+5:37089:x1874004634915840:12345-192.168.202.101@tcp:104: Request processed in 194us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191341.883880:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1420 00000100:00100000:3.0:1787191341.883899:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1421 00000100:00100000:3.0:1787191341.883906:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+5:8419:x1874004634915968:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191341.883915:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a795 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4606349 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191341.883945:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787191341.883951:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+5:8419:x1874004634915968:12345-192.168.202.101@tcp:104: Request processed in 45us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191341.883957:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1421 00000100:00100000:3.0:1787191341.883966:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1422 00000100:00100000:3.0:1787191341.883970:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8422:x1874004634916096:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191341.883976:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e46063c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191341.883995:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787191341.883998:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8422:x1874004634916096:12345-192.168.202.101@tcp:104: Request processed in 29us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191341.884002:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1422 00000100:00100000:3.0:1787191341.884008:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1423 00000100:00100000:3.0:1787191341.884011:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30511:x1874004634916224:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191341.884016:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003b2ea1d7/0xe5129dc88483a7c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e46063e3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191341.884052:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787191341.884056:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30511:x1874004634916224:12345-192.168.202.101@tcp:104: Request processed in 44us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191341.884062:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1423 00010000:00010000:0.0:1787191341.884154:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787191341.884162:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a79c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4606350 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.884171:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030600 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191341.884177:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a79c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e4606350 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.884225:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a79c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4606350 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.884233:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191341.884257:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a79c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4606350 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.884264:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a79c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4606350 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.884290:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787191341.884294:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a795 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4606349 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.884300:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030e00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191341.884304:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a795 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e4606349 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.884328:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a795 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4606349 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.884339:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191341.884345:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a795 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4606349 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.884352:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a795 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4606349 expref: -99 pid: 57919 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.884364:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787191341.884367:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e46063c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191341.884373:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b6a608800 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191341.884376:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e46063c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191341.884395:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e46063c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191341.884402:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191341.884407:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e46063c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191341.884414:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a7bf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e46063c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191341.884432:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191341.884435:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003b2ea1d7/0xe5129dc88483a7c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e46063e3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.884441:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b6a609e00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191341.884445:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003b2ea1d7/0xe5129dc88483a7c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e46063e3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.884462:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003b2ea1d7/0xe5129dc88483a7c6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e46063e3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.884469:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191341.884474:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003b2ea1d7/0xe5129dc88483a7c6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e46063e3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.884481:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000003b2ea1d7/0xe5129dc88483a7c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e46063e3 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.884492:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191341.884494:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191341.884496:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191341.884503:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191341.884508:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191341.884522:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626761344:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191341.884578:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626761600:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787191341.884593:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191341.884607:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787191341.884615:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626761472:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191341.884801:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626761728:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191341.887538:0:57570:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589937029 gen 1 00000100:00100000:0.0:1787191341.887626:0:57570:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b513bbb80 x1874004626760064/t8589937026(8589937026) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787191341.888997:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626761088:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191341.889042:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a83d lrc: 4/0,1 mode: --/EX res: [0x200000405:0xda:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606548 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.889056:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a83d lrc: 4/0,1 mode: --/CR res: [0x200000405:0xda:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606548 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.889069:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a83d lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606548 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.889083:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a83d lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606548 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.889098:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a83d lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606548 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.889106:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a83d lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606548 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.889286:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a83d lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606548 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191341.889300:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b6a475180 x1874004626761088/t8589937029(8589937029) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191341.889319:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a83d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606548 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191341.889331:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a83d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606548 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.889341:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/218 (0 0) 00000080:00200000:0.0:1787191341.889347:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xda:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191341.889359:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xda:0x0](ffff936b5395d348) for lock 0xe5129dc88483a83d 00000080:00010000:0.0:1787191341.889366:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a83d from it ffffa3fb41cab930 00010000:00010000:0.0:1787191341.889369:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a83d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606548 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.889377:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a83d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606548 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191341.889395:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:0.0:1787191341.889402:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xda:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:0.0:1787191341.889417:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a83d lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606548 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.889432:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a83d lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606548 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1787191341.889439:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xda:0x0](000000001d24cd79) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a83d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606548 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.889477:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a83d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606548 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.889485:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a83d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606548 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191341.889497:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xda:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191341.889506:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xda:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191341.889509:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191341.889515:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:0.0:1787191341.889583:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xda:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:0.0:1787191341.889595:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a83d lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606548 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.889604:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a83d lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606548 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:0.0:1787191341.889610:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xda:0x0](000000001d24cd79) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a83d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606548 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191341.889626:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xda:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191341.889630:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xda:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191341.889633:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191341.889635:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:0.0:1787191341.889680:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xda:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:0.0:1787191341.889712:0:57570:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483a821 lrc: 1/0,0 mode: PR/PR res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606517 expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000008:00010000:0.0:1787191341.889728:0:57570:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c6e8a95c/0xe5129dc88483a828 lrc: 1/0,0 mode: PR/PR res: [0x280000401:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460652c expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191341.889778:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xda:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:0.0:1787191341.889782:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a83d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606548 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.889789:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a83d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606548 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00020000:00200000:0.0:1787191341.889800:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xda:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:0.0:1787191341.889804:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xda:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191341.889806:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191341.889811:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191341.889821:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191341.889824:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:0.0:1787191341.889862:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:0.0:1787191341.889867:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f993f0, osc lock ffff936b50b630a0, flags 0x80000000 00000008:00010000:0.0:1787191341.889871:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:0.0:1787191341.889873:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f99430, osc lock ffff936b50b624c0, flags 0x80000000 00010000:00010000:0.0:1787191341.889922:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc88483a84b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.889932:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc88483a84b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.889943:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc88483a84b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.889968:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626761856:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191341.890057:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00000100:00100000:1.0:1787191341.890274:0:57928:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57928:1874004626761216:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191341.890288:0:57928:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a844 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606564 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.890304:0:57928:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a844 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xda:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606564 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.890311:0:57928:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a844 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xda:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606564 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.890325:0:57928:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a844 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606564 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.890334:0:57928:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a844 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606564 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.890344:0:57928:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a844 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606564 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.890351:0:57928:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a844 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606564 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.890357:0:57928:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a844 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606564 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191341.890368:0:57928:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b453ab800 x1874004626761216/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/976 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191341.890380:0:57928:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a844 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606564 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.890388:0:57928:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/218 (0 0) 00000080:00200000:1.0:1787191341.890394:0:57928:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191341.890427:0:57928:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xda:0x0](ffff936b5395d348): rc = 0 00000080:00010000:1.0:1787191341.890432:0:57928:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xda:0x0](ffff936b5395d348) for lock 0xe5129dc88483a844 00000080:00010000:1.0:1787191341.890444:0:57928:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xda:0x0](ffff936b5395d348) 00000080:00010000:1.0:1787191341.890448:0:57928:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a844 from it ffffa3fb422abb20 00010000:00010000:1.0:1787191341.890451:0:57928:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a844 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606564 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.890459:0:57928:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a844 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606564 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:1.0:1787191341.890492:0:57928:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xda:0x0](ffff936b5395d348), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191341.890500:0:57928:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xda:0x0](ffff936b5395d348),name=f70.sanity-flr 00000002:00010000:1.0:1787191341.890521:0:57928:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xda:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191341.890528:0:57928:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a844 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606564 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.890538:0:57928:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a844 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606564 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191341.890544:0:57928:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191341.890549:0:57928:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xda:0x0](ffff936b5395d348) 00000080:00010000:1.0:1787191341.890552:0:57928:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xda:0x0](ffff936b5395d348) for lock 0xe5129dc88483a844 00000080:00010000:1.0:1787191341.890556:0:57928:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a844 from it ffffa3fb422abcb8 00010000:00010000:1.0:1787191341.890560:0:57928:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a844 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606564 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.890567:0:57928:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a844 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606564 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191341.890582:0:57928:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xda:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00020000:00200000:1.0:1787191341.890588:0:57928:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xda:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191341.890591:0:57928:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191341.890594:0:57928:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xda:0x0] 00000008:00010000:1.0:1787191341.890604:0:57928:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191341.890606:0:57928:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b47d7dab0, osc lock ffff936b46836be0, flags 0x400000400001002 00010000:00010000:1.0:1787191341.890614:0:57928:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b52377800 type 11 mode 6 res 10737419265/460 (0 1048575) 00010000:00010000:1.0:1787191341.890633:0:57928:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483a852 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.890643:0:57928:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483a852 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.890653:0:57928:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b453ab800 x1874004626761984/t0(0) o101->lustre-OST0000-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:1.0:1787191341.890688:0:57928:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:0.0:1787191341.891103:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787191341.891118:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626761984:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191341.891825:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626761728:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191341.891946:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626761344:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191341.891957:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626761600:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191341.893628:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626761856:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191341.893664:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc88483a84b lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606587 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.893683:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc88483a84b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4606587 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.893696:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc88483a84b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4606587 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.893710:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc88483a84b lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4606587 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191341.893721:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc88483a84b lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4606587 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.893732:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc88483a84b lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606587 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.893740:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc88483a84b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606587 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.893805:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a859 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.893815:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a859 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.893825:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a859 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191341.893867:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626762112:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191341.893926:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893780 going to sleep for 11 seconds 00000100:00100000:2.0:1787191341.894066:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191341.894162:0:40922:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787191341.894175:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634916352 00000100:00100000:2.0:1787191341.894181:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634916352 00000100:00100000:2.0:1787191341.894223:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1424 00000100:00100000:2.0:1787191341.894233:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51f66450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30353:x1874004634916352:12345-192.168.202.101@tcp:106: 00010000:00010000:2.0:1787191341.894242:0:40922:0:(ldlm_lockd.c:2541:ldlm_callback_handler()) ### glimpse ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc88483a84b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606587 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.894252:0:40922:0:(ldlm_lockd.c:2123:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc88483a84b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606587 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00010000:2.0:1787191341.894274:0:40922:0:(cl_object.c:322:cl_object_glimpse()) header@00000000c7db49b2[0x110, 1, [0x200000405:0xda:0x0] hash] 00000020:00010000:2.0:1787191341.894277:0:40922:0:(cl_object.c:322:cl_object_glimpse()) size: 0 mtime: 1787191341 atime: 1787191341 ctime: 1787191341 blocks: 0 00000020:00010000:2.0:1787191341.894281:0:40922:0:(cl_object.c:322:cl_object_glimpse()) header@00000000f5e2c747[0x110, 2, [0x280000401:0x1cc:0x0] hash] 00000020:00010000:2.0:1787191341.894283:0:40922:0:(cl_object.c:322:cl_object_glimpse()) size: 0 mtime: 1787191341 atime: 1787191341 ctime: 1787191341 blocks: 0 00000100:00100000:2.0:1787191341.894314:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51f66450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30353:x1874004634916352:12345-192.168.202.101@tcp:106: Request processed in 82us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191341.894322:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1424 00000100:00100000:0.0:1787191341.895311:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626761472:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191341.897116:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626762112:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191341.897142:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a859 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606595 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.897163:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a859 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4606595 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.897183:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a859 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4606595 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.897198:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a859 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4606595 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191341.897211:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a859 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4606595 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.897225:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a859 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606595 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.897234:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a859 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606595 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.897447:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626762240:192.168.202.101@tcp:10:bash.0 00010000:00010000:0.0:1787191341.897539:0:2390:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483a852 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.897552:0:2390:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483a852 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.897562:0:2390:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483a852 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.897569:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483a852 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.897576:0:2390:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483a852 lrc: 5/1,0 mode: --/PR res: [0x280000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191341.897585:0:2390:0:(osc_lock.c:187:osc_lock_lvb_update()) ### no dlm lock: acquired size 0, setting rss=0; leaving kms=0, end=18446744073709551615 00000020:00200000:0.0:1787191341.897589:0:2390:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1787191341.897648:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483a852 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.897655:0:2390:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483a852 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.897664:0:2390:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483a852 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.897671:0:2390:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030000 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191341.897676:0:2390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483a852 lrc: 5/0,0 mode: --/PR res: [0x280000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.897687:0:2390:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191341.897693:0:2390:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483a852 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.897700:0:2390:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483a852 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.897716:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626761984:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191341.897731:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787191341.897737:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626762368:192.168.202.101@tcp:10:bash.0 00000080:00200000:1.0:1787191341.902243:0:57928:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xda:0x0] updating i_size 0 i_blocks 0 00000020:00010000:1.0:1787191341.902255:0:57928:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509b9e10 (ffff936b47a17b48/0) at cl_lock_release():245 00000020:00010000:1.0:1787191341.902260:0:57928:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509b9e10 (ffff936b47a17b48/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191341.902265:0:57928:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7dab0 (ffff936b465cc998/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191341.902269:0:57928:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509b9e10 (ffff936b47a17b48/0) at cl_lock_fini():72 00000100:00100000:0.0:1787191341.902270:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626762368:192.168.202.101@tcp:10:bash.0 00000020:00010000:1.0:1787191341.902272:0:57928:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7dab0 (ffff936b47a17b48/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191341.902285:0:57928:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xda:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:0.0:1787191341.902305:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626762240:192.168.202.101@tcp:10:bash.0 00000080:00200008:1.0:1787191341.902324:0:57928:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xda:0x0](ffff936b5395d348), flags 154002 00000080:00200000:1.0:1787191341.902396:0:57928:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191341.902417:0:57928:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191341.902430:0:57928:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.902444:0:57928:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191341.902452:0:57928:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191341.902459:0:57928:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191341.902462:0:57928:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191341.902469:0:57928:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422abbf8 00010000:00010000:1.0:1787191341.902478:0:57928:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191341.902487:0:57928:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191341.902533:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xda:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191341.902539:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894d58 (ffff936b47a175a8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191341.902542:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894d58 (ffff936b47a175a8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191341.902545:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f993f0 (ffff936b47a17d88/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191341.902552:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc88483a84b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606587 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.902564:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc88483a84b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606587 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191341.902571:0:57928:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000020:00010000:2.0:1787191341.902573:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99430 (ffff936b47a17248/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191341.902577:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a859 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606595 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1787191341.902578:0:57928:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191341.902583:0:57928:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00010000:00010000:2.0:1787191341.902585:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a859 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606595 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191341.902587:0:57928:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:1.0:1787191341.902591:0:57928:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xda:0x0](ffff936b5395d348), inode mode 81a4 mask 44 00000020:00010000:2.0:1787191341.902593:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894d58 (ffff936b47a175a8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191341.902596:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f993f0 (ffff936b47a175a8/1) at cl_lock_fini():72 00000080:00200008:1.0:1787191341.902597:0:57928:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xda:0x0](ffff936b5395d348), flags 154400 00000020:00010000:2.0:1787191341.902599:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99430 (ffff936b47a175a8/1) at cl_lock_fini():72 00000002:00010000:1.0:1787191341.902611:0:57928:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xda:0x0]) in obj [0x200000405:0xda:0x0], intent: open flags 0104240114401 00000080:00200000:2.0:1787191341.902614:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xda:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191341.902625:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xda:0x0](ffff936b5395d348) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191341.000000000, mtime 1787191341.000000000, ctime 1787191341.000000000, rc 0 00000080:00200008:2.0:1787191341.902702:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xda:0x0], ppos: 0, count: 5 00000080:00200000:2.0:1787191341.902715:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191341.902721:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:2.0:1787191341.902725:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:2.0:1787191341.902729:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1787191341.902735:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@00000000c7db49b2[0x110, 1, [0x200000405:0xda:0x0] hash] 00000020:00200000:2.0:1787191341.902737:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:2.0:1787191341.902742:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xda:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:2.0:1787191341.902754:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xda:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:2.0:1787191341.902759:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xda:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191341.902762:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1787191341.902767:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1787191341.902773:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:2.0:1787191341.902776:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00010000:00010000:1.0:1787191341.902778:0:57928:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a860 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xda:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.902785:0:57928:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a860 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xda:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57928 initiator: MDT0 lru_score: 0 lru_type: 0 00000080:00200000:2.0:1787191341.902791:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000020:00100000:1.0:1787191341.902799:0:57928:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000008:00010000:2.0:1787191341.902804:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000100:00100000:1.0:1787191341.902807:0:57928:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9180 x1874004626762624/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000008:00010000:2.0:1787191341.902808:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d10b0, osc lock ffff936b44e63430, flags 0x0 00010000:00010000:1.0:1787191341.902816:0:57928:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a860 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xda:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.902821:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc88483a84b lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606587 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.902856:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc88483a84b lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606587 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1787191341.902864:0:57928:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57928:1874004626762624:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191341.902867:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc88483a84b lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606587 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.902874:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc88483a84b lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606587 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.902881:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc88483a84b lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606587 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191341.902892:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:2.0:1787191341.902902:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191341.902945:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:2.0:1787191341.902954:0:57570:0:(rw26.c:927:ll_write_end()) page@0000000021691588[3 00000000f680a9cf 2 1 000000002f7fd0b4 0 0 0] 00000080:00200000:2.0:1787191341.902958:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @00000000e9b31572 17ffffc0001001 3:0 ffff936b43a1ea80 0 lru 00000080:00200000:2.0:1787191341.902965:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@0000000067d7f92b 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000a2a44f55 00000000f9406232 > 3< 0 0 > 4< 0 0 8 412041216 - | - - - - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1787191341.902967:0:57570:0:(rw26.c:927:ll_write_end()) end page@0000000021691588 00000080:00200000:2.0:1787191341.902968:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:2.0:1787191341.902974:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:2.0:1787191341.902994:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 00000000d3bf90b2 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc88483a84b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606587 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191341.903013:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b5395d4f8, count 1, dirtied 1 00000080:00200000:2.0:1787191341.903017:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:2.0:1787191341.903031:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:2.0:1787191341.903045:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894d58 (ffff936b47a175a8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191341.903048:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894d58 (ffff936b47a175a8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191341.903051:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d10b0 (ffff936b47a17248/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191341.903056:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc88483a84b lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606587 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.903064:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc88483a84b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606587 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:2.0:1787191341.903074:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894d58 (ffff936b47a175a8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191341.903077:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d10b0 (ffff936b47a175a8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191341.903083:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:2.0:1787191341.903087:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1787191341.903092:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xda:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191341.903095:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:2.0:1787191341.903100:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xda:0x0] updating i_size 5 i_blocks 0 00000100:00100000:1.0:1787191341.903101:0:57928:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893780 going to sleep for 11 seconds 00000080:00200000:2.0:1787191341.903104:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:2.0:1787191341.903118:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xda:0x0](ffff936b5395d348), flags 100001 00000002:00100000:2.0:1787191341.903149:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513bbb80 x1874004626760064/t8589937026(8589937026) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191341.903157:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:2.0:1787191341.903161:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8380 x1874004626762880/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191341.903174:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626762880:192.168.202.101@tcp:35:bash.0 00000100:00100000:2.0:1787191341.903300:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191341.905305:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626762880:192.168.202.101@tcp:35:bash.0 00000002:00100000:2.0:1787191341.905335:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513bbb80 x1874004626760064/t8589937026(8589937026) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191341.913334:0:57929:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191341.913364:0:57929:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.913379:0:57929:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.913395:0:57929:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.913403:0:57929:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191341.913412:0:57929:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191341.913415:0:57929:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191341.913422:0:57929:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422b3b58 00010000:00010000:0.0:1787191341.913427:0:57929:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.913435:0:57929:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.913452:0:57929:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.913461:0:57929:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:0.0:1787191341.913466:0:57929:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.913470:0:57929:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=8 00000080:00200008:0.0:1787191341.913476:0:57929:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xda:0x0](ffff936b5395d348), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191341.913481:0:57929:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xda:0x0](ffff936b5395d348),name=f70.sanity-flr 00000002:00010000:0.0:1787191341.913495:0:57929:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xda:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.913503:0:57929:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a844 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606564 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.913512:0:57929:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a844 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606564 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000100:00100000:3.0:1787191341.913893:0:57928:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57928:1874004626762624:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191341.913915:0:57928:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a860 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xda:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46065a3 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.913928:0:57928:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a860 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46065a3 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.913939:0:57928:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a860 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46065a3 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191341.913954:0:57928:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x200002b, status=0 req@ffff936b453a9180 x1874004626762624/t8589937031(8589937031) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191341.913967:0:57928:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9180 x1874004626762624/t8589937031(8589937031) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191341.913980:0:57928:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a860 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46065a3 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191341.913994:0:57928:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a860 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46065a3 expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.914007:0:57928:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/218 (0 0) 00000080:00200000:3.0:1787191341.914012:0:57928:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xda:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1787191341.914087:0:57928:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xda:0x0]: layout version change: 4 -> 4 00000080:00010000:3.0:1787191341.914092:0:57928:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xda:0x0](ffff936b5395d348) for lock 0xe5129dc88483a860 00000080:00010000:3.0:1787191341.914097:0:57928:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a860 from it ffffa3fb422abbf0 00010000:00010000:3.0:1787191341.914101:0:57928:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a860 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46065a3 expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.914109:0:57928:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a860 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46065a3 expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000002:00100000:3.0:1787191341.914130:0:57928:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9180 x1874004626762624/t8589937031(8589937031) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191341.914242:0:57928:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xda:0x0](ffff936b5395d348), inode mode 81a4 mask 4 00000080:00200000:3.0:1787191341.914250:0:57928:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xda:0x0](ffff936b5395d348), xattr lov 00000080:00200008:3.0:1787191341.914271:0:57928:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xda:0x0](ffff936b5395d348), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191341.914277:0:57928:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xda:0x0](ffff936b5395d348),name=f70.sanity-flr 00000002:00010000:3.0:1787191341.914288:0:57928:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xda:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191341.914295:0:57928:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a844 lrc: 3/2,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606564 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191341.914304:0:57928:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a844 lrc: 3/2,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606564 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191341.914311:0:57928:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191341.914317:0:57928:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xda:0x0](ffff936b5395d348) 00000080:00010000:3.0:1787191341.914320:0:57928:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xda:0x0](ffff936b5395d348) for lock 0xe5129dc88483a844 00000080:00010000:3.0:1787191341.914324:0:57928:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a844 from it ffffa3fb422abcd8 00010000:00010000:3.0:1787191341.914327:0:57928:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a844 lrc: 4/2,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606564 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191341.914335:0:57928:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a844 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606564 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191341.914352:0:57928:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xda:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:3.0:1787191341.914362:0:57928:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xda:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191341.914366:0:57928:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191341.914369:0:57928:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xda:0x0] 00000008:00010000:3.0:1787191341.914388:0:57928:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191341.914391:0:57928:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b506676b0, osc lock ffff936b44f65690, flags 0x400000400001002 00010000:00010000:3.0:1787191341.914407:0:57928:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc88483a84b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606587 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191341.914418:0:57928:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc88483a84b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606587 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:3.0:1787191341.914430:0:57928:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191341.914434:0:57928:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc88483a84b lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606587 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191341.914443:0:57928:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc88483a84b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606587 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:3.0:1787191341.914453:0:57928:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191341.914463:0:57928:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xda:0x0] updating i_size 5 i_blocks 0 00000020:00010000:3.0:1787191341.914469:0:57928:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509b8000 (ffff936b47a17998/0) at cl_lock_release():245 00000020:00010000:3.0:1787191341.914472:0:57928:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509b8000 (ffff936b47a17998/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191341.914476:0:57928:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b506676b0 (ffff936b465cc008/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191341.914480:0:57928:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509b8000 (ffff936b47a17998/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191341.914483:0:57928:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b506676b0 (ffff936b47a17998/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191341.914492:0:57928:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xda:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191341.914517:0:57928:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xda:0x0](ffff936b5395d348), flags 154000 00010000:00010000:3.0:1787191341.914542:0:57928:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a860 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46065a3 expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191341.914583:0:57928:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191341.914590:0:57928:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191341.914596:0:57928:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191341.914605:0:57928:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191341.914610:0:57928:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191341.914614:0:57928:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191341.914616:0:57928:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191341.914620:0:57928:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422abbf8 00010000:00010000:3.0:1787191341.914623:0:57928:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191341.914629:0:57928:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191341.914642:0:57928:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191341.914647:0:57928:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191341.914650:0:57928:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191341.914653:0:57928:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:3.0:1787191341.914657:0:57928:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xda:0x0](ffff936b5395d348), inode mode 81a4 mask 46 00000080:00200008:3.0:1787191341.914662:0:57928:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xda:0x0](ffff936b5395d348), flags 154402 00000002:00010000:3.0:1787191341.914676:0:57928:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xda:0x0]) in obj [0x200000405:0xda:0x0], intent: open flags 0104240114403 00010000:00010000:3.0:1787191341.914720:0:57928:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a867 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xda:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x10000000000000 pid: 57928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.914728:0:57928:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a867 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xda:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x0 pid: 57928 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191341.914738:0:57928:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191341.914746:0:57928:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1f480 x1874004626763136/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191341.914755:0:57928:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a867 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xda:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x0 pid: 57928 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191341.914774:0:57928:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57928:1874004626763136:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191341.914961:0:57928:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c9c0 going to sleep for 11 seconds 00000080:00200000:0.0:1787191341.915460:0:57929:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191341.915470:0:57929:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xda:0x0](ffff936b5395d348) 00000080:00010000:0.0:1787191341.915473:0:57929:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xda:0x0](ffff936b5395d348) for lock 0xe5129dc88483a844 00000080:00010000:0.0:1787191341.915479:0:57929:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a844 from it ffffa3fb422b3cb8 00010000:00010000:0.0:1787191341.915483:0:57929:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a844 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606564 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.915493:0:57929:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a844 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606564 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191341.915512:0:57929:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xda:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1787191341.915580:0:57929:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xda:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191341.915584:0:57929:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191341.915587:0:57929:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xda:0x0] 00000008:00010000:0.0:1787191341.915602:0:57929:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191341.915605:0:57929:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee67b0, osc lock ffff936b50b63690, flags 0x400000400001002 00010000:00010000:0.0:1787191341.915619:0:57929:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc88483a84b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606587 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.915631:0:57929:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc88483a84b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606587 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:0.0:1787191341.915640:0:57929:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191341.915644:0:57929:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc88483a84b lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606587 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.915652:0:57929:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc88483a84b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606587 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:0.0:1787191341.915661:0:57929:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191341.915669:0:57929:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xda:0x0] updating i_size 5 i_blocks 0 00000020:00010000:0.0:1787191341.915673:0:57929:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509bb090 (ffff936b47a17cf8/0) at cl_lock_release():245 00000020:00010000:0.0:1787191341.915676:0:57929:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509bb090 (ffff936b47a17cf8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191341.915678:0:57929:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee67b0 (ffff936b47a172d8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191341.915682:0:57929:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509bb090 (ffff936b47a17cf8/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191341.915684:0:57929:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee67b0 (ffff936b47a17cf8/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191341.915692:0:57929:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xda:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191341.915726:0:57929:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191341.915739:0:57929:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.915747:0:57929:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.915755:0:57929:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.915766:0:57929:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191341.915770:0:57929:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191341.915772:0:57929:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191341.915776:0:57929:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422b3c10 00010000:00010000:0.0:1787191341.915779:0:57929:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.915786:0:57929:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.915794:0:57929:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.915799:0:57929:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:0.0:1787191341.915803:0:57929:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.915809:0:57929:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:0.0:1787191341.915812:0:57929:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:0.0:1787191341.915817:0:57929:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:0.0:1787191341.915954:0:57929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a860 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46065a3 expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000002:00100000:0.0:1787191341.916002:0:57929:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a9180 x1874004626762624/t8589937031(8589937031) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191341.916012:0:57929:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:0.0:1787191341.916016:0:57929:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477b80 x1874004626763392/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191341.916041:0:57929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57929:1874004626763392:192.168.202.101@tcp:35:rm.0 00000100:00100000:0.0:1787191341.916150:0:57929:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00000100:00100000:2.0:1787191341.919292:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:0.0:1787191341.919739:0:57929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57929:1874004626763392:192.168.202.101@tcp:35:rm.0 00000002:00100000:0.0:1787191341.919772:0:57929:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a9180 x1874004626762624/t8589937031(8589937031) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191341.919808:0:57929:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xda:0x0]: losing layout lock 00000100:00100000:3.0:1787191341.919860:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634916480 00000100:00100000:3.0:1787191341.919868:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634916480 00010000:00010000:0.0:1787191341.919996:0:57929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a83d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4606548 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191341.920011:0:57929:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xda:0x0]: losing layout lock 00000100:00100000:2.0:1787191341.920017:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1425 00010000:00010000:0.0:1787191341.920027:0:57929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a844 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4606564 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000100:00100000:2.0:1787191341.920038:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634916480:12345-192.168.202.101@tcp:104: 00010000:00010000:0.0:1787191341.920039:0:57929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a82f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xda:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4606525 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.920047:0:51131:0:(ldlm_lockd.c:2455:ldlm_callback_handler()) callback on lock 0xe5129dc88483a844 - lock disappeared 00010000:00010000:0.0:1787191341.920078:0:57929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a860 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xda:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46065a3 expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.920085:0:57929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a83d lrc: 1/0,0 mode: --/CR res: [0x200000405:0xda:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606548 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.920090:0:57929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a844 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xda:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4606564 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.920095:0:57929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a82f lrc: 1/0,0 mode: --/PR res: [0x200000405:0xda:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4606525 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.920101:0:57929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 4 locks packed 00010000:00010000:2.0:1787191341.920103:0:51131:0:(ldlm_lockd.c:2352:ldlm_callback_errmsg()) @@@ Operate with invalid parameter, NID=12345-192.168.202.101@tcp lock=0xe5129dc88483a844: rc = 0 req@ffff936b513b8380 x1874004634916480/t0(0) o104->f10005b0-4ec5-4888-9c81-49c0b11e82c4@192.168.202.101@tcp:652/0 lens 328/224 e 0 to 0 dl 1787191352 ref 1 fl Interpret:/0/0 rc -22/-22 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787191341.920113:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634916480:12345-192.168.202.101@tcp:104: Request processed in 79us (832us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787191341.920120:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1425 00010000:00010000:0.0:1787191341.920169:0:57929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a860 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xda:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46065a3 expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.920183:0:57929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a83d lrc: 0/0,0 mode: --/CR res: [0x200000405:0xda:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606548 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.920192:0:57929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a844 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xda:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4606564 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.920199:0:57929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483a82f lrc: 0/0,0 mode: --/PR res: [0x200000405:0xda:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4606525 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1787191341.920215:0:57929:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 36, max 7 00000100:00100000:0.0:1787191341.920221:0:57929:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477b80 x1874004626763648/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 512/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787191341.920241:0:57929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57929:1874004626763648:192.168.202.101@tcp:36:rm.0 00000100:00100000:0.0:1787191341.920292:0:57929:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00000100:00100000:3.0:1787191341.922798:0:57928:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57928:1874004626763136:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191341.922822:0:57928:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CW ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a867 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xda:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46065b8 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.922860:0:57928:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a867 lrc: 4/1,0 mode: --/CW res: [0x200000405:0xda:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46065b8 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.922871:0:57928:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a867 lrc: 4/1,0 mode: CW/CW res: [0x200000405:0xda:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46065b8 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.922882:0:57928:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a867 lrc: 4/1,0 mode: CW/CW res: [0x200000405:0xda:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46065b8 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.922896:0:57928:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a867 lrc: 5/1,1 mode: CW/CW res: [0x200000405:0xda:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46065b8 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.922904:0:57928:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a867 lrc: 5/1,1 mode: CW/CW res: [0x200000405:0xda:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46065b8 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.922911:0:57928:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a867 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xda:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46065b8 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191341.922922:0:57928:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x200002b, status=0 req@ffff936b51d1f480 x1874004626763136/t8589937033(8589937033) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191341.922935:0:57928:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1f480 x1874004626763136/t8589937033(8589937033) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191341.922947:0:57928:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a867 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xda:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46065b8 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191341.923249:0:57928:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a867 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xda:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46065b8 expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.923264:0:57928:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 8 res 8589935621/218 (0 0) 00000080:00200000:2.0:1787191341.923269:0:57928:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xda:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1787191341.923330:0:57928:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xda:0x0]: layout version change: 4294967294 -> 4 00000080:00010000:2.0:1787191341.923336:0:57928:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xda:0x0](ffff936b5395d348) for lock 0xe5129dc88483a867 00000080:00010000:2.0:1787191341.923343:0:57928:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a867 from it ffffa3fb422abbf0 00010000:00010000:2.0:1787191341.923346:0:57928:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a867 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xda:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46065b8 expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.923355:0:57928:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a867 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xda:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46065b8 expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000002:00100000:2.0:1787191341.923402:0:57928:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1f480 x1874004626763136/t8589937033(8589937033) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200080:2.0:1787191341.923499:0:57928:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xda:0x0](ffff936b5395d348) cmd=800466af arg=7ffe6f26b3dc 00000080:00200080:2.0:1787191341.923511:0:57928:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xda:0x0](ffff936b5395d348) cmd=80086601 arg=7ffe6f26b378 00000100:00100000:2.0:1787191341.923550:0:57928:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57928:1874004626763776:192.168.202.101@tcp:33:lfs.0 00000100:00100000:2.0:1787191341.923627:0:57928:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191341.923822:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191341.924027:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634916608 00000100:00100000:2.0:1787191341.924035:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634916608 00000100:00100000:2.0:1787191341.924082:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1426 00000100:00100000:2.0:1787191341.924091:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634916608:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191341.924103:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a867 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xda:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46065b8 expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.924152:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191341.924159:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634916608:12345-192.168.202.101@tcp:104: Request processed in 70us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191341.924167:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1426 00010000:00010000:0.0:1787191341.924329:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191341.924336:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a867 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xda:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46065b8 expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.924345:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9ba00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191341.924350:0:43384:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a867 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xda:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46065b8 expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.924358:0:43384:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a867 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xda:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46065b8 expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.924370:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a867 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0xda:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e46065b8 expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191341.924386:0:43384:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xda:0x0]: losing layout lock 00010000:00010000:0.0:1787191341.925227:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a867 lrc: 2/0,0 mode: --/CW res: [0x200000405:0xda:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46065b8 expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.925240:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787191341.925316:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626763904:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787191341.925414:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a867 lrc: 1/0,0 mode: --/CW res: [0x200000405:0xda:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46065b8 expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.925422:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483a867 lrc: 0/0,0 mode: --/CW res: [0x200000405:0xda:0x0].0x0 bits 0xd/0xd rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46065b8 expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.925445:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191341.925448:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191341.925449:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191341.925972:0:57928:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57928:1874004626763776:192.168.202.101@tcp:33:lfs.0 00000080:00200080:2.0:1787191341.926008:0:57928:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xda:0x0](ffff936b5395d348) cmd=c00c66f3 arg=7ffe6f26b364 00000002:00010000:2.0:1787191341.926041:0:57928:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xda:0x0]) in obj [0x200000405:0xda:0x0], intent: open flags 01004040000002 00010000:00010000:2.0:1787191341.926085:0:57928:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483a86e lrc: 3/1,0 mode: --/CR res: [0x200000405:0xda:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.926094:0:57928:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483a86e lrc: 3/1,0 mode: --/CR res: [0x200000405:0xda:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57928 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191341.926106:0:57928:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191341.926114:0:57928:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bbb80 x1874004626764160/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191341.926124:0:57928:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483a86e lrc: 3/1,0 mode: --/CR res: [0x200000405:0xda:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x81000000000000 pid: 57928 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191341.926139:0:57928:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57928:1874004626764160:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191341.926276:0:57928:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191341.932300:0:57928:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57928:1874004626764160:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191341.932327:0:57928:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483a86e lrc: 4/1,0 mode: --/CR res: [0x200000405:0xda:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e46065e2 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.932340:0:57928:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483a86e lrc: 4/1,0 mode: --/PW res: [0x200000405:0xda:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e46065e2 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.932351:0:57928:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483a86e lrc: 4/1,0 mode: PW/PW res: [0x200000405:0xda:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e46065e2 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.932362:0:57928:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483a86e lrc: 4/1,0 mode: PW/PW res: [0x200000405:0xda:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e46065e2 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.932376:0:57928:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483a86e lrc: 5/1,1 mode: PW/PW res: [0x200000405:0xda:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e46065e2 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.932391:0:57928:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483a86e lrc: 5/1,1 mode: PW/PW res: [0x200000405:0xda:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e46065e2 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.932455:0:57928:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483a86e lrc: 4/0,1 mode: PW/PW res: [0x200000405:0xda:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e46065e2 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191341.932467:0:57928:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x600002b, status=0 req@ffff936b513bbb80 x1874004626764160/t8589937034(8589937034) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191341.932480:0:57928:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bbb80 x1874004626764160/t8589937034(8589937034) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191341.932504:0:57928:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483a86e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xda:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e46065e2 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.932515:0:57928:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 2 res 8589935621/218 (0 0) 00000080:00200000:1.0:1787191341.932521:0:57928:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xda:0x0] suppgids 0 0: rc 0 00000002:00100000:1.0:1787191341.932543:0:57928:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bbb80 x1874004626764160/t8589937034(8589937034) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191341.932551:0:57928:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xda:0x0](ffff936b5395d348) for lock 0xe5129dc88483a86e 00000080:00010000:1.0:1787191341.932557:0:57928:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a86e from it ffffa3fb422abcc0 00010000:00010000:1.0:1787191341.932560:0:57928:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483a86e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xda:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e46065e2 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.932567:0:57928:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483a86e lrc: 2/0,0 mode: PW/PW res: [0x200000405:0xda:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e46065e2 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00200080:1.0:1787191341.932750:0:57928:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xda:0x0](ffff936b5395d348) cmd=c00c66f3 arg=6fd510 00010000:00010000:1.0:1787191341.932796:0:57928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483a86e lrc: 2/0,0 mode: PW/PW res: [0x200000405:0xda:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x81008000000000 nid: local remote: 0x7130d520e46065e2 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.932810:0:57928:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483a86e lrc: 0/0,0 mode: --/PW res: [0x200000405:0xda:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x85809400000000 nid: local remote: 0x7130d520e46065e2 expref: -99 pid: 57928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191341.932981:0:57928:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513bbb80 x1874004626764160/t8589937034(8589937034) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191341.932992:0:57928:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191341.932999:0:57928:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453aa300 x1874004626764416/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191341.933031:0:57928:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57928:1874004626764416:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191341.933118:0:57928:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893780 going to sleep for 11 seconds 00000100:00100000:1.0:1787191341.933369:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626763904:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191341.934446:0:57929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57929:1874004626763648:192.168.202.101@tcp:36:rm.0 00000100:00100000:1.0:1787191341.942751:0:57928:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57928:1874004626764416:192.168.202.101@tcp:35:lfs.0 00000080:00020000:1.0:1787191341.942773:0:57928:0:(file.c:251:ll_close_inode_openhandle()) lustre-clilmv-ffff936b581fb000: inode [0x200000405:0xda:0x0] mdc close failed: rc = -1 00000002:00100000:1.0:1787191341.942815:0:57928:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513bbb80 x1874004626764160/t8589937034(8589937034) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191341.942862:0:57928:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xda:0x0](ffff936b5395d348) 00000002:00010000:1.0:1787191341.942872:0:57928:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xda:0x0]) in obj [0x200000405:0xda:0x0], intent: layout flags 0 00010000:00010000:1.0:1787191341.942920:0:57928:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a875 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xda:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.942931:0:57928:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a875 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xda:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57928 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.942941:0:57928:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a875 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xda:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57928 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191341.942962:0:57928:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57928:1874004626764544:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191341.943065:0:57928:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893780 going to sleep for 11 seconds 00000100:00100000:1.0:1787191341.947745:0:57928:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57928:1874004626764544:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191341.947773:0:57928:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a875 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46065f7 expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.947784:0:57928:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a875 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46065f7 expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191341.947796:0:57928:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b453a9c00 x1874004626764544/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191341.947805:0:57928:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a875 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46065f7 expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191341.947814:0:57928:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a875 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46065f7 expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.947821:0:57928:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/218 (0 0) 00000080:00200000:1.0:1787191341.947826:0:57928:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xda:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191341.947860:0:57928:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xda:0x0](ffff936b5395d348) for lock 0xe5129dc88483a875 00000080:00010000:1.0:1787191341.947868:0:57928:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a875 from it ffffa3fb422abbc8 00010000:00010000:1.0:1787191341.947871:0:57928:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a875 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46065f7 expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191341.947877:0:57928:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a875 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46065f7 expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.947897:0:57928:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a875 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46065f7 expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.947904:0:57928:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a875 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46065f7 expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:1.0:1787191341.947909:0:57928:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xda:0x0](000000001d24cd79) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a875 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46065f7 expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191341.947943:0:57928:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xda:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:1.0:1787191341.947946:0:57928:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a875 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46065f7 expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191341.947951:0:57928:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031800/0xe5129dc88483a875 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xda:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46065f7 expref: -99 pid: 57928 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200008:1.0:1787191341.948034:0:57928:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xda:0x0](ffff936b5395d348), flags 154002 00000002:00100000:1.0:1787191341.948079:0:57928:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1f480 x1874004626763136/t8589937033(8589937033) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191341.948089:0:57928:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191341.948094:0:57928:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9c00 x1874004626764800/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191341.948230:0:57928:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57928:1874004626764800:192.168.202.101@tcp:35:lfs.0 00000080:00200000:0.0:1787191341.948324:0:57930:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191341.948340:0:57930:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.948351:0:57930:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000100:00100000:1.0:1787191341.948356:0:57928:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893780 going to sleep for 11 seconds 00010000:00010000:0.0:1787191341.948360:0:57930:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.948366:0:57930:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191341.948373:0:57930:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191341.948377:0:57930:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191341.948381:0:57930:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422bbb58 00010000:00010000:0.0:1787191341.948384:0:57930:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.948962:0:57930:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.948979:0:57930:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.948988:0:57930:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:0.0:1787191341.948995:0:57930:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.949005:0:57930:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:0.0:1787191341.949008:0:57930:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:0.0:1787191341.949029:0:57930:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:0.0:1787191341.949076:0:57930:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a87c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.949084:0:57930:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a87c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.949093:0:57930:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a87c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.949107:0:57930:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57930:1874004626764928:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191341.949157:0:57930:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00000100:00100000:0.0:1787191341.951688:0:57930:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57930:1874004626764928:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191341.951688:0:57928:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57928:1874004626764800:192.168.202.101@tcp:35:lfs.0 00010000:00010000:0.0:1787191341.951710:0:57930:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a87c lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.951721:0:57930:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a87c lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191341.951724:0:57928:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1f480 x1874004626763136/t8589937033(8589937033) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1787191341.951728:0:57930:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a87c lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.951734:0:57930:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a87c lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.951741:0:57930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a87c lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.951746:0:57930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b6a608200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191341.951751:0:57930:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a87c lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.951757:0:57930:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a87c lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.951764:0:57930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a87c lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.951770:0:57930:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000080:00200000:1.0:1787191341.951774:0:57928:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xda:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00010000:00010000:0.0:1787191341.951777:0:57930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a87c lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.951782:0:57930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a87c lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00020000:00200000:1.0:1787191341.951785:0:57928:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xda:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191341.951788:0:57928:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191341.951794:0:57928:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000002:00100000:0.0:1787191341.951802:0:57930:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b6a474700 x1874004626764928/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00020000:00200000:1.0:1787191341.951804:0:57928:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191341.951819:0:57930:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000008:00010000:1.0:1787191341.951822:0:57928:0:(osc_cache.c:1183:osc_extent_make_ready()) ### extent: 00000000d3bf90b2 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc88483a84b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606587 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000008:00010000:1.0:1787191341.951870:0:57928:0:(osc_cache.c:917:osc_extent_finish()) ### extent: 00000000d3bf90b2 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc88483a84b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606587 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000008:00010000:1.0:1787191341.951892:0:57928:0:(osc_cache.c:497:__osc_extent_remove()) ### extent: 00000000d3bf90b2 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc88483a84b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606587 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1787191341.951912:0:57930:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000080:00200000:1.0:1787191341.951913:0:57928:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xda:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000002:00010000:0.0:1787191341.951927:0:57930:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.951935:0:57930:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.951947:0:57930:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.951952:0:57930:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191341.951957:0:57930:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00200000:1.0:1787191341.951958:0:57928:0:(llite_lib.c:2066:ll_clear_inode()) VFS Op:inode=[0x200000405:0xda:0x0](ffff936b5395d348) 00000080:00010000:0.0:1787191341.951960:0:57930:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191341.951965:0:57930:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422bbbe8 00010000:00010000:0.0:1787191341.951968:0:57930:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.951974:0:57930:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000008:00010000:1.0:1787191341.951984:0:57928:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 5 blocks 0 [cma]time 1787191341 1787191341 1787191341 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc88483a84b lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606587 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1787191341.951988:0:57930:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.951994:0:57930:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000080:00200000:0.0:1787191341.951999:0:57930:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.952010:0:57930:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000008:00010000:1.0:1787191341.952010:0:57928:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191341 1787191341 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a859 lrc: 1/0,0 mode: PW/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606595 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191341.952014:0:57930:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:0.0:1787191341.952039:0:57930:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:0.0:1787191341.952081:0:57930:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc88483a883 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.952092:0:57930:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc88483a883 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.952101:0:57930:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc88483a883 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.952121:0:57930:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57930:1874004626765056:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191341.952268:0:57930:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00000100:00100000:0.0:1787191341.959050:0:57930:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57930:1874004626765056:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191341.959074:0:57930:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc88483a883 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.959088:0:57930:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc88483a883 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.959095:0:57930:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc88483a883 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.959103:0:57930:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc88483a883 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.959112:0:57930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc88483a883 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.959118:0:57930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b6a609e00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191341.959122:0:57930:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc88483a883 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.959129:0:57930:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc88483a883 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.959136:0:57930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc88483a883 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.959143:0:57930:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191341.959150:0:57930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc88483a883 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.959157:0:57930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc88483a883 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191341.959186:0:57930:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b6a474700 x1874004626765056/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191341.959200:0:57930:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191341.959308:0:57930:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191341.959324:0:57930:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.959334:0:57930:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.959347:0:57930:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.959354:0:57930:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191341.959359:0:57930:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191341.959362:0:57930:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191341.959368:0:57930:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422bbb58 00010000:00010000:0.0:1787191341.959371:0:57930:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.959384:0:57930:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.959408:0:57930:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.959417:0:57930:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:0.0:1787191341.959427:0:57930:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1787191341.959432:0:57930:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:0.0:1787191341.959444:0:57930:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.959452:0:57930:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 93 lru_type: 1 00010000:00010000:0.0:1787191341.959460:0:57930:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 93 lru_type: 1 00000002:00010000:0.0:1787191341.959469:0:57930:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.959519:0:57930:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a88a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.959527:0:57930:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a88a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.959537:0:57930:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a88a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.959556:0:57930:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57930:1874004626765184:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191341.959629:0:57930:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00000100:00100000:0.0:1787191341.963057:0:57930:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57930:1874004626765184:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191341.963082:0:57930:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a88a lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606636 expref: -99 pid: 57930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.963095:0:57930:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a88a lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606636 expref: -99 pid: 57930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.963173:0:57930:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a88a lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606636 expref: -99 pid: 57930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.963186:0:57930:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a88a lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606636 expref: -99 pid: 57930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.963198:0:57930:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a88a lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606636 expref: -99 pid: 57930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.963207:0:57930:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a88a lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606636 expref: -99 pid: 57930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.963214:0:57930:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a88a lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606636 expref: -99 pid: 57930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191341.963225:0:57930:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b6a474700 x1874004626765184/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191341.963309:0:57930:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a88a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606636 expref: -99 pid: 57930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.963320:0:57930:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:0.0:1787191341.963329:0:57930:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a88a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606636 expref: -99 pid: 57930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.963337:0:57930:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a88a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606636 expref: -99 pid: 57930 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:0.0:1787191341.963366:0:57930:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.963376:0:57930:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 186 lru_type: 1 00010000:00010000:0.0:1787191341.963388:0:57930:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 186 lru_type: 1 00010000:00010000:0.0:1787191341.966085:0:57930:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 186 lru_type: 1 00010000:00010000:0.0:1787191341.966097:0:57930:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 187 lru_type: 1 00000080:00200000:0.0:1787191341.966130:0:57930:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191341.966140:0:57930:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:0.0:1787191341.966145:0:57930:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:0.0:1787191341.966152:0:57930:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb422bbcb8 00010000:00010000:0.0:1787191341.966156:0:57930:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 93 lru_type: 1 00010000:00010000:0.0:1787191341.966164:0:57930:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 94 lru_type: 1 00000002:00010000:0.0:1787191341.966182:0:57930:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.966194:0:57930:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a88a lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606636 expref: -99 pid: 57930 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.966207:0:57930:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a88a lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606636 expref: -99 pid: 57930 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.966216:0:57930:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a88a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606636 expref: -99 pid: 57930 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.966224:0:57930:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a88a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606636 expref: -99 pid: 57930 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:0.0:1787191341.966246:0:57930:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.966253:0:57930:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 187 lru_type: 1 00010000:00010000:0.0:1787191341.966262:0:57930:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 187 lru_type: 1 00010000:00010000:0.0:1787191341.966271:0:57930:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 187 lru_type: 1 00010000:00010000:0.0:1787191341.966279:0:57930:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 188 lru_type: 1 00000080:00200008:0.0:1787191341.967591:0:57930:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1787191341.967601:0:57930:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191341.967620:0:57930:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.967633:0:57930:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.967717:0:57930:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.967724:0:57930:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191341.967730:0:57930:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191341.967734:0:57930:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191341.967741:0:57930:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422bbcb8 00010000:00010000:0.0:1787191341.967744:0:57930:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.967753:0:57930:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.967892:0:57930:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191341.967901:0:57930:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.967907:0:57930:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.967918:0:57930:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.967924:0:57930:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191341.967927:0:57930:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191341.967930:0:57930:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191341.967934:0:57930:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422bbb58 00010000:00010000:0.0:1787191341.967937:0:57930:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.967945:0:57930:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.967954:0:57930:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.967960:0:57930:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:0.0:1787191341.967966:0:57930:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.967975:0:57930:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:0.0:1787191341.967979:0:57930:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:0.0:1787191341.967992:0:57930:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:0.0:1787191341.968049:0:57930:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a891 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.968057:0:57930:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a891 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.968067:0:57930:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a891 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.968089:0:57930:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57930:1874004626765312:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191341.968176:0:57930:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00000100:00100000:0.0:1787191341.970940:0:57930:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57930:1874004626765312:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191341.970965:0:57930:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a891 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.970977:0:57930:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a891 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.970988:0:57930:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a891 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.970996:0:57930:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a891 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.971005:0:57930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a891 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.971011:0:57930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b6a608200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191341.971015:0:57930:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a891 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.971036:0:57930:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a891 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.971043:0:57930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a891 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.971051:0:57930:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191341.971058:0:57930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a891 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.971064:0:57930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a891 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191341.971079:0:57930:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b6a474700 x1874004626765312/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191341.971092:0:57930:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1787191341.971128:0:57930:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a88a lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606636 expref: -99 pid: 57930 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.971141:0:57930:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a88a lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606636 expref: -99 pid: 57930 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:0.0:1787191341.971150:0:57930:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a88a from it ffffa3fb422bb930 00010000:00010000:0.0:1787191341.971154:0:57930:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a88a lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606636 expref: -99 pid: 57930 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191341.971161:0:57930:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a88a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606636 expref: -99 pid: 57930 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191341.971228:0:57930:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191341.971354:0:57930:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191341.971363:0:57930:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.971372:0:57930:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.971378:0:57930:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191341.971384:0:57930:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191341.971387:0:57930:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191341.971400:0:57930:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422bbbf8 00010000:00010000:0.0:1787191341.971403:0:57930:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191341.971410:0:57930:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191341.971424:0:57930:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.971432:0:57930:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191341.971437:0:57930:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191341.971443:0:57930:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:0.0:1787191341.971446:0:57930:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:0.0:1787191341.971451:0:57930:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b464a8a80, open_flags a141, mode 81b6 opened 0 00000080:00200000:0.0:1787191341.971460:0:57930:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:0.0:1787191341.971479:0:57930:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xdb:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:0.0:1787191341.971488:0:57930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a88a lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4606636 expref: -99 pid: 57930 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.971621:0:57930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a88a lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4606636 expref: -99 pid: 57930 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.971628:0:57930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191341.971630:0:57930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a88a lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4606636 expref: -99 pid: 57930 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191341.972199:0:57930:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483a898 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.972209:0:57930:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483a898 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191341.972221:0:57930:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191341.972348:0:57930:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474700 x1874004626765568/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191341.972365:0:57930:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483a898 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.972385:0:57930:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57930:1874004626765568:192.168.202.101@tcp:101:lfs.0 00000080:00200000:2.0:1787191341.972764:0:57931:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191341.972782:0:57931:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191341.972792:0:57931:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191341.972802:0:57931:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191341.972809:0:57931:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191341.972816:0:57931:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191341.972819:0:57931:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191341.972825:0:57931:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422c3bf8 00010000:00010000:2.0:1787191341.972829:0:57931:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191341.972903:0:57931:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191341.972920:0:57931:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191341.972927:0:57931:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191341.972931:0:57931:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:0.0:1787191341.972983:0:57930:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00000100:00100000:0.0:1787191341.977827:0:57930:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57930:1874004626765568:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191341.978077:0:57930:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483a898 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606667 expref: -99 pid: 57930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.978111:0:57930:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483a898 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606667 expref: -99 pid: 57930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.978120:0:57930:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483a898 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606667 expref: -99 pid: 57930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.978131:0:57930:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483a898 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606667 expref: -99 pid: 57930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.978142:0:57930:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483a898 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606667 expref: -99 pid: 57930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.978212:0:57930:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483a898 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606667 expref: -99 pid: 57930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.978217:0:57930:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483a898 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606667 expref: -99 pid: 57930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.978226:0:57930:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483a898 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606667 expref: -99 pid: 57930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191341.978235:0:57930:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b6a474700 x1874004626765568/t8589937038(8589937038) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191341.978243:0:57930:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474700 x1874004626765568/t8589937038(8589937038) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191341.978251:0:57930:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483a898 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606667 expref: -99 pid: 57930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.978258:0:57930:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/219 (0 0) 00000080:00200000:0.0:1787191341.978263:0:57930:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191341.978274:0:57930:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:0.0:1787191341.978298:0:57930:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xdb:0x0](ffff936b5396b248) 00000080:00200000:0.0:1787191341.978304:0:57930:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xdb:0x0], updating i_size 0 00000080:00200000:0.0:1787191341.978331:0:57930:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xdb:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1787191341.978334:0:57930:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xdb:0x0](ffff936b5396b248) 00000080:00010000:0.0:1787191341.978337:0:57930:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdb:0x0](ffff936b5396b248) for lock 0xe5129dc88483a898 00000080:00010000:0.0:1787191341.978344:0:57930:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xdb:0x0](ffff936b5396b248) 00000080:00200008:0.0:1787191341.978355:0:57930:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xdb:0x0](ffff936b5396b248), flags 120501 00000002:00100000:0.0:1787191341.978369:0:57930:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474700 x1874004626765568/t8589937038(8589937038) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191341.978715:0:57930:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a898 from it ffff936b530f56c0 00010000:00010000:0.0:1787191341.978721:0:57930:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483a898 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606667 expref: -99 pid: 57930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.978729:0:57930:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483a898 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606667 expref: -99 pid: 57930 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191341.978746:0:57930:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xdb:0x0](ffff936b5396b248), inode mode 81a4 mask 40 00000080:00200000:2.0:1787191341.978794:0:57931:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:2.0:1787191341.978801:0:57931:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xdb:0x0](ffff936b5396b248), inode mode 81a4 mask 44 00000080:00200008:2.0:1787191341.978806:0:57931:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xdb:0x0](ffff936b5396b248), flags 154400 00000080:00200000:0.0:1787191341.978808:0:57930:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xdb:0x0](ffff936b5396b248), inode mode 81a4 mask 2 00000080:00200000:0.0:1787191341.978816:0:57930:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xdb:0x0](ffff936b5396b248), xattr lov 00000002:00010000:0.0:1787191341.978825:0:57930:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xdb:0x0]) in obj [0x200000405:0xdb:0x0], intent: open flags 040000002 00000002:00010000:2.0:1787191341.978825:0:57931:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xdb:0x0]) in obj [0x200000405:0xdb:0x0], intent: open flags 0100240114401 00010000:00010000:2.0:1787191341.978894:0:57931:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483a89f lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.978941:0:57931:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483a89f lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57931 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191341.978955:0:57931:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00010000:00010000:0.0:1787191341.978958:0:57930:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483a8a6 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191341.978963:0:57931:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb100 x1874004626765952/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191341.978965:0:57930:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483a8a6 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.978972:0:57931:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483a89f lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57931 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191341.978973:0:57930:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:0.0:1787191341.978977:0:57930:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474380 x1874004626766080/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191341.978984:0:57930:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483a8a6 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191341.978992:0:57930:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57930:1874004626766080:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191341.978993:0:57931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57931:1874004626765952:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191341.979239:0:57930:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00000100:00100000:2.0:1787191341.979239:0:57931:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191341.981536:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191341.981567:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191341.981590:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634916736 00000100:00100000:3.0:1787191341.981598:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634916736 00000100:00100000:2.0:1787191341.981725:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634916864 00000100:00100000:2.0:1787191341.981730:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634916864 00000100:00100000:2.0:1787191341.981749:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1427 00000100:00100000:2.0:1787191341.981755:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+6:6505:x1874004634916736:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191341.981768:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483a89f lrc: 4/1,0 mode: --/CR res: [0x200000405:0xdb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e460667c expref: -99 pid: 57931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.981823:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191341.981829:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+6:6505:x1874004634916736:12345-192.168.202.101@tcp:104: Request processed in 74us (304us total) trans 0 rc 0/0 00010000:00010000:0.0:1787191341.981859:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1787191341.981860:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1427 00010000:00010000:0.0:1787191341.981865:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483a89f lrc: 4/1,0 mode: --/CR res: [0x200000405:0xdb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e460667c expref: -99 pid: 57931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.981874:0:40929:0:(ldlm_lockd.c:1935:ldlm_handle_bl_callback()) Lock ffff936b51184000 is referenced, will be cancelled later 00000100:00100000:2.0:1787191341.981876:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1428 00010000:00010000:0.0:1787191341.981877:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483a89f lrc: 4/1,0 mode: --/CR res: [0x200000405:0xdb:0x0].0x0 bits 0x1/0x8 rrc: 4 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e460667c expref: -99 pid: 57931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191341.981882:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634916864:12345-192.168.202.101@tcp:104: 00010000:00010000:0.0:1787191341.981885:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191341.981887:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191341.981889:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191341.981890:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483a898 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4606667 expref: -99 pid: 57930 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191341.981922:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191341.981928:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634916864:12345-192.168.202.101@tcp:104: Request processed in 46us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191341.981934:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1428 00010000:00010000:0.0:1787191341.981945:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191341.981950:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483a898 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4606667 expref: -99 pid: 57930 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.981956:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51fe1e00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191341.981960:0:40930:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483a898 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4606667 expref: -99 pid: 57930 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.981968:0:40930:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483a898 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4606667 expref: -99 pid: 57930 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.981976:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483a898 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4606667 expref: -99 pid: 57930 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191341.981997:0:40930:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xdb:0x0]: losing layout lock 00010000:00010000:0.0:1787191341.982051:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483a898 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4606667 expref: -99 pid: 57930 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.982059:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787191341.982118:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626766208:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787191341.982223:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483a898 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4606667 expref: -99 pid: 57930 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.982232:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483a898 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4606667 expref: -99 pid: 57930 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191341.982251:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191341.982253:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191341.982255:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191341.983915:0:57931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57931:1874004626765952:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191341.983942:0:57931:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483a89f lrc: 4/1,0 mode: --/CR res: [0x200000405:0xdb:0x0].0x0 bits 0x1/0x8 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e460667c expref: -99 pid: 57931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.983953:0:57931:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483a89f lrc: 4/1,0 mode: --/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x8 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e460667c expref: -99 pid: 57931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.983964:0:57931:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483a89f lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x8 rrc: 3 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e460667c expref: -99 pid: 57931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.983975:0:57931:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483a89f lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x8 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e460667c expref: -99 pid: 57931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.983994:0:57931:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483a89f lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x8 rrc: 3 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e460667c expref: -99 pid: 57931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.984002:0:57931:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483a89f lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x8 rrc: 3 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e460667c expref: -99 pid: 57931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.984009:0:57931:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483a89f lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x8 rrc: 3 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e460667c expref: -99 pid: 57931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191341.984031:0:57931:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b513bb100 x1874004626765952/t8589937039(8589937039) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191341.984045:0:57931:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bb100 x1874004626765952/t8589937039(8589937039) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191341.984056:0:57931:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483a89f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x8 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e460667c expref: -99 pid: 57931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.984065:0:57931:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/219 (0 0) 00000080:00200000:2.0:1787191341.984071:0:57931:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xdb:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1787191341.984091:0:57931:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xdb:0x0], updating i_size 0 00000080:00200000:2.0:1787191341.984169:0:57931:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xdb:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:2.0:1787191341.984176:0:57931:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdb:0x0](ffff936b5396b248) for lock 0xe5129dc88483a89f 00000080:00010000:2.0:1787191341.984183:0:57931:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a89f from it ffffa3fb422c3bf0 00010000:00010000:2.0:1787191341.984187:0:57931:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483a89f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x8 rrc: 3 type: IBT gid 0 flags: 0x10420400000000 nid: local remote: 0x7130d520e460667c expref: -99 pid: 57931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.984199:0:57931:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483a89f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x8 rrc: 3 type: IBT gid 0 flags: 0x10420400000000 nid: local remote: 0x7130d520e460667c expref: -99 pid: 57931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191341.984227:0:57931:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000002:00100000:2.0:1787191341.984246:0:57931:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bb100 x1874004626765952/t8589937039(8589937039) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191341.984394:0:57931:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xdb:0x0](ffff936b5396b248), inode mode 81a4 mask 4 00000080:00200000:2.0:1787191341.984402:0:57931:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xdb:0x0](ffff936b5396b248), xattr lov 00000080:00200008:2.0:1787191341.984440:0:57931:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xdb:0x0](ffff936b5396b248), flags 154000 00000002:00100000:2.0:1787191341.984483:0:57931:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513bb100 x1874004626765952/t8589937039(8589937039) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191357 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191341.984493:0:57931:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191341.984794:0:57931:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9880 x1874004626766464/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191341.984816:0:57931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57931:1874004626766464:192.168.202.101@tcp:35:lfs.0 00010000:00010000:0.0:1787191341.984959:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191341.984967:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483a89f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x8 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e460667c expref: -99 pid: 57931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.984976:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51184000 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191341.984981:0:57627:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483a89f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e460667c expref: -99 pid: 57931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.984989:0:57627:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483a89f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e460667c expref: -99 pid: 57931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.984998:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483a89f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e460667c expref: -99 pid: 57931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1787191341.985011:0:57627:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xdb:0x0]: losing layout lock 00010000:00010000:0.0:1787191341.985049:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483a89f lrc: 2/0,0 mode: --/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e460667c expref: -99 pid: 57931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.985056:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191341.985065:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483a89f lrc: 1/0,0 mode: --/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e460667c expref: -99 pid: 57931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.985072:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483a89f lrc: 0/0,0 mode: --/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e460667c expref: -99 pid: 57931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.985089:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191341.985091:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191341.985093:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191341.985247:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787191341.985256:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626766592:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191341.985895:0:57931:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787191341.987828:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626766208:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191341.988361:0:57931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57931:1874004626766464:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191341.988390:0:57931:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513bb100 x1874004626765952/t8589937039(8589937039) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787191341.988670:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626766592:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00200000:3.0:1787191341.988936:0:57931:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191341.988956:0:57931:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191341.988972:0:57931:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191341.988984:0:57931:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191341.988991:0:57931:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191341.988997:0:57931:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191341.989001:0:57931:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191341.989007:0:57931:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422c3bf8 00010000:00010000:3.0:1787191341.989010:0:57931:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191341.989030:0:57931:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191341.989046:0:57931:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191341.989054:0:57931:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191341.989060:0:57931:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191341.989073:0:57931:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b483e7380, open_flags d900, mode 0 opened 0 00000080:00200000:3.0:1787191341.989079:0:57931:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:3.0:1787191341.989217:0:57931:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:3.0:1787191341.989280:0:57931:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a8ad lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.989288:0:57931:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a8ad lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57931 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191341.989299:0:57931:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191341.989306:0:57931:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1e680 x1874004626766848/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191341.989315:0:57931:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a8ad lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57931 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191341.989336:0:57931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1e680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57931:1874004626766848:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191341.991907:0:57931:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191341.993562:0:57930:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57930:1874004626766080:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191341.993583:0:57930:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483a8a6 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xdb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.993596:0:57930:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483a8a6 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xdb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.993604:0:57930:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483a8a6 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xdb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.993610:0:57930:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483a8a6 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xdb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.993619:0:57930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483a8a6 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xdb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.993624:0:57930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51fe0a00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191341.993628:0:57930:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483a8a6 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xdb:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.993704:0:57930:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483a8a6 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xdb:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.993715:0:57930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483a8a6 lrc: 5/0,0 mode: --/CR res: [0x200000405:0xdb:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.993726:0:57930:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191341.993732:0:57930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483a8a6 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xdb:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191341.993739:0:57930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483a8a6 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xdb:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57930 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191341.993764:0:57930:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b6a474380 x1874004626766080/t8589937041(8589937041) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191341.993777:0:57930:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474380 x1874004626766080/t8589937041(8589937041) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191341.993792:0:57930:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xdb:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787191341.993930:0:57930:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdb:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1787191341.993939:0:57930:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdb:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191341.993990:0:57930:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xdb:0x0], updating i_size 0 00000002:00100000:0.0:1787191341.994009:0:57930:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474380 x1874004626766080/t8589937041(8589937041) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191341.994056:0:57930:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a474380 x1874004626766080/t8589937041(8589937041) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191341.994065:0:57930:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:0.0:1787191341.994070:0:57930:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475500 x1874004626767104/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191341.994311:0:57930:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57930:1874004626767104:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191341.994378:0:57930:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00000100:00100000:0.0:1787191341.997608:0:57930:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57930:1874004626767104:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191341.997745:0:57930:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a474380 x1874004626766080/t8589937041(8589937041) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1787191341.997800:0:57930:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xdb:0x0](ffff936b5396b248), flags 100001 00000002:00100000:0.0:1787191341.997890:0:57930:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a474700 x1874004626765568/t8589937038(8589937038) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191357 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191341.997900:0:57930:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:0.0:1787191341.997905:0:57930:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477800 x1874004626767360/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191341.997926:0:57930:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57930:1874004626767360:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191341.998000:0:57930:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00000100:00100000:3.0:1787191341.999905:0:57931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1e680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57931:1874004626766848:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191341.999927:0:57931:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a8ad lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46066b4 expref: -99 pid: 57931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.999952:0:57931:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a8ad lrc: 4/1,0 mode: --/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46066b4 expref: -99 pid: 57931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.999962:0:57931:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a8ad lrc: 4/1,0 mode: --/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46066b4 expref: -99 pid: 57931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.999979:0:57931:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a8ad lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46066b4 expref: -99 pid: 57931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191341.999989:0:57931:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a8ad lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46066b4 expref: -99 pid: 57931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.000002:0:57931:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a8ad lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46066b4 expref: -99 pid: 57931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.000011:0:57931:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a8ad lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46066b4 expref: -99 pid: 57931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.000034:0:57931:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a8ad lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46066b4 expref: -99 pid: 57931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191342.000048:0:57931:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b51d1e680 x1874004626766848/t8589937043(8589937043) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191342.000060:0:57931:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1e680 x1874004626766848/t8589937043(8589937043) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191342.000073:0:57931:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a8ad lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46066b4 expref: -99 pid: 57931 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191342.000084:0:57931:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a8ad lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46066b4 expref: -99 pid: 57931 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.000108:0:57931:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/219 (0 0) 00000080:00200000:3.0:1787191342.000115:0:57931:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191342.000166:0:57931:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xdb:0x0](ffff936b5396b248): rc = 0 00000080:00200000:3.0:1787191342.000181:0:57931:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xdb:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:3.0:1787191342.000187:0:57931:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdb:0x0](ffff936b5396b248) for lock 0xe5129dc88483a8ad 00000080:00010000:3.0:1787191342.000200:0:57931:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xdb:0x0](ffff936b5396b248) 00000080:00200008:3.0:1787191342.000212:0:57931:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xdb:0x0](ffff936b5396b248), flags 154400 00000002:00100000:3.0:1787191342.000244:0:57931:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1e680 x1874004626766848/t8589937043(8589937043) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1787191342.000298:0:57931:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a8ad from it ffff936b466f4ba0 00010000:00010000:3.0:1787191342.000303:0:57931:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a8ad lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46066b4 expref: -99 pid: 57931 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.000313:0:57931:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a8ad lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46066b4 expref: -99 pid: 57931 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191342.000338:0:57931:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xdb:0x0](ffff936b5396b248), inode mode 81a4 mask 44 00000080:00200000:3.0:1787191342.000397:0:57931:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xdb:0x0](ffff936b5396b248), inode mode 81a4 mask 4 00000080:00200000:3.0:1787191342.000405:0:57931:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xdb:0x0](ffff936b5396b248), xattr lov 00000080:00200008:3.0:1787191342.000438:0:57931:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xdb:0x0](ffff936b5396b248), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191342.000445:0:57931:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xdb:0x0](ffff936b5396b248),name=f70.sanity-flr 00000002:00010000:3.0:1787191342.000462:0:57931:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xdb:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191342.000471:0:57931:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a8ad lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46066b4 expref: -99 pid: 57931 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191342.000481:0:57931:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a8ad lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46066b4 expref: -99 pid: 57931 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191342.000493:0:57931:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191342.001602:0:57931:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xdb:0x0](ffff936b5396b248) 00000080:00010000:3.0:1787191342.001607:0:57931:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdb:0x0](ffff936b5396b248) for lock 0xe5129dc88483a8ad 00000080:00010000:3.0:1787191342.001615:0:57931:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a8ad from it ffffa3fb422c3cd8 00010000:00010000:3.0:1787191342.001620:0:57931:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a8ad lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46066b4 expref: -99 pid: 57931 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191342.001631:0:57931:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a8ad lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46066b4 expref: -99 pid: 57931 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191342.001796:0:57931:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdb:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:2.0:1787191342.001808:0:57931:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdb:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191342.001811:0:57931:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191342.001814:0:57931:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xdb:0x0] 00000008:00010000:2.0:1787191342.001865:0:57931:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191342.001869:0:57931:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1530, osc lock ffff936b44e63430, flags 0x400000400001002 00010000:00010000:2.0:1787191342.001917:0:57931:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b63039a1/0xe5129dc88483a8b4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.001929:0:57931:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b63039a1/0xe5129dc88483a8b4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.001940:0:57931:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b513bbb80 x1874004626767488/t0(0) o101->lustre-OST0001-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:2.0:1787191342.001964:0:57931:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:3.0:1787191342.002254:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626767488:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191342.002627:0:57930:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57930:1874004626767360:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191342.002709:0:57930:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a474700 x1874004626765568/t8589937038(8589937038) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191342.004394:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191342.004420:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.004436:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.004451:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.004459:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191342.004466:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191342.004469:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191342.004475:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:2.0:1787191342.004479:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.004487:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.004501:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.004508:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191342.004514:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.004520:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:2.0:1787191342.004526:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xdb:0x0](ffff936b5396b248), inode mode 81a4 mask 42 00000080:00200008:2.0:1787191342.004532:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xdb:0x0](ffff936b5396b248), flags 101101 00000002:00010000:2.0:1787191342.004547:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xdb:0x0]) in obj [0x200000405:0xdb:0x0], intent: open|creat flags 04240101102 00010000:00010000:2.0:1787191342.004558:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a8ad lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46066b4 expref: -99 pid: 57931 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191342.004576:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xdb:0x0]: losing layout lock 00010000:00010000:2.0:1787191342.004615:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a8ad lrc: 1/0,0 mode: --/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46066b4 expref: -99 pid: 57931 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191342.004623:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191342.004626:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483a8ad lrc: 0/0,0 mode: --/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46066b4 expref: -99 pid: 57931 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191342.004732:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a8bb lrc: 3/0,1 mode: --/CW res: [0x200000405:0xdb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.004740:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a8bb lrc: 3/0,1 mode: --/CW res: [0x200000405:0xdb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191342.004751:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191342.004761:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8a80 x1874004626767744/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191342.004770:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a8bb lrc: 3/0,1 mode: --/CW res: [0x200000405:0xdb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191342.004790:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8a80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626767744:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191342.004992:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5fa80 going to sleep for 11 seconds 00010000:00010000:3.0:1787191342.006500:0:2391:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b63039a1/0xe5129dc88483a8b4 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.006522:0:2391:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b63039a1/0xe5129dc88483a8b4 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46066c2 expref: -99 pid: 57931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.006537:0:2391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b63039a1/0xe5129dc88483a8b4 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46066c2 expref: -99 pid: 57931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.006548:0:2391:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b63039a1/0xe5129dc88483a8b4 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46066c2 expref: -99 pid: 57931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191342.006564:0:2391:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b63039a1/0xe5129dc88483a8b4 lrc: 5/2,0 mode: PR/PR res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46066c2 expref: -99 pid: 57931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1787191342.006583:0:2391:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1787191342.006632:0:2391:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b63039a1/0xe5129dc88483a8b4 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46066c2 expref: -99 pid: 57931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.006649:0:2391:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b63039a1/0xe5129dc88483a8b4 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46066c2 expref: -99 pid: 57931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.006656:0:2391:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b63039a1/0xe5129dc88483a8b4 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46066c2 expref: -99 pid: 57931 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.006665:0:2391:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b63039a1/0xe5129dc88483a8b4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46066c2 expref: -99 pid: 57931 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1787191342.006684:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626767488:192.168.202.101@tcp:101:lfs.0 00000080:00200000:2.0:1787191342.006810:0:57931:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xdb:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191342.006816:0:57931:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509b86f0 (ffff936b47a175a8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191342.006820:0:57931:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509b86f0 (ffff936b47a175a8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.006825:0:57931:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1530 (ffff936b47a17248/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.006939:0:57931:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509b86f0 (ffff936b47a175a8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191342.006944:0:57931:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1530 (ffff936b47a175a8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191342.006959:0:57931:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdb:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:2.0:1787191342.006974:0:57931:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/219 (0 0) 00000080:00010000:2.0:1787191342.006984:0:57931:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xdb:0x0](ffff936b5396b248) 00000002:00010000:2.0:1787191342.006993:0:57931:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xdb:0x0]) in obj [0x200000405:0xdb:0x0], intent: layout flags 0 00010000:00010000:2.0:1787191342.007044:0:57931:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483a8c2 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.007053:0:57931:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483a8c2 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.007063:0:57931:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483a8c2 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57931 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191342.007081:0:57931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57931:1874004626767872:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191342.007318:0:57931:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191342.007959:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8a80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626767744:192.168.202.101@tcp:101:bash.0 00010000:00010000:2.0:1787191342.007975:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a8bb lrc: 4/0,1 mode: --/CW res: [0x200000405:0xdb:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46066d0 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.007987:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a8bb lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xdb:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46066d0 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.008001:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a8bb lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xdb:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46066d0 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191342.008015:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x200002b, status=0 req@ffff936b513b8a80 x1874004626767744/t8589937045(8589937045) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191342.008042:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b8a80 x1874004626767744/t8589937045(8589937045) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191342.008055:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a8bb lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xdb:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46066d0 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191342.008066:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a8bb lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xdb:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46066d0 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.008075:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 8 res 8589935621/219 (0 0) 00000080:00200000:2.0:1787191342.008080:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000405:0xdb:0x0] suppgids 0 0: rc 0 00000100:00100000:0.0:1787191342.008479:0:57931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57931:1874004626767872:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191342.008493:0:57931:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483a8c2 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xdb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46066de expref: -99 pid: 57931 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.008502:0:57931:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483a8c2 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xdb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46066de expref: -99 pid: 57931 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.008511:0:57931:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b513b9180 x1874004626767872/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191342.008518:0:57931:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483a8c2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46066de expref: -99 pid: 57931 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191342.008529:0:57931:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483a8c2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46066de expref: -99 pid: 57931 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.008536:0:57931:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/219 (0 0) 00000080:00200000:0.0:1787191342.008540:0:57931:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xdb:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191342.008551:0:57931:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdb:0x0](ffff936b5396b248) for lock 0xe5129dc88483a8c2 00000080:00010000:0.0:1787191342.008557:0:57931:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a8c2 from it ffffa3fb422c3bc8 00010000:00010000:0.0:1787191342.008561:0:57931:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483a8c2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46066de expref: -99 pid: 57931 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.008570:0:57931:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483a8c2 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46066de expref: -99 pid: 57931 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.008589:0:57931:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a8bb lrc: 3/0,2 mode: CW/CW res: [0x200000405:0xdb:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46066d0 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.008599:0:57931:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a8bb lrc: 3/0,2 mode: CW/CW res: [0x200000405:0xdb:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46066d0 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000080:00010000:0.0:1787191342.008607:0:57931:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xdb:0x0](00000000b4d08dee) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a8bb lrc: 4/0,2 mode: CW/CW res: [0x200000405:0xdb:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46066d0 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1787191342.008707:0:57931:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xdb:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:0.0:1787191342.008713:0:57931:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a8bb lrc: 4/0,2 mode: CW/CW res: [0x200000405:0xdb:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46066d0 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.008721:0:57931:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a8bb lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xdb:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46066d0 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000080:00200008:0.0:1787191342.008784:0:57931:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xdb:0x0](ffff936b5396b248), flags 154000 00000002:00100000:0.0:1787191342.008829:0:57931:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1e680 x1874004626766848/t8589937043(8589937043) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191342.008911:0:57931:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191342.008917:0:57931:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474a80 x1874004626768128/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191342.008936:0:57931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57931:1874004626768128:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191342.008992:0:57931:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00000080:00200000:2.0:1787191342.009998:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xdb:0x0]: layout version change: 3 -> 3 00000080:00010000:2.0:1787191342.010007:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdb:0x0](ffff936b5396b248) for lock 0xe5129dc88483a8bb 00000080:00010000:2.0:1787191342.010012:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a8bb from it ffffa3fb41cabbf0 00010000:00010000:2.0:1787191342.010016:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a8bb lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xdb:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46066d0 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.010037:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a8bb lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xdb:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46066d0 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000002:00100000:2.0:1787191342.010066:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b8a80 x1874004626767744/t8589937045(8589937045) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191342.010182:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xdb:0x0], intent: getxattr flags 0 00010000:00010000:2.0:1787191342.010220:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483a8c9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.010226:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483a8c9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.010233:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483a8c9 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191342.010313:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626768256:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191342.010412:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.013681:0:57931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57931:1874004626768128:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191342.013720:0:57931:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1e680 x1874004626766848/t8589937043(8589937043) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191357 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191342.016201:0:57931:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191342.016672:0:57931:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.016689:0:57931:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.016705:0:57931:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.016714:0:57931:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191342.016722:0:57931:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191342.016726:0:57931:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191342.016734:0:57931:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422c3bf8 00010000:00010000:0.0:1787191342.016738:0:57931:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.016748:0:57931:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.016773:0:57931:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.016783:0:57931:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191342.016790:0:57931:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.016808:0:57931:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b464a8a80, open_flags d902, mode 0 opened 0 00000080:00200000:0.0:1787191342.016814:0:57931:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:0.0:1787191342.016827:0:57931:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154403 00000100:00100000:2.0:1787191342.016903:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626768256:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191342.016907:0:57931:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483a8d0 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.016914:0:57931:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483a8d0 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.016919:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483a8c9 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46066ec expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191342.016923:0:57931:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191342.016931:0:57931:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474a80 x1874004626768512/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191342.016931:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483a8c9 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46066ec expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.016941:0:57931:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483a8d0 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.016942:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483a8c9 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46066ec expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191342.016953:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b513bad80 x1874004626768256/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787191342.016958:0:57931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57931:1874004626768512:192.168.202.101@tcp:101:lfs.0 00000002:00010000:2.0:1787191342.016962:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483a8c9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46066ec expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.016974:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/219 (0 0) 00000080:00200000:2.0:1787191342.016978:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xdb:0x0] suppgids 0 -1: rc 0 00000080:00010000:2.0:1787191342.017001:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdb:0x0](ffff936b5396b248) for lock 0xe5129dc88483a8c9 00000080:00010000:2.0:1787191342.017006:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a8c9 from it ffffa3fb41caba38 00010000:00010000:2.0:1787191342.017010:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483a8c9 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46066ec expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.017086:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483a8c9 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46066ec expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:2.0:1787191342.017118:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xdb:0x0](ffff936b5396b248) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191342.000000000, mtime 1787191342.000000000, ctime 1787191342.000000000 00010000:00010000:2.0:1787191342.017141:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a8bb lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xdb:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46066d0 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.017160:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483a8c2 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46066de expref: -99 pid: 57931 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191342.017187:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a8bb lrc: 1/0,0 mode: --/CW res: [0x200000405:0xdb:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46066d0 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.017194:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191342.017197:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483a8bb lrc: 0/0,0 mode: --/CW res: [0x200000405:0xdb:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46066d0 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:2.0:1787191342.017210:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 36, max 7 00000100:00100000:2.0:1787191342.017217:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bad80 x1874004626768768/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787191342.017230:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626768768:192.168.202.101@tcp:36:bash.0 00000100:00100000:2.0:1787191342.017330:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.017993:0:57931:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.020706:0:57931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57931:1874004626768512:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191342.020728:0:57931:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483a8d0 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.020745:0:57931:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483a8d0 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.020752:0:57931:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483a8d0 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.020760:0:57931:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483a8d0 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.020769:0:57931:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483a8d0 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.020774:0:57931:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51fe0a00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191342.020779:0:57931:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483a8d0 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.020785:0:57931:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483a8d0 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.020792:0:57931:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483a8d0 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.020798:0:57931:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191342.020804:0:57931:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483a8d0 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57931 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.020811:0:57931:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483a8d0 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57931 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.021062:0:57931:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b6a474a80 x1874004626768512/t8589937047(8589937047) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191342.021082:0:57931:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474a80 x1874004626768512/t8589937047(8589937047) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191342.021100:0:57931:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191342.021152:0:57931:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xdb:0x0](ffff936b5396b248): rc = 0 00000080:00010000:0.0:1787191342.021157:0:57931:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdb:0x0](ffff936b5396b248) for lock 0x0 00000080:00200008:0.0:1787191342.021179:0:57931:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xdb:0x0](ffff936b5396b248), flags 154402 00000002:00100000:0.0:1787191342.021202:0:57931:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474a80 x1874004626768512/t8589937047(8589937047) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191342.021238:0:57931:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a474a80 x1874004626768512/t8589937047(8589937047) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191342.021247:0:57931:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191342.021252:0:57931:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475f80 x1874004626769024/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191342.021273:0:57931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57931:1874004626769024:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191342.021348:0:57931:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00000100:00100000:1.0:1787191342.023608:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626768768:192.168.202.101@tcp:36:bash.0 00000080:00200000:1.0:1787191342.023930:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:1.0:1787191342.023937:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdb:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:1.0:1787191342.023948:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xdb:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:1.0:1787191342.023954:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdb:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191342.023958:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xdb:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:1.0:1787191342.023968:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xdb:0x0](ffff936b5396b248) 00000002:00010000:1.0:1787191342.023980:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xdb:0x0]) in obj [0x200000405:0xdb:0x0], intent: layout flags 02 00010000:00010000:1.0:1787191342.023999:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483a8c2 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e46066de expref: -99 pid: 57931 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000100:00100000:0.0:1787191342.024053:0:57931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57931:1874004626769024:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191342.024073:0:57931:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a474a80 x1874004626768512/t8589937047(8589937047) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191342.024163:0:57931:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xdb:0x0](ffff936b5396b248), inode mode 81a4 mask 46 00000080:00200000:1.0:1787191342.024198:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xdb:0x0]: losing layout lock 00010000:00010000:1.0:1787191342.024239:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483a8c2 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xdb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46066de expref: -99 pid: 57931 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.024246:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191342.024249:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483a8c2 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xdb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46066de expref: -99 pid: 57931 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200080:0.0:1787191342.024252:0:57931:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xdb:0x0](ffff936b5396b248) cmd=800466af arg=7ffe8e350c1c 00000080:00200080:0.0:1787191342.024264:0:57931:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xdb:0x0](ffff936b5396b248) cmd=80086601 arg=7ffe8e350bb8 00010000:00010000:1.0:1787191342.024270:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a8d7 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xdb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.024276:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a8d7 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xdb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191342.024286:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191342.024296:0:57931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57931:1874004626769280:192.168.202.101@tcp:33:lfs.0 00000100:00100000:0.0:1787191342.024367:0:57931:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00000100:00100000:1.0:1787191342.024704:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9c00 x1874004626769408/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191342.024715:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a8d7 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xdb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191342.024729:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626769408:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191342.024756:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893780 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.028781:0:57931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57931:1874004626769280:192.168.202.101@tcp:33:lfs.0 00000080:00200080:0.0:1787191342.028827:0:57931:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xdb:0x0](ffff936b5396b248) cmd=c00c66f3 arg=7ffe8e350ba4 00000080:00200008:0.0:1787191342.028973:0:57931:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xdb:0x0](ffff936b5396b248), flags 154002 00000100:00100000:2.0:1787191342.033782:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191342.033810:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191342.033850:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634917632 00000100:00100000:2.0:1787191342.033859:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634917632 00000100:00100000:2.0:1787191342.033903:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634917760 00000100:00100000:2.0:1787191342.033906:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634917760 00000100:00100000:2.0:1787191342.033924:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1429 00000100:00100000:2.0:1787191342.033934:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+5:29543:x1874004634917632:12345-192.168.202.101@tcp:104: 00000100:00100000:3.0:1787191342.033948:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1430 00010000:00010000:2.0:1787191342.033952:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483a821 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4606517 expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1787191342.033963:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+5:30510:x1874004634917760:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191342.033977:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a859 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4606595 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191342.034263:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191342.034270:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+5:30510:x1874004634917760:12345-192.168.202.101@tcp:104: Request processed in 314us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191342.034276:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1430 00000100:00100000:3.0:1787191342.034321:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191342.034347:0:40921:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787191342.034359:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634918400 00000100:00100000:3.0:1787191342.034363:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634918400 00010000:00010000:2.0:1787191342.034369:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787191342.034377:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:29543:x1874004634917632:12345-192.168.202.101@tcp:104: Request processed in 444us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191342.034384:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1431 00000100:00100000:3.0:1787191342.034391:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b50880450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8419:x1874004634918400:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191342.034551:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c6e8a95c/0xe5129dc88483a828 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e460652c expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191342.034590:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787191342.034661:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b50880450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8419:x1874004634918400:12345-192.168.202.101@tcp:104: Request processed in 205us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191342.035412:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1429 00000100:00100000:3.0:1787191342.035481:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1431 00000100:00100000:3.0:1787191342.035569:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191342.035590:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634918528 00000100:00100000:3.0:1787191342.035661:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634918528 00000100:00100000:3.0:1787191342.035682:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1432 00000100:00100000:3.0:1787191342.035689:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8422:x1874004634918528:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191342.035700:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc88483a84b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4606587 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191342.035740:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787191342.035746:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8422:x1874004634918528:12345-192.168.202.101@tcp:104: Request processed in 58us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191342.035753:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1432 00000100:00100000:0.0:1787191342.036105:0:57570:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589937051 gen 1 00000100:00100000:0.0:1787191342.036246:0:57570:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b513b8a80 x1874004626767744/t8589937045(8589937045) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787191342.036263:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626769408:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191342.036281:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a8d7 lrc: 4/0,1 mode: --/EX res: [0x200000405:0xdb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606724 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.036301:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a8d7 lrc: 4/0,1 mode: --/CR res: [0x200000405:0xdb:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606724 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.036314:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a8d7 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xdb:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606724 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.036324:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a8d7 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xdb:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606724 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.036336:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a8d7 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xdb:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606724 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.036343:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a8d7 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xdb:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606724 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.036350:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a8d7 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xdb:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606724 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.036365:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b453a9c00 x1874004626769408/t8589937051(8589937051) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1787191342.037314:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787191342.037323:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a859 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4606595 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.037334:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030800 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191342.037340:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a859 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4606595 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.037398:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a859 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4606595 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.037405:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191342.037428:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a859 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4606595 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.037436:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a859 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4606595 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.037455:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787191342.037459:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483a821 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4606517 expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.037466:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51184800 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191342.037470:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483a821 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e4606517 expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.037489:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483a821 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4606517 expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.037510:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191342.037517:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483a821 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4606517 expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.037599:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483a821 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4606517 expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.037613:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787191342.037617:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c6e8a95c/0xe5129dc88483a828 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e460652c expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.037624:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51184600 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191342.037628:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c6e8a95c/0xe5129dc88483a828 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e460652c expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.037650:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c6e8a95c/0xe5129dc88483a828 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e460652c expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.037656:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191342.037662:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c6e8a95c/0xe5129dc88483a828 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e460652c expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.037673:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000c6e8a95c/0xe5129dc88483a828 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e460652c expref: -99 pid: 57928 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.037686:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191342.037690:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc88483a84b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4606587 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191342.037697:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b6a609c00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191342.037701:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc88483a84b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4606587 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191342.037719:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc88483a84b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4606587 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191342.037726:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191342.037731:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc88483a84b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4606587 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191342.037739:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfac68f4/0xe5129dc88483a84b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4606587 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191342.037751:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191342.037753:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191342.037766:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191342.037774:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191342.037780:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191342.037785:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191342.037801:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626769536:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191342.037907:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626769792:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191342.037941:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787191342.037947:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626769664:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191342.037974:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626769920:192.168.202.101@tcp:103:ldlm_bl.0 00000002:00010000:0.0:1787191342.038037:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a8d7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdb:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606724 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191342.038051:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a8d7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdb:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606724 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.038063:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/219 (0 0) 00000080:00200000:0.0:1787191342.038072:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xdb:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191342.038088:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdb:0x0](ffff936b5396b248) for lock 0xe5129dc88483a8d7 00000080:00010000:0.0:1787191342.038097:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a8d7 from it ffffa3fb41cab930 00010000:00010000:0.0:1787191342.038101:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a8d7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdb:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606724 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.038110:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a8d7 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdb:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606724 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191342.038126:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:0.0:1787191342.038132:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdb:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:0.0:1787191342.038288:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a8d7 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xdb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606724 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.038300:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a8d7 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xdb:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606724 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1787191342.038309:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xdb:0x0](00000000b4d08dee) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a8d7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdb:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606724 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.038345:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a8d7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdb:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606724 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.038354:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a8d7 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdb:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606724 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191342.038368:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdb:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00020000:00200000:0.0:1787191342.038601:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdb:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191342.038605:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191342.038612:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191342.038624:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191342.038641:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdb:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:0.0:1787191342.038654:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a8d7 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xdb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606724 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191342.038663:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a8d7 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xdb:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606724 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:0.0:1787191342.038670:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xdb:0x0](00000000b4d08dee) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a8d7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdb:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606724 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191342.038692:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdb:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191342.038697:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdb:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191342.038699:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191342.038702:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191342.038706:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191342.038713:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdb:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:0.0:1787191342.038725:0:57570:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b63039a1/0xe5129dc88483a8b4 lrc: 1/0,0 mode: PR/PR res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46066c2 expref: -99 pid: 57931 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191342.038794:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xdb:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:0.0:1787191342.038799:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a8d7 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdb:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606724 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191342.038808:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a8d7 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdb:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606724 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00020000:00200000:0.0:1787191342.038821:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xdb:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:0.0:1787191342.038824:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdb:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191342.038827:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191342.038871:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191342.038883:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191342.038886:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:0.0:1787191342.038897:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:0.0:1787191342.038902:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f994b0, osc lock ffff936b50b63690, flags 0x80000000 00000008:00010000:0.0:1787191342.038905:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:0.0:1787191342.038907:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f994f0, osc lock ffff936b50b62be0, flags 0x80000000 00010000:00010000:0.0:1787191342.038916:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b52373000 type 11 mode 2 res 11811161089/465 (0 1048575) 00010000:00010000:0.0:1787191342.038944:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.038952:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.038961:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.038978:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626770048:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191342.039015:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.044133:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626769536:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191342.044145:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191342.044242:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634918656 00000100:00100000:2.0:1787191342.044249:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634918656 00000100:00100000:2.0:1787191342.044325:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1433 00000100:00100000:2.0:1787191342.044335:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30510:x1874004634918656:12345-192.168.202.101@tcp:104: 00000080:00200000:1.0:1787191342.044344:0:57932:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00010000:00010000:2.0:1787191342.044353:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b63039a1/0xe5129dc88483a8b4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e46066c2 expref: -99 pid: 57931 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000002:00010000:1.0:1787191342.044366:0:57932:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191342.044379:0:57932:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191342.044392:0:57932:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191342.044399:0:57932:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191342.044406:0:57932:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191342.044409:0:57932:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191342.044416:0:57932:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422cbbf8 00010000:00010000:1.0:1787191342.044420:0:57932:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191342.044429:0:57932:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.044435:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191342.044441:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30510:x1874004634918656:12345-192.168.202.101@tcp:104: Request processed in 107us (302us total) trans 0 rc 0/0 00000080:00200000:1.0:1787191342.044445:0:57932:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000100:00100000:2.0:1787191342.044448:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1433 00000080:00200000:1.0:1787191342.044452:0:57932:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191342.044457:0:57932:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191342.044469:0:57932:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b42f3bc80, open_flags d900, mode 0 opened 0 00000080:00200000:1.0:1787191342.044475:0:57932:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:1.0:1787191342.044490:0:57932:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:2.0:1787191342.044559:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787191342.044565:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b63039a1/0xe5129dc88483a8b4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e46066c2 expref: -99 pid: 57931 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.044574:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51184a00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:2.0:1787191342.044580:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b63039a1/0xe5129dc88483a8b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e46066c2 expref: -99 pid: 57931 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.044810:0:57932:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a8e5 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.044819:0:57932:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a8e5 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57932 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191342.044830:0:57932:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191342.044865:0:57932:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8a80 x1874004626770304/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191342.044875:0:57932:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a8e5 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57932 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191342.044896:0:57932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57932:1874004626770304:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191342.044944:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626769792:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787191342.044995:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b63039a1/0xe5129dc88483a8b4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e46066c2 expref: -99 pid: 57931 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.045003:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191342.045035:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b63039a1/0xe5129dc88483a8b4 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e46066c2 expref: -99 pid: 57931 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1787191342.045043:0:57932:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1787191342.045043:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000b63039a1/0xe5129dc88483a8b4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e46066c2 expref: -99 pid: 57931 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.045058:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191342.045060:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191342.045063:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191342.045063:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626770432:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191342.045113:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626769664:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191342.045123:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626769920:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191342.049967:0:57932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57932:1874004626770304:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191342.049995:0:57932:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a8e5 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606763 expref: -99 pid: 57932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.050027:0:57932:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a8e5 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606763 expref: -99 pid: 57932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.050035:0:57932:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a8e5 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606763 expref: -99 pid: 57932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.050045:0:57932:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a8e5 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606763 expref: -99 pid: 57932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.050055:0:57932:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a8e5 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606763 expref: -99 pid: 57932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.050067:0:57932:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a8e5 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606763 expref: -99 pid: 57932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.050074:0:57932:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a8e5 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606763 expref: -99 pid: 57932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.050081:0:57932:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a8e5 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606763 expref: -99 pid: 57932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191342.050103:0:57932:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b453a8a80 x1874004626770304/t8589937052(8589937052) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191342.050115:0:57932:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8a80 x1874004626770304/t8589937052(8589937052) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191342.050127:0:57932:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606763 expref: -99 pid: 57932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191342.050139:0:57932:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606763 expref: -99 pid: 57932 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.050149:0:57932:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/219 (0 0) 00000080:00200000:1.0:1787191342.050155:0:57932:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191342.050208:0:57932:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xdb:0x0](ffff936b5396b248): rc = 0 00000080:00200000:1.0:1787191342.050225:0:57932:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xdb:0x0]: layout version change: 4 -> 4 00000080:00010000:1.0:1787191342.050242:0:57932:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdb:0x0](ffff936b5396b248) for lock 0xe5129dc88483a8e5 00000080:00010000:1.0:1787191342.050257:0:57932:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xdb:0x0](ffff936b5396b248) 00000080:00200008:1.0:1787191342.050270:0:57932:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xdb:0x0](ffff936b5396b248), flags 154400 00000100:00100000:0.0:1787191342.050276:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626770048:192.168.202.101@tcp:101:bash.0 00000002:00100000:1.0:1787191342.050292:0:57932:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8a80 x1874004626770304/t8589937052(8589937052) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191342.050337:0:57932:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a8e5 from it ffff936b5339fc00 00010000:00010000:1.0:1787191342.050342:0:57932:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606763 expref: -99 pid: 57932 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.050352:0:57932:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a8e5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606763 expref: -99 pid: 57932 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.050353:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.050364:0:57570:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.050372:0:57570:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1787191342.050375:0:57932:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xdb:0x0](ffff936b5396b248), inode mode 81a4 mask 44 00000080:00200000:1.0:1787191342.050469:0:57932:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xdb:0x0](ffff936b5396b248), inode mode 81a4 mask 4 00000080:00200000:1.0:1787191342.050476:0:57932:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xdb:0x0](ffff936b5396b248), xattr lov 00000080:00200008:1.0:1787191342.050513:0:57932:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xdb:0x0](ffff936b5396b248), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191342.050520:0:57932:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xdb:0x0](ffff936b5396b248),name=f70.sanity-flr 00000002:00010000:1.0:1787191342.050538:0:57932:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xdb:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191342.050546:0:57932:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a8e5 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606763 expref: -99 pid: 57932 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.050557:0:57932:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a8e5 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606763 expref: -99 pid: 57932 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191342.050564:0:57932:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191342.050569:0:57932:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xdb:0x0](ffff936b5396b248) 00000080:00010000:1.0:1787191342.050572:0:57932:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdb:0x0](ffff936b5396b248) for lock 0xe5129dc88483a8e5 00000080:00010000:1.0:1787191342.050577:0:57932:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a8e5 from it ffffa3fb422cbcd8 00010000:00010000:1.0:1787191342.050580:0:57932:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606763 expref: -99 pid: 57932 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.050586:0:57932:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a8e5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606763 expref: -99 pid: 57932 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191342.050604:0:57932:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdb:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:1.0:1787191342.050614:0:57932:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdb:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191342.050617:0:57932:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191342.050621:0:57932:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xdb:0x0] 00000008:00010000:1.0:1787191342.050650:0:57932:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191342.050654:0:57932:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b47d7d1b0, osc lock ffff936b46836be0, flags 0x400000400001002 00010000:00010000:1.0:1787191342.050668:0:57932:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b52373000 type 11 mode 6 res 11811161089/465 (0 1048575) 00010000:00010000:1.0:1787191342.050699:0:57932:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a8ec lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57932 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.050713:0:57932:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a8ec lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57932 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.050723:0:57932:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b453ab480 x1874004626770560/t0(0) o101->lustre-OST0001-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:1.0:1787191342.050759:0:57932:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:0.0:1787191342.050858:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787191342.050875:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626770560:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191342.051501:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191342.051535:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634918784 00000100:00100000:3.0:1787191342.051542:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634918784 00000100:00100000:3.0:1787191342.051586:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1434 00000100:00100000:3.0:1787191342.051607:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:6491:x1874004634918784:12345-192.168.202.101@tcp:105: 00010000:00010000:3.0:1787191342.051620:0:40922:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.051632:0:40922:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.051641:0:40922:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.051650:0:40922:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080080020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.051659:0:40922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080080020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.051669:0:40922:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80080020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.051691:0:40922:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b51fe1e00) 00000100:00100000:3.0:1787191342.051718:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:6491:x1874004634918784:12345-192.168.202.101@tcp:105: Request processed in 125us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191342.051723:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1434 00010000:00010000:0.0:1787191342.052082:0:57570:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.052093:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.052108:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191342.052121:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.052133:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.052141:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.052201:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483a8f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.052210:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483a8f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.052220:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483a8f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.052238:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626770688:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191342.052279:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191342.053631:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626770432:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191342.054603:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191342.054671:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634918912 00000100:00100000:2.0:1787191342.054679:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634918912 00000100:00100000:2.0:1787191342.054730:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1435 00000100:00100000:2.0:1787191342.054738:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30511:x1874004634918912:12345-192.168.202.101@tcp:106: 00010000:00010000:2.0:1787191342.054753:0:40921:0:(ldlm_lockd.c:2541:ldlm_callback_handler()) ### glimpse ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.054767:0:40921:0:(ldlm_lockd.c:2123:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00010000:2.0:1787191342.054793:0:40921:0:(cl_object.c:322:cl_object_glimpse()) header@00000000a295d399[0x110, 1, [0x200000405:0xdb:0x0] hash] 00000020:00010000:2.0:1787191342.054796:0:40921:0:(cl_object.c:322:cl_object_glimpse()) size: 0 mtime: 1787191342 atime: 1787191341 ctime: 1787191342 blocks: 0 00000020:00010000:2.0:1787191342.054799:0:40921:0:(cl_object.c:322:cl_object_glimpse()) header@000000005b4220b2[0x110, 2, [0x2c0000401:0x1d1:0x0] hash] 00000020:00010000:2.0:1787191342.054801:0:40921:0:(cl_object.c:322:cl_object_glimpse()) size: 0 mtime: 1787191342 atime: 1787191341 ctime: 1787191342 blocks: 0 00000100:00100000:2.0:1787191342.054912:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30511:x1874004634918912:12345-192.168.202.101@tcp:106: Request processed in 174us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191342.054921:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1435 00010000:00010000:0.0:1787191342.056762:0:2390:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a8ec lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57932 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.056782:0:2390:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a8ec lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57932 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.056794:0:2390:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a8ec lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 57932 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.056801:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a8ec lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 57932 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.056809:0:2390:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a8ec lrc: 5/1,0 mode: --/PR res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 57932 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191342.056823:0:2390:0:(osc_lock.c:187:osc_lock_lvb_update()) ### no dlm lock: acquired size 0, setting rss=0; leaving kms=0, end=18446744073709551615 00000020:00200000:0.0:1787191342.056865:0:2390:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1787191342.056876:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a8ec lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 57932 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.056885:0:2390:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a8ec lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 57932 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.056893:0:2390:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a8ec lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 57932 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.056900:0:2390:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030400 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191342.056905:0:2390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a8ec lrc: 5/0,0 mode: --/PR res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 57932 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.056914:0:2390:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191342.056921:0:2390:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a8ec lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 57932 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.056929:0:2390:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483a8ec lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 57932 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.056950:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626770560:192.168.202.101@tcp:101:lfs.0 00000080:00200000:1.0:1787191342.057043:0:57932:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xdb:0x0] updating i_size 0 i_blocks 0 00000020:00010000:1.0:1787191342.057050:0:57932:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51656e40 (ffff936b465cc998/0) at cl_lock_release():245 00000020:00010000:1.0:1787191342.057053:0:57932:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51656e40 (ffff936b465cc998/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191342.057059:0:57932:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7d1b0 (ffff936b47a17128/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191342.057063:0:57932:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51656e40 (ffff936b465cc998/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191342.057066:0:57932:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7d1b0 (ffff936b465cc998/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191342.057078:0:57932:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdb:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1787191342.057150:0:57932:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xdb:0x0](ffff936b5396b248), flags 154000 00000002:00100000:1.0:1787191342.057220:0:57932:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a8a80 x1874004626770304/t8589937052(8589937052) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191342.057244:0:57932:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191342.057250:0:57932:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453aa680 x1874004626770944/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191342.057272:0:57932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57932:1874004626770944:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191342.057361:0:57932:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.058296:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626770688:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191342.058316:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483a8f3 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606778 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.058331:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483a8f3 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4606778 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.058344:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483a8f3 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4606778 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.058362:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483a8f3 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4606778 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191342.058373:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483a8f3 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4606778 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.058385:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483a8f3 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606778 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.058393:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483a8f3 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606778 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.058474:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787191342.058488:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626771072:192.168.202.101@tcp:10:bash.0 00000100:00100000:0.0:1787191342.058574:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626771200:192.168.202.101@tcp:10:bash.0 00000100:00100000:2.0:1787191342.059525:0:57932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57932:1874004626770944:192.168.202.101@tcp:35:lfs.0 00000002:00100000:2.0:1787191342.059553:0:57932:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a8a80 x1874004626770304/t8589937052(8589937052) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191342.059824:0:57932:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191342.059874:0:57932:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.059889:0:57932:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.059902:0:57932:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.059909:0:57932:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191342.059915:0:57932:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191342.059919:0:57932:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191342.059926:0:57932:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422cbb58 00010000:00010000:2.0:1787191342.059930:0:57932:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.059939:0:57932:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.059954:0:57932:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.059961:0:57932:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191342.059967:0:57932:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.059970:0:57932:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=9 00000080:00200008:2.0:1787191342.059977:0:57932:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xdb:0x0](ffff936b5396b248), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191342.059981:0:57932:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xdb:0x0](ffff936b5396b248),name=f70.sanity-flr 00000002:00010000:2.0:1787191342.059994:0:57932:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xdb:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.060001:0:57932:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a8e5 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606763 expref: -99 pid: 57932 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191342.060009:0:57932:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a8e5 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606763 expref: -99 pid: 57932 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191342.060015:0:57932:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191342.060034:0:57932:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xdb:0x0](ffff936b5396b248) 00000080:00010000:2.0:1787191342.060037:0:57932:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdb:0x0](ffff936b5396b248) for lock 0xe5129dc88483a8e5 00000080:00010000:2.0:1787191342.060041:0:57932:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a8e5 from it ffffa3fb422cbcb8 00010000:00010000:2.0:1787191342.060044:0:57932:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606763 expref: -99 pid: 57932 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191342.060052:0:57932:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a8e5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606763 expref: -99 pid: 57932 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191342.060075:0:57932:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdb:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:2.0:1787191342.060084:0:57932:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdb:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191342.060088:0:57932:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191342.060091:0:57932:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xdb:0x0] 00000008:00010000:2.0:1787191342.060110:0:57932:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191342.060113:0:57932:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1530, osc lock ffff936b44e63430, flags 0x400000400001002 00010000:00010000:2.0:1787191342.060193:0:57932:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.060206:0:57932:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:2.0:1787191342.060218:0:57932:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191342.060222:0:57932:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 7/0,2 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.060230:0:57932:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:2.0:1787191342.060237:0:57932:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191342.060248:0:57932:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xdb:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191342.060253:0:57932:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509b8b90 (ffff936b47a17248/0) at cl_lock_release():245 00000020:00010000:2.0:1787191342.060255:0:57932:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509b8b90 (ffff936b47a17248/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.060258:0:57932:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1530 (ffff936b47a17d88/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.060261:0:57932:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509b8b90 (ffff936b47a17248/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191342.060264:0:57932:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1530 (ffff936b47a17248/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191342.060276:0:57932:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdb:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191342.060301:0:57932:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191342.060309:0:57932:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.060315:0:57932:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.060323:0:57932:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.060329:0:57932:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191342.060333:0:57932:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191342.060335:0:57932:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191342.060338:0:57932:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422cbbf8 00010000:00010000:2.0:1787191342.060341:0:57932:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.060349:0:57932:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.060357:0:57932:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.060361:0:57932:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191342.060365:0:57932:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.060368:0:57932:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:2.0:1787191342.060372:0:57932:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xdb:0x0](ffff936b5396b248), inode mode 81a4 mask 46 00000080:00200008:2.0:1787191342.060379:0:57932:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xdb:0x0](ffff936b5396b248), flags 154402 00000080:00200000:2.0:1787191342.060464:0:57932:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xdb:0x0](ffff936b5396b248), inode mode 81a4 mask 4 00000080:00200000:2.0:1787191342.060471:0:57932:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xdb:0x0](ffff936b5396b248), xattr lov 00000080:00200008:2.0:1787191342.060495:0:57932:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xdb:0x0](ffff936b5396b248), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191342.060500:0:57932:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xdb:0x0](ffff936b5396b248),name=f70.sanity-flr 00000002:00010000:2.0:1787191342.060509:0:57932:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xdb:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.060515:0:57932:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a8e5 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606763 expref: -99 pid: 57932 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191342.060523:0:57932:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a8e5 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606763 expref: -99 pid: 57932 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191342.060528:0:57932:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191342.060532:0:57932:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xdb:0x0](ffff936b5396b248) 00000080:00010000:2.0:1787191342.060534:0:57932:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdb:0x0](ffff936b5396b248) for lock 0xe5129dc88483a8e5 00000080:00010000:2.0:1787191342.060538:0:57932:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a8e5 from it ffffa3fb422cbcd8 00010000:00010000:2.0:1787191342.060541:0:57932:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606763 expref: -99 pid: 57932 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191342.060548:0:57932:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a8e5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606763 expref: -99 pid: 57932 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 1 00000080:00200000:2.0:1787191342.060561:0:57932:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdb:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:2.0:1787191342.060566:0:57932:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdb:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191342.060569:0:57932:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191342.060571:0:57932:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xdb:0x0] 00000008:00010000:2.0:1787191342.060580:0:57932:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191342.060582:0:57932:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1530, osc lock ffff936b44e63430, flags 0x400000400001002 00010000:00010000:2.0:1787191342.060590:0:57932:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.060598:0:57932:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:2.0:1787191342.060607:0:57932:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191342.060610:0:57932:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 7/0,2 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.060617:0:57932:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:2.0:1787191342.060624:0:57932:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191342.060628:0:57932:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xdb:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191342.060631:0:57932:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509b8b90 (ffff936b47a17248/0) at cl_lock_release():245 00000020:00010000:2.0:1787191342.060633:0:57932:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509b8b90 (ffff936b47a17248/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.060636:0:57932:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1530 (ffff936b47a17d88/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.060639:0:57932:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509b8b90 (ffff936b47a17248/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191342.060641:0:57932:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1530 (ffff936b47a17248/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191342.060647:0:57932:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdb:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200080:2.0:1787191342.060704:0:57932:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xdb:0x0](ffff936b5396b248) cmd=c00c66f3 arg=12cb2e0 00000080:00200008:2.0:1787191342.060798:0:57932:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xdb:0x0](ffff936b5396b248), flags 154002 00000100:00100000:1.0:1787191342.063701:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626771200:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191342.063747:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626771072:192.168.202.101@tcp:10:bash.0 00000080:00200000:2.0:1787191342.064352:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xdb:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191342.064361:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894308 (ffff936b47a17b48/0) at cl_lock_release():245 00000020:00010000:2.0:1787191342.064364:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894308 (ffff936b47a17b48/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.064369:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f994b0 (ffff936b47a175a8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191342.064380:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.064397:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191342.064415:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f994f0 (ffff936b47a17cf8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191342.064420:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483a8f3 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606778 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.064438:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483a8f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606778 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191342.064449:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894308 (ffff936b47a17b48/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191342.064453:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f994b0 (ffff936b47a17b48/1) at cl_lock_fini():72 00000020:00010000:2.0:1787191342.064458:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f994f0 (ffff936b47a17b48/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191342.064504:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdb:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191342.064526:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xdb:0x0](ffff936b5396b248) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191342.000000000, mtime 1787191342.000000000, ctime 1787191342.000000000, rc 0 00000080:00200008:2.0:1787191342.064600:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xdb:0x0], ppos: 0, count: 5 00000080:00200000:2.0:1787191342.064613:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191342.064619:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:2.0:1787191342.064624:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:2.0:1787191342.064629:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1787191342.064635:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@00000000a295d399[0x110, 1, [0x200000405:0xdb:0x0] hash] 00000020:00200000:2.0:1787191342.064638:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:2.0:1787191342.064642:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdb:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00020000:00200000:2.0:1787191342.064656:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xdb:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:2.0:1787191342.064660:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdb:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191342.064664:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1787191342.064668:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1787191342.064676:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:2.0:1787191342.064680:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1787191342.064696:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:2.0:1787191342.064710:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1787191342.064714:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1530, osc lock ffff936b44e63430, flags 0x0 00010000:00010000:2.0:1787191342.064732:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.064745:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.064759:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.064767:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.064773:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191342.064782:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:2.0:1787191342.064791:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191342.065521:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:2.0:1787191342.065536:0:57570:0:(rw26.c:927:ll_write_end()) page@00000000c2912ee6[3 0000000068f03f4d 2 1 000000002f7fd0b4 0 0 0] 00000080:00200000:2.0:1787191342.065540:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @00000000e337f84f 17ffffc0001001 3:0 ffff936b43a1e700 0 lru 00000080:00200000:2.0:1787191342.065548:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@000000000d61ba3b 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000ef00a996 00000000a27deffe > 3< 0 0 > 4< 0 0 8 484610048 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1787191342.065551:0:57570:0:(rw26.c:927:ll_write_end()) end page@00000000c2912ee6 00000080:00200000:2.0:1787191342.065552:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:2.0:1787191342.065558:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:2.0:1787191342.065579:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 00000000e08ab444 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191342.065608:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b5396b3f8, count 1, dirtied 1 00000080:00200000:2.0:1787191342.065614:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:2.0:1787191342.065617:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:2.0:1787191342.065632:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894d58 (ffff936b47a175a8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191342.065635:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894d58 (ffff936b47a175a8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.065638:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1530 (ffff936b47a17248/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191342.065643:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.065652:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:2.0:1787191342.065665:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894d58 (ffff936b47a175a8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191342.065668:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1530 (ffff936b47a175a8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191342.065677:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:2.0:1787191342.065682:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1787191342.065689:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdb:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191342.065693:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:2.0:1787191342.065699:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xdb:0x0] updating i_size 5 i_blocks 0 00000080:00200000:2.0:1787191342.065703:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:2.0:1787191342.065724:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xdb:0x0](ffff936b5396b248), flags 100001 00000002:00100000:2.0:1787191342.065788:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513b8a80 x1874004626767744/t8589937045(8589937045) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191342.065799:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191342.065804:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9c00 x1874004626771456/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191342.065829:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626771456:192.168.202.101@tcp:35:bash.0 00000100:00100000:2.0:1787191342.065932:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191342.071905:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626771456:192.168.202.101@tcp:35:bash.0 00000002:00100000:3.0:1787191342.071938:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513b8a80 x1874004626767744/t8589937045(8589937045) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191342.075237:0:57934:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191342.075272:0:57934:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.075290:0:57934:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.075309:0:57934:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.075317:0:57934:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191342.075326:0:57934:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191342.075331:0:57934:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191342.075340:0:57934:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422a3b58 00010000:00010000:2.0:1787191342.075345:0:57934:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.075354:0:57934:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.075370:0:57934:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.075378:0:57934:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191342.075385:0:57934:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.075389:0:57934:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=8 00000080:00200008:2.0:1787191342.075395:0:57934:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xdb:0x0](ffff936b5396b248), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191342.075399:0:57934:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xdb:0x0](ffff936b5396b248),name=f70.sanity-flr 00000002:00010000:2.0:1787191342.075414:0:57934:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xdb:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.075421:0:57934:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a8e5 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606763 expref: -99 pid: 57932 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 1 00010000:00010000:2.0:1787191342.075430:0:57934:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a8e5 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606763 expref: -99 pid: 57932 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 1 00000080:00200000:2.0:1787191342.075437:0:57934:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191342.075442:0:57934:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xdb:0x0](ffff936b5396b248) 00000080:00010000:2.0:1787191342.075444:0:57934:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdb:0x0](ffff936b5396b248) for lock 0xe5129dc88483a8e5 00000080:00010000:2.0:1787191342.075449:0:57934:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a8e5 from it ffffa3fb422a3cb8 00010000:00010000:2.0:1787191342.075452:0:57934:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606763 expref: -99 pid: 57932 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 1 00010000:00010000:2.0:1787191342.075459:0:57934:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a8e5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606763 expref: -99 pid: 57932 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00000080:00200000:2.0:1787191342.075483:0:57934:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdb:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:2.0:1787191342.075497:0:57934:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdb:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191342.075501:0:57934:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191342.075504:0:57934:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xdb:0x0] 00000008:00010000:2.0:1787191342.075524:0:57934:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191342.075527:0:57934:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1530, osc lock ffff936b44e63430, flags 0x400000400001002 00010000:00010000:2.0:1787191342.075543:0:57934:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191342.075555:0:57934:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:2.0:1787191342.075572:0:57934:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191342.075576:0:57934:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191342.075583:0:57934:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:2.0:1787191342.075591:0:57934:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191342.075601:0:57934:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xdb:0x0] updating i_size 5 i_blocks 0 00000020:00010000:2.0:1787191342.075607:0:57934:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509b86f0 (ffff936b47a175a8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191342.075610:0:57934:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509b86f0 (ffff936b47a175a8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.075613:0:57934:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1530 (ffff936b47a17248/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.075617:0:57934:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509b86f0 (ffff936b47a175a8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191342.075620:0:57934:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1530 (ffff936b47a175a8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191342.075631:0:57934:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdb:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191342.075651:0:57934:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191342.075658:0:57934:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.075664:0:57934:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.075673:0:57934:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.075680:0:57934:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191342.075685:0:57934:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191342.075687:0:57934:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191342.075691:0:57934:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422a3c10 00010000:00010000:2.0:1787191342.075695:0:57934:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.075703:0:57934:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.075712:0:57934:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.075716:0:57934:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191342.075719:0:57934:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.075725:0:57934:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:2.0:1787191342.075730:0:57934:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:2.0:1787191342.075734:0:57934:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:2.0:1787191342.075764:0:57934:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a8d7 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdb:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4606724 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191342.075781:0:57934:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xdb:0x0]: losing layout lock 00010000:00010000:2.0:1787191342.075795:0:57934:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a8e5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4606763 expref: -99 pid: 57932 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00000080:00200000:2.0:1787191342.075802:0:57934:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xdb:0x0]: losing layout lock 00010000:00010000:2.0:1787191342.075811:0:57934:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483a8c9 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e46066ec expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.075881:0:57934:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a8d7 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xdb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606724 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191342.075889:0:57934:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a8e5 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606763 expref: -99 pid: 57932 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00010000:00010000:2.0:1787191342.075902:0:57934:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483a8c9 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46066ec expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.075908:0:57934:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:2.0:1787191342.075912:0:57934:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a8d7 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xdb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606724 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191342.075927:0:57934:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a8e5 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606763 expref: -99 pid: 57932 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00010000:00010000:2.0:1787191342.075936:0:57934:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483a8c9 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xdb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46066ec expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:2.0:1787191342.075957:0:57934:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1787191342.075971:0:57934:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb800 x1874004626771712/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787191342.075996:0:57934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57934:1874004626771712:192.168.202.101@tcp:36:rm.0 00000080:00200000:1.0:1787191342.076145:0:57933:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191342.076157:0:57933:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191342.076167:0:57933:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191342.076177:0:57933:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191342.076184:0:57933:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191342.076189:0:57933:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191342.076191:0:57933:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191342.076196:0:57933:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4228bbf8 00010000:00010000:1.0:1787191342.076199:0:57933:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191342.076207:0:57933:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191342.076217:0:57933:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191342.076221:0:57933:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191342.076225:0:57933:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:2.0:1787191342.076496:0:57934:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f300 going to sleep for 11 seconds 00000100:00100000:3.0:1787191342.082294:0:57934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57934:1874004626771712:192.168.202.101@tcp:36:rm.0 00000080:00200000:3.0:1787191342.082375:0:57934:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdb:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00020000:00200000:3.0:1787191342.082389:0:57934:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdb:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191342.082493:0:57934:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191342.082500:0:57934:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191342.082511:0:57934:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000008:00010000:3.0:1787191342.082531:0:57934:0:(osc_cache.c:1183:osc_extent_make_ready()) ### extent: 00000000e08ab444 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191342.082541:0:57933:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b589fb800, open_flags d900, mode 0 opened 0 00000080:00200000:1.0:1787191342.082552:0:57933:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000008:00010000:3.0:1787191342.082559:0:57934:0:(osc_cache.c:917:osc_extent_finish()) ### extent: 00000000e08ab444 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000002:00010000:1.0:1787191342.082583:0:57933:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00000008:00010000:3.0:1787191342.082584:0:57934:0:(osc_cache.c:497:__osc_extent_remove()) ### extent: 00000000e08ab444 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787191342.082614:0:57934:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdb:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:1.0:1787191342.082647:0:57933:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a8fa lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57933 initiator: MDT0 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1787191342.082649:0:57934:0:(llite_lib.c:2066:ll_clear_inode()) VFS Op:inode=[0x200000405:0xdb:0x0](ffff936b5396b248) 00010000:00010000:1.0:1787191342.082659:0:57933:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a8fa lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57933 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191342.082672:0:57933:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000008:00010000:3.0:1787191342.082674:0:57934:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 5 blocks 0 [cma]time 1787191342 1787191342 1787191341 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 1/0,0 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:1.0:1787191342.082682:0:57933:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453abb80 x1874004626771968/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191342.082696:0:57933:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a8fa lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57933 initiator: MDT0 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191342.082704:0:57934:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191342 1787191342 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483a8f3 lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606778 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1787191342.082719:0:57933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57933:1874004626771968:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191342.082965:0:57933:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893480 going to sleep for 11 seconds 00000100:00100000:3.0:1787191342.089532:0:57933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57933:1874004626771968:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191342.089559:0:57933:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a8fa lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.089574:0:57933:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a8fa lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.089580:0:57933:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a8fa lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.089588:0:57933:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a8fa lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.089598:0:57933:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a8fa lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.089604:0:57933:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030000 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191342.089608:0:57933:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a8fa lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.089615:0:57933:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a8fa lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.089622:0:57933:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a8fa lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.089629:0:57933:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191342.089636:0:57933:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a8fa lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.089643:0:57933:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a8fa lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57933 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191342.089671:0:57933:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x7, status=0 req@ffff936b453abb80 x1874004626771968/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/608 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191342.089686:0:57933:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191342.089954:0:57933:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191342.089970:0:57933:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191342.089981:0:57933:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191342.089992:0:57933:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191342.090000:0:57933:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191342.090005:0:57933:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191342.090010:0:57933:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191342.090016:0:57933:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4228bb58 00010000:00010000:3.0:1787191342.090028:0:57933:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191342.090036:0:57933:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191342.090051:0:57933:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191342.090058:0:57933:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191342.090064:0:57933:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191342.090547:0:57933:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=9 00000080:00200000:3.0:1787191342.090554:0:57933:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:3.0:1787191342.090569:0:57933:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1787191342.090617:0:57933:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a901 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.090626:0:57933:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a901 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.090635:0:57933:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a901 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57933 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191342.090662:0:57933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57933:1874004626772096:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191342.090749:0:57933:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787191342.096009:0:57933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57933:1874004626772096:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191342.096040:0:57933:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a901 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.096056:0:57933:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a901 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.096063:0:57933:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a901 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.096071:0:57933:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a901 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.096080:0:57933:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a901 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.096087:0:57933:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9a400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191342.096092:0:57933:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a901 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.096111:0:57933:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a901 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.096119:0:57933:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a901 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.096234:0:57933:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191342.096241:0:57933:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a901 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57933 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.096249:0:57933:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483a901 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57933 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191342.096273:0:57933:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b51d1c380 x1874004626772096/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191342.096289:0:57933:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191342.103443:0:57935:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191342.103473:0:57935:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.103489:0:57935:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.103505:0:57935:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.103519:0:57935:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191342.103527:0:57935:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191342.103531:0:57935:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191342.103538:0:57935:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4220bb58 00010000:00010000:2.0:1787191342.103542:0:57935:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.103551:0:57935:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.103566:0:57935:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.103573:0:57935:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:2.0:1787191342.103578:0:57935:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.103588:0:57935:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:2.0:1787191342.103592:0:57935:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191342.103603:0:57935:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191342.103652:0:57935:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483a908 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.103659:0:57935:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483a908 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.103668:0:57935:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483a908 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191342.103693:0:57935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57935:1874004626772224:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191342.104260:0:57935:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f300 going to sleep for 11 seconds 00000100:00100000:2.0:1787191342.107633:0:57935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57935:1874004626772224:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191342.107657:0:57935:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483a908 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.107672:0:57935:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483a908 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.107679:0:57935:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483a908 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.107687:0:57935:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483a908 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.107695:0:57935:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483a908 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.107701:0:57935:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51185000 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191342.107707:0:57935:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483a908 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.107714:0:57935:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483a908 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.107721:0:57935:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483a908 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.107729:0:57935:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191342.107735:0:57935:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483a908 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.107742:0:57935:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483a908 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191342.107767:0:57935:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513b9500 x1874004626772224/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191342.107780:0:57935:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191342.108006:0:57935:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191342.108032:0:57935:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.108043:0:57935:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.108055:0:57935:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.108061:0:57935:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191342.108068:0:57935:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191342.108071:0:57935:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191342.108076:0:57935:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4220bbe8 00010000:00010000:2.0:1787191342.108079:0:57935:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.108087:0:57935:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.108261:0:57935:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.108270:0:57935:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000080:00200000:2.0:1787191342.108275:0:57935:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.108287:0:57935:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:2.0:1787191342.108292:0:57935:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191342.108305:0:57935:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191342.108352:0:57935:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a90f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.108359:0:57935:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a90f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.108369:0:57935:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a90f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191342.108459:0:57935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57935:1874004626772352:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191342.108588:0:57935:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f300 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.111928:0:57935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57935:1874004626772352:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191342.111952:0:57935:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a90f lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.111966:0:57935:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a90f lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.111973:0:57935:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a90f lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.111984:0:57935:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a90f lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.111993:0:57935:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a90f lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.111999:0:57935:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51185800 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191342.112004:0:57935:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a90f lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.112010:0:57935:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a90f lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.112025:0:57935:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a90f lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.112033:0:57935:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191342.112039:0:57935:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a90f lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.112044:0:57935:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483a90f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.112066:0:57935:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513b9500 x1874004626772352/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191342.112081:0:57935:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191342.112296:0:57935:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191342.112312:0:57935:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.112323:0:57935:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.112336:0:57935:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.112344:0:57935:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191342.112349:0:57935:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191342.112353:0:57935:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191342.112358:0:57935:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4220bb58 00010000:00010000:0.0:1787191342.112361:0:57935:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.112369:0:57935:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.112385:0:57935:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.112403:0:57935:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:0.0:1787191342.112412:0:57935:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1787191342.112418:0:57935:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:0.0:1787191342.112430:0:57935:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.112438:0:57935:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 94 lru_type: 1 00010000:00010000:0.0:1787191342.112447:0:57935:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 94 lru_type: 1 00000002:00010000:0.0:1787191342.112456:0:57935:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.112493:0:57935:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a916 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.112500:0:57935:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a916 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.112510:0:57935:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a916 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.112531:0:57935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57935:1874004626772480:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191342.112875:0:57935:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.116484:0:57935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57935:1874004626772480:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191342.116512:0:57935:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a916 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46067f6 expref: -99 pid: 57935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.116525:0:57935:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a916 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46067f6 expref: -99 pid: 57935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.116537:0:57935:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a916 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46067f6 expref: -99 pid: 57935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.116548:0:57935:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a916 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46067f6 expref: -99 pid: 57935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.116560:0:57935:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a916 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46067f6 expref: -99 pid: 57935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.116568:0:57935:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a916 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46067f6 expref: -99 pid: 57935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.116580:0:57935:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a916 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46067f6 expref: -99 pid: 57935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.116592:0:57935:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b6a475500 x1874004626772480/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191342.116666:0:57936:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191342.116691:0:57936:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191342.116704:0:57936:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000002:00010000:0.0:1787191342.116708:0:57935:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a916 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46067f6 expref: -99 pid: 57935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.116716:0:57935:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:1.0:1787191342.116716:0:57936:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.116723:0:57935:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a916 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46067f6 expref: -99 pid: 57935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1787191342.116723:0:57936:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191342.116730:0:57936:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00010000:00010000:0.0:1787191342.116731:0:57935:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a916 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46067f6 expref: -99 pid: 57935 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00010000:1.0:1787191342.116734:0:57936:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191342.116739:0:57936:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422a3bf8 00010000:00010000:1.0:1787191342.116742:0:57936:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191342.116748:0:57936:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000002:00010000:0.0:1787191342.116756:0:57935:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00000080:00200000:1.0:1787191342.116756:0:57936:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00010000:00010000:0.0:1787191342.116764:0:57935:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 188 lru_type: 1 00000080:00200000:1.0:1787191342.116764:0:57936:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191342.116769:0:57936:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00010000:00010000:0.0:1787191342.116772:0:57935:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 188 lru_type: 1 00010000:00010000:0.0:1787191342.116779:0:57935:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 188 lru_type: 1 00000080:00200000:1.0:1787191342.116781:0:57936:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b43928480, open_flags d900, mode 0 opened 0 00010000:00010000:0.0:1787191342.116786:0:57935:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 189 lru_type: 1 00000080:00200000:1.0:1787191342.116787:0:57936:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000080:00200000:0.0:1787191342.116796:0:57935:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191342.116800:0:57935:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000002:00010000:1.0:1787191342.116800:0:57936:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00000080:00010000:0.0:1787191342.116803:0:57935:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:0.0:1787191342.116806:0:57935:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb4220bcb8 00010000:00010000:0.0:1787191342.116809:0:57935:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 94 lru_type: 1 00010000:00010000:0.0:1787191342.116815:0:57935:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 95 lru_type: 1 00000002:00010000:0.0:1787191342.116825:0:57935:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.117009:0:57935:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a916 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46067f6 expref: -99 pid: 57935 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.117030:0:57935:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a916 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46067f6 expref: -99 pid: 57935 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.117218:0:57936:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a91d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.117227:0:57936:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a91d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.117229:0:57935:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a916 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46067f6 expref: -99 pid: 57935 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.117236:0:57935:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a916 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46067f6 expref: -99 pid: 57935 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000020:00100000:1.0:1787191342.117239:0:57936:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000002:00010000:0.0:1787191342.117246:0:57935:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00000100:00100000:1.0:1787191342.117247:0:57936:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453abb80 x1874004626772736/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191342.117252:0:57935:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 189 lru_type: 1 00010000:00010000:1.0:1787191342.117256:0:57936:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a91d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.117266:0:57935:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 189 lru_type: 1 00010000:00010000:0.0:1787191342.117272:0:57935:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 189 lru_type: 1 00000100:00100000:1.0:1787191342.117278:0:57936:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57936:1874004626772736:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191342.117279:0:57935:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 190 lru_type: 1 00000100:00100000:1.0:1787191342.117465:0:57936:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191342.120707:0:57936:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57936:1874004626772736:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191342.120732:0:57936:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a91d lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.120746:0:57936:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a91d lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.120752:0:57936:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a91d lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.120759:0:57936:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a91d lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.120768:0:57936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a91d lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.120774:0:57936:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030e00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191342.120779:0:57936:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a91d lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.120786:0:57936:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a91d lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.120793:0:57936:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a91d lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.120799:0:57936:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191342.120806:0:57936:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a91d lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.120812:0:57936:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a91d lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57936 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191342.120852:0:57936:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x7, status=0 req@ffff936b453abb80 x1874004626772736/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/608 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191342.120874:0:57936:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1787191342.120902:0:57936:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a916 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46067f6 expref: -99 pid: 57935 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.120915:0:57936:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a916 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46067f6 expref: -99 pid: 57935 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:1.0:1787191342.120924:0:57936:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a916 from it ffffa3fb422a39a0 00010000:00010000:1.0:1787191342.120928:0:57936:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a916 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46067f6 expref: -99 pid: 57935 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.120935:0:57936:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a916 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46067f6 expref: -99 pid: 57935 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191342.121185:0:57936:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191342.121200:0:57936:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191342.121209:0:57936:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191342.121218:0:57936:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191342.121225:0:57936:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191342.121230:0:57936:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191342.121233:0:57936:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191342.121238:0:57936:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422a3b58 00010000:00010000:1.0:1787191342.121241:0:57936:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191342.121249:0:57936:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191342.121258:0:57936:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191342.121265:0:57936:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191342.121270:0:57936:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191342.121274:0:57936:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=9 00000080:00200008:0.0:1787191342.122502:0:57935:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1787191342.122509:0:57935:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191342.122522:0:57935:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.122532:0:57935:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.122543:0:57935:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.122549:0:57935:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191342.122555:0:57935:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191342.122557:0:57935:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191342.122562:0:57935:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4220bcb8 00010000:00010000:0.0:1787191342.122565:0:57935:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.122573:0:57935:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.122685:0:57935:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191342.122695:0:57935:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.122701:0:57935:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.122710:0:57935:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.122717:0:57935:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191342.122721:0:57935:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191342.122724:0:57935:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191342.122727:0:57935:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4220bb58 00010000:00010000:0.0:1787191342.122731:0:57935:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.122738:0:57935:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.122747:0:57935:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.122751:0:57935:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:0.0:1787191342.122755:0:57935:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.122758:0:57935:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=8 00000080:00200000:0.0:1787191342.122775:0:57935:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191342.122780:0:57935:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.122785:0:57935:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.122799:0:57935:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.122806:0:57935:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191342.122809:0:57935:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191342.122811:0:57935:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191342.122814:0:57935:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4220bbf8 00010000:00010000:0.0:1787191342.122817:0:57935:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.122824:0:57935:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.123048:0:57935:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.123052:0:57935:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191342.123056:0:57935:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.123061:0:57935:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:0.0:1787191342.123063:0:57935:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:0.0:1787191342.123068:0:57935:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b464a8d80, open_flags a141, mode 81b6 opened 0 00000080:00200000:0.0:1787191342.123077:0:57935:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:0.0:1787191342.123096:0:57935:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xdc:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:0.0:1787191342.123106:0:57935:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a916 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e46067f6 expref: -99 pid: 57935 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191342.123209:0:57935:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a916 lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46067f6 expref: -99 pid: 57935 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191342.123223:0:57935:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191342.123226:0:57935:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a916 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46067f6 expref: -99 pid: 57935 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191342.123256:0:57935:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a924 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.123263:0:57935:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a924 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191342.123273:0:57935:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191342.123284:0:57935:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475500 x1874004626772992/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191342.123294:0:57935:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a924 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.123315:0:57935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57935:1874004626772992:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191342.123628:0:57935:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.129422:0:57935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57935:1874004626772992:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191342.129454:0:57935:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a924 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606827 expref: -99 pid: 57935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.129482:0:57935:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a924 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606827 expref: -99 pid: 57935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.129491:0:57935:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a924 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606827 expref: -99 pid: 57935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.129508:0:57935:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a924 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606827 expref: -99 pid: 57935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.129519:0:57935:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a924 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606827 expref: -99 pid: 57935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.129532:0:57935:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a924 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606827 expref: -99 pid: 57935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.129540:0:57935:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a924 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606827 expref: -99 pid: 57935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.129547:0:57935:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a924 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606827 expref: -99 pid: 57935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.129558:0:57935:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b6a475500 x1874004626772992/t8589937056(8589937056) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191342.129572:0:57935:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475500 x1874004626772992/t8589937056(8589937056) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191342.129584:0:57935:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a924 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606827 expref: -99 pid: 57935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.129602:0:57935:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/220 (0 0) 00000080:00200000:0.0:1787191342.129609:0:57935:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191342.129622:0:57935:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:0.0:1787191342.129647:0:57935:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88) 00000080:00200000:0.0:1787191342.129654:0:57935:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xdc:0x0], updating i_size 0 00000080:00200000:0.0:1787191342.129685:0:57935:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xdc:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1787191342.129690:0:57935:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) 00000080:00010000:0.0:1787191342.129693:0:57935:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) for lock 0xe5129dc88483a924 00000080:00010000:0.0:1787191342.129703:0:57935:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) 00000080:00200008:0.0:1787191342.129715:0:57935:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xdc:0x0](ffff936b5396ba88), flags 120501 00000002:00100000:0.0:1787191342.129732:0:57935:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475500 x1874004626772992/t8589937056(8589937056) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191342.129761:0:57935:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a924 from it ffff936b530f52a0 00010000:00010000:0.0:1787191342.129766:0:57935:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a924 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606827 expref: -99 pid: 57935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.129774:0:57935:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a924 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606827 expref: -99 pid: 57935 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191342.129794:0:57935:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88), inode mode 81a4 mask 40 00000080:00200000:0.0:1787191342.129866:0:57935:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88), inode mode 81a4 mask 2 00000080:00200000:0.0:1787191342.129878:0:57935:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88), xattr lov 00000002:00010000:0.0:1787191342.129895:0:57935:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xdc:0x0]) in obj [0x200000405:0xdc:0x0], intent: open flags 040000002 00010000:00010000:0.0:1787191342.129938:0:57935:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a92b lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.129945:0:57935:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a92b lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191342.129953:0:57935:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191342.129959:0:57935:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474380 x1874004626773248/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191342.129973:0:57935:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a92b lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.129991:0:57935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57935:1874004626773248:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191342.130525:0:57935:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191342.134270:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191342.134363:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634919040 00000100:00100000:2.0:1787191342.134371:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634919040 00000100:00100000:2.0:1787191342.134517:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1436 00000100:00100000:2.0:1787191342.134529:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634919040:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191342.134548:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a924 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4606827 expref: -99 pid: 57935 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.134668:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191342.134677:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634919040:12345-192.168.202.101@tcp:104: Request processed in 150us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191342.134685:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1436 00010000:00010000:0.0:1787191342.134783:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191342.134791:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a924 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4606827 expref: -99 pid: 57935 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.134801:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b6a609c00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191342.134807:0:40929:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a924 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4606827 expref: -99 pid: 57935 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.134816:0:40929:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a924 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4606827 expref: -99 pid: 57935 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.134825:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a924 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4606827 expref: -99 pid: 57935 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191342.136258:0:40929:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xdc:0x0]: losing layout lock 00010000:00010000:0.0:1787191342.136326:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a924 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4606827 expref: -99 pid: 57935 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.136335:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191342.136366:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a924 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4606827 expref: -99 pid: 57935 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.136374:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a924 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4606827 expref: -99 pid: 57935 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.136392:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191342.136394:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191342.136396:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191342.136418:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626773376:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191342.141166:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626773376:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00200000:1.0:1787191342.141802:0:57937:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191342.141825:0:57937:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191342.141857:0:57937:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191342.141874:0:57937:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191342.141882:0:57937:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191342.141891:0:57937:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191342.141895:0:57937:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191342.141903:0:57937:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422d3bf8 00010000:00010000:1.0:1787191342.141908:0:57937:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191342.141917:0:57937:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191342.141932:0:57937:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191342.141940:0:57937:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191342.141947:0:57937:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191342.141961:0:57937:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b5233c300, open_flags d900, mode 0 opened 0 00000080:00200000:1.0:1787191342.141967:0:57937:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:1.0:1787191342.141982:0:57937:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:1.0:1787191342.142049:0:57937:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a932 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.142058:0:57937:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a932 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57937 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.142067:0:57935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57935:1874004626773248:192.168.202.101@tcp:101:lfs.0 00000020:00100000:1.0:1787191342.142069:0:57937:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:1.0:1787191342.142077:0:57937:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453abb80 x1874004626773632/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191342.142080:0:57935:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a92b lrc: 4/1,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.142086:0:57937:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a932 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.142090:0:57935:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a92b lrc: 4/1,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.142095:0:57935:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a92b lrc: 4/1,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191342.142106:0:57937:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57937:1874004626773632:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191342.142223:0:57935:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a92b lrc: 3/0,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.142233:0:57935:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a92b lrc: 4/0,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.142239:0:57935:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b6a608800 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191342.142244:0:57935:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a92b lrc: 4/0,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.142250:0:57935:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a92b lrc: 4/0,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.142261:0:57935:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a92b lrc: 5/0,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.142268:0:57935:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191342.142275:0:57935:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a92b lrc: 3/0,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.142282:0:57935:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a92b lrc: 0/0,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57935 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.142305:0:57935:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b6a474380 x1874004626773248/t8589937057(8589937057) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191342.142318:0:57935:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474380 x1874004626773248/t8589937057(8589937057) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191342.142331:0:57935:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xdc:0x0] suppgids 0 0: rc 0 00000100:00100000:1.0:1787191342.142554:0:57937:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00000080:00200000:0.0:1787191342.143429:0:57935:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdc:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1787191342.143441:0:57935:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdc:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191342.143501:0:57935:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xdc:0x0], updating i_size 0 00000002:00100000:0.0:1787191342.143529:0:57935:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474380 x1874004626773248/t8589937057(8589937057) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191342.143565:0:57935:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a474380 x1874004626773248/t8589937057(8589937057) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191342.143575:0:57935:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191342.143580:0:57935:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477800 x1874004626773888/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191342.143608:0:57935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57935:1874004626773888:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191342.143669:0:57935:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191342.147909:0:57937:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57937:1874004626773632:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191342.147937:0:57937:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a932 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460685f expref: -99 pid: 57937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.147966:0:57937:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a932 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460685f expref: -99 pid: 57937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.147974:0:57937:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a932 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460685f expref: -99 pid: 57937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.147991:0:57937:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a932 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460685f expref: -99 pid: 57937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.148002:0:57937:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a932 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460685f expref: -99 pid: 57937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.148015:0:57937:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a932 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460685f expref: -99 pid: 57937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.148036:0:57937:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a932 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460685f expref: -99 pid: 57937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.148044:0:57937:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a932 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460685f expref: -99 pid: 57937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191342.148056:0:57937:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b453abb80 x1874004626773632/t8589937058(8589937058) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191342.148069:0:57937:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453abb80 x1874004626773632/t8589937058(8589937058) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191342.148082:0:57937:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a932 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460685f expref: -99 pid: 57937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191342.148096:0:57937:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a932 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460685f expref: -99 pid: 57937 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.148115:0:57937:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/220 (0 0) 00000080:00200000:1.0:1787191342.148122:0:57937:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191342.148175:0:57937:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xdc:0x0](ffff936b5396ba88): rc = 0 00000080:00200000:1.0:1787191342.148191:0:57937:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xdc:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:1.0:1787191342.148196:0:57937:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) for lock 0xe5129dc88483a932 00000080:00010000:1.0:1787191342.148211:0:57937:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) 00000080:00200008:1.0:1787191342.148225:0:57937:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xdc:0x0](ffff936b5396ba88), flags 154400 00000002:00100000:1.0:1787191342.148249:0:57937:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453abb80 x1874004626773632/t8589937058(8589937058) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191342.148318:0:57937:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a932 from it ffff936b5339fd80 00010000:00010000:1.0:1787191342.148323:0:57937:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a932 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460685f expref: -99 pid: 57937 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.148334:0:57937:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a932 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460685f expref: -99 pid: 57937 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191342.148371:0:57937:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88), inode mode 81a4 mask 44 00000080:00200000:1.0:1787191342.148481:0:57937:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88), inode mode 81a4 mask 4 00000080:00200000:1.0:1787191342.148489:0:57937:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88), xattr lov 00000080:00200008:1.0:1787191342.148525:0:57937:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xdc:0x0](ffff936b5396ba88), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191342.148531:0:57937:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88),name=f70.sanity-flr 00000002:00010000:1.0:1787191342.148550:0:57937:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xdc:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191342.148560:0:57937:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a932 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460685f expref: -99 pid: 57937 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.148572:0:57937:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a932 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460685f expref: -99 pid: 57937 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191342.148597:0:57937:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191342.148603:0:57937:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) 00000080:00010000:1.0:1787191342.148606:0:57937:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) for lock 0xe5129dc88483a932 00000080:00010000:1.0:1787191342.148610:0:57937:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a932 from it ffffa3fb422d3cd8 00010000:00010000:1.0:1787191342.148613:0:57937:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a932 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460685f expref: -99 pid: 57937 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.148621:0:57937:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a932 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460685f expref: -99 pid: 57937 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191342.148639:0:57937:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdc:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:1.0:1787191342.148650:0:57937:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdc:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191342.148654:0:57937:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191342.148657:0:57937:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xdc:0x0] 00000008:00010000:1.0:1787191342.148676:0:57937:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191342.148679:0:57937:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b47d7d2b0, osc lock ffff936b46836be0, flags 0x400000400001002 00010000:00010000:1.0:1787191342.148727:0:57937:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a939 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57937 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.148737:0:57937:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a939 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57937 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.148748:0:57937:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b453aa680 x1874004626774016/t0(0) o101->lustre-OST0000-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:1.0:1787191342.148789:0:57937:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:0.0:1787191342.148818:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626774016:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191342.153003:0:57935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57935:1874004626773888:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191342.153054:0:57935:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a474380 x1874004626773248/t8589937057(8589937057) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1787191342.153116:0:57935:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xdc:0x0](ffff936b5396ba88), flags 100001 00000002:00100000:0.0:1787191342.153168:0:57935:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a475500 x1874004626772992/t8589937056(8589937056) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191342.153180:0:57935:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191342.153185:0:57935:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474a80 x1874004626774272/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191342.153205:0:57935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57935:1874004626774272:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191342.153282:0:57935:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787191342.153628:0:2389:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a939 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57937 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.153646:0:2389:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a939 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e460686d expref: -99 pid: 57937 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.153660:0:2389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a939 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460686d expref: -99 pid: 57937 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.153673:0:2389:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a939 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e460686d expref: -99 pid: 57937 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191342.153694:0:2389:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a939 lrc: 5/2,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460686d expref: -99 pid: 57937 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1787191342.153707:0:2389:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1787191342.153726:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a939 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460686d expref: -99 pid: 57937 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.153735:0:2389:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a939 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460686d expref: -99 pid: 57937 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.153744:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a939 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460686d expref: -99 pid: 57937 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.153752:0:2389:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a939 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460686d expref: -99 pid: 57937 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1787191342.153772:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626774016:192.168.202.101@tcp:101:lfs.0 00000080:00200000:1.0:1787191342.153872:0:57937:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xdc:0x0] updating i_size 0 i_blocks 0 00000020:00010000:1.0:1787191342.153878:0:57937:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51656e40 (ffff936b465cc998/0) at cl_lock_release():245 00000020:00010000:1.0:1787191342.153882:0:57937:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51656e40 (ffff936b465cc998/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191342.153886:0:57937:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7d2b0 (ffff936b47a17128/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191342.153891:0:57937:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51656e40 (ffff936b465cc998/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191342.153894:0:57937:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7d2b0 (ffff936b465cc998/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191342.153907:0:57937:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdc:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1787191342.153957:0:57937:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xdc:0x0](ffff936b5396ba88), flags 154000 00000002:00100000:1.0:1787191342.153988:0:57937:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453abb80 x1874004626773632/t8589937058(8589937058) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191342.153997:0:57937:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:1.0:1787191342.154001:0:57937:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8a80 x1874004626774528/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191342.154016:0:57937:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57937:1874004626774528:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191342.154071:0:57937:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.157280:0:57935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57935:1874004626774272:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191342.157327:0:57935:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a475500 x1874004626772992/t8589937056(8589937056) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787191342.157723:0:57937:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57937:1874004626774528:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191342.157738:0:57937:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453abb80 x1874004626773632/t8589937058(8589937058) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191342.157913:0:57937:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191342.157933:0:57937:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191342.157950:0:57937:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191342.157960:0:57937:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191342.157965:0:57937:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191342.157970:0:57937:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191342.157973:0:57937:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191342.157979:0:57937:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422d3bf8 00010000:00010000:1.0:1787191342.157982:0:57937:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191342.157989:0:57937:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191342.158000:0:57937:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191342.158005:0:57937:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191342.158009:0:57937:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191342.158011:0:57937:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:1.0:1787191342.158015:0:57937:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88), inode mode 81a4 mask 44 00000080:00200008:1.0:1787191342.158031:0:57937:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xdc:0x0](ffff936b5396ba88), flags 154400 00000002:00010000:1.0:1787191342.158043:0:57937:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xdc:0x0]) in obj [0x200000405:0xdc:0x0], intent: open flags 0104240114401 00010000:00010000:1.0:1787191342.158082:0:57937:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a940 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.158086:0:57937:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a940 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57937 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191342.158095:0:57937:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191342.158099:0:57937:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8a80 x1874004626774784/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191342.158107:0:57937:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a940 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57937 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191342.158126:0:57937:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57937:1874004626774784:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191342.158276:0:57937:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00000080:00200000:1.0:1787191342.160772:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191342.160799:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191342.160815:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191342.160828:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191342.160870:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191342.160878:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191342.160882:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191342.160889:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:1.0:1787191342.160893:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191342.160902:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191342.160917:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191342.160924:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191342.160929:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191342.160935:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:1.0:1787191342.160941:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88), inode mode 81a4 mask 42 00000080:00200008:1.0:1787191342.160947:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xdc:0x0](ffff936b5396ba88), flags 101101 00000002:00010000:1.0:1787191342.160962:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xdc:0x0]) in obj [0x200000405:0xdc:0x0], intent: open|creat flags 04240101102 00010000:00010000:1.0:1787191342.160974:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a932 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e460685f expref: -99 pid: 57937 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191342.160997:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xdc:0x0]: losing layout lock 00010000:00010000:1.0:1787191342.161050:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a932 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460685f expref: -99 pid: 57937 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.161057:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191342.161061:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030600/0xe5129dc88483a932 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460685f expref: -99 pid: 57937 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.161086:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a947 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xdc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.161094:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a947 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xdc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191342.161104:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:1.0:1787191342.161116:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453abb80 x1874004626775040/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191342.161125:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a947 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xdc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191342.161145:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626775040:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191342.161357:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628939c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191342.163326:0:57937:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57937:1874004626774784:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191342.163351:0:57937:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a940 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460687b expref: -99 pid: 57937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.163366:0:57937:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a940 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460687b expref: -99 pid: 57937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.163378:0:57937:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a940 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460687b expref: -99 pid: 57937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191342.163713:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626775040:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191342.163724:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a947 lrc: 4/0,1 mode: --/CW res: [0x200000405:0xdc:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606890 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.163734:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a947 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xdc:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606890 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.163742:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a947 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xdc:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606890 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191342.163752:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x200002b, status=0 req@ffff936b453abb80 x1874004626775040/t8589937063(8589937063) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191342.163764:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453abb80 x1874004626775040/t8589937063(8589937063) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191342.163778:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a947 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xdc:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606890 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191342.163789:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a947 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xdc:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606890 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.163798:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 8 res 8589935621/220 (0 0) 00000080:00200000:3.0:1787191342.163804:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000405:0xdc:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1787191342.163953:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xdc:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:3.0:1787191342.163959:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) for lock 0xe5129dc88483a947 00000080:00010000:3.0:1787191342.163965:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a947 from it ffffa3fb41cabbf0 00010000:00010000:3.0:1787191342.163969:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a947 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xdc:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606890 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.163978:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a947 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xdc:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606890 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000002:00100000:3.0:1787191342.164005:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453abb80 x1874004626775040/t8589937063(8589937063) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191342.164076:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xdc:0x0], intent: getxattr flags 0 00010000:00010000:3.0:1787191342.164113:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a94e lrc: 3/1,0 mode: --/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.164179:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a94e lrc: 3/1,0 mode: --/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.164191:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a94e lrc: 3/1,0 mode: --/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191342.164210:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626775168:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191342.164276:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cd80 going to sleep for 11 seconds 00000002:00100000:1.0:1787191342.164590:0:57937:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x200002b, status=0 req@ffff936b453a8a80 x1874004626774784/t8589937062(8589937062) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191342.164609:0:57937:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8a80 x1874004626774784/t8589937062(8589937062) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191342.164620:0:57937:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a940 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460687b expref: -99 pid: 57937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191342.164648:0:57937:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a940 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460687b expref: -99 pid: 57937 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.164657:0:57937:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/220 (0 0) 00000080:00200000:1.0:1787191342.164661:0:57937:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xdc:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787191342.164693:0:57937:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xdc:0x0]: layout version change: 3 -> 3 00000080:00010000:1.0:1787191342.164697:0:57937:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) for lock 0xe5129dc88483a940 00000080:00010000:1.0:1787191342.164702:0:57937:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a940 from it ffffa3fb422d3bf0 00010000:00010000:1.0:1787191342.164706:0:57937:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a940 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460687b expref: -99 pid: 57937 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.164715:0:57937:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a940 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460687b expref: -99 pid: 57937 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000002:00100000:1.0:1787191342.164733:0:57937:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8a80 x1874004626774784/t8589937062(8589937062) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787191342.166487:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626775168:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191342.166509:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a94e lrc: 4/1,0 mode: --/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46068a5 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.166523:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a94e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46068a5 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.166533:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a94e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46068a5 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191342.166547:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b51d1c700 x1874004626775168/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191342.166557:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a94e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46068a5 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.166566:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/220 (0 0) 00000080:00200000:3.0:1787191342.166571:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xdc:0x0] suppgids 0 -1: rc 0 00000080:00010000:3.0:1787191342.166592:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) for lock 0xe5129dc88483a94e 00000080:00010000:3.0:1787191342.166599:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a94e from it ffffa3fb41caba38 00010000:00010000:3.0:1787191342.166603:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a94e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46068a5 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.166612:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a94e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46068a5 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:3.0:1787191342.166645:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xdc:0x0](ffff936b5396ba88) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191342.000000000, mtime 1787191342.000000000, ctime 1787191342.000000000 00010000:00010000:3.0:1787191342.166671:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a947 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xdc:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4606890 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191342.166692:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a940 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460687b expref: -99 pid: 57937 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191342.166724:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a947 lrc: 1/0,0 mode: --/CW res: [0x200000405:0xdc:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606890 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191342.166731:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191342.166734:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483a947 lrc: 0/0,0 mode: --/CW res: [0x200000405:0xdc:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606890 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:3.0:1787191342.166752:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1787191342.166758:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1c700 x1874004626775424/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191342.166775:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626775424:192.168.202.101@tcp:36:bash.0 00000100:00100000:3.0:1787191342.166957:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cd80 going to sleep for 11 seconds 00000080:00200000:1.0:1787191342.167081:0:57937:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88), inode mode 81a4 mask 4 00000080:00200000:1.0:1787191342.167090:0:57937:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88), xattr lov 00000080:00200008:0.0:1787191342.167179:0:57937:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xdc:0x0](ffff936b5396ba88), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191342.167188:0:57937:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88),name=f70.sanity-flr 00000002:00010000:0.0:1787191342.167199:0:57937:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xdc:0x0]) in obj [0x200000405:0xdc:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.167206:0:57937:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 30 res 8589935621/220 (0 0) 00010000:00010000:0.0:1787191342.167233:0:57937:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a955 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.167241:0:57937:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a955 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.167249:0:57937:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a955 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57937 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.167261:0:57937:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57937:1874004626775552:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191342.167289:0:57937:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191342.173938:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626775424:192.168.202.101@tcp:36:bash.0 00000080:00200000:3.0:1787191342.173989:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:3.0:1787191342.173996:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdc:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:3.0:1787191342.174007:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xdc:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:3.0:1787191342.174012:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdc:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191342.174028:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xdc:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:3.0:1787191342.174037:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xdc:0x0](ffff936b5396ba88) 00000002:00010000:3.0:1787191342.174051:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xdc:0x0]) in obj [0x200000405:0xdc:0x0], intent: layout flags 02 00010000:00010000:3.0:1787191342.174067:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a940 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e460687b expref: -99 pid: 57937 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191342.174084:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xdc:0x0]: losing layout lock 00010000:00010000:3.0:1787191342.174115:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a940 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460687b expref: -99 pid: 57937 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191342.174119:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191342.174122:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483a940 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460687b expref: -99 pid: 57937 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191342.174146:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483a95c lrc: 3/0,1 mode: --/EX res: [0x200000405:0xdc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.174153:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483a95c lrc: 3/0,1 mode: --/EX res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191342.174163:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191342.174170:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1ca80 x1874004626775808/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191342.174180:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483a95c lrc: 3/0,1 mode: --/EX res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191342.174195:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ca80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626775808:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191342.174260:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787191342.176890:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191342.176999:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634919168 00000100:00100000:2.0:1787191342.177007:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634919168 00000100:00100000:2.0:1787191342.177064:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1437 00000100:00100000:2.0:1787191342.177075:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634919168:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191342.177095:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a955 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e46068ba expref: -99 pid: 57937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.177171:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191342.177178:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634919168:12345-192.168.202.101@tcp:104: Request processed in 105us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191342.177186:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1437 00000100:00100000:1.0:1787191342.177889:0:57937:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57937:1874004626775552:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191342.177909:0:57937:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a955 lrc: 5/1,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e46068ba expref: -99 pid: 57937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.177919:0:57937:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a955 lrc: 5/1,0 mode: --/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e46068ba expref: -99 pid: 57937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.177931:0:57937:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a955 lrc: 5/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10400000000000 nid: local remote: 0x7130d520e46068ba expref: -99 pid: 57937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.177942:0:57937:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a955 lrc: 5/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e46068ba expref: -99 pid: 57937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.177953:0:57937:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a955 lrc: 6/2,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10400000000000 nid: local remote: 0x7130d520e46068ba expref: -99 pid: 57937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.177961:0:57937:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a955 lrc: 6/2,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10400000000000 nid: local remote: 0x7130d520e46068ba expref: -99 pid: 57937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.177969:0:57937:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a955 lrc: 5/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10400000000000 nid: local remote: 0x7130d520e46068ba expref: -99 pid: 57937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191342.177981:0:57937:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b6a475f80 x1874004626775552/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/976 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191342.177999:0:57937:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a955 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e46068ba expref: -99 pid: 57937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191342.178011:0:57937:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a955 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e46068ba expref: -99 pid: 57937 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.178237:0:57937:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/220 (0 0) 00000080:00200000:1.0:1787191342.178245:0:57937:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xdc:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787191342.178302:0:57937:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xdc:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:1.0:1787191342.178307:0:57937:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) for lock 0xe5129dc88483a955 00000080:00010000:1.0:1787191342.178313:0:57937:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) 00000080:00010000:1.0:1787191342.178316:0:57937:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a955 from it ffffa3fb422d3cd8 00010000:00010000:1.0:1787191342.178320:0:57937:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a955 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10420000000000 nid: local remote: 0x7130d520e46068ba expref: -99 pid: 57937 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.178328:0:57937:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a955 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10420000000000 nid: local remote: 0x7130d520e46068ba expref: -99 pid: 57937 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1787191342.178720:0:57937:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdc:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:1.0:1787191342.178732:0:57937:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdc:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191342.178735:0:57937:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191342.178738:0:57937:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xdc:0x0] 00000008:00010000:1.0:1787191342.178757:0:57937:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191342.178760:0:57937:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b47d7d2b0, osc lock ffff936b46836be0, flags 0x400000400001002 00010000:00010000:1.0:1787191342.178776:0:57937:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a939 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460686d expref: -99 pid: 57937 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.178794:0:57937:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a939 lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460686d expref: -99 pid: 57937 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1787191342.178807:0:57937:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191342.178810:0:57937:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a939 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460686d expref: -99 pid: 57937 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.178819:0:57937:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a939 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460686d expref: -99 pid: 57937 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1787191342.178938:0:57937:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191342.178948:0:57937:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xdc:0x0] updating i_size 0 i_blocks 0 00000020:00010000:1.0:1787191342.178952:0:57937:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509bb9d0 (ffff936b47a17128/0) at cl_lock_release():245 00000020:00010000:1.0:1787191342.178955:0:57937:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509bb9d0 (ffff936b47a17128/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191342.178958:0:57937:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47d7d2b0 (ffff936b465cca28/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191342.178962:0:57937:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509bb9d0 (ffff936b47a17128/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191342.178965:0:57937:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47d7d2b0 (ffff936b47a17128/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191342.178975:0:57937:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdc:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1787191342.179012:0:57937:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xdc:0x0](ffff936b5396ba88), flags 154000 00000002:00100000:1.0:1787191342.179066:0:57937:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a8a80 x1874004626774784/t8589937062(8589937062) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191342.179076:0:57937:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:1.0:1787191342.179081:0:57937:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453ab480 x1874004626776064/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191342.179100:0:57937:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57937:1874004626776064:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191342.179268:0:57937:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787191342.180043:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191342.180052:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a955 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46068ba expref: -99 pid: 57937 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.180062:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b6a608800 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191342.180067:0:40930:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a955 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46068ba expref: -99 pid: 57937 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.180075:0:40930:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a955 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46068ba expref: -99 pid: 57937 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.180083:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a955 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e46068ba expref: -99 pid: 57937 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1787191342.180097:0:40930:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xdc:0x0]: losing layout lock 00010000:00010000:0.0:1787191342.180199:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a955 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46068ba expref: -99 pid: 57937 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.180210:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787191342.180262:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626776192:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787191342.180508:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a955 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46068ba expref: -99 pid: 57937 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.180517:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608800/0xe5129dc88483a955 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46068ba expref: -99 pid: 57937 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.180534:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191342.180535:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191342.180537:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191342.183159:0:57937:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57937:1874004626776064:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191342.183198:0:57937:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a8a80 x1874004626774784/t8589937062(8589937062) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191342.183324:0:57937:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191342.183344:0:57937:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191342.183360:0:57937:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191342.183373:0:57937:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191342.183381:0:57937:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191342.183387:0:57937:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191342.183390:0:57937:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191342.183396:0:57937:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422d3bf8 00010000:00010000:1.0:1787191342.183400:0:57937:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191342.183408:0:57937:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191342.183423:0:57937:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191342.183430:0:57937:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191342.183436:0:57937:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191342.183450:0:57937:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b5233d200, open_flags d902, mode 0 opened 0 00000080:00200000:1.0:1787191342.183456:0:57937:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:1.0:1787191342.183471:0:57937:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154403 00010000:00010000:1.0:1787191342.183573:0:57937:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a963 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.183593:0:57937:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a963 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57937 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191342.183605:0:57937:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:0.0:1787191342.184055:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626776192:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191342.184266:0:57937:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453ab480 x1874004626776448/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191342.184276:0:57937:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a963 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57937 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191342.184294:0:57937:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57937:1874004626776448:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191342.184597:0:57937:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191342.189069:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191342.189111:0:51131:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787191342.189138:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634919808 00000100:00100000:2.0:1787191342.189147:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634919808 00000100:00100000:2.0:1787191342.189204:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1438 00000100:00100000:2.0:1787191342.189214:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b4121c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8422:x1874004634919808:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191342.189232:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080030000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191342.189306:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191342.189313:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b4121c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8422:x1874004634919808:12345-192.168.202.101@tcp:104: Request processed in 102us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191342.189320:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1438 00010000:00010000:0.0:1787191342.189772:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191342.189781:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080030000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191342.189790:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51fe1e00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191342.189796:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428480030000 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191342.189943:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480030020 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191342.189952:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191342.189972:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480030020 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191342.189987:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a8de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480030020 nid: local remote: 0x7130d520e4606747 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191342.190005:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191342.190007:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191342.190009:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191342.190036:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626776576:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191342.190193:0:57937:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57937:1874004626776448:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191342.190207:0:57937:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a963 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.190216:0:57937:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a963 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.190222:0:57937:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a963 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.190229:0:57937:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a963 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.190239:0:57937:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a963 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.190244:0:57937:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40031a00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191342.190248:0:57937:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a963 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.190255:0:57937:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a963 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.190261:0:57937:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a963 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.190267:0:57937:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191342.190271:0:57937:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a963 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.190276:0:57937:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a963 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57937 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191342.190296:0:57937:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b453ab480 x1874004626776448/t8589937068(8589937068) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191342.190309:0:57937:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453ab480 x1874004626776448/t8589937068(8589937068) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191342.190324:0:57937:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191342.190368:0:57937:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdc:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1787191342.190378:0:57937:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdc:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191342.190381:0:57937:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191342.190386:0:57937:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191342.190421:0:57937:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191342.190439:0:57937:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdc:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:1.0:1787191342.190454:0:57937:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a939 lrc: 1/0,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460686d expref: -99 pid: 57937 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191342.190531:0:57937:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xdc:0x0](ffff936b5396ba88): rc = 0 00000080:00010000:1.0:1787191342.190536:0:57937:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) for lock 0x0 00000080:00200008:1.0:1787191342.190560:0:57937:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xdc:0x0](ffff936b5396ba88), flags 154402 00000002:00100000:1.0:1787191342.190580:0:57937:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453ab480 x1874004626776448/t8589937068(8589937068) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191342.190610:0:57937:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453ab480 x1874004626776448/t8589937068(8589937068) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191342.190620:0:57937:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:1.0:1787191342.190625:0:57937:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8a80 x1874004626776832/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191342.190641:0:57937:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57937:1874004626776832:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191342.190676:0:57937:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191342.191257:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191342.191333:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634920448 00000100:00100000:2.0:1787191342.191340:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634920448 00000100:00100000:2.0:1787191342.191380:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1439 00000100:00100000:2.0:1787191342.191388:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30510:x1874004634920448:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191342.191495:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483a8f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4606778 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.191608:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191342.191615:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30510:x1874004634920448:12345-192.168.202.101@tcp:104: Request processed in 227us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191342.191622:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1439 00000100:00100000:1.0:1787191342.191726:0:57570:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589937067 gen 1 00000100:00100000:1.0:1787191342.191795:0:57570:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b453abb80 x1874004626775040/t8589937063(8589937063) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787191342.191810:0:57570:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff936b453ab480 x1874004626776448/t8589937068(8589937068) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787191342.191820:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ca80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626775808:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191342.191858:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483a95c lrc: 4/0,1 mode: --/EX res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46068c8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.191868:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483a95c lrc: 4/0,1 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46068c8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.191880:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483a95c lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46068c8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.191891:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483a95c lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46068c8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.191902:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483a95c lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46068c8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.191910:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483a95c lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46068c8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.191917:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483a95c lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46068c8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191342.191927:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b51d1ca80 x1874004626775808/t8589937067(8589937067) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191342.191942:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483a95c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46068c8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191342.191951:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483a95c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46068c8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.191966:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/220 (0 0) 00000080:00200000:1.0:1787191342.191971:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xdc:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191342.191980:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) for lock 0xe5129dc88483a95c 00000080:00010000:1.0:1787191342.191987:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a95c from it ffffa3fb41cab930 00010000:00010000:1.0:1787191342.191990:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483a95c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46068c8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.191999:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483a95c lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46068c8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191342.192014:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:1.0:1787191342.192030:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdc:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:1.0:1787191342.192041:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483a95c lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46068c8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.192052:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483a95c lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46068c8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:1.0:1787191342.192062:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xdc:0x0](0000000030f058e9) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483a95c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46068c8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191342.192095:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xdc:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:1.0:1787191342.192100:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483a95c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46068c8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.192108:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483a95c lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46068c8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:1.0:1787191342.192138:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xdc:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:1.0:1787191342.192143:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdc:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191342.192146:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191342.192153:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191342.192170:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191342.192173:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:1.0:1787191342.192185:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:1.0:1787191342.192189:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b628931b0, osc lock ffff936b46836be0, flags 0x80000000 00000008:00010000:1.0:1787191342.192193:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:1.0:1787191342.192195:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b628931f0, osc lock ffff936b46837430, flags 0x80000000 00010000:00010000:1.0:1787191342.192205:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b52377800 type 11 mode 2 res 10737419265/464 (0 1048575) 00010000:00010000:1.0:1787191342.192233:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.192241:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.192251:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191342.192266:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626776960:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191342.192313:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893000 going to sleep for 11 seconds 00010000:00010000:0.0:1787191342.194446:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191342.194459:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483a8f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4606778 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.194472:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51fe0a00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191342.194480:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483a8f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4606778 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.194539:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483a8f3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4606778 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.194547:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787191342.194598:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626777088:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787191342.194823:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483a8f3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4606778 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.194850:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483a8f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4606778 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.194875:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191342.194877:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191342.194878:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191342.196518:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626776576:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191342.197338:0:57937:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57937:1874004626776832:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191342.197371:0:57937:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453ab480 x1874004626776448/t8589937068(8589937068) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191342.197464:0:57937:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88), inode mode 81a4 mask 46 00000100:00100000:2.0:1787191342.202060:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000080:00200080:1.0:1787191342.202092:0:57937:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88) cmd=800466af arg=7ffe695feddc 00000080:00200080:1.0:1787191342.202123:0:57937:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88) cmd=80086601 arg=7ffe695fed78 00000100:00100000:1.0:1787191342.202176:0:57937:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57937:1874004626777216:192.168.202.101@tcp:33:lfs.0 00000100:00100000:1.0:1787191342.202259:0:57937:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191342.202691:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634920576 00000100:00100000:3.0:1787191342.202699:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634920576 00000100:00100000:3.0:1787191342.202804:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1440 00000100:00100000:3.0:1787191342.202814:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30353:x1874004634920576:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191342.202871:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a939 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e460686d expref: -99 pid: 57937 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191342.202932:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191342.202939:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30353:x1874004634920576:12345-192.168.202.101@tcp:104: Request processed in 127us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191342.202946:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1440 00010000:00010000:1.0:1787191342.204099:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191342.204109:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a939 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e460686d expref: -99 pid: 57937 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.204121:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030e00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191342.204128:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a939 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e460686d expref: -99 pid: 57937 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.204179:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a939 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e460686d expref: -99 pid: 57937 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.204187:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191342.204206:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a939 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e460686d expref: -99 pid: 57937 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.204213:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000044b621c4/0xe5129dc88483a939 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e460686d expref: -99 pid: 57937 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.204229:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191342.204231:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191342.204233:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191342.204462:0:57937:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57937:1874004626777216:192.168.202.101@tcp:33:lfs.0 00000080:00200080:1.0:1787191342.204499:0:57937:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88) cmd=c00c66f3 arg=7ffe695fed64 00000080:00200008:1.0:1787191342.204649:0:57937:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xdc:0x0](ffff936b5396ba88), flags 154002 00000100:00100000:2.0:1787191342.205217:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626776960:192.168.202.101@tcp:101:bash.0 00010000:00010000:2.0:1787191342.205236:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.205248:0:57570:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.205256:0:57570:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.205893:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626777088:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191342.205915:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787191342.205926:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626777344:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191342.208098:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191342.208137:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634920704 00000100:00100000:3.0:1787191342.208145:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634920704 00000100:00100000:3.0:1787191342.208189:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1441 00000100:00100000:3.0:1787191342.208199:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:6489:x1874004634920704:12345-192.168.202.101@tcp:105: 00010000:00010000:3.0:1787191342.208215:0:40922:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.208228:0:40922:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.208238:0:40922:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.208250:0:40922:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080080020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.208264:0:40922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080080020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.208274:0:40922:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80080020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.208309:0:40922:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b40030600) 00000100:00100000:3.0:1787191342.208372:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:6489:x1874004634920704:12345-192.168.202.101@tcp:105: Request processed in 175us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191342.208379:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1441 00010000:00010000:0.0:1787191342.208520:0:57570:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.208531:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.208545:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191342.208558:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.208569:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.208589:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.208655:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a971 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.208664:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a971 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.208674:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a971 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.208694:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626777472:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191342.208743:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99840 going to sleep for 11 seconds 00000080:00200000:1.0:1787191342.220519:0:57938:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191342.220548:0:57938:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191342.220563:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191342.220577:0:57938:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191342.220586:0:57938:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191342.220593:0:57938:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191342.220597:0:57938:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191342.220604:0:57938:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422dbbf8 00010000:00010000:1.0:1787191342.220608:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191342.220616:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191342.220632:0:57938:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191342.220639:0:57938:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000100:00100000:0.0:1787191342.220642:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626777344:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00200000:1.0:1787191342.220644:0:57938:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191342.220657:0:57938:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b49566a80, open_flags d900, mode 0 opened 0 00000080:00200000:1.0:1787191342.220663:0:57938:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:1.0:1787191342.220677:0:57938:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:1.0:1787191342.220728:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a978 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.220736:0:57938:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a978 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57938 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191342.220747:0:57938:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191342.220755:0:57938:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453ab480 x1874004626777728/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191342.220765:0:57938:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a978 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57938 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191342.220790:0:57938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626777728:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191342.220973:0:57938:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.221564:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626777472:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191342.221989:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a971 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606915 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.222009:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a971 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4606915 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.222031:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a971 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4606915 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.222045:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a971 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4606915 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191342.222063:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a971 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4606915 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.222074:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a971 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606915 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.222082:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a971 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606915 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.222184:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626777984:192.168.202.101@tcp:10:bash.0 00000100:00100000:0.0:1787191342.222250:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787191342.222257:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626777856:192.168.202.101@tcp:10:bash.0 00010000:00010000:3.0:1787191342.226000:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191342.226287:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626777856:192.168.202.101@tcp:10:bash.0 00000100:00100000:0.0:1787191342.226307:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626777984:192.168.202.101@tcp:10:bash.0 00000080:00200000:2.0:1787191342.226392:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xdc:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191342.226399:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894e48 (ffff936b47a17998/0) at cl_lock_release():245 00000020:00010000:2.0:1787191342.226402:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894e48 (ffff936b47a17998/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.226407:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b628931b0 (ffff936b47a17128/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191342.226417:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.226432:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191342.226451:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b628931f0 (ffff936b465cca28/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191342.226456:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a971 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606915 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.226464:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a971 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606915 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191342.226471:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894e48 (ffff936b47a17998/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191342.226474:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b628931b0 (ffff936b47a17998/1) at cl_lock_fini():72 00000020:00010000:2.0:1787191342.226479:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b628931f0 (ffff936b47a17998/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191342.226529:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdc:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191342.226551:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xdc:0x0](ffff936b5396ba88) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191342.000000000, mtime 1787191342.000000000, ctime 1787191342.000000000, rc 0 00000080:00200008:2.0:1787191342.226967:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xdc:0x0], ppos: 0, count: 5 00000080:00200000:2.0:1787191342.226980:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191342.226986:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:2.0:1787191342.226991:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:2.0:1787191342.226996:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1787191342.227002:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@000000006f9502d7[0x110, 1, [0x200000405:0xdc:0x0] hash] 00000020:00200000:2.0:1787191342.227004:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:2.0:1787191342.227008:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdc:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:2.0:1787191342.227031:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xdc:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:2.0:1787191342.227036:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdc:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191342.227039:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1787191342.227044:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1787191342.227051:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:2.0:1787191342.227055:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1787191342.227070:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:2.0:1787191342.227083:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1787191342.227087:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1530, osc lock ffff936b44e63430, flags 0x0 00010000:00010000:2.0:1787191342.227687:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.227705:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.227717:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.227725:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.227731:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191342.227743:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:2.0:1787191342.227753:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191342.227795:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:2.0:1787191342.227803:0:57570:0:(rw26.c:927:ll_write_end()) page@000000001afc971b[3 0000000044c1b95a 2 1 000000002f7fd0b4 0 0 0] 00000080:00200000:2.0:1787191342.227806:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @0000000073224db3 17ffffc0001001 3:0 ffff936b43a1eb60 0 lru 00000080:00200000:2.0:1787191342.227813:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@000000003eb8e0e6 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000a2a44f55 00000000fca7e965 > 3< 0 0 > 4< 0 0 8 412012544 - | - - - - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1787191342.227815:0:57570:0:(rw26.c:927:ll_write_end()) end page@000000001afc971b 00000080:00200000:2.0:1787191342.227816:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:2.0:1787191342.227820:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:2.0:1787191342.227856:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 00000000d83a4033 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191342.227881:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b5396bc38, count 1, dirtied 1 00000080:00200000:2.0:1787191342.227886:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:2.0:1787191342.227889:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:2.0:1787191342.227902:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894d58 (ffff936b47a175a8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191342.227906:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894d58 (ffff936b47a175a8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.227908:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1530 (ffff936b47a17248/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191342.227912:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.227921:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:2.0:1787191342.227933:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894d58 (ffff936b47a175a8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191342.227936:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1530 (ffff936b47a175a8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191342.227943:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:2.0:1787191342.227947:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1787191342.227953:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdc:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191342.227956:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:2.0:1787191342.227962:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xdc:0x0] updating i_size 5 i_blocks 0 00000080:00200000:2.0:1787191342.227967:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:2.0:1787191342.227989:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xdc:0x0](ffff936b5396ba88), flags 100001 00000002:00100000:2.0:1787191342.228061:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453abb80 x1874004626775040/t8589937063(8589937063) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191342.228072:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:2.0:1787191342.228077:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8e00 x1874004626778240/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191342.228114:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626778240:192.168.202.101@tcp:35:bash.0 00000100:00100000:1.0:1787191342.228234:0:57938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626777728:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191342.228249:0:57938:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a978 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606931 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.228280:0:57938:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a978 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606931 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.228287:0:57938:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a978 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606931 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.228299:0:57938:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a978 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606931 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.228308:0:57938:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a978 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606931 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.228320:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a978 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606931 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.228328:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a978 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606931 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.228335:0:57938:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a978 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606931 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191342.228345:0:57938:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b453ab480 x1874004626777728/t8589937070(8589937070) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191342.228356:0:57938:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453ab480 x1874004626777728/t8589937070(8589937070) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191342.228368:0:57938:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a978 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606931 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191342.228529:0:57938:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a978 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606931 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.228540:0:57938:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/220 (0 0) 00000080:00200000:0.0:1787191342.228546:0:57938:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191342.228589:0:57938:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xdc:0x0](ffff936b5396ba88): rc = 0 00000080:00200000:0.0:1787191342.228614:0:57938:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xdc:0x0]: layout version change: 4 -> 4 00000080:00010000:0.0:1787191342.228620:0:57938:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) for lock 0xe5129dc88483a978 00000080:00010000:0.0:1787191342.228632:0:57938:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) 00000080:00200008:0.0:1787191342.228645:0:57938:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xdc:0x0](ffff936b5396ba88), flags 154400 00000002:00100000:0.0:1787191342.228663:0:57938:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453ab480 x1874004626777728/t8589937070(8589937070) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191342.228710:0:57938:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a978 from it ffff936b5339fd80 00010000:00010000:0.0:1787191342.228715:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a978 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606931 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.228723:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a978 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606931 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191342.228742:0:57938:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88), inode mode 81a4 mask 44 00000080:00200000:0.0:1787191342.228857:0:57938:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88), inode mode 81a4 mask 4 00000080:00200000:0.0:1787191342.228864:0:57938:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88), xattr lov 00000080:00200008:0.0:1787191342.228890:0:57938:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xdc:0x0](ffff936b5396ba88), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191342.228896:0:57938:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88),name=f70.sanity-flr 00000002:00010000:0.0:1787191342.228913:0:57938:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xdc:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.228921:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a978 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606931 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.228929:0:57938:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a978 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606931 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191342.228936:0:57938:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191342.228940:0:57938:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) 00000080:00010000:0.0:1787191342.228943:0:57938:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) for lock 0xe5129dc88483a978 00000080:00010000:0.0:1787191342.228947:0:57938:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a978 from it ffffa3fb422dbcd8 00010000:00010000:0.0:1787191342.228949:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a978 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606931 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.228956:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a978 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606931 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191342.228972:0:57938:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdc:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00020000:00200000:0.0:1787191342.228981:0:57938:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdc:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191342.228984:0:57938:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191342.228987:0:57938:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xdc:0x0] 00000008:00010000:0.0:1787191342.229002:0:57938:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191342.229005:0:57938:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee6430, osc lock ffff936b50b62390, flags 0x400000400001002 00010000:00010000:0.0:1787191342.229027:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191342.229037:0:57938:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:0.0:1787191342.229047:0:57938:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191342.229050:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191342.229057:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:0.0:1787191342.229066:0:57938:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191342.229073:0:57938:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xdc:0x0] updating i_size 5 i_blocks 0 00000020:00010000:0.0:1787191342.229077:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51656e40 (ffff936b465cc998/0) at cl_lock_release():245 00000020:00010000:0.0:1787191342.229080:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51656e40 (ffff936b465cc998/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191342.229083:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee6430 (ffff936b47a172d8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191342.229086:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51656e40 (ffff936b465cc998/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191342.229089:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee6430 (ffff936b465cc998/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191342.229098:0:57938:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdc:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:2.0:1787191342.230436:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5ff00 going to sleep for 11 seconds 00000080:00200008:0.0:1787191342.230688:0:57938:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xdc:0x0](ffff936b5396ba88), flags 154000 00000002:00100000:0.0:1787191342.230749:0:57938:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453ab480 x1874004626777728/t8589937070(8589937070) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191342.230761:0:57938:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191342.230766:0:57938:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a476d80 x1874004626778496/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191342.230788:0:57938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626778496:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191342.230864:0:57938:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99840 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.232653:0:57938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626778496:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191342.232686:0:57938:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453ab480 x1874004626777728/t8589937070(8589937070) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191342.232985:0:57938:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191342.233004:0:57938:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.233031:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.233045:0:57938:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.233054:0:57938:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191342.233060:0:57938:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191342.233064:0:57938:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191342.233071:0:57938:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422dbb58 00010000:00010000:0.0:1787191342.233075:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.233083:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.233098:0:57938:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.233114:0:57938:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191342.233119:0:57938:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.233341:0:57938:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=9 00000080:00200008:0.0:1787191342.233349:0:57938:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xdc:0x0](ffff936b5396ba88), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191342.233354:0:57938:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88),name=f70.sanity-flr 00000002:00010000:0.0:1787191342.233366:0:57938:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xdc:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.233374:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a978 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606931 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191342.233382:0:57938:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a978 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606931 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191342.233389:0:57938:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191342.233393:0:57938:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) 00000080:00010000:0.0:1787191342.233396:0:57938:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) for lock 0xe5129dc88483a978 00000080:00010000:0.0:1787191342.233400:0:57938:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a978 from it ffffa3fb422dbcb8 00010000:00010000:0.0:1787191342.233403:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a978 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606931 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191342.233416:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a978 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606931 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191342.233436:0:57938:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdc:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:0.0:1787191342.233447:0:57938:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdc:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191342.233450:0:57938:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191342.233453:0:57938:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xdc:0x0] 00000008:00010000:0.0:1787191342.233473:0:57938:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191342.233476:0:57938:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee6430, osc lock ffff936b50b62390, flags 0x400000400001002 00010000:00010000:0.0:1787191342.233491:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191342.233502:0:57938:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:0.0:1787191342.233513:0:57938:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191342.233517:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191342.233525:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:0.0:1787191342.233535:0:57938:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191342.233543:0:57938:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xdc:0x0] updating i_size 5 i_blocks 0 00000020:00010000:0.0:1787191342.233548:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51656e40 (ffff936b465cc998/0) at cl_lock_release():245 00000020:00010000:0.0:1787191342.233551:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51656e40 (ffff936b465cc998/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191342.233555:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee6430 (ffff936b47a172d8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191342.233558:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51656e40 (ffff936b465cc998/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191342.233560:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee6430 (ffff936b465cc998/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191342.233570:0:57938:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdc:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191342.233605:0:57938:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191342.233613:0:57938:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.233619:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.233628:0:57938:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.233635:0:57938:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191342.233639:0:57938:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191342.233642:0:57938:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191342.233646:0:57938:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422dbbf8 00010000:00010000:0.0:1787191342.233648:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.233655:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.233663:0:57938:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.233667:0:57938:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191342.233671:0:57938:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.233674:0:57938:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:0.0:1787191342.233678:0:57938:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88), inode mode 81a4 mask 46 00000080:00200008:0.0:1787191342.233686:0:57938:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xdc:0x0](ffff936b5396ba88), flags 154402 00000002:00010000:0.0:1787191342.233701:0:57938:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xdc:0x0]) in obj [0x200000405:0xdc:0x0], intent: open flags 0104240114403 00010000:00010000:0.0:1787191342.233742:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a97f lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.233749:0:57938:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a97f lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57938 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191342.233759:0:57938:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191342.233768:0:57938:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a476d80 x1874004626778752/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191342.233778:0:57938:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a97f lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57938 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.233797:0:57938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626778752:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191342.234355:0:57938:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99840 going to sleep for 11 seconds 00000100:00100000:2.0:1787191342.234440:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626778240:192.168.202.101@tcp:35:bash.0 00000002:00100000:2.0:1787191342.234458:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453abb80 x1874004626775040/t8589937063(8589937063) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191342.240749:0:57939:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191342.240783:0:57939:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.240800:0:57939:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.240816:0:57939:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.240824:0:57939:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000100:00100000:3.0:1787191342.241290:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191342.241419:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634920832 00000100:00100000:2.0:1787191342.241427:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634920832 00000100:00100000:2.0:1787191342.241479:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1442 00000100:00100000:2.0:1787191342.241490:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634920832:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191342.241505:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a978 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4606931 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191342.241583:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191342.241590:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634920832:12345-192.168.202.101@tcp:104: Request processed in 102us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191342.241598:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1442 00010000:00010000:1.0:1787191342.241660:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191342.241667:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a978 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4606931 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191342.241676:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40031a00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191342.241681:0:57627:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a978 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4606931 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191342.241690:0:57627:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a978 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4606931 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191342.241699:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a978 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4606931 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191342.241717:0:57627:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483a95c lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46068c8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191342.241757:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a978 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4606931 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191342.241764:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191342.241788:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a978 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4606931 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191342.241795:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a978 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4606931 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191342.241811:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191342.241813:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191342.241814:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191342.241821:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787191342.241866:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626778880:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00010000:0.0:1787191342.242981:0:57939:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191342.242988:0:57939:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191342.242997:0:57939:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422e3b58 00010000:00010000:0.0:1787191342.243002:0:57939:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.243015:0:57939:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.243039:0:57939:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.243050:0:57939:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:1.0:1787191342.243300:0:57939:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191342.243320:0:57939:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:1.0:1787191342.243325:0:57939:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191342.243345:0:57939:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191342.243387:0:57939:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a986 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.243396:0:57939:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a986 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57939 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.243404:0:57939:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a986 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57939 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191342.243423:0:57939:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57939:1874004626779008:192.168.202.101@tcp:101:rm.0 00000100:00100000:1.0:1787191342.243535:0:57939:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.246660:0:57938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626778752:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191342.246686:0:57938:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CW ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a97f lrc: 4/1,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606946 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.246699:0:57938:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a97f lrc: 4/1,0 mode: --/CW res: [0x200000405:0xdc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606946 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.246710:0:57938:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a97f lrc: 4/1,0 mode: CW/CW res: [0x200000405:0xdc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606946 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.246720:0:57938:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a97f lrc: 4/1,0 mode: CW/CW res: [0x200000405:0xdc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606946 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.246732:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a97f lrc: 5/1,1 mode: CW/CW res: [0x200000405:0xdc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606946 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.246742:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a97f lrc: 5/1,1 mode: CW/CW res: [0x200000405:0xdc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606946 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.246749:0:57938:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a97f lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xdc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606946 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.246766:0:57938:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x200002b, status=0 req@ffff936b6a476d80 x1874004626778752/t8589937073(8589937073) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191342.246779:0:57938:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a476d80 x1874004626778752/t8589937073(8589937073) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191342.246794:0:57938:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a97f lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xdc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606946 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.246804:0:57938:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 8 res 8589935621/220 (0 0) 00000080:00200000:0.0:1787191342.246810:0:57938:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xdc:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191342.246892:0:57938:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) for lock 0xe5129dc88483a97f 00000080:00010000:0.0:1787191342.246899:0:57938:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a97f from it ffffa3fb422dbbf0 00010000:00010000:0.0:1787191342.246903:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a97f lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xdc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606946 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.246913:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a97f lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xdc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606946 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00100000:0.0:1787191342.246940:0:57938:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a476d80 x1874004626778752/t8589937073(8589937073) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191342.247105:0:57938:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88), inode mode 81a4 mask 4 00000080:00200000:0.0:1787191342.247113:0:57938:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88), xattr lov 00000080:00200008:0.0:1787191342.247144:0:57938:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xdc:0x0](ffff936b5396ba88), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191342.247151:0:57938:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88),name=f70.sanity-flr 00000002:00010000:0.0:1787191342.247164:0:57938:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xdc:0x0]) in obj [0x200000405:0xdc:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.247171:0:57938:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 30 res 8589935621/220 (0 0) 00010000:00010000:0.0:1787191342.247207:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a98d lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.247215:0:57938:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a98d lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.247224:0:57938:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a98d lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57938 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.247251:0:57938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626779136:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191342.247318:0:57938:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99840 going to sleep for 11 seconds 00000100:00100000:2.0:1787191342.249397:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191342.249516:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634920960 00000100:00100000:3.0:1787191342.249524:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634920960 00000100:00100000:3.0:1787191342.249568:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1443 00000100:00100000:3.0:1787191342.249576:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634920960:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191342.249592:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a97f lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xdc:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e4606946 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191342.249659:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191342.249666:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634920960:12345-192.168.202.101@tcp:104: Request processed in 90us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191342.249673:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1443 00010000:00010000:0.0:1787191342.249939:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191342.249947:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a97f lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xdc:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e4606946 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.249955:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b6a609c00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191342.249959:0:43384:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a97f lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xdc:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4606946 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.249967:0:43384:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a97f lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xdc:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4606946 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.249975:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a97f lrc: 3/0,0 mode: CW/CW res: [0x200000405:0xdc:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x7130d520e4606946 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.250041:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a97f lrc: 2/0,0 mode: --/CW res: [0x200000405:0xdc:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e4606946 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.250049:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191342.250071:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a97f lrc: 1/0,0 mode: --/CW res: [0x200000405:0xdc:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e4606946 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.250078:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a97f lrc: 0/0,0 mode: --/CW res: [0x200000405:0xdc:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e4606946 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.250090:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191342.250092:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191342.250094:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191342.250112:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787191342.250132:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626779264:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191342.250967:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626778880:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191342.252891:0:57938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626779136:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191342.252913:0:57938:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a98d lrc: 4/1,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606969 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.252922:0:57938:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a98d lrc: 4/1,0 mode: --/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606969 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.252931:0:57938:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a98d lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606969 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.252939:0:57938:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a98d lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606969 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.252948:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a98d lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606969 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.252953:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a98d lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606969 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.252959:0:57938:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a98d lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606969 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191342.252967:0:57938:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b6a476680 x1874004626779136/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/976 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191342.252975:0:57938:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a98d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606969 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191342.252984:0:57938:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a98d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606969 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.252992:0:57938:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/220 (0 0) 00000080:00200000:1.0:1787191342.252997:0:57938:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xdc:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787191342.253071:0:57938:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xdc:0x0]: layout version change: 4 -> 4 00000080:00010000:1.0:1787191342.253077:0:57938:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) for lock 0xe5129dc88483a98d 00000080:00010000:1.0:1787191342.253083:0:57938:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) 00000080:00010000:1.0:1787191342.253086:0:57938:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a98d from it ffffa3fb422dbcd8 00010000:00010000:1.0:1787191342.253089:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a98d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606969 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.253102:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a98d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606969 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1787191342.253173:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626779264:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00200000:1.0:1787191342.253307:0:57938:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdc:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:1.0:1787191342.253318:0:57938:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdc:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191342.253321:0:57938:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191342.253326:0:57938:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xdc:0x0] 00000008:00010000:1.0:1787191342.253344:0:57938:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191342.253348:0:57938:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b44ca8130, osc lock ffff936b468377c0, flags 0x400000400001002 00010000:00010000:1.0:1787191342.253363:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191342.253374:0:57938:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:1.0:1787191342.253384:0:57938:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191342.253386:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191342.253391:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000020:00200000:1.0:1787191342.253450:0:57938:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191342.253458:0:57938:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xdc:0x0] updating i_size 5 i_blocks 0 00000020:00010000:1.0:1787191342.253462:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51654de0 (ffff936b465cc908/0) at cl_lock_release():245 00000020:00010000:1.0:1787191342.253464:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51654de0 (ffff936b465cc908/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191342.253466:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b44ca8130 (ffff936b465cc878/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191342.253469:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51654de0 (ffff936b465cc908/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191342.253471:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b44ca8130 (ffff936b465cc908/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191342.253478:0:57938:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdc:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200080:1.0:1787191342.253554:0:57938:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88) cmd=c00c66f3 arg=24d72e0 00000002:00010000:1.0:1787191342.253575:0:57938:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xdc:0x0]) in obj [0x200000405:0xdc:0x0], intent: open flags 05004040000002 00010000:00010000:1.0:1787191342.253618:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a994 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.253630:0:57938:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a994 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57938 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191342.253641:0:57938:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191342.253646:0:57938:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453aa300 x1874004626779520/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191342.253653:0:57938:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a994 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x81000000000000 pid: 57938 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191342.253669:0:57938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626779520:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191342.253800:0:57938:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628933c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191342.253824:0:57939:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57939:1874004626779008:192.168.202.101@tcp:101:rm.0 00010000:00010000:1.0:1787191342.253851:0:57939:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a986 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606977 expref: -99 pid: 57939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.253867:0:57939:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a986 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606977 expref: -99 pid: 57939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.253875:0:57939:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a986 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606977 expref: -99 pid: 57939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.253883:0:57939:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a986 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606977 expref: -99 pid: 57939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.253891:0:57939:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a986 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606977 expref: -99 pid: 57939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.253904:0:57939:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a986 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606977 expref: -99 pid: 57939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.253912:0:57939:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a986 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606977 expref: -99 pid: 57939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.253920:0:57939:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a986 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606977 expref: -99 pid: 57939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191342.253928:0:57939:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b453a9180 x1874004626779008/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/976 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191342.253934:0:57939:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a986 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606977 expref: -99 pid: 57939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191342.253942:0:57939:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a986 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606977 expref: -99 pid: 57939 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.253948:0:57939:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a98d lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606969 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.253954:0:57939:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a98d lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606969 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.253959:0:57939:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a986 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606977 expref: -99 pid: 57939 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.253963:0:57939:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a986 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x7130d520e4606977 expref: -99 pid: 57939 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.253968:0:57939:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a986 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x7130d520e4606977 expref: -99 pid: 57939 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.253984:0:57939:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000080:00200000:1.0:1787191342.253989:0:57939:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1787191342.254006:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191342.254012:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a986 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x7130d520e4606977 expref: -99 pid: 57939 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1787191342.254015:0:57939:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xdc:0x0](ffff936b5396ba88): rc = 0 00010000:00010000:0.0:1787191342.254031:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030e00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191342.254036:0:40929:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a986 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x7130d520e4606977 expref: -99 pid: 57939 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1787191342.254039:0:57939:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xdc:0x0]: layout version change: 4 -> 4 00000080:00010000:1.0:1787191342.254044:0:57939:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) for lock 0xe5129dc88483a98d 00010000:00010000:0.0:1787191342.254045:0:40929:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a986 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x7130d520e4606977 expref: -99 pid: 57939 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.254052:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a986 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4606977 expref: -99 pid: 57939 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000080:00010000:1.0:1787191342.254054:0:57939:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) 00000080:00010000:1.0:1787191342.254058:0:57939:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a98d from it ffffa3fb422e3b20 00010000:00010000:1.0:1787191342.254061:0:57939:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a98d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606969 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.254820:0:57939:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a98d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606969 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200008:1.0:1787191342.254926:0:57939:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xdc:0x0](ffff936b5396ba88), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191342.254934:0:57939:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88),name=f70.sanity-flr 00000002:00010000:1.0:1787191342.254956:0:57939:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xdc:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191342.255062:0:57939:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a98d lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606969 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.255073:0:57939:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a98d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606969 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191342.255074:0:40929:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a98d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606969 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191342.255081:0:57939:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191342.255086:0:57939:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) 00000080:00010000:1.0:1787191342.255090:0:57939:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) for lock 0xe5129dc88483a98d 00000080:00010000:1.0:1787191342.255094:0:57939:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a98d from it ffffa3fb422e3cb8 00010000:00010000:1.0:1787191342.255097:0:57939:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a98d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606969 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.255209:0:57939:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a98d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606969 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191342.255210:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a986 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x1b rrc: 7 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4606977 expref: -99 pid: 57939 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.255217:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000080:00200000:1.0:1787191342.255229:0:57939:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdc:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:1.0:1787191342.255237:0:57939:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdc:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00010000:00010000:0.0:1787191342.255239:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a986 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4606977 expref: -99 pid: 57939 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00020000:00200000:1.0:1787191342.255240:0:57939:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191342.255244:0:57939:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xdc:0x0] 00010000:00010000:0.0:1787191342.255246:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483a986 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4606977 expref: -99 pid: 57939 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.255259:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000008:00010000:1.0:1787191342.255260:0:57939:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00010000:00010000:0.0:1787191342.255261:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191342.255263:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000008:00010000:1.0:1787191342.255263:0:57939:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b44ca8130, osc lock ffff936b468377c0, flags 0x400000400001002 00000100:00100000:0.0:1787191342.255270:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1787191342.255277:0:57939:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000100:00100000:0.0:1787191342.255285:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626779648:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787191342.255287:0:57939:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000020:00200000:1.0:1787191342.255297:0:57939:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191342.255300:0:57939:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1787191342.255307:0:57939:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00000020:00200000:1.0:1787191342.255320:0:57939:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191342.255328:0:57939:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xdc:0x0] updating i_size 5 i_blocks 0 00000020:00010000:1.0:1787191342.255333:0:57939:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51654de0 (ffff936b465cc908/0) at cl_lock_release():245 00000020:00010000:1.0:1787191342.255336:0:57939:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51654de0 (ffff936b465cc908/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191342.255339:0:57939:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b44ca8130 (ffff936b465cc878/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191342.255343:0:57939:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51654de0 (ffff936b465cc908/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191342.255345:0:57939:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b44ca8130 (ffff936b465cc908/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191342.255354:0:57939:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdc:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191342.256595:0:57939:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191342.256619:0:57939:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191342.256632:0:57939:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191342.256644:0:57939:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191342.256649:0:57939:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191342.256653:0:57939:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191342.256656:0:57939:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191342.256660:0:57939:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422e3c10 00010000:00010000:1.0:1787191342.256663:0:57939:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191342.256669:0:57939:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191342.256681:0:57939:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191342.256688:0:57939:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:1.0:1787191342.256693:0:57939:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191342.256699:0:57939:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:1.0:1787191342.256701:0:57939:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:1.0:1787191342.256705:0:57939:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:1.0:1787191342.256726:0:57939:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483a95c lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46068c8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191342.256735:0:57939:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xdc:0x0]: losing layout lock 00010000:00010000:1.0:1787191342.256744:0:57939:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a98d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4606969 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191342.256749:0:57939:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xdc:0x0]: losing layout lock 00010000:00010000:1.0:1787191342.256754:0:57939:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a94e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e46068a5 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.256784:0:57939:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483a95c lrc: 1/0,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46068c8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191342.256789:0:57939:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a98d lrc: 1/0,0 mode: --/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606969 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191342.256793:0:57939:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a94e lrc: 1/0,0 mode: --/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46068a5 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.256796:0:57939:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:1.0:1787191342.256798:0:57939:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483a95c lrc: 0/0,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46068c8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191342.256807:0:57939:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a98d lrc: 0/0,0 mode: --/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606969 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191342.256813:0:57939:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483a94e lrc: 0/0,0 mode: --/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46068a5 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1787191342.256823:0:57939:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 36, max 7 00000100:00100000:1.0:1787191342.256845:0:57939:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9180 x1874004626779904/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787191342.256864:0:57939:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57939:1874004626779904:192.168.202.101@tcp:36:rm.0 00000100:00100000:1.0:1787191342.256935:0:57939:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893900 going to sleep for 11 seconds 00000100:00100000:1.0:1787191342.258600:0:57938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626779520:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191342.258622:0:57938:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a994 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4606985 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.258634:0:57938:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a994 lrc: 4/1,0 mode: --/PW res: [0x200000405:0xdc:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4606985 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.258645:0:57938:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a994 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0xdc:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4606985 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.258656:0:57938:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a994 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0xdc:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4606985 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.258667:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a994 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0xdc:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4606985 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.258677:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a994 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0xdc:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4606985 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.258684:0:57938:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a994 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0xdc:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4606985 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191342.258694:0:57938:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x600002b, status=0 req@ffff936b453aa300 x1874004626779520/t8589937074(8589937074) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191342.258705:0:57938:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453aa300 x1874004626779520/t8589937074(8589937074) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191342.258720:0:57938:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a994 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xdc:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4606985 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.258730:0:57938:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 2 res 8589935621/220 (0 0) 00000080:00200000:1.0:1787191342.258736:0:57938:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xdc:0x0] suppgids 0 0: rc 0 00000002:00100000:1.0:1787191342.258753:0:57938:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453aa300 x1874004626779520/t8589937074(8589937074) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191342.258761:0:57938:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) for lock 0xe5129dc88483a994 00000080:00010000:1.0:1787191342.258766:0:57938:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a994 from it ffffa3fb422dbcc0 00010000:00010000:1.0:1787191342.258770:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a994 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xdc:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4606985 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.258778:0:57938:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a994 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0xdc:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4606985 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1787191342.258860:0:57938:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdc:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00010000:00010000:1.0:1787191342.258871:0:57938:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/220 (0 0) 00000080:00010000:1.0:1787191342.258877:0:57938:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xdc:0x0](ffff936b5396ba88) 00000002:00010000:1.0:1787191342.258886:0:57938:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xdc:0x0]) in obj [0x200000405:0xdc:0x0], intent: layout flags 0 00010000:00010000:1.0:1787191342.258922:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a99b lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.258928:0:57938:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a99b lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.258937:0:57938:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a99b lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57938 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191342.258953:0:57938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626780032:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191342.259032:0:57938:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628933c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.259249:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626779648:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191342.260403:0:57939:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57939:1874004626779904:192.168.202.101@tcp:36:rm.0 00000100:00100000:1.0:1787191342.262115:0:57938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626780032:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191342.262140:0:57938:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a99b lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46069a8 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.262154:0:57938:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a99b lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46069a8 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191342.262168:0:57938:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b453ab800 x1874004626780032/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191342.262179:0:57938:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a99b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46069a8 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191342.262191:0:57938:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a99b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46069a8 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.262200:0:57938:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/220 (0 0) 00000080:00200000:1.0:1787191342.262207:0:57938:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xdc:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191342.262222:0:57938:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) for lock 0xe5129dc88483a99b 00000080:00010000:1.0:1787191342.262230:0:57938:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a99b from it ffffa3fb422dbb70 00010000:00010000:1.0:1787191342.262233:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a99b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46069a8 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.262242:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a99b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46069a8 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.262266:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a99b lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46069a8 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.262278:0:57938:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a99b lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46069a8 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:1.0:1787191342.262286:0:57938:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xdc:0x0](0000000030f058e9) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a99b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46069a8 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191342.263489:0:57938:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xdc:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:1.0:1787191342.263503:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a99b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46069a8 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.263513:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a99b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46069a8 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:1.0:1787191342.263533:0:57938:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdc:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191342.263536:0:57938:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191342.263543:0:57938:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191342.263554:0:57938:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000100:00100000:0.0:1787191342.263785:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626780160:192.168.202.101@tcp:1:lfs.0 00000100:00100000:3.0:1787191342.266878:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191342.266911:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634921088 00000100:00100000:3.0:1787191342.266920:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634921088 00000100:00100000:3.0:1787191342.266965:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1444 00000100:00100000:3.0:1787191342.266977:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8420:x1874004634921088:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191342.266993:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420080020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00010000:00010000:3.0:1787191342.267073:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191342.267081:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8420:x1874004634921088:12345-192.168.202.101@tcp:104: Request processed in 107us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191342.267153:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1444 00010000:00010000:0.0:1787191342.267225:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191342.267233:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420080020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00010000:00010000:0.0:1787191342.267242:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030600 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191342.267248:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800428480020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00000008:00010000:0.0:1787191342.267278:0:40930:0:(osc_cache.c:2029:try_to_add_extent_for_io()) ### extent: 00000000d83a4033 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800429480020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00000008:00010000:0.0:1787191342.267291:0:40930:0:(osc_cache.c:1183:osc_extent_make_ready()) ### extent: 00000000d83a4033 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800429480020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00010000:00010000:0.0:1787191342.267339:0:40930:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800429480020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00000008:00100000:0.0:1787191342.267418:0:40930:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff936b6a477100 - object 0x280000401:464 offset 0<>5 00000100:00100000:0.0:1787191342.267464:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787191342.267475:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626780288:192.168.202.101@tcp:4:bash.0 00000008:00010000:0.0:1787191342.272000:0:2389:0:(osc_cache.c:917:osc_extent_finish()) ### extent: 00000000d83a4033 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800429480020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00000080:00200000:2.0:1787191342.272070:0:57940:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191342.272094:0:57940:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.272107:0:57940:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.272179:0:57940:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000008:00010000:0.0:1787191342.272181:0:2389:0:(osc_cache.c:497:__osc_extent_remove()) ### extent: 00000000d83a4033 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800429480020000 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00000080:00200000:2.0:1787191342.272194:0:57940:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191342.272201:0:57940:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191342.272204:0:57940:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191342.272210:0:57940:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422ebb58 00000100:00100000:0.0:1787191342.272212:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626780288:192.168.202.101@tcp:4:bash.0 00010000:00010000:2.0:1787191342.272214:0:57940:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.272222:0:57940:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.272238:0:57940:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.272246:0:57940:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:2.0:1787191342.272252:0:57940:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.272263:0:57940:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:2.0:1787191342.272268:0:57940:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191342.272282:0:57940:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00000080:00200000:3.0:1787191342.272297:0:40930:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdc:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00010000:00010000:2.0:1787191342.272325:0:57940:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a9a2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.272332:0:57940:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a9a2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1787191342.272339:0:40930:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdc:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:2.0:1787191342.272342:0:57940:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a9a2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191342.272361:0:57940:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57940:1874004626780416:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191342.272392:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69480020020 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00010000:00010000:3.0:1787191342.272400:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191342.272419:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69480020020 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00010000:00010000:3.0:1787191342.272427:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483a96a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69480020020 nid: local remote: 0x7130d520e460690e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00000100:00100000:2.0:1787191342.272430:0:57940:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5ff00 going to sleep for 11 seconds 00010000:00010000:3.0:1787191342.272446:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191342.272448:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191342.272450:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191342.272460:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626780544:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191342.276249:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626780544:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191342.276817:0:57940:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57940:1874004626780416:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191342.276898:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626780160:192.168.202.101@tcp:1:lfs.0 00010000:00010000:3.0:1787191342.277040:0:57938:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a99b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46069a8 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191342.277062:0:57938:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xdc:0x0]: losing layout lock 00010000:00010000:2.0:1787191342.277109:0:57940:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a9a2 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.277180:0:57940:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a9a2 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.277188:0:57940:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a9a2 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.277195:0:57940:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a9a2 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.277202:0:57940:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a9a2 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.277209:0:57940:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51185600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191342.277214:0:57940:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a9a2 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.277221:0:57940:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a9a2 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.277228:0:57940:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a9a2 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.277235:0:57940:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191342.277239:0:57940:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a9a2 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.277250:0:57940:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a9a2 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191342.277273:0:57940:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513b8700 x1874004626780416/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191342.277288:0:57940:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191342.277369:0:57940:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191342.277385:0:57940:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.277450:0:57940:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.277462:0:57940:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.277470:0:57940:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191342.277476:0:57940:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191342.277479:0:57940:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191342.277485:0:57940:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422ebbe8 00010000:00010000:2.0:1787191342.277488:0:57940:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.277496:0:57940:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.277509:0:57940:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.277516:0:57940:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000080:00200000:2.0:1787191342.277521:0:57940:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.277532:0:57940:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:2.0:1787191342.277536:0:57940:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191342.277548:0:57940:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191342.277590:0:57940:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483a9a9 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.277594:0:57938:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a99b lrc: 1/0,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46069a8 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191342.277598:0:57940:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483a9a9 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.277607:0:57938:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191342.277607:0:57940:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483a9a9 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.277610:0:57938:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483a99b lrc: 0/0,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46069a8 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000020:00100000:0.0:1787191342.277626:0:57938:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1787191342.277626:0:57940:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57940:1874004626780672:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191342.277632:0:57938:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1df80 x1874004626780928/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 472/440 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787191342.277644:0:57938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626780928:192.168.202.101@tcp:36:lfs.0 00000100:00100000:0.0:1787191342.278012:0:57938:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99840 going to sleep for 11 seconds 00000100:00100000:2.0:1787191342.278039:0:57940:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787191342.280226:0:57940:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57940:1874004626780672:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191342.280248:0:57940:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483a9a9 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.280262:0:57940:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483a9a9 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.280269:0:57940:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483a9a9 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.280275:0:57940:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483a9a9 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.280284:0:57940:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483a9a9 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.280295:0:57940:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51184600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191342.280299:0:57940:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483a9a9 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.280306:0:57940:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483a9a9 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.280313:0:57940:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483a9a9 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.280320:0:57940:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191342.280326:0:57940:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483a9a9 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.280333:0:57940:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483a9a9 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191342.280354:0:57940:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513b8700 x1874004626780672/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191342.280369:0:57940:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191342.280458:0:57940:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191342.280471:0:57940:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.280478:0:57940:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.280486:0:57940:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.280491:0:57940:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191342.280496:0:57940:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191342.280498:0:57940:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191342.280502:0:57940:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422ebb58 00010000:00010000:2.0:1787191342.280504:0:57940:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.280510:0:57940:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.280519:0:57940:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.280524:0:57940:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:2.0:1787191342.280531:0:57940:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:2.0:1787191342.280534:0:57940:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:2.0:1787191342.280541:0:57940:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.280545:0:57940:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 95 lru_type: 1 00010000:00010000:2.0:1787191342.280550:0:57940:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 95 lru_type: 1 00000002:00010000:2.0:1787191342.280557:0:57940:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.280601:0:57940:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a9b0 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.280606:0:57940:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a9b0 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.280612:0:57940:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a9b0 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191342.280629:0:57940:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57940:1874004626781056:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191342.280689:0:57940:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787191342.282994:0:57940:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57940:1874004626781056:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191342.283029:0:57940:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a9b0 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46069ee expref: -99 pid: 57940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.283040:0:57940:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a9b0 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46069ee expref: -99 pid: 57940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.283051:0:57940:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a9b0 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46069ee expref: -99 pid: 57940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.283061:0:57940:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a9b0 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46069ee expref: -99 pid: 57940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.283072:0:57940:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a9b0 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46069ee expref: -99 pid: 57940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.283079:0:57940:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a9b0 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46069ee expref: -99 pid: 57940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.283085:0:57940:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a9b0 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46069ee expref: -99 pid: 57940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191342.283096:0:57940:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b513b8700 x1874004626781056/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191342.283116:0:57940:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a9b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46069ee expref: -99 pid: 57940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.283191:0:57940:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:2.0:1787191342.283199:0:57940:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a9b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46069ee expref: -99 pid: 57940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.283207:0:57940:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a9b0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46069ee expref: -99 pid: 57940 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:2.0:1787191342.283234:0:57940:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.283245:0:57940:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 190 lru_type: 1 00010000:00010000:2.0:1787191342.283257:0:57940:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 190 lru_type: 1 00010000:00010000:2.0:1787191342.283266:0:57940:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 190 lru_type: 1 00010000:00010000:2.0:1787191342.283273:0:57940:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 191 lru_type: 1 00000080:00200000:2.0:1787191342.283284:0:57940:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1787191342.283295:0:57940:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:2.0:1787191342.283299:0:57940:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:2.0:1787191342.283304:0:57940:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb422ebcb8 00010000:00010000:2.0:1787191342.283309:0:57940:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 95 lru_type: 1 00010000:00010000:2.0:1787191342.283316:0:57940:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 96 lru_type: 1 00000002:00010000:2.0:1787191342.283331:0:57940:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.283338:0:57940:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a9b0 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46069ee expref: -99 pid: 57940 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.283346:0:57940:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a9b0 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46069ee expref: -99 pid: 57940 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.283353:0:57940:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a9b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46069ee expref: -99 pid: 57940 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.283360:0:57940:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a9b0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46069ee expref: -99 pid: 57940 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:2.0:1787191342.283369:0:57940:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.283374:0:57940:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 191 lru_type: 1 00010000:00010000:2.0:1787191342.283381:0:57940:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 191 lru_type: 1 00010000:00010000:2.0:1787191342.283389:0:57940:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 191 lru_type: 1 00010000:00010000:2.0:1787191342.283502:0:57940:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 192 lru_type: 1 00000080:00200008:2.0:1787191342.285964:0:57940:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:2.0:1787191342.285972:0:57940:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191342.285992:0:57940:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.286005:0:57940:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.286027:0:57940:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.286036:0:57940:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191342.286042:0:57940:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191342.286045:0:57940:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191342.286052:0:57940:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422ebcb8 00010000:00010000:2.0:1787191342.286056:0:57940:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.286065:0:57940:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.286371:0:57940:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191342.286381:0:57940:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.286388:0:57940:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.286463:0:57940:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.286469:0:57940:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191342.286474:0:57940:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191342.286477:0:57940:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191342.286481:0:57940:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422ebb58 00010000:00010000:2.0:1787191342.286484:0:57940:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.286491:0:57940:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.286500:0:57940:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.286507:0:57940:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191342.286512:0:57940:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.286523:0:57940:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:2.0:1787191342.286527:0:57940:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191342.286539:0:57940:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191342.286657:0:57940:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a9b7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.286666:0:57940:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a9b7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.286676:0:57940:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a9b7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191342.286706:0:57940:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57940:1874004626781184:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191342.286814:0:57940:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.287758:0:57938:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589937076 gen 1 00000100:00100000:0.0:1787191342.287771:0:57938:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b6a476d80 x1874004626778752/t8589937073(8589937073) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787191342.287781:0:57938:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b453aa300 x1874004626779520/t8589937074(8589937074) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787191342.287807:0:57938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626780928:192.168.202.101@tcp:36:lfs.0 00010000:00010000:0.0:1787191342.287872:0:57938:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/220 (0 0) 00000080:00010000:0.0:1787191342.287882:0:57938:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xdc:0x0](ffff936b5396ba88) 00000002:00010000:0.0:1787191342.287890:0:57938:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xdc:0x0]) in obj [0x200000405:0xdc:0x0], intent: layout flags 0 00010000:00010000:0.0:1787191342.287921:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a9be lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.287929:0:57938:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a9be lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.287937:0:57938:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a9be lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57938 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.287951:0:57938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626781312:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191342.288005:0:57938:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99840 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.289804:0:57940:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57940:1874004626781184:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191342.289823:0:57940:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a9b7 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.289863:0:57940:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a9b7 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.289870:0:57940:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a9b7 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.289875:0:57940:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a9b7 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.289884:0:57940:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a9b7 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.289890:0:57940:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51185600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191342.289894:0:57940:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a9b7 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.289902:0:57940:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a9b7 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.289909:0:57940:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a9b7 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.289916:0:57940:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191342.289922:0:57940:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a9b7 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.289933:0:57940:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483a9b7 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.289952:0:57940:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513b8700 x1874004626781184/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191342.289966:0:57940:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1787191342.289992:0:57940:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a9b0 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46069ee expref: -99 pid: 57940 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191342.290004:0:57940:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a9b0 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46069ee expref: -99 pid: 57940 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:0.0:1787191342.290012:0:57940:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a9b0 from it ffffa3fb422eb930 00010000:00010000:0.0:1787191342.290025:0:57940:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a9b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46069ee expref: -99 pid: 57940 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191342.290033:0:57940:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a9b0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46069ee expref: -99 pid: 57940 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191342.290135:0:57940:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191342.290149:0:57940:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.290157:0:57940:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.290166:0:57940:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.290178:0:57940:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191342.290183:0:57940:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191342.290191:0:57940:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191342.290198:0:57940:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422ebbf8 00010000:00010000:0.0:1787191342.290204:0:57940:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.290226:0:57940:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.290240:0:57940:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.290253:0:57940:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191342.290262:0:57940:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.290270:0:57940:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:0.0:1787191342.290277:0:57940:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:0.0:1787191342.290291:0:57940:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b42f3a780, open_flags a141, mode 81b6 opened 0 00000080:00200000:0.0:1787191342.290308:0:57940:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:0.0:1787191342.290337:0:57940:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xdd:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:0.0:1787191342.290357:0:57940:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a9b0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e46069ee expref: -99 pid: 57940 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191342.290412:0:57940:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a9b0 lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46069ee expref: -99 pid: 57940 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191342.290423:0:57940:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191342.290426:0:57940:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483a9b0 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46069ee expref: -99 pid: 57940 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191342.290463:0:57940:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc88483a9c5 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.290473:0:57940:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc88483a9c5 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191342.290490:0:57940:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191342.290499:0:57940:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474a80 x1874004626781568/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191342.290514:0:57940:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc88483a9c5 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.290542:0:57940:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57940:1874004626781568:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191342.290709:0:57940:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.293451:0:57938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626781312:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191342.293479:0:57938:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a9be lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606a0a expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.293493:0:57938:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a9be lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606a0a expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.293506:0:57938:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b6a476680 x1874004626781312/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191342.293517:0:57938:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a9be lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606a0a expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191342.293536:0:57938:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a9be lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606a0a expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.293546:0:57938:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/220 (0 0) 00000080:00200000:0.0:1787191342.293552:0:57938:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xdc:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191342.293568:0:57938:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) for lock 0xe5129dc88483a9be 00000080:00010000:0.0:1787191342.293574:0:57938:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a9be from it ffffa3fb422dbc70 00010000:00010000:0.0:1787191342.293578:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a9be lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606a0a expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.293587:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a9be lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606a0a expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.293609:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a9be lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606a0a expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.293620:0:57938:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a9be lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606a0a expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1787191342.293627:0:57938:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xdc:0x0](0000000030f058e9) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a9be lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606a0a expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.293669:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a9be lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606a0a expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.293677:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a9be lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606a0a expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191342.293692:0:57938:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdc:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191342.293702:0:57938:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdc:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191342.293705:0:57938:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191342.293711:0:57938:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191342.293750:0:57938:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191342.293767:0:57938:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdc:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:0.0:1787191342.293777:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a9be lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606a0a expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191342.293786:0:57938:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a9be lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606a0a expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:0.0:1787191342.293794:0:57938:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xdc:0x0](0000000030f058e9) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a9be lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606a0a expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191342.293808:0:57938:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdc:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191342.293811:0:57938:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdc:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191342.293814:0:57938:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191342.293816:0:57938:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191342.293829:0:57938:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191342.293868:0:57938:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdc:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:0.0:1787191342.293894:0:57938:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191342 1787191342 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a971 lrc: 1/0,0 mode: PW/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606915 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191342.293955:0:57938:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xdc:0x0]: layout version change: 4294967294 -> 5 00010000:00010000:0.0:1787191342.293961:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a9be lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606a0a expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191342.293969:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a9be lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606a0a expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200080:0.0:1787191342.293990:0:57938:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88) cmd=66f4 arg=24d72e0 00000080:00200008:0.0:1787191342.294001:0:57938:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xdc:0x0](ffff936b5396ba88), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191342.294008:0:57938:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88),name=f70.sanity-flr 00000002:00010000:0.0:1787191342.294030:0:57938:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xdc:0x0]) in obj [0x200000405:0xdc:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.294036:0:57938:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 30 res 8589935621/220 (0 0) 00010000:00010000:0.0:1787191342.294066:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a9cc lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.294073:0:57938:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a9cc lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.294082:0:57938:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a9cc lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57938 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.294100:0:57938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626781696:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191342.294182:0:57938:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99840 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.297324:0:57940:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57940:1874004626781568:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191342.297350:0:57940:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc88483a9c5 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606a34 expref: -99 pid: 57940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.297378:0:57940:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc88483a9c5 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606a34 expref: -99 pid: 57940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.297403:0:57940:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc88483a9c5 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606a34 expref: -99 pid: 57940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.297416:0:57940:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc88483a9c5 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606a34 expref: -99 pid: 57940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.297427:0:57940:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc88483a9c5 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606a34 expref: -99 pid: 57940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.297440:0:57940:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc88483a9c5 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606a34 expref: -99 pid: 57940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.297448:0:57940:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc88483a9c5 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606a34 expref: -99 pid: 57940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.297455:0:57940:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc88483a9c5 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606a34 expref: -99 pid: 57940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.297530:0:57940:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b6a474a80 x1874004626781568/t8589937077(8589937077) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191342.297544:0:57940:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474a80 x1874004626781568/t8589937077(8589937077) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191342.297557:0:57940:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc88483a9c5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606a34 expref: -99 pid: 57940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.297573:0:57940:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/221 (0 0) 00000080:00200000:0.0:1787191342.297589:0:57940:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191342.297610:0:57940:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:0.0:1787191342.297642:0:57940:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xdd:0x0](ffff936b53969148) 00000080:00200000:0.0:1787191342.297648:0:57940:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xdd:0x0], updating i_size 0 00000080:00200000:0.0:1787191342.297677:0:57940:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xdd:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1787191342.297681:0:57940:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xdd:0x0](ffff936b53969148) 00000080:00010000:0.0:1787191342.297684:0:57940:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdd:0x0](ffff936b53969148) for lock 0xe5129dc88483a9c5 00000080:00010000:0.0:1787191342.297692:0:57940:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xdd:0x0](ffff936b53969148) 00000080:00200008:0.0:1787191342.297706:0:57940:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xdd:0x0](ffff936b53969148), flags 120501 00000002:00100000:0.0:1787191342.297728:0:57940:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474a80 x1874004626781568/t8589937077(8589937077) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191342.297761:0:57940:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a9c5 from it ffff936b530f5e40 00010000:00010000:0.0:1787191342.297764:0:57940:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc88483a9c5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606a34 expref: -99 pid: 57940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.297773:0:57940:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc88483a9c5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606a34 expref: -99 pid: 57940 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191342.297793:0:57940:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xdd:0x0](ffff936b53969148), inode mode 81a4 mask 40 00000080:00200000:0.0:1787191342.297878:0:57940:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xdd:0x0](ffff936b53969148), inode mode 81a4 mask 2 00000080:00200000:0.0:1787191342.297887:0:57940:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xdd:0x0](ffff936b53969148), xattr lov 00000002:00010000:0.0:1787191342.297900:0:57940:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xdd:0x0]) in obj [0x200000405:0xdd:0x0], intent: open flags 040000002 00010000:00010000:0.0:1787191342.297940:0:57940:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483a9d3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.297947:0:57940:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483a9d3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191342.297961:0:57940:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191342.297967:0:57940:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477800 x1874004626781952/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191342.297976:0:57940:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483a9d3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.297993:0:57940:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57940:1874004626781952:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191342.298255:0:57940:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.300239:0:57938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626781696:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191342.300260:0:57938:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a9cc lrc: 4/1,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606a2d expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.300271:0:57938:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a9cc lrc: 4/1,0 mode: --/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606a2d expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.300283:0:57938:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a9cc lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606a2d expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.300295:0:57938:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a9cc lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606a2d expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.300306:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a9cc lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606a2d expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.300313:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a9cc lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606a2d expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.300326:0:57938:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a9cc lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606a2d expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.300337:0:57938:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b6a476680 x1874004626781696/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/976 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191342.300348:0:57938:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a9cc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606a2d expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191342.300361:0:57938:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a9cc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606a2d expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.300803:0:57938:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/220 (0 0) 00000080:00200000:0.0:1787191342.300808:0:57938:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xdc:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787191342.300898:0:57938:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xdc:0x0]: layout version change: 5 -> 5 00000080:00010000:0.0:1787191342.300903:0:57938:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) for lock 0xe5129dc88483a9cc 00000080:00010000:0.0:1787191342.300908:0:57938:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) 00000080:00010000:0.0:1787191342.300911:0:57938:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a9cc from it ffffa3fb422dbcd8 00010000:00010000:0.0:1787191342.300915:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a9cc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606a2d expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.300924:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a9cc lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606a2d expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191342.300956:0:57938:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdc:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1787191342.300965:0:57938:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdc:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191342.300968:0:57938:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191342.300972:0:57938:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xdc:0x0] 00000008:00010000:0.0:1787191342.300987:0:57938:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191342.300990:0:57938:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee6430, osc lock ffff936b50b62390, flags 0x400000400001002 00010000:00010000:0.0:1787191342.301039:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.301051:0:57938:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.301062:0:57938:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b6a476680 x1874004626782080/t0(0) o101->lustre-OST0000-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:0.0:1787191342.301090:0:57938:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:1.0:1787191342.301177:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626782080:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191342.302787:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191342.303723:0:51131:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787191342.303742:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634921728 00000100:00100000:3.0:1787191342.303751:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634921728 00000100:00100000:3.0:1787191342.303908:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1445 00000100:00100000:3.0:1787191342.303918:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b50882050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634921728:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191342.303934:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc88483a9c5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4606a34 expref: -99 pid: 57940 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191342.303989:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191342.303994:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b50882050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634921728:12345-192.168.202.101@tcp:104: Request processed in 79us (1213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191342.304001:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1445 00010000:00010000:1.0:1787191342.304217:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191342.304225:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc88483a9c5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4606a34 expref: -99 pid: 57940 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.304234:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b6a609e00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191342.304238:0:57627:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc88483a9c5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4606a34 expref: -99 pid: 57940 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.304246:0:57627:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc88483a9c5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4606a34 expref: -99 pid: 57940 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.304254:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc88483a9c5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4606a34 expref: -99 pid: 57940 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191342.304299:0:57627:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xdd:0x0]: losing layout lock 00010000:00010000:1.0:1787191342.304341:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc88483a9c5 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4606a34 expref: -99 pid: 57940 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.304349:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191342.304374:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc88483a9c5 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4606a34 expref: -99 pid: 57940 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.304388:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609e00/0xe5129dc88483a9c5 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4606a34 expref: -99 pid: 57940 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.304411:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191342.304413:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191342.304414:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191342.304427:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787191342.304439:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626782208:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787191342.304887:0:2389:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.304903:0:2389:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.304916:0:2389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.304928:0:2389:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191342.304941:0:2389:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 5, setting rss=5; kms=5, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 5/2,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1787191342.304952:0:2389:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1787191342.304961:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.304969:0:2389:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.304977:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.304985:0:2389:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1787191342.304998:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626782080:192.168.202.101@tcp:101:lfs.0 00000080:00200000:2.0:1787191342.305411:0:57938:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xdc:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191342.305418:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509b94d0 (ffff936b47a17bd8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191342.305421:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509b94d0 (ffff936b47a17bd8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.305425:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee6430 (ffff936b47a176c8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.305429:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509b94d0 (ffff936b47a17bd8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191342.305432:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee6430 (ffff936b47a17bd8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191342.305461:0:57938:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdc:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:1.0:1787191342.311115:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626782208:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191342.311996:0:57940:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57940:1874004626781952:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191342.312013:0:57940:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483a9d3 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xdd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.312037:0:57940:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483a9d3 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xdd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.312044:0:57940:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483a9d3 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xdd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.312051:0:57940:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483a9d3 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xdd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.312060:0:57940:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483a9d3 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xdd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.312067:0:57940:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51fe0a00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191342.312072:0:57940:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483a9d3 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xdd:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.312078:0:57940:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483a9d3 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xdd:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.312085:0:57940:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483a9d3 lrc: 5/0,0 mode: --/CR res: [0x200000405:0xdd:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.312092:0:57940:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191342.312098:0:57940:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483a9d3 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xdd:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.312109:0:57940:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483a9d3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xdd:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57940 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191342.312134:0:57940:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b6a477800 x1874004626781952/t8589937078(8589937078) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191342.312147:0:57940:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477800 x1874004626781952/t8589937078(8589937078) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191342.312163:0:57940:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xdd:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787191342.312257:0:57940:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdd:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1787191342.312266:0:57940:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdd:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191342.312328:0:57940:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xdd:0x0], updating i_size 0 00000002:00100000:1.0:1787191342.312358:0:57940:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477800 x1874004626781952/t8589937078(8589937078) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191342.312416:0:57940:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a477800 x1874004626781952/t8589937078(8589937078) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191342.312426:0:57940:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191342.312431:0:57940:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453ab100 x1874004626782464/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191342.312453:0:57940:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57940:1874004626782464:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191342.312534:0:57940:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628933c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191342.316479:0:57940:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57940:1874004626782464:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191342.316517:0:57940:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a477800 x1874004626781952/t8589937078(8589937078) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1787191342.316701:0:57940:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xdd:0x0](ffff936b53969148), flags 100001 00000002:00100000:1.0:1787191342.316752:0:57940:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a474a80 x1874004626781568/t8589937077(8589937077) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191342.316762:0:57940:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191342.316768:0:57940:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8380 x1874004626782720/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191342.316790:0:57940:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57940:1874004626782720:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191342.316892:0:57940:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628933c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191342.319191:0:57940:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57940:1874004626782720:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191342.319421:0:57940:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a474a80 x1874004626781568/t8589937077(8589937077) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191342.321241:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191342.321268:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.321286:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.321302:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.321310:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191342.321317:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191342.321321:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191342.321329:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:0.0:1787191342.321333:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.321342:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.321364:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.321371:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191342.321378:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.321482:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:0.0:1787191342.321493:0:57570:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b42f3b500, open_flags 8241, mode 81b6 opened 0 00000080:00200000:0.0:1787191342.321502:0:57570:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:0.0:1787191342.321522:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xde:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0101102 00010000:00010000:0.0:1787191342.321580:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a9e1 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.321589:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a9e1 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191342.321600:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191342.321612:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474380 x1874004626782976/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191342.321621:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a9e1 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.321641:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626782976:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191342.321782:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99840 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.324816:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626782976:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191342.324921:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a9e1 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606a73 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.324952:0:57570:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a9e1 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606a73 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.324962:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a9e1 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606a73 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.324973:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a9e1 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606a73 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.324985:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a9e1 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606a73 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.324998:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a9e1 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606a73 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.325007:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a9e1 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606a73 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.325014:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a9e1 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606a73 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.325039:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x2b, status=0 req@ffff936b6a474380 x1874004626782976/t8589937081(8589937081) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191342.325054:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474380 x1874004626782976/t8589937081(8589937081) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191342.325068:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a9e1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606a73 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191342.325081:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a9e1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606a73 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.325091:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/221 (0 0) 00000080:00200000:0.0:1787191342.325099:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191342.325256:0:57570:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xdd:0x0](ffff936b53969148): rc = 0 00000080:00200000:0.0:1787191342.325274:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xdd:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:0.0:1787191342.325280:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdd:0x0](ffff936b53969148) for lock 0xe5129dc88483a9e1 00000080:00010000:0.0:1787191342.325291:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xdd:0x0](ffff936b53969148) 00000080:00200008:0.0:1787191342.325305:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xdd:0x0](ffff936b53969148), flags 101101 00000002:00100000:0.0:1787191342.325327:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474380 x1874004626782976/t8589937081(8589937081) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191342.325356:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a9e1 from it ffff936b530f5e40 00010000:00010000:0.0:1787191342.325361:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a9e1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606a73 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.325370:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a9e1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606a73 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191342.325390:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xdd:0x0](ffff936b53969148), inode mode 81a4 mask 42 00000002:00010000:0.0:1787191342.325478:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xdd:0x0], intent: getxattr flags 0 00010000:00010000:0.0:1787191342.325519:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483a9e8 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.325527:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483a9e8 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.325537:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483a9e8 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.325559:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626783104:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191342.325651:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99840 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.328562:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626783104:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191342.328589:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483a9e8 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606a88 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.328603:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483a9e8 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606a88 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.328613:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483a9e8 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606a88 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.328628:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b6a475500 x1874004626783104/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191342.328639:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483a9e8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606a88 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.328650:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/221 (0 0) 00000080:00200000:0.0:1787191342.328667:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xdd:0x0] suppgids 0 -1: rc 0 00000080:00010000:0.0:1787191342.328692:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdd:0x0](ffff936b53969148) for lock 0xe5129dc88483a9e8 00000080:00010000:0.0:1787191342.328700:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a9e8 from it ffffa3fb41caba38 00010000:00010000:0.0:1787191342.328704:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483a9e8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606a88 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.328713:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483a9e8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606a88 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:0.0:1787191342.328748:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xdd:0x0](ffff936b53969148) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191342.000000000, mtime 1787191342.000000000, ctime 1787191342.000000000 00010000:00010000:0.0:1787191342.328781:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a9e1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4606a73 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191342.328802:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xdd:0x0]: losing layout lock 00010000:00010000:0.0:1787191342.329322:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a9e1 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606a73 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.329331:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191342.329334:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483a9e1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606a73 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1787191342.329354:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1787191342.329361:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475500 x1874004626783360/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787191342.329383:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626783360:192.168.202.101@tcp:36:bash.0 00000100:00100000:0.0:1787191342.329558:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99840 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.332095:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626783360:192.168.202.101@tcp:36:bash.0 00000080:00200000:0.0:1787191342.332266:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:0.0:1787191342.332273:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdd:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00010000:00010000:0.0:1787191342.332289:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/221 (0 0) 00000080:00010000:0.0:1787191342.332302:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xdd:0x0](ffff936b53969148) 00000002:00010000:0.0:1787191342.332311:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xdd:0x0]) in obj [0x200000405:0xdd:0x0], intent: layout flags 0 00010000:00010000:0.0:1787191342.332355:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f600/0xe5129dc88483a9ef lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.332364:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f600/0xe5129dc88483a9ef lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.332374:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f600/0xe5129dc88483a9ef lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.332486:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626783488:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191342.332619:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99840 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.339360:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626783488:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191342.339390:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f600/0xe5129dc88483a9ef lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xdd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606a96 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.340554:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f600/0xe5129dc88483a9ef lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xdd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606a96 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.340585:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b6a475f80 x1874004626783488/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191342.340793:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f600/0xe5129dc88483a9ef lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606a96 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191342.340811:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f600/0xe5129dc88483a9ef lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606a96 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.340823:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/221 (0 0) 00000080:00200000:0.0:1787191342.340829:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xdd:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191342.340942:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdd:0x0](ffff936b53969148) for lock 0xe5129dc88483a9ef 00000080:00010000:0.0:1787191342.340953:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a9ef from it ffffa3fb41cab8c8 00010000:00010000:0.0:1787191342.340958:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f600/0xe5129dc88483a9ef lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606a96 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.340968:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f600/0xe5129dc88483a9ef lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606a96 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.340996:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f600/0xe5129dc88483a9ef lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xdd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606a96 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.341008:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f600/0xe5129dc88483a9ef lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xdd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606a96 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1787191342.341026:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xdd:0x0](0000000042c6b655) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f600/0xe5129dc88483a9ef lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606a96 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191342.341072:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xdd:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:0.0:1787191342.341079:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f600/0xe5129dc88483a9ef lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606a96 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.341087:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f600/0xe5129dc88483a9ef lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606a96 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:0.0:1787191342.341284:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xdd:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:0.0:1787191342.341292:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdd:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191342.341296:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xdd:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:0.0:1787191342.341305:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xdd:0x0](ffff936b53969148) 00000002:00010000:0.0:1787191342.341314:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xdd:0x0]) in obj [0x200000405:0xdd:0x0], intent: layout flags 02 00010000:00010000:0.0:1787191342.341330:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f600/0xe5129dc88483a9ef lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4606a96 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191342.341343:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xdd:0x0]: losing layout lock 00010000:00010000:0.0:1787191342.341376:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f600/0xe5129dc88483a9ef lrc: 1/0,0 mode: --/CR res: [0x200000405:0xdd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606a96 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191342.341383:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191342.341386:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f600/0xe5129dc88483a9ef lrc: 0/0,0 mode: --/CR res: [0x200000405:0xdd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606a96 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191342.341797:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7e600/0xe5129dc88483a9f6 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xdd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.341805:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7e600/0xe5129dc88483a9f6 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xdd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191342.341817:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191342.341826:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475f80 x1874004626783744/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191342.341926:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7e600/0xe5129dc88483a9f6 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xdd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.341948:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626783744:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191342.342043:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99840 going to sleep for 11 seconds 00000080:00200080:2.0:1787191342.350726:0:57938:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88) cmd=400866b1 arg=1 00000080:00200008:2.0:1787191342.350746:0:57938:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xdc:0x0](ffff936b5396ba88), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191342.350755:0:57938:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88),name=f70.sanity-flr 00000002:00010000:2.0:1787191342.350778:0:57938:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xdc:0x0]) in obj [0x200000405:0xdc:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.350794:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a9cc lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606a2d expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.350807:0:57938:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a9cc lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606a2d expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191342.350814:0:57938:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xdc:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191342.350822:0:57938:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) 00000080:00010000:2.0:1787191342.350825:0:57938:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) for lock 0xe5129dc88483a9cc 00000080:00010000:2.0:1787191342.351014:0:57938:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a9cc from it ffffa3fb422dbcd8 00010000:00010000:2.0:1787191342.351492:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a9cc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606a2d expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.351503:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a9cc lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606a2d expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191342.351533:0:57938:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdc:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:2.0:1787191342.351545:0:57938:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdc:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191342.351548:0:57938:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191342.351551:0:57938:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xdc:0x0] 00000008:00010000:2.0:1787191342.351570:0:57938:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191342.351574:0:57938:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1b30, osc lock ffff936b44e63430, flags 0x400000400001002 00010000:00010000:2.0:1787191342.351598:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.351611:0:57938:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:2.0:1787191342.351622:0:57938:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191342.351626:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.351633:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:2.0:1787191342.351643:0:57938:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191342.351652:0:57938:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xdc:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191342.351657:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509b86f0 (ffff936b47a175a8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191342.351660:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509b86f0 (ffff936b47a175a8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.351663:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1b30 (ffff936b47a17248/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.351667:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509b86f0 (ffff936b47a175a8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191342.351669:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1b30 (ffff936b47a175a8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191342.351681:0:57938:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdc:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191342.351699:0:57938:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xdc:0x0], offset: 0, type: SEEK_DATA 00000080:00200000:2.0:1787191342.351705:0:57938:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdc:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:2.0:1787191342.351708:0:57938:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdc:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191342.351711:0:57938:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191342.351715:0:57938:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191342.351721:0:57938:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191342.351733:0:57938:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xdc:0x0] updating i_size 5 i_blocks 8 00000080:00200000:2.0:1787191342.351741:0:57938:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdc:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191342.351746:0:57938:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000080:00200000:2.0:1787191342.351748:0:57938:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdc:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191342.351753:0:57938:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191342.351755:0:57938:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191342.351758:0:57938:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:2.0:1787191342.351765:0:57938:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:2.0:1787191342.351767:0:57938:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1b30, osc lock ffff936b44e63430, flags 0x0 00010000:00010000:2.0:1787191342.351776:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191342.351786:0:57938:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191342.351795:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191342.351801:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191342.351808:0:57938:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000100:00100000:0.0:1787191342.351809:0:57570:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589937084 gen 1 00000080:00200000:2.0:1787191342.351818:0:57938:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xdc:0x0] updating i_size 5 i_blocks 8 00000100:00100000:0.0:1787191342.352001:0:57570:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b6a474380 x1874004626782976/t8589937081(8589937081) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787191342.352007:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626783872:192.168.202.101@tcp:23:lfs.0 00000100:00100000:0.0:1787191342.352028:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626783744:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191342.352044:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7e600/0xe5129dc88483a9f6 lrc: 4/0,1 mode: --/EX res: [0x200000405:0xdd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606aa4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.352052:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7e600/0xe5129dc88483a9f6 lrc: 4/0,1 mode: --/CR res: [0x200000405:0xdd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606aa4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.352062:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7e600/0xe5129dc88483a9f6 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xdd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606aa4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.352072:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7e600/0xe5129dc88483a9f6 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xdd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606aa4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.352081:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7e600/0xe5129dc88483a9f6 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xdd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606aa4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.352088:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7e600/0xe5129dc88483a9f6 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xdd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606aa4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.352094:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7e600/0xe5129dc88483a9f6 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xdd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606aa4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.352103:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b6a475f80 x1874004626783744/t8589937084(8589937084) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191342.352242:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7e600/0xe5129dc88483a9f6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606aa4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191342.352255:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7e600/0xe5129dc88483a9f6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606aa4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.352264:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/221 (0 0) 00000080:00200000:1.0:1787191342.352270:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xdd:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191342.352281:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdd:0x0](ffff936b53969148) for lock 0xe5129dc88483a9f6 00000080:00010000:1.0:1787191342.352298:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a9f6 from it ffffa3fb41cab930 00010000:00010000:1.0:1787191342.352301:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7e600/0xe5129dc88483a9f6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606aa4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.352309:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7e600/0xe5129dc88483a9f6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606aa4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191342.352320:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:1.0:1787191342.352324:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdd:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:1.0:1787191342.352335:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7e600/0xe5129dc88483a9f6 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xdd:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606aa4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.352402:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7e600/0xe5129dc88483a9f6 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xdd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606aa4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:1.0:1787191342.352411:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xdd:0x0](0000000042c6b655) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7e600/0xe5129dc88483a9f6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606aa4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.352444:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7e600/0xe5129dc88483a9f6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606aa4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.352457:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7e600/0xe5129dc88483a9f6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606aa4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191342.352471:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdd:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1787191342.352475:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdd:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191342.352477:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191342.352479:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191342.352484:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191342.352490:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdd:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:1.0:1787191342.352499:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7e600/0xe5129dc88483a9f6 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xdd:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606aa4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.352504:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7e600/0xe5129dc88483a9f6 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xdd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606aa4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:1.0:1787191342.352509:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xdd:0x0](0000000042c6b655) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7e600/0xe5129dc88483a9f6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606aa4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191342.352520:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdd:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1787191342.352523:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdd:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191342.352524:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191342.352525:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191342.352546:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191342.352549:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdd:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191342.352616:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xdd:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:1.0:1787191342.352622:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7e600/0xe5129dc88483a9f6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606aa4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.352635:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7e600/0xe5129dc88483a9f6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdd:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606aa4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00020000:00200000:1.0:1787191342.352643:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xdd:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:1.0:1787191342.352646:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdd:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191342.352647:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191342.352651:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191342.352658:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191342.352660:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:1.0:1787191342.352666:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:1.0:1787191342.352668:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b628933f0, osc lock ffff936b468377c0, flags 0x80000000 00000008:00010000:1.0:1787191342.352670:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:1.0:1787191342.352671:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b62893430, osc lock ffff936b46836ab0, flags 0x80000000 00010000:00010000:1.0:1787191342.352695:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a9fd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.352701:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a9fd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.352708:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a9fd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191342.352718:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626784000:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191342.352740:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893900 going to sleep for 11 seconds 00000100:00100000:2.0:1787191342.356710:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626783872:192.168.202.101@tcp:23:lfs.0 00000020:00010000:0.0:1787191342.356728:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894d58 (ffff936b47a175a8/0) at cl_lock_release():245 00000020:00010000:0.0:1787191342.356733:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894d58 (ffff936b47a175a8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191342.356738:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1b30 (ffff936b47a17248/1) at cl_lock_cancel():142 00010000:00010000:0.0:1787191342.356748:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191342.356765:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00010000:0.0:1787191342.356781:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894d58 (ffff936b47a175a8/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191342.356784:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1b30 (ffff936b47a175a8/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191342.356801:0:57938:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdc:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1787191342.356813:0:57938:0:(file.c:5244:ll_file_seek()) COMPLETED file f70.sanity-flr:[0x200000405:0xdc:0x0], offset: 0, type: SEEK_DATA, rc = 0 00000080:00200008:0.0:1787191342.356827:0:57938:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xdc:0x0], offset: 0, type: SEEK_HOLE 00000100:00100000:1.0:1787191342.356910:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626784000:192.168.202.101@tcp:101:bash.0 00000080:00200000:0.0:1787191342.356918:0:57938:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdc:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:0.0:1787191342.356926:0:57938:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdc:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00010000:00010000:1.0:1787191342.356927:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a9fd lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606aab expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00020000:00200000:0.0:1787191342.356929:0:57938:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191342.356934:0:57938:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191342.356942:0:57938:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00010000:00010000:1.0:1787191342.356942:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a9fd lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4606aab expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.356952:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a9fd lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4606aab expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1787191342.356957:0:57938:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xdc:0x0] updating i_size 5 i_blocks 8 00000080:00200000:0.0:1787191342.356962:0:57938:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdc:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:1.0:1787191342.356965:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a9fd lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4606aab expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1787191342.356967:0:57938:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000080:00200000:0.0:1787191342.356970:0:57938:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdc:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191342.356974:0:57938:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191342.356976:0:57938:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000008:00010000:1.0:1787191342.356976:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a9fd lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4606aab expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1787191342.356979:0:57938:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00010000:00010000:1.0:1787191342.356986:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a9fd lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606aab expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191342.356989:0:57938:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:0.0:1787191342.356991:0:57938:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee67b0, osc lock ffff936b50b62f70, flags 0x0 00010000:00010000:1.0:1787191342.356994:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a9fd lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606aab expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.357006:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191342.357028:0:57938:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191342.357044:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191342.357051:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191342.357054:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa04 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.357060:0:57938:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191342.357063:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa04 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1787191342.357070:0:57938:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xdc:0x0] updating i_size 5 i_blocks 8 00010000:00010000:1.0:1787191342.357071:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa04 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191342.357089:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626784128:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191342.357111:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787191342.357130:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626784256:192.168.202.101@tcp:23:lfs.0 00000100:00100000:1.0:1787191342.358296:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893900 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.360128:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626784256:192.168.202.101@tcp:23:lfs.0 00000020:00010000:2.0:1787191342.360202:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894d58 (ffff936b47a175a8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191342.360207:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894d58 (ffff936b47a175a8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.360212:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee67b0 (ffff936b47a17248/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191342.360221:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191342.360235:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00010000:2.0:1787191342.360249:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894d58 (ffff936b47a175a8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191342.360252:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee67b0 (ffff936b47a175a8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191342.360267:0:57938:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdc:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191342.360277:0:57938:0:(file.c:5244:ll_file_seek()) COMPLETED file f70.sanity-flr:[0x200000405:0xdc:0x0], offset: 0, type: SEEK_HOLE, rc = 5 00000080:00200080:2.0:1787191342.360290:0:57938:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88) cmd=400866b1 arg=0 00000080:00200080:2.0:1787191342.360300:0:57938:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88) cmd=400866b1 arg=1 00000080:00200008:2.0:1787191342.360307:0:57938:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xdc:0x0](ffff936b5396ba88), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191342.360314:0:57938:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88),name=f70.sanity-flr 00000002:00010000:2.0:1787191342.360332:0:57938:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xdc:0x0]) in obj [0x200000405:0xdc:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.360356:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a9cc lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606a2d expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191342.360367:0:57938:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a9cc lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606a2d expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191342.360373:0:57938:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xdc:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191342.360379:0:57938:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) 00000080:00010000:2.0:1787191342.360381:0:57938:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) for lock 0xe5129dc88483a9cc 00000080:00010000:2.0:1787191342.360386:0:57938:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a9cc from it ffffa3fb422dbcd8 00010000:00010000:2.0:1787191342.360388:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a9cc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606a2d expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191342.360393:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a9cc lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606a2d expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191342.360408:0:57938:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdc:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:2.0:1787191342.360414:0:57938:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdc:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191342.360416:0:57938:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191342.360419:0:57938:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xdc:0x0] 00000008:00010000:2.0:1787191342.360430:0:57938:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191342.360432:0:57938:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1330, osc lock ffff936b44e630a0, flags 0x400000400001002 00010000:00010000:2.0:1787191342.360442:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191342.360448:0:57938:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:2.0:1787191342.360456:0:57938:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191342.360459:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191342.360464:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000020:00200000:2.0:1787191342.360468:0:57938:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191342.360475:0:57938:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xdc:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191342.360477:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509b86f0 (ffff936b47a175a8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191342.360478:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509b86f0 (ffff936b47a175a8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.360480:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1330 (ffff936b47a17248/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.360481:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509b86f0 (ffff936b47a175a8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191342.360483:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1330 (ffff936b47a175a8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191342.360487:0:57938:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdc:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191342.360505:0:57938:0:(file.c:2483:do_file_read_iter()) START file f70.sanity-flr:[0x200000405:0xdc:0x0], ppos: 0, count: 4096 00000080:00200000:2.0:1787191342.360511:0:57938:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: read ppos: 0, bytes: 4096 00000080:00200000:2.0:1787191342.360517:0:57938:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000020:00200000:2.0:1787191342.360521:0:57938:0:(cl_io.c:214:cl_io_rw_init()) header@000000006f9502d7[0x110, 2, [0x200000405:0xdc:0x0] hash] 00000020:00200000:2.0:1787191342.360523:0:57938:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 4096) 2048 0 00000080:00200000:2.0:1787191342.360525:0:57938:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdc:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00000080:00200000:2.0:1787191342.360530:0:57938:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1787191342.360535:0:57938:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:2.0:1787191342.360538:0:57938:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1787191342.360546:0:57938:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:2.0:1787191342.360552:0:57938:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:2.0:1787191342.360554:0:57938:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1330, osc lock ffff936b44e630a0, flags 0x40000 00000080:00200000:2.0:1787191342.360557:0:57938:0:(vvp_io.c:835:vvp_io_read_start()) f70.sanity-flr: read [0, 4096) 00000001:00010000:2.0:1787191342.360561:0:57938:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xdc:0x0] 00000008:00010000:2.0:1787191342.360564:0:57938:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191342.360565:0:57938:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d19b0, osc lock ffff936b44e63690, flags 0x400001002 00010000:00010000:2.0:1787191342.360569:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1787191342.360577:0:57938:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000020:00200000:2.0:1787191342.360585:0:57938:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191342.360588:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1787191342.360595:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00000020:00200000:2.0:1787191342.360602:0:57938:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191342.360606:0:57938:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xdc:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191342.360608:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509b86f0 (ffff936b47a175a8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191342.360611:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509b86f0 (ffff936b47a175a8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.360613:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d19b0 (ffff936b47a17248/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.360616:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509b86f0 (ffff936b47a175a8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191342.360618:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d19b0 (ffff936b47a175a8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191342.360624:0:57938:0:(vvp_io.c:893:vvp_io_read_start()) count:4096 iocb pos:0 00000080:00200000:2.0:1787191342.360630:0:57938:0:(rw26.c:362:ll_direct_IO()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88), size=4096 (max 536870912), offset=0=0x0, pages 1 (max 131072), lockless, parallel 00000020:00200000:2.0:1787191342.360671:0:57938:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1787191342.360672:0:57938:0:(rw26.c:544:ll_direct_IO()) result 0 tot_bytes 5 count 5 file_offset 5 00000020:00010000:2.0:1787191342.360676:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894d58 (ffff936b47a175a8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191342.360678:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894d58 (ffff936b47a175a8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.360679:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1330 (ffff936b47a17248/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.360681:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894d58 (ffff936b47a175a8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191342.360683:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1330 (ffff936b47a175a8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191342.360686:0:57938:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000020:00200000:2.0:1787191342.360690:0:57938:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1787191342.360703:0:25580:0:(osc_cache.c:2029:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff936b466996c0 00000008:00100000:2.0:1787191342.360736:0:25580:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff936b513ba680 - object 0x280000401:464 offset 0<>5 00000100:00100000:2.0:1787191342.360770:0:2392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787191342.360784:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626784384:192.168.202.101@tcp:3:lfs.0 00000100:00100000:1.0:1787191342.361484:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626784128:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191342.361504:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa04 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606ab2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.361520:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa04 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4606ab2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.361532:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa04 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4606ab2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.361543:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa04 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4606ab2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191342.361554:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa04 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4606ab2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.361564:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa04 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606ab2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.361571:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa04 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606ab2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191342.361718:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787191342.361730:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626784512:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191342.361878:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626784640:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191342.364364:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626784512:192.168.202.101@tcp:10:bash.0 00000008:00010000:2.0:1787191342.364907:0:2392:0:(osc_cache.c:917:osc_extent_finish()) ### no dlm lock: extent: ffff936b466996c0 00000020:00200000:2.0:1787191342.364914:0:2392:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:2.0:1787191342.364923:0:2392:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:2.0:1787191342.364941:0:2392:0:(osc_cache.c:497:__osc_extent_remove()) ### no dlm lock: extent: ffff936b466996c0 00000100:00100000:2.0:1787191342.364961:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626784384:192.168.202.101@tcp:3:lfs.0 00000080:00200000:0.0:1787191342.364968:0:57938:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:0.0:1787191342.364980:0:57938:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdc:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191342.364985:0:57938:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 1 io complete with rc: 0, result: 5, restart: 0 00000020:00200000:0.0:1787191342.364988:0:57938:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191342.364995:0:57938:0:(file.c:2324:ll_file_io_generic()) iot: 1, result: 5 00000080:00200080:0.0:1787191342.365013:0:57938:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88) cmd=400866b1 arg=0 00000080:00200080:0.0:1787191342.365035:0:57938:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88) cmd=400866b1 arg=2 00000080:00200008:0.0:1787191342.365045:0:57938:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xdc:0x0](ffff936b5396ba88), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191342.365053:0:57938:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88),name=f70.sanity-flr 00000002:00010000:0.0:1787191342.365072:0:57938:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xdc:0x0]) in obj [0x200000405:0xdc:0x0], intent: getattr flags 0 00000100:00100000:1.0:1787191342.365074:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626784640:192.168.202.101@tcp:10:bash.0 00010000:00010000:0.0:1787191342.365089:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a9cc lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606a2d expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191342.365113:0:57938:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a9cc lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606a2d expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191342.365127:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xdd:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191342.365134:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b628948a8 (ffff936b47a17998/0) at cl_lock_release():245 00000020:00010000:2.0:1787191342.365137:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b628948a8 (ffff936b47a17998/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.365141:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b628933f0 (ffff936b465cc908/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191342.365149:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a9fd lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606aab expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.365160:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a9fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606aab expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191342.365175:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62893430 (ffff936b465cc878/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191342.365180:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa04 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606ab2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.365187:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606ab2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191342.365201:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b628948a8 (ffff936b47a17998/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191342.365204:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b628933f0 (ffff936b47a17998/1) at cl_lock_fini():72 00000020:00010000:2.0:1787191342.365208:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62893430 (ffff936b47a17998/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191342.365223:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdd:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191342.365230:0:57938:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xdc:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191342.365237:0:57938:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) 00000080:00010000:0.0:1787191342.365240:0:57938:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) for lock 0xe5129dc88483a9cc 00000080:00010000:0.0:1787191342.365246:0:57938:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a9cc from it ffffa3fb422dbcd8 00010000:00010000:0.0:1787191342.365249:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a9cc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606a2d expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200008:2.0:1787191342.365252:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xdd:0x0](ffff936b53969148) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191342.000000000, mtime 1787191342.000000000, ctime 1787191342.000000000, rc 0 00010000:00010000:0.0:1787191342.365257:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a9cc lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606a2d expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1787191342.365275:0:57938:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdc:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00000080:00200008:2.0:1787191342.365331:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xdd:0x0], ppos: 0, count: 5 00000080:00200000:2.0:1787191342.365401:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00020000:00200000:0.0:1787191342.365402:0:57938:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdc:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191342.365405:0:57938:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000080:00200000:2.0:1787191342.365407:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000001:00010000:0.0:1787191342.365409:0:57938:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xdc:0x0] 00000080:00200000:2.0:1787191342.365410:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:2.0:1787191342.365415:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1787191342.365420:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@000000002edcf4f9[0x110, 1, [0x200000405:0xdd:0x0] hash] 00000020:00200000:2.0:1787191342.365422:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000008:00010000:0.0:1787191342.365425:0:57938:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000080:00200000:2.0:1787191342.365425:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdd:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00000008:00010000:0.0:1787191342.365428:0:57938:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee65b0, osc lock ffff936b50b62ab0, flags 0x400000400001002 00020000:00200000:2.0:1787191342.365434:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xdd:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:2.0:1787191342.365437:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdd:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191342.365439:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00010000:00010000:0.0:1787191342.365441:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00000080:00200000:2.0:1787191342.365442:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1787191342.365447:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:2.0:1787191342.365449:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00010000:00010000:0.0:1787191342.365450:0:57938:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00000020:00200000:0.0:1787191342.365459:0:57938:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1787191342.365459:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00010000:00010000:0.0:1787191342.365463:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00000008:00010000:2.0:1787191342.365467:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00010000:00010000:0.0:1787191342.365470:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 0 00000008:00010000:2.0:1787191342.365471:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1330, osc lock ffff936b44e630a0, flags 0x0 00010000:00010000:2.0:1787191342.365478:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a9fd lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606aab expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:0.0:1787191342.365479:0:57938:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191342.365484:0:57938:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xdc:0x0] updating i_size 5 i_blocks 8 00000020:00010000:0.0:1787191342.365487:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509b86f0 (ffff936b47a175a8/0) at cl_lock_release():245 00010000:00010000:2.0:1787191342.365487:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a9fd lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606aab expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:0.0:1787191342.365489:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509b86f0 (ffff936b47a175a8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191342.365492:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee65b0 (ffff936b47a17248/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191342.365495:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509b86f0 (ffff936b47a175a8/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191342.365498:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee65b0 (ffff936b47a175a8/1) at cl_lock_fini():72 00010000:00010000:2.0:1787191342.365502:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a9fd lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606aab expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191342.365504:0:57938:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdc:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:2.0:1787191342.365511:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a9fd lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606aab expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.365517:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a9fd lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606aab expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200008:0.0:1787191342.365521:0:57938:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xdc:0x0], ppos: 0, count: 4096 00000080:00200000:0.0:1787191342.365525:0:57938:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 4096 00000080:00200000:2.0:1787191342.365527:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:0.0:1787191342.365529:0:57938:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 2 00000020:00200000:0.0:1787191342.365533:0:57938:0:(cl_io.c:214:cl_io_rw_init()) header@000000006f9502d7[0x110, 2, [0x200000405:0xdc:0x0] hash] 00000020:00200000:0.0:1787191342.365534:0:57938:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 4096) 2048 0 00000080:00200000:2.0:1787191342.365535:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:0.0:1787191342.365537:0:57938:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdc:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00000080:00200000:0.0:1787191342.365542:0:57938:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:0.0:1787191342.365545:0:57938:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:0.0:1787191342.365548:0:57938:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x11 00000080:00200000:0.0:1787191342.365554:0:57938:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:0.0:1787191342.365559:0:57938:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:0.0:1787191342.365561:0:57938:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee65b0, osc lock ffff936b50b62ab0, flags 0x40000 00000080:00200000:0.0:1787191342.365565:0:57938:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 4096) append 0 append lockpos 0 00000080:00200000:2.0:1787191342.365578:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:2.0:1787191342.365585:0:57570:0:(rw26.c:927:ll_write_end()) page@00000000861c6314[3 00000000bc3a3a4d 2 1 0000000004f6bc01 0 0 0] 00000080:00200000:2.0:1787191342.365589:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @0000000010e86a58 17ffffc0001001 3:0 ffff936b43a1ed20 0 lru 00000080:00200000:2.0:1787191342.365606:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@00000000643634db 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000ef00a996 00000000fca7e965 > 3< 0 0 > 4< 0 0 8 484581376 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1787191342.365609:0:57570:0:(rw26.c:927:ll_write_end()) end page@00000000861c6314 00000080:00200000:2.0:1787191342.365610:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:2.0:1787191342.365614:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:2.0:1787191342.365631:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 00000000185964a3 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a9fd lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606aab expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191342.365647:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b539692f8, count 1, dirtied 1 00000080:00200000:2.0:1787191342.365652:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:2.0:1787191342.365654:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:2.0:1787191342.365666:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b497c95d8 (ffff936b465cc878/0) at cl_lock_release():245 00000020:00010000:2.0:1787191342.365669:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b497c95d8 (ffff936b465cc878/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.365671:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1330 (ffff936b465cc908/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191342.365675:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a9fd lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606aab expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.365684:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a9fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606aab expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:2.0:1787191342.365693:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b497c95d8 (ffff936b465cc878/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191342.365696:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1330 (ffff936b465cc878/1) at cl_lock_fini():72 00000002:00010000:0.0:1787191342.365700:0:57938:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xdc:0x0], intent: getxattr flags 0 00000080:00200000:2.0:1787191342.365701:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:2.0:1787191342.365704:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1787191342.365708:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdd:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191342.365710:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:2.0:1787191342.365715:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xdd:0x0] updating i_size 5 i_blocks 0 00000080:00200000:2.0:1787191342.365718:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:2.0:1787191342.365732:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xdd:0x0](ffff936b53969148), flags 100001 00010000:00010000:0.0:1787191342.365737:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f600/0xe5129dc88483aa0b lrc: 3/1,0 mode: --/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.365748:0:57938:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f600/0xe5129dc88483aa0b lrc: 3/1,0 mode: --/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.365758:0:57938:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f600/0xe5129dc88483aa0b lrc: 3/1,0 mode: --/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57938 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191342.365763:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a474380 x1874004626782976/t8589937081(8589937081) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191342.365773:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191342.365775:0:57938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626784768:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191342.365779:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513ba680 x1874004626785024/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191342.365789:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626785024:192.168.202.101@tcp:35:bash.0 00000100:00100000:0.0:1787191342.365909:0:57938:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99840 going to sleep for 11 seconds 00000100:00100000:2.0:1787191342.365965:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f300 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.368227:0:57938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626784768:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191342.368227:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626785024:192.168.202.101@tcp:35:bash.0 00010000:00010000:0.0:1787191342.368246:0:57938:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f600/0xe5129dc88483aa0b lrc: 4/1,0 mode: --/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606ac7 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191342.368253:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a474380 x1874004626782976/t8589937081(8589937081) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1787191342.368260:0:57938:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f600/0xe5129dc88483aa0b lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606ac7 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.368269:0:57938:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f600/0xe5129dc88483aa0b lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606ac7 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.368279:0:57938:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b6a475500 x1874004626784768/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1408 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191342.368299:0:57938:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f600/0xe5129dc88483aa0b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606ac7 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.368308:0:57938:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/220 (0 0) 00000080:00200000:0.0:1787191342.368313:0:57938:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xdc:0x0] suppgids 0 -1: rc 0 00000080:00010000:0.0:1787191342.368330:0:57938:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) for lock 0xe5129dc88483aa0b 00000080:00010000:0.0:1787191342.368337:0:57938:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483aa0b from it ffffa3fb422db8e8 00010000:00010000:0.0:1787191342.368340:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f600/0xe5129dc88483aa0b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606ac7 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.368349:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f600/0xe5129dc88483aa0b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606ac7 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191342.368379:0:57938:0:(rw26.c:362:ll_direct_IO()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88), size=4096 (max 536870912), offset=0=0x0, pages 1 (max 131072), lockless, parallel 00000020:00200000:0.0:1787191342.368447:0:57938:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:0.0:1787191342.368451:0:57938:0:(rw26.c:544:ll_direct_IO()) result 0 tot_bytes 4096 count 4096 file_offset 4096 00000080:00200000:0.0:1787191342.368463:0:57938:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xdc:0x0] updating i_size 5 i_blocks 8 00000020:00010000:0.0:1787191342.368469:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894d58 (ffff936b47a175a8/0) at cl_lock_release():245 00000020:00010000:0.0:1787191342.368472:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894d58 (ffff936b47a175a8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191342.368475:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee65b0 (ffff936b47a17248/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191342.368479:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894d58 (ffff936b47a175a8/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191342.368481:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee65b0 (ffff936b47a175a8/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191342.368488:0:57938:0:(vvp_io.c:533:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:0.0:1787191342.368495:0:57938:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:0.0:1787191342.368511:0:31426:0:(osc_cache.c:2029:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff936b532d5240 00000008:00100000:0.0:1787191342.368602:0:31426:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff936b6a475500 - object 0x2c0000401:468 offset 0<>4096 00000100:00100000:0.0:1787191342.368642:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626785152:192.168.202.101@tcp:4:lfs.0 00000080:00200000:2.0:1787191342.373944:0:57941:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191342.373973:0:57941:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.373989:0:57941:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.374011:0:57941:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.375456:0:57941:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191342.375467:0:57941:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191342.375472:0:57941:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191342.375480:0:57941:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4228bb58 00010000:00010000:2.0:1787191342.375485:0:57941:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.375496:0:57941:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.375514:0:57941:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.375524:0:57941:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191342.375532:0:57941:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.375549:0:57941:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:2.0:1787191342.375553:0:57941:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191342.375570:0:57941:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191342.375681:0:57941:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483aa12 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.375691:0:57941:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483aa12 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57941 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.375701:0:57941:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483aa12 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57941 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191342.375732:0:57941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57941:1874004626785280:192.168.202.101@tcp:101:rm.0 00000100:00100000:2.0:1787191342.376079:0:57941:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f300 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.376753:0:2390:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-ffff936b581fb000: committing for last_committed 17179870427 gen 1 00000008:00010000:0.0:1787191342.376823:0:2390:0:(osc_cache.c:917:osc_extent_finish()) ### no dlm lock: extent: ffff936b532d5240 00000020:00200000:0.0:1787191342.376829:0:2390:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:0.0:1787191342.376898:0:2390:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:0.0:1787191342.376913:0:2390:0:(osc_cache.c:497:__osc_extent_remove()) ### no dlm lock: extent: ffff936b532d5240 00000100:00100000:0.0:1787191342.376934:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626785152:192.168.202.101@tcp:4:lfs.0 00000080:00200000:2.0:1787191342.376938:0:57938:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1787191342.376971:0:57938:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdc:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191342.376976:0:57938:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:2.0:1787191342.376985:0:57938:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xdc:0x0] updating i_size 5 i_blocks 8 00000020:00200000:2.0:1787191342.376988:0:57938:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191342.377002:0:57938:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200080:2.0:1787191342.377032:0:57938:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88) cmd=400866b1 arg=0 00000080:00200080:2.0:1787191342.377040:0:57938:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88) cmd=400866b1 arg=1 00000080:00200008:2.0:1787191342.377050:0:57938:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xdc:0x0](ffff936b5396ba88), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191342.377057:0:57938:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88),name=f70.sanity-flr 00000002:00010000:2.0:1787191342.377072:0:57938:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xdc:0x0]) in obj [0x200000405:0xdc:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.377083:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a9cc lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606a2d expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191342.377095:0:57938:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a9cc lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606a2d expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:2.0:1787191342.377107:0:57938:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xdc:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191342.377113:0:57938:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) 00000080:00010000:2.0:1787191342.377117:0:57938:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) for lock 0xe5129dc88483a9cc 00000080:00010000:2.0:1787191342.377123:0:57938:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a9cc from it ffffa3fb422dbcd8 00010000:00010000:2.0:1787191342.377126:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a9cc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606a2d expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191342.377135:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a9cc lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606a2d expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00000080:00200000:2.0:1787191342.377156:0:57938:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdc:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:2.0:1787191342.377167:0:57938:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdc:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191342.377170:0:57938:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191342.377173:0:57938:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xdc:0x0] 00000008:00010000:2.0:1787191342.377192:0:57938:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191342.377195:0:57938:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d19b0, osc lock ffff936b44e630a0, flags 0x400000400001002 00010000:00010000:2.0:1787191342.377211:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 0 00010000:00010000:2.0:1787191342.377223:0:57938:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 0 00000020:00200000:2.0:1787191342.377233:0:57938:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191342.377236:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 0 00010000:00010000:2.0:1787191342.377244:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 0 00000020:00200000:2.0:1787191342.377254:0:57938:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191342.377259:0:57938:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xdc:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191342.377263:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51657c20 (ffff936b465cc878/0) at cl_lock_release():245 00000020:00010000:2.0:1787191342.377266:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51657c20 (ffff936b465cc878/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.377269:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d19b0 (ffff936b465cc908/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.377272:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51657c20 (ffff936b465cc878/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191342.377275:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d19b0 (ffff936b465cc878/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191342.377283:0:57938:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdc:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191342.377295:0:57938:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xdc:0x0], offset: 5, type: SEEK_DATA 00000080:00200000:2.0:1787191342.377300:0:57938:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdc:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:2.0:1787191342.377303:0:57938:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdc:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191342.377306:0:57938:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191342.377310:0:57938:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191342.377315:0:57938:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191342.377329:0:57938:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xdc:0x0] updating i_size 5 i_blocks 8 00000080:00200000:2.0:1787191342.377336:0:57938:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdc:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191342.377353:0:57938:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000080:00200000:2.0:1787191342.377356:0:57938:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdc:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191342.377360:0:57938:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191342.377364:0:57938:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191342.377366:0:57938:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:2.0:1787191342.377372:0:57938:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:2.0:1787191342.377374:0:57938:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d19b0, osc lock ffff936b44e630a0, flags 0x0 00010000:00010000:2.0:1787191342.377383:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 0 00010000:00010000:2.0:1787191342.377455:0:57938:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 0 00010000:00010000:2.0:1787191342.377468:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 0 00010000:00010000:2.0:1787191342.377475:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 0 00010000:00010000:2.0:1787191342.377483:0:57938:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 0 00000080:00200000:2.0:1787191342.377494:0:57938:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xdc:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191342.377499:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b497c95d8 (ffff936b465cc878/0) at cl_lock_release():245 00000020:00010000:2.0:1787191342.377501:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b497c95d8 (ffff936b465cc878/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.377504:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d19b0 (ffff936b465cc908/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191342.377507:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 0 00010000:00010000:2.0:1787191342.377515:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00000020:00010000:2.0:1787191342.377523:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b497c95d8 (ffff936b465cc878/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191342.377526:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d19b0 (ffff936b465cc878/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191342.377533:0:57938:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdc:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191342.377539:0:57938:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xdc:0x0], offset: 0, type: (null) 00000080:00200000:2.0:1787191342.377543:0:57938:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdc:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:2.0:1787191342.377547:0:57938:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdc:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191342.377550:0:57938:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191342.377552:0:57938:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xdc:0x0] 00000008:00010000:2.0:1787191342.377558:0:57938:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191342.377560:0:57938:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d19b0, osc lock ffff936b44e630a0, flags 0x400000400001002 00010000:00010000:2.0:1787191342.377568:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00010000:00010000:2.0:1787191342.377577:0:57938:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00000020:00200000:2.0:1787191342.377598:0:57938:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191342.377602:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00010000:00010000:2.0:1787191342.377609:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00000020:00200000:2.0:1787191342.377618:0:57938:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191342.377622:0:57938:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xdc:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191342.377625:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51657c20 (ffff936b465cc878/0) at cl_lock_release():245 00000020:00010000:2.0:1787191342.377628:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51657c20 (ffff936b465cc878/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.377630:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d19b0 (ffff936b465cc908/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.377633:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51657c20 (ffff936b465cc878/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191342.377635:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d19b0 (ffff936b465cc878/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191342.377641:0:57938:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdc:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191342.377648:0:57938:0:(file.c:5244:ll_file_seek()) COMPLETED file f70.sanity-flr:[0x200000405:0xdc:0x0], offset: 0, type: (null), rc = 5 00000080:00200080:2.0:1787191342.377653:0:57938:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88) cmd=400866b1 arg=0 00000100:00100000:1.0:1787191342.380726:0:57941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57941:1874004626785280:192.168.202.101@tcp:101:rm.0 00010000:00010000:1.0:1787191342.380751:0:57941:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483aa12 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606aea expref: -99 pid: 57941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.380772:0:57941:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483aa12 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606aea expref: -99 pid: 57941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.380779:0:57941:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483aa12 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606aea expref: -99 pid: 57941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.380789:0:57941:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483aa12 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606aea expref: -99 pid: 57941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.380799:0:57941:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483aa12 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606aea expref: -99 pid: 57941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.380810:0:57941:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483aa12 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606aea expref: -99 pid: 57941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.380817:0:57941:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483aa12 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606aea expref: -99 pid: 57941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.380824:0:57941:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483aa12 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606aea expref: -99 pid: 57941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191342.380859:0:57941:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b513b9f80 x1874004626785280/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/976 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191342.380871:0:57941:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483aa12 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606aea expref: -99 pid: 57941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191342.380887:0:57941:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483aa12 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606aea expref: -99 pid: 57941 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.380896:0:57941:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/221 (0 0) 00000080:00200000:1.0:1787191342.380902:0:57941:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191342.380951:0:57941:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xdd:0x0](ffff936b53969148): rc = 0 00000080:00200000:1.0:1787191342.380965:0:57941:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xdd:0x0]: layout version change: 4 -> 4 00000080:00010000:1.0:1787191342.380969:0:57941:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdd:0x0](ffff936b53969148) for lock 0xe5129dc88483aa12 00000080:00010000:1.0:1787191342.380979:0:57941:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xdd:0x0](ffff936b53969148) 00000080:00010000:1.0:1787191342.380982:0:57941:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483aa12 from it ffffa3fb4228bb20 00010000:00010000:1.0:1787191342.380986:0:57941:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483aa12 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606aea expref: -99 pid: 57941 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.381000:0:57941:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483aa12 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606aea expref: -99 pid: 57941 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200008:1.0:1787191342.381114:0:57941:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xdd:0x0](ffff936b53969148), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191342.381271:0:57941:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xdd:0x0](ffff936b53969148),name=f70.sanity-flr 00000002:00010000:1.0:1787191342.381350:0:57941:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xdd:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191342.381360:0:57941:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483aa12 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606aea expref: -99 pid: 57941 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.381370:0:57941:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483aa12 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606aea expref: -99 pid: 57941 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191342.381376:0:57941:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191342.381381:0:57941:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xdd:0x0](ffff936b53969148) 00000080:00010000:1.0:1787191342.381384:0:57941:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdd:0x0](ffff936b53969148) for lock 0xe5129dc88483aa12 00000080:00010000:1.0:1787191342.381388:0:57941:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483aa12 from it ffffa3fb4228bcb8 00010000:00010000:1.0:1787191342.381438:0:57941:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483aa12 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606aea expref: -99 pid: 57941 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.381446:0:57941:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483aa12 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606aea expref: -99 pid: 57941 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191342.381465:0:57941:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdd:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:1.0:1787191342.381474:0:57941:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdd:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191342.381477:0:57941:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191342.381479:0:57941:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xdd:0x0] 00000008:00010000:1.0:1787191342.381515:0:57941:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191342.381518:0:57941:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b44ca8130, osc lock ffff936b46837db0, flags 0x400000400001002 00010000:00010000:1.0:1787191342.381534:0:57941:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a9fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606aab expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.381544:0:57941:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a9fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606aab expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1787191342.381555:0:57941:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191342.381558:0:57941:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a9fd lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606aab expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.381741:0:57941:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a9fd lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606aab expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:1.0:1787191342.381755:0:57941:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191342.381763:0:57941:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xdd:0x0] updating i_size 5 i_blocks 0 00000020:00010000:1.0:1787191342.381768:0:57941:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51655030 (ffff936b465cc998/0) at cl_lock_release():245 00000020:00010000:1.0:1787191342.381771:0:57941:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51655030 (ffff936b465cc998/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191342.381773:0:57941:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b44ca8130 (ffff936b465cca28/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191342.381777:0:57941:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51655030 (ffff936b465cc998/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191342.381779:0:57941:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b44ca8130 (ffff936b465cc998/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191342.381788:0:57941:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdd:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191342.381901:0:57941:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191342.381912:0:57941:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191342.381919:0:57941:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191342.381932:0:57941:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191342.381938:0:57941:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191342.381942:0:57941:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191342.381944:0:57941:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191342.381948:0:57941:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4228bc10 00010000:00010000:1.0:1787191342.381951:0:57941:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191342.381958:0:57941:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191342.381966:0:57941:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191342.381972:0:57941:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:1.0:1787191342.381977:0:57941:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191342.381982:0:57941:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:1.0:1787191342.381986:0:57941:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:1.0:1787191342.381990:0:57941:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:1.0:1787191342.382009:0:57941:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7e600/0xe5129dc88483a9f6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdd:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4606aa4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191342.382036:0:57941:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xdd:0x0]: losing layout lock 00010000:00010000:1.0:1787191342.382047:0:57941:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483aa12 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4606aea expref: -99 pid: 57941 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191342.382054:0:57941:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xdd:0x0]: losing layout lock 00010000:00010000:1.0:1787191342.382061:0:57941:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483a9e8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4606a88 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.382098:0:57941:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7e600/0xe5129dc88483a9f6 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xdd:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606aa4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191342.382106:0:57941:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483aa12 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606aea expref: -99 pid: 57941 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.382112:0:57941:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483a9e8 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4606a88 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.382349:0:57941:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:1.0:1787191342.382354:0:57941:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7e600/0xe5129dc88483a9f6 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xdd:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606aa4 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191342.382367:0:57941:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483aa12 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606aea expref: -99 pid: 57941 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.382375:0:57941:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483a9e8 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xdd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4606a88 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1787191342.382446:0:57941:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1787191342.382457:0:57941:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453ab100 x1874004626785536/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787191342.382479:0:57941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57941:1874004626785536:192.168.202.101@tcp:36:rm.0 00000100:00100000:1.0:1787191342.382683:0:57941:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893900 going to sleep for 11 seconds 00000100:00100000:1.0:1787191342.386399:0:57941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57941:1874004626785536:192.168.202.101@tcp:36:rm.0 00000080:00200000:1.0:1787191342.386461:0:57941:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdd:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00020000:00200000:1.0:1787191342.386473:0:57941:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdd:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191342.386476:0:57941:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191342.386483:0:57941:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191342.386493:0:57941:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000008:00010000:1.0:1787191342.386512:0:57941:0:(osc_cache.c:1183:osc_extent_make_ready()) ### extent: 00000000185964a3 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a9fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606aab expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1787191342.386541:0:57941:0:(osc_cache.c:917:osc_extent_finish()) ### extent: 00000000185964a3 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a9fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606aab expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1787191342.386566:0:57941:0:(osc_cache.c:497:__osc_extent_remove()) ### extent: 00000000185964a3 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a9fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606aab expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191342.387372:0:57941:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdd:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191342.387410:0:57941:0:(llite_lib.c:2066:ll_clear_inode()) VFS Op:inode=[0x200000405:0xdd:0x0](ffff936b53969148) 00000008:00010000:1.0:1787191342.387439:0:57941:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 5 blocks 0 [cma]time 1787191342 1787191342 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a9fd lrc: 1/0,0 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606aab expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:1.0:1787191342.387462:0:57941:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191342 1787191342 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa04 lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606ab2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200080:2.0:1787191342.389719:0:57938:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88) cmd=400866b1 arg=2 00000080:00200008:2.0:1787191342.389736:0:57938:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xdc:0x0](ffff936b5396ba88), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191342.389744:0:57938:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88),name=f70.sanity-flr 00000002:00010000:2.0:1787191342.389764:0:57938:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xdc:0x0]) in obj [0x200000405:0xdc:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.389779:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a9cc lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606a2d expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00010000:00010000:2.0:1787191342.389792:0:57938:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a9cc lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606a2d expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00000080:00200000:2.0:1787191342.389800:0:57938:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xdc:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191342.389808:0:57938:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) 00000080:00010000:2.0:1787191342.389812:0:57938:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) for lock 0xe5129dc88483a9cc 00000080:00010000:2.0:1787191342.389819:0:57938:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483a9cc from it ffffa3fb422dbcd8 00010000:00010000:2.0:1787191342.389823:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a9cc lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606a2d expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00010000:00010000:2.0:1787191342.389848:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a9cc lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606a2d expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00000080:00200000:2.0:1787191342.389876:0:57938:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdc:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:2.0:1787191342.389887:0:57938:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdc:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191342.389890:0:57938:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191342.389893:0:57938:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xdc:0x0] 00000008:00010000:2.0:1787191342.389912:0:57938:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191342.389915:0:57938:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d19b0, osc lock ffff936b44e630a0, flags 0x400000400001002 00010000:00010000:2.0:1787191342.389931:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00010000:00010000:2.0:1787191342.389942:0:57938:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00000020:00200000:2.0:1787191342.389953:0:57938:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191342.389956:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00010000:00010000:2.0:1787191342.389968:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00000020:00200000:2.0:1787191342.389977:0:57938:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191342.389985:0:57938:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xdc:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191342.389988:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51657c20 (ffff936b465cc878/0) at cl_lock_release():245 00000020:00010000:2.0:1787191342.389991:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51657c20 (ffff936b465cc878/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.389993:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d19b0 (ffff936b465cc908/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.389996:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51657c20 (ffff936b465cc878/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191342.389998:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d19b0 (ffff936b465cc878/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191342.390008:0:57938:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdc:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191342.390047:0:57938:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xdc:0x0](ffff936b5396ba88) current size 5, valid attrs 2068, mode 0, uid -1322410190, gid -1, new size 5, atime 1787191342.000000000, mtime 1787191342.000000000, ctime 1787191342.000000000 00010000:00010000:2.0:1787191342.390066:0:57938:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a9cc lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4606a2d expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00010000:00010000:2.0:1787191342.390080:0:57938:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a9be lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606a0a expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191342.390185:0:57938:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a9cc lrc: 1/0,0 mode: --/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606a2d expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00010000:00010000:2.0:1787191342.390193:0:57938:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191342.390196:0:57938:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a608200/0xe5129dc88483a9cc lrc: 0/0,0 mode: --/PR res: [0x200000405:0xdc:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606a2d expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00000020:00100000:2.0:1787191342.390218:0:57938:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1787191342.390231:0:57938:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9f80 x1874004626785792/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787191342.390253:0:57938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626785792:192.168.202.101@tcp:36:lfs.0 00000100:00100000:2.0:1787191342.390355:0:57938:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787191342.393608:0:57938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626785792:192.168.202.101@tcp:36:lfs.0 00000080:00200000:2.0:1787191342.393652:0:57938:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 2 00000080:00200000:2.0:1787191342.393659:0:57938:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdc:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:2.0:1787191342.393679:0:57938:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x11 00000080:00200000:2.0:1787191342.393701:0:57938:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:2.0:1787191342.393717:0:57938:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1787191342.393722:0:57938:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b62b5ff30, osc lock ffff936b44e630a0, flags 0x0 00000008:00010000:2.0:1787191342.393727:0:57938:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1787191342.393729:0:57938:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b62b5ff70, osc lock ffff936b44e63690, flags 0x0 00010000:00010000:2.0:1787191342.393787:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000008d07e5df/0xe5129dc88483aa19 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.393799:0:57938:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000008d07e5df/0xe5129dc88483aa19 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.393811:0:57938:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000008d07e5df/0xe5129dc88483aa19 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191342.393854:0:57938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626785920:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191342.393923:0:57938:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f300 going to sleep for 11 seconds 00000100:00100000:2.0:1787191342.396919:0:57938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626785920:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191342.396953:0:57938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000008d07e5df/0xe5129dc88483aa19 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606b14 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.396970:0:57938:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000008d07e5df/0xe5129dc88483aa19 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606b14 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.396985:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000008d07e5df/0xe5129dc88483aa19 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606b14 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1787191342.396997:0:57938:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 4096, setting rss=4096; kms=4096, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000008d07e5df/0xe5129dc88483aa19 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606b14 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.397010:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000008d07e5df/0xe5129dc88483aa19 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606b14 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.397029:0:57938:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000008d07e5df/0xe5129dc88483aa19 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606b14 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1787191342.398036:0:57942:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191342.398064:0:57942:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.398078:0:57942:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.398091:0:57942:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.398100:0:57942:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191342.398108:0:57942:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191342.398112:0:57942:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191342.398165:0:57942:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422f3b58 00010000:00010000:0.0:1787191342.398170:0:57942:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.398179:0:57942:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.398194:0:57942:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.398202:0:57942:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:0.0:1787191342.398208:0:57942:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.398219:0:57942:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:0.0:1787191342.398223:0:57942:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:0.0:1787191342.398236:0:57942:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:0.0:1787191342.398281:0:57942:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483aa20 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.398288:0:57942:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483aa20 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.398298:0:57942:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483aa20 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.398318:0:57942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57942:1874004626786048:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191342.398403:0:57942:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00010000:00010000:1.0:1787191342.400983:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aa27 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.401002:0:57938:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aa27 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.401024:0:57938:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aa27 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191342.401092:0:57942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57942:1874004626786048:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191342.401107:0:57942:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483aa20 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.401117:0:57942:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483aa20 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.401127:0:57942:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483aa20 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.401134:0:57942:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483aa20 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.401142:0:57942:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483aa20 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.401148:0:57942:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b47a7ee00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191342.401152:0:57942:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483aa20 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.401160:0:57942:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483aa20 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.401167:0:57942:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483aa20 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.401174:0:57942:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191342.401180:0:57942:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483aa20 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.401185:0:57942:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483aa20 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191342.401203:0:57942:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b6a475500 x1874004626786048/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191342.401218:0:57942:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191342.401301:0:57942:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191342.401317:0:57942:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.401327:0:57942:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.401337:0:57942:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000100:00100000:1.0:1787191342.401422:0:57938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626786176:192.168.202.101@tcp:101:lfs.0 00000080:00200000:2.0:1787191342.401494:0:57942:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191342.401499:0:57942:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191342.401501:0:57942:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191342.401506:0:57942:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422f3be8 00010000:00010000:2.0:1787191342.401508:0:57942:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.401514:0:57942:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.401523:0:57942:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.401528:0:57942:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000080:00200000:2.0:1787191342.401532:0:57942:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.401540:0:57942:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:2.0:1787191342.401543:0:57942:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191342.401552:0:57942:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191342.401574:0:57942:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483aa2e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.401581:0:57942:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483aa2e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.401593:0:57942:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483aa2e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191342.401606:0:57942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57942:1874004626786304:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191342.401734:0:57938:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893900 going to sleep for 11 seconds 00000100:00100000:2.0:1787191342.401735:0:57942:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f300 going to sleep for 11 seconds 00000100:00100000:1.0:1787191342.406032:0:57938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626786176:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191342.406032:0:57942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57942:1874004626786304:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191342.406051:0:57942:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483aa2e lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.406062:0:57942:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483aa2e lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.406066:0:57938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aa27 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606b30 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.406069:0:57942:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483aa2e lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.406076:0:57942:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483aa2e lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.406082:0:57938:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aa27 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606b30 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.406084:0:57942:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483aa2e lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.406091:0:57942:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51185400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191342.406096:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aa27 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606b30 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191342.406110:0:57938:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aa27 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606b30 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.406163:0:57942:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483aa2e lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.406174:0:57942:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483aa2e lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.406181:0:57942:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483aa2e lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.406188:0:57942:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191342.406194:0:57942:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483aa2e lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.406201:0:57942:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483aa2e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191342.406225:0:57942:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513b8000 x1874004626786304/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191342.406240:0:57942:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191342.406328:0:57942:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191342.406342:0:57942:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.406352:0:57942:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.406364:0:57942:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.406370:0:57942:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191342.406385:0:57942:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00010000:00010000:1.0:1787191342.406388:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aa27 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606b30 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00010000:2.0:1787191342.406388:0:57942:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191342.406394:0:57942:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422f3b58 00010000:00010000:1.0:1787191342.406397:0:57938:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aa27 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606b30 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.406397:0:57942:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.406406:0:57942:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.406425:0:57942:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.406432:0:57942:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:2.0:1787191342.406440:0:57942:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:2.0:1787191342.406445:0:57942:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:2.0:1787191342.406465:0:57942:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00000100:00100000:0.0:1787191342.406561:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626786432:192.168.202.101@tcp:10:lfs.0 00000100:00100000:0.0:1787191342.406659:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787191342.406666:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626786560:192.168.202.101@tcp:10:lfs.0 00010000:00010000:2.0:1787191342.406707:0:57942:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 96 lru_type: 1 00010000:00010000:2.0:1787191342.406958:0:57942:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 96 lru_type: 1 00000002:00010000:2.0:1787191342.406966:0:57942:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.406992:0:57942:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa35 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.406997:0:57942:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa35 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.407003:0:57942:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa35 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191342.407012:0:57942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57942:1874004626786688:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191342.407068:0:57942:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f300 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.409712:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626786560:192.168.202.101@tcp:10:lfs.0 00000100:00100000:2.0:1787191342.409727:0:57942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57942:1874004626786688:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191342.409744:0:57942:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa35 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606b53 expref: -99 pid: 57942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.409767:0:57942:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa35 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606b53 expref: -99 pid: 57942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.409776:0:57942:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa35 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606b53 expref: -99 pid: 57942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.409784:0:57942:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa35 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606b53 expref: -99 pid: 57942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.409793:0:57942:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa35 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606b53 expref: -99 pid: 57942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.409798:0:57942:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa35 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606b53 expref: -99 pid: 57942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.409802:0:57942:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa35 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606b53 expref: -99 pid: 57942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191342.409810:0:57942:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b513b8000 x1874004626786688/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191342.409819:0:57942:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606b53 expref: -99 pid: 57942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.409826:0:57942:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:2.0:1787191342.409859:0:57942:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606b53 expref: -99 pid: 57942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.409873:0:57942:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa35 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606b53 expref: -99 pid: 57942 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:2.0:1787191342.409908:0:57942:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.409918:0:57942:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 192 lru_type: 1 00010000:00010000:2.0:1787191342.409926:0:57942:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 192 lru_type: 1 00010000:00010000:2.0:1787191342.409932:0:57942:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 192 lru_type: 1 00010000:00010000:2.0:1787191342.409937:0:57942:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 193 lru_type: 1 00000080:00200000:2.0:1787191342.409945:0:57942:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1787191342.409953:0:57942:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:2.0:1787191342.409956:0:57942:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:2.0:1787191342.409960:0:57942:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb422f3cb8 00010000:00010000:2.0:1787191342.409961:0:57942:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 96 lru_type: 1 00010000:00010000:2.0:1787191342.409966:0:57942:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 97 lru_type: 1 00000002:00010000:2.0:1787191342.409976:0:57942:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.409981:0:57942:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa35 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606b53 expref: -99 pid: 57942 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.409985:0:57942:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa35 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606b53 expref: -99 pid: 57942 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.409990:0:57942:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606b53 expref: -99 pid: 57942 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.409994:0:57942:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa35 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606b53 expref: -99 pid: 57942 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:2.0:1787191342.409998:0:57942:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.410000:0:57942:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 193 lru_type: 1 00010000:00010000:2.0:1787191342.410004:0:57942:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 193 lru_type: 1 00010000:00010000:2.0:1787191342.410008:0:57942:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 193 lru_type: 1 00010000:00010000:2.0:1787191342.410012:0:57942:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 194 lru_type: 1 00000100:00100000:0.0:1787191342.410406:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626786432:192.168.202.101@tcp:10:lfs.0 00000080:00200000:1.0:1787191342.410479:0:57938:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xdc:0x0] updating i_size 5 i_blocks 8 00000020:00010000:1.0:1787191342.410486:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b497c95d8 (ffff936b465cc878/0) at cl_lock_release():245 00000020:00010000:1.0:1787191342.410489:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b497c95d8 (ffff936b465cc878/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191342.410493:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62b5ff30 (ffff936b465cc908/1) at cl_lock_cancel():142 00010000:00010000:1.0:1787191342.410500:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000008d07e5df/0xe5129dc88483aa19 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606b14 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.410510:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000008d07e5df/0xe5129dc88483aa19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606b14 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1787191342.410523:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62b5ff70 (ffff936b47a17d88/1) at cl_lock_cancel():142 00010000:00010000:1.0:1787191342.410527:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aa27 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606b30 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.410534:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aa27 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606b30 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1787191342.410542:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b497c95d8 (ffff936b465cc878/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191342.410545:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62b5ff30 (ffff936b465cc878/1) at cl_lock_fini():72 00000020:00010000:1.0:1787191342.410549:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62b5ff70 (ffff936b465cc878/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191342.410565:0:57938:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdc:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1787191342.410576:0:57938:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xdc:0x0](ffff936b5396ba88) current size 5, valid attrs 10002168, mode 0, uid -1322410190, gid -1, new size 5, atime 1787191342.000000000, mtime 1787191342.000000000, ctime 1787191342.000000000, rc 0 00000080:00200080:1.0:1787191342.410593:0:57938:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88) cmd=400866b1 arg=0 00000080:00200008:1.0:1787191342.410616:0:57938:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xdc:0x0](ffff936b5396ba88) current size 5, valid attrs 101f0, mode a3fb, uid 1108042808, gid -27797, new size 18446624687906011784, atime 1787191342.000000000, mtime 1787191342.000000000, ctime 1787191342.000000000 00000020:00100000:1.0:1787191342.410661:0:57938:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1787191342.410668:0:57938:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453abb80 x1874004626786944/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787191342.410689:0:57938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626786944:192.168.202.101@tcp:36:lfs.0 00000100:00100000:1.0:1787191342.410757:0:57938:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893900 going to sleep for 11 seconds 00000080:00200008:2.0:1787191342.411009:0:57942:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:2.0:1787191342.411024:0:57942:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191342.411035:0:57942:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.411042:0:57942:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.411050:0:57942:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.411057:0:57942:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191342.411062:0:57942:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191342.411066:0:57942:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191342.411070:0:57942:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422f3cb8 00010000:00010000:2.0:1787191342.411073:0:57942:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.411080:0:57942:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.411250:0:57942:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191342.411261:0:57942:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.411267:0:57942:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.411275:0:57942:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.411281:0:57942:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191342.411285:0:57942:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191342.411287:0:57942:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191342.411291:0:57942:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422f3b58 00010000:00010000:2.0:1787191342.411294:0:57942:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.411301:0:57942:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.411309:0:57942:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.411315:0:57942:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191342.411319:0:57942:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.411327:0:57942:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:2.0:1787191342.411332:0:57942:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191342.411344:0:57942:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191342.411373:0:57942:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483aa3c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.411380:0:57942:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483aa3c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.411389:0:57942:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483aa3c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191342.411401:0:57942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57942:1874004626787072:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191342.411446:0:57942:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f300 going to sleep for 11 seconds 00000100:00100000:1.0:1787191342.415960:0:57938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626786944:192.168.202.101@tcp:36:lfs.0 00000080:00200000:1.0:1787191342.416007:0:57938:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdc:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:1.0:1787191342.416031:0:57938:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdc:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191342.416035:0:57938:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191342.416043:0:57938:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191342.416056:0:57938:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000100:00100000:0.0:1787191342.416344:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787191342.416361:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626787200:192.168.202.101@tcp:2:lfs.0 00000100:00100000:2.0:1787191342.416519:0:57942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57942:1874004626787072:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191342.416533:0:57942:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483aa3c lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.416545:0:57942:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483aa3c lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.416558:0:57942:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483aa3c lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.416565:0:57942:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483aa3c lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.416574:0:57942:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483aa3c lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.416580:0:57942:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51184400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191342.416585:0:57942:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483aa3c lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.416593:0:57942:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483aa3c lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.416600:0:57942:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483aa3c lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.416608:0:57942:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191342.416614:0:57942:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483aa3c lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.416619:0:57942:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483aa3c lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191342.416635:0:57942:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513b8000 x1874004626787072/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191342.416650:0:57942:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1787191342.416695:0:57942:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa35 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606b53 expref: -99 pid: 57942 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191342.416707:0:57942:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa35 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606b53 expref: -99 pid: 57942 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:2.0:1787191342.416716:0:57942:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483aa35 from it ffffa3fb422f3930 00010000:00010000:2.0:1787191342.416720:0:57942:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606b53 expref: -99 pid: 57942 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191342.416728:0:57942:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa35 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606b53 expref: -99 pid: 57942 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191342.416817:0:57942:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191342.417003:0:57942:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.417013:0:57942:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.417032:0:57942:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.417039:0:57942:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191342.417045:0:57942:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191342.417048:0:57942:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191342.417062:0:57942:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422f3bf8 00010000:00010000:2.0:1787191342.417065:0:57942:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.417073:0:57942:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.417087:0:57942:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.417096:0:57942:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191342.417100:0:57942:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.417106:0:57942:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:2.0:1787191342.417110:0:57942:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:2.0:1787191342.417311:0:57942:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b60797980, open_flags a141, mode 81b6 opened 0 00000080:00200000:2.0:1787191342.417323:0:57942:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:2.0:1787191342.417345:0:57942:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xdf:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:2.0:1787191342.417356:0:57942:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa35 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4606b53 expref: -99 pid: 57942 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191342.417400:0:57942:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa35 lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4606b53 expref: -99 pid: 57942 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191342.417408:0:57942:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191342.417411:0:57942:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa35 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4606b53 expref: -99 pid: 57942 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191342.417503:0:57942:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483aa43 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.417512:0:57942:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483aa43 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191342.417524:0:57942:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191342.417532:0:57942:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8000 x1874004626787456/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191342.417548:0:57942:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483aa43 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191342.417565:0:57942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57942:1874004626787456:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191342.417680:0:57942:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f300 going to sleep for 11 seconds 00000100:00100000:2.0:1787191342.421211:0:57942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57942:1874004626787456:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191342.421232:0:57942:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483aa43 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606b8b expref: -99 pid: 57942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.421255:0:57942:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483aa43 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606b8b expref: -99 pid: 57942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.421261:0:57942:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483aa43 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606b8b expref: -99 pid: 57942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.421270:0:57942:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483aa43 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606b8b expref: -99 pid: 57942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.421276:0:57942:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483aa43 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606b8b expref: -99 pid: 57942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.421285:0:57942:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483aa43 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606b8b expref: -99 pid: 57942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.421290:0:57942:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483aa43 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606b8b expref: -99 pid: 57942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.421298:0:57942:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483aa43 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606b8b expref: -99 pid: 57942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191342.421307:0:57942:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b513b8000 x1874004626787456/t8589937089(8589937089) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191342.421316:0:57942:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b8000 x1874004626787456/t8589937089(8589937089) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191342.421324:0:57942:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483aa43 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606b8b expref: -99 pid: 57942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.421331:0:57942:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/223 (0 0) 00000080:00200000:2.0:1787191342.421335:0:57942:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191342.421345:0:57942:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:2.0:1787191342.421370:0:57942:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xdf:0x0](ffff936b4898f448) 00000080:00200000:2.0:1787191342.421376:0:57942:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xdf:0x0], updating i_size 0 00000080:00200000:2.0:1787191342.421403:0:57942:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xdf:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:2.0:1787191342.421406:0:57942:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xdf:0x0](ffff936b4898f448) 00000080:00010000:2.0:1787191342.421408:0:57942:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdf:0x0](ffff936b4898f448) for lock 0xe5129dc88483aa43 00000080:00010000:2.0:1787191342.421415:0:57942:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xdf:0x0](ffff936b4898f448) 00000080:00200008:2.0:1787191342.421427:0:57942:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xdf:0x0](ffff936b4898f448), flags 120501 00000002:00100000:2.0:1787191342.421454:0:57942:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b8000 x1874004626787456/t8589937089(8589937089) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1787191342.421491:0:57942:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483aa43 from it ffff936b60dc4000 00010000:00010000:2.0:1787191342.421495:0:57942:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483aa43 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606b8b expref: -99 pid: 57942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.421504:0:57942:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483aa43 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606b8b expref: -99 pid: 57942 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191342.421526:0:57942:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xdf:0x0](ffff936b4898f448), inode mode 81a4 mask 40 00000080:00200000:2.0:1787191342.421580:0:57942:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xdf:0x0](ffff936b4898f448), inode mode 81a4 mask 2 00000080:00200000:2.0:1787191342.421588:0:57942:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xdf:0x0](ffff936b4898f448), xattr lov 00000002:00010000:2.0:1787191342.421604:0:57942:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xdf:0x0]) in obj [0x200000405:0xdf:0x0], intent: open flags 040000002 00010000:00010000:2.0:1787191342.421643:0:57942:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483aa4a lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.421649:0:57942:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483aa4a lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191342.421659:0:57942:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191342.421665:0:57942:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513ba680 x1874004626787712/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191342.421674:0:57942:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483aa4a lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191342.421693:0:57942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57942:1874004626787712:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191342.421888:0:57942:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62b5f300 going to sleep for 11 seconds 00000100:00100000:3.0:1787191342.426547:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191342.426603:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634922496 00000100:00100000:2.0:1787191342.426612:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634922496 00000100:00100000:2.0:1787191342.426673:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1446 00000100:00100000:2.0:1787191342.426682:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634922496:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191342.426699:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483aa43 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4606b8b expref: -99 pid: 57942 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.426778:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191342.426784:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634922496:12345-192.168.202.101@tcp:104: Request processed in 104us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191342.426791:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1446 00010000:00010000:1.0:1787191342.426959:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191342.426966:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483aa43 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4606b8b expref: -99 pid: 57942 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1787191342.426975:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626787200:192.168.202.101@tcp:2:lfs.0 00010000:00010000:1.0:1787191342.426975:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51185200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191342.426980:0:43384:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483aa43 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4606b8b expref: -99 pid: 57942 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.426988:0:43384:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483aa43 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4606b8b expref: -99 pid: 57942 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.426997:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483aa43 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4606b8b expref: -99 pid: 57942 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191342.427034:0:43384:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xdf:0x0]: losing layout lock 00010000:00010000:1.0:1787191342.427087:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483aa43 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4606b8b expref: -99 pid: 57942 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.427094:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191342.427116:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483aa43 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4606b8b expref: -99 pid: 57942 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1787191342.427151:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626787840:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00200000:2.0:1787191342.427227:0:57938:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdc:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191342.427242:0:57938:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xdc:0x0](ffff936b5396ba88) current size 5, valid attrs 100101f0, mode a3fb, uid 1108042808, gid -27797, new size 18446624687906011784, atime 1787191342.000000000, mtime 1787191342.000000000, ctime 1787191342.000000000, rc 0 00000080:00200080:2.0:1787191342.427264:0:57938:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88) cmd=c00c66f3 arg=24d72e0 00010000:00010000:2.0:1787191342.427302:0:57938:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a994 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0xdc:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81008000000000 nid: local remote: 0x7130d520e4606985 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.427316:0:57938:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483a994 lrc: 0/0,0 mode: --/PW res: [0x200000405:0xdc:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x85809400000000 nid: local remote: 0x7130d520e4606985 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191342.427333:0:57938:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453aa300 x1874004626779520/t8589937074(8589937074) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191342.427344:0:57938:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:2.0:1787191342.427349:0:57938:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb480 x1874004626788096/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191342.427363:0:57938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626788096:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191342.427389:0:57938:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787191342.427427:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483aa43 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4606b8b expref: -99 pid: 57942 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.427450:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191342.427452:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191342.427454:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191342.434491:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191342.434552:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634922624 00000100:00100000:2.0:1787191342.434563:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634922624 00000100:00100000:0.0:1787191342.434632:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626787840:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191342.434672:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1447 00000100:00100000:2.0:1787191342.434683:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35858:x1874004634922624:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191342.434703:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a9be lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4606a0a expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191342.434792:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191342.434800:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35858:x1874004634922624:12345-192.168.202.101@tcp:104: Request processed in 119us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191342.434807:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1447 00010000:00010000:0.0:1787191342.434862:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191342.434870:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a9be lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4606a0a expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191342.434889:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b6a609c00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191342.434894:0:40929:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a9be lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4606a0a expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191342.434909:0:40929:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a9be lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4606a0a expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191342.434919:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a9be lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4606a0a expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1787191342.434941:0:40929:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xdc:0x0]: losing layout lock 00010000:00010000:0.0:1787191342.434982:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a9be lrc: 2/0,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4606a0a expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191342.434990:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191342.435023:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a9be lrc: 1/0,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4606a0a expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191342.435031:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b6a609c00/0xe5129dc88483a9be lrc: 0/0,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4606a0a expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191342.435047:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191342.435049:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191342.435051:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191342.435058:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787191342.435070:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626788224:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191342.438761:0:57942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57942:1874004626787712:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191342.438783:0:57942:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483aa4a lrc: 4/1,0 mode: --/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.438796:0:57942:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483aa4a lrc: 4/1,0 mode: --/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.438804:0:57942:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483aa4a lrc: 4/1,0 mode: --/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.438811:0:57942:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483aa4a lrc: 3/0,0 mode: --/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.438819:0:57942:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483aa4a lrc: 4/0,0 mode: --/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.438825:0:57942:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51185400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191342.438829:0:57942:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483aa4a lrc: 4/0,0 mode: --/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.438854:0:57942:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483aa4a lrc: 4/0,0 mode: --/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.438861:0:57942:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483aa4a lrc: 5/0,0 mode: --/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.438868:0:57942:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191342.438875:0:57942:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483aa4a lrc: 3/0,0 mode: --/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.439004:0:57942:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483aa4a lrc: 0/0,0 mode: --/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57942 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.439038:0:57942:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b513ba680 x1874004626787712/t8589937090(8589937090) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191342.439052:0:57942:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513ba680 x1874004626787712/t8589937090(8589937090) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191342.439068:0:57942:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xdf:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787191342.439276:0:57942:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdf:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1787191342.439283:0:57942:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdf:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191342.439322:0:57942:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xdf:0x0], updating i_size 0 00000002:00100000:0.0:1787191342.439336:0:57942:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513ba680 x1874004626787712/t8589937090(8589937090) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191342.439364:0:57942:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513ba680 x1874004626787712/t8589937090(8589937090) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191342.439371:0:57942:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191342.439374:0:57942:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477b80 x1874004626788480/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191342.439390:0:57942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57942:1874004626788480:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191342.439453:0:57942:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.446227:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626788224:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191342.447137:0:57942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57942:1874004626788480:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191342.447169:0:57942:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513ba680 x1874004626787712/t8589937090(8589937090) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1787191342.447228:0:57942:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xdf:0x0](ffff936b4898f448), flags 100001 00000002:00100000:0.0:1787191342.447279:0:57942:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513b8000 x1874004626787456/t8589937089(8589937089) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191342.447290:0:57942:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191342.447295:0:57942:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475c00 x1874004626788736/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191342.447316:0:57942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57942:1874004626788736:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191342.447400:0:57942:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191342.452901:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:1.0:1787191342.453105:0:57938:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589937091 gen 1 00000100:00100000:1.0:1787191342.453193:0:57938:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff936b6a477b80 x1874004626788480/t8589937092(8589937092) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/456 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787191342.453207:0:57938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626788096:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191342.453235:0:57938:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453aa300 x1874004626779520/t8589937074(8589937074) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1787191342.453261:0:57938:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/220 (0 0) 00000080:00010000:1.0:1787191342.453272:0:57938:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xdc:0x0](ffff936b5396ba88) 00000002:00010000:1.0:1787191342.453281:0:57938:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xdc:0x0]) in obj [0x200000405:0xdc:0x0], intent: layout flags 0 00010000:00010000:1.0:1787191342.453322:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483aa51 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.453336:0:57938:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483aa51 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.453346:0:57938:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483aa51 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57938 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191342.453364:0:57938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626788864:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191342.453454:0:57938:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893900 going to sleep for 11 seconds 00000100:00100000:2.0:1787191342.454215:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634923776 00000100:00100000:2.0:1787191342.454224:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634923776 00000100:00100000:2.0:1787191342.454284:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1448 00000100:00100000:2.0:1787191342.454294:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30353:x1874004634923776:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191342.454308:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a9fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4606aab expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191342.454371:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191342.454379:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30353:x1874004634923776:12345-192.168.202.101@tcp:104: Request processed in 85us (1488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191342.454387:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1448 00010000:00010000:0.0:1787191342.455012:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191342.455032:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a9fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4606aab expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191342.455043:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030800 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191342.455049:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a9fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4606aab expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191342.455095:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a9fd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4606aab expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191342.455102:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191342.455133:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a9fd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4606aab expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191342.455141:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483a9fd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4606aab expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191342.455161:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191342.455163:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191342.455165:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191342.456292:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626788992:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191342.461985:0:57942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57942:1874004626788736:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191342.462035:0:57942:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513b8000 x1874004626787456/t8589937089(8589937089) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191358 ref 1 fl Complete:RMQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787191342.462205:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:1.0:1787191342.463356:0:57938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626788864:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191342.463381:0:57938:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483aa51 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606bd1 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.463395:0:57938:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483aa51 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606bd1 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191342.463408:0:57938:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b453aa300 x1874004626788864/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191342.463417:0:57938:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483aa51 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606bd1 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191342.463430:0:57938:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483aa51 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606bd1 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.463441:0:57938:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/220 (0 0) 00000080:00200000:1.0:1787191342.463447:0:57938:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xdc:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191342.463460:0:57938:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdc:0x0](ffff936b5396ba88) for lock 0xe5129dc88483aa51 00000080:00010000:1.0:1787191342.463467:0:57938:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483aa51 from it ffffa3fb422dbbc8 00010000:00010000:1.0:1787191342.463471:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483aa51 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606bd1 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.463481:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483aa51 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606bd1 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.463504:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483aa51 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606bd1 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.463515:0:57938:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483aa51 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606bd1 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:1.0:1787191342.463522:0:57938:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xdc:0x0](0000000030f058e9) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483aa51 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606bd1 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.463562:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483aa51 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606bd1 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.463571:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483aa51 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606bd1 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191342.463586:0:57938:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdc:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1787191342.463596:0:57938:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdc:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191342.463599:0:57938:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191342.463607:0:57938:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191342.463617:0:57938:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191342.463638:0:57938:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdc:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:1.0:1787191342.463650:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483aa51 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606bd1 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.463658:0:57938:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483aa51 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606bd1 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:1.0:1787191342.463666:0:57938:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xdc:0x0](0000000030f058e9) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483aa51 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606bd1 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191342.463684:0:57938:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdc:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1787191342.463688:0:57938:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdc:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191342.463691:0:57938:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191342.463693:0:57938:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191342.463723:0:57938:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191342.463730:0:57938:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdc:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:1.0:1787191342.463741:0:57938:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 5 blocks 8 [cma]time: 1787191342 1787191342 0 by oinfo size 5 blocks 8 [cma]time 1787191342 1787191342 1787191342 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 1/0,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00000008:00010000:1.0:1787191342.463768:0:57938:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 4096 blocks 8 [cma]time: 1787191342 1787191342 0 by oinfo size 5 blocks 8 [cma]time 1787191342 1787191342 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000008d07e5df/0xe5129dc88483aa19 lrc: 1/0,0 mode: PW/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606b14 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000008:00010000:1.0:1787191342.463780:0:57938:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191342 1787191342 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aa27 lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606b30 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191342.463853:0:57938:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xdc:0x0]: layout version change: 4294967294 -> 6 00010000:00010000:1.0:1787191342.463858:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483aa51 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606bd1 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.463866:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030e00/0xe5129dc88483aa51 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606bd1 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200008:1.0:1787191342.463891:0:57938:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xdc:0x0](ffff936b5396ba88), flags 154002 00000080:00200000:2.0:1787191342.463931:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00100000:1.0:1787191342.463932:0:57938:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a476d80 x1874004626778752/t8589937073(8589937073) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191342.463942:0:57938:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000002:00010000:2.0:1787191342.463944:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00000100:00100000:1.0:1787191342.463948:0:57938:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453aa300 x1874004626789248/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191342.463954:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.463961:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000100:00100000:1.0:1787191342.463967:0:57938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626789248:192.168.202.101@tcp:35:lfs.0 00000080:00200000:2.0:1787191342.463973:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191342.463979:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191342.463982:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191342.463986:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:2.0:1787191342.463988:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.463995:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.464004:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.464010:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191342.464027:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.464038:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:2.0:1787191342.464042:0:57570:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b60796780, open_flags 8241, mode 81b6 opened 0 00000080:00200000:2.0:1787191342.464049:0:57570:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000100:00100000:1.0:1787191342.464051:0:57938:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893900 going to sleep for 11 seconds 00000002:00010000:2.0:1787191342.464067:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xe0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0101102 00010000:00010000:2.0:1787191342.464121:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa58 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.464128:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa58 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191342.464137:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:2.0:1787191342.464143:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8700 x1874004626789504/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191342.464157:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa58 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191342.464170:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626789504:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191342.464384:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f840 going to sleep for 11 seconds 00000100:00100000:3.0:1787191342.465484:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634923904 00000100:00100000:3.0:1787191342.465493:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634923904 00000100:00100000:2.0:1787191342.468536:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1449 00000100:00100000:2.0:1787191342.468550:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30510:x1874004634923904:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191342.468571:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4606ab2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1787191342.469215:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626789504:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191342.469236:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa58 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606bed expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.469263:0:57570:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa58 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606bed expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.469271:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa58 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606bed expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.469282:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa58 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606bed expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.469292:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa58 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606bed expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.469304:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa58 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606bed expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.469312:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa58 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606bed expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.469320:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa58 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606bed expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.469332:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x2b, status=0 req@ffff936b513b8700 x1874004626789504/t8589937094(8589937094) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191342.469347:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b8700 x1874004626789504/t8589937094(8589937094) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191342.469359:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa58 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606bed expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191342.469371:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa58 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606bed expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191342.469373:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626788992:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787191342.469380:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/223 (0 0) 00000080:00200000:0.0:1787191342.469386:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191342.469431:0:57570:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xdf:0x0](ffff936b4898f448): rc = 0 00000080:00200000:0.0:1787191342.469446:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xdf:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:2.0:1787191342.469450:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000080:00010000:0.0:1787191342.469451:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdf:0x0](ffff936b4898f448) for lock 0xe5129dc88483aa58 00000100:00100000:2.0:1787191342.469457:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30510:x1874004634923904:12345-192.168.202.101@tcp:104: Request processed in 910us (7253us total) trans 0 rc 0/0 00000080:00010000:0.0:1787191342.469461:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xdf:0x0](ffff936b4898f448) 00000100:00100000:2.0:1787191342.469464:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1449 00000080:00200008:0.0:1787191342.469476:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xdf:0x0](ffff936b4898f448), flags 101101 00000002:00100000:0.0:1787191342.469499:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b8700 x1874004626789504/t8589937094(8589937094) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1787191342.469521:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191342.469528:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4606ab2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1787191342.469530:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483aa58 from it ffff936b60dc4000 00010000:00010000:0.0:1787191342.469534:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa58 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606bed expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.469537:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030400 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191342.469543:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa58 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606bed expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.469543:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4606ab2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191342.469565:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xdf:0x0](ffff936b4898f448), inode mode 81a4 mask 42 00010000:00010000:1.0:1787191342.469577:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa04 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4606ab2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.469583:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000002:00010000:0.0:1787191342.469589:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xdf:0x0], intent: getxattr flags 0 00010000:00010000:1.0:1787191342.469601:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa04 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4606ab2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.469608:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa04 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4606ab2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.469615:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483aa5f lrc: 3/1,0 mode: --/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.469622:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483aa5f lrc: 3/1,0 mode: --/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.469623:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191342.469624:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191342.469626:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191342.469631:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483aa5f lrc: 3/1,0 mode: --/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191342.469649:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626789632:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191342.470813:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626789760:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191342.471573:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191342.474274:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626789632:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191342.478131:0:57938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626789248:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191342.478171:0:57938:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a476d80 x1874004626778752/t8589937073(8589937073) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191342.478226:0:57938:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdc:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1787191342.478238:0:57938:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdc:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191342.478241:0:57938:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191342.478248:0:57938:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191342.478258:0:57938:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1787191342.478276:0:57938:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdc:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191342.478283:0:57938:0:(llite_lib.c:2066:ll_clear_inode()) VFS Op:inode=[0x200000405:0xdc:0x0](ffff936b5396ba88) 00000080:00200000:3.0:1787191342.478402:0:57938:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191342.478422:0:57938:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191342.478435:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191342.478448:0:57938:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191342.478455:0:57938:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191342.478461:0:57938:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191342.478464:0:57938:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191342.478471:0:57938:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422dbbf8 00010000:00010000:3.0:1787191342.478476:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191342.478485:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191342.478501:0:57938:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191342.478508:0:57938:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191342.478513:0:57938:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191342.478516:0:57938:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:3.0:1787191342.478520:0:57938:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xdf:0x0](ffff936b4898f448), inode mode 81a4 mask 44 00000080:00200008:3.0:1787191342.478528:0:57938:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xdf:0x0](ffff936b4898f448), flags 154400 00000002:00010000:3.0:1787191342.478543:0:57938:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xdf:0x0]) in obj [0x200000405:0xdf:0x0], intent: open flags 0104240114401 00010000:00010000:3.0:1787191342.478588:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483aa66 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.478596:0:57938:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483aa66 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57938 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191342.478607:0:57938:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191342.478613:0:57938:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1ea00 x1874004626790016/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191342.478623:0:57938:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483aa66 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57938 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191342.478806:0:57938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626790016:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191342.479082:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626789760:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191342.479160:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483aa5f lrc: 4/1,0 mode: --/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c02 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.479175:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483aa5f lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606c02 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.479186:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483aa5f lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c02 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.479198:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b6a474e00 x1874004626789760/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191342.479208:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483aa5f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c02 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.479217:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/223 (0 0) 00000080:00200000:0.0:1787191342.479221:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xdf:0x0] suppgids 0 -1: rc 0 00000100:00100000:1.0:1787191342.479287:0:57938:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cf00 going to sleep for 11 seconds 00000080:00010000:1.0:1787191342.479316:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdf:0x0](ffff936b4898f448) for lock 0xe5129dc88483aa5f 00000080:00010000:1.0:1787191342.479322:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483aa5f from it ffffa3fb41caba38 00010000:00010000:1.0:1787191342.479326:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483aa5f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606c02 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.479334:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483aa5f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c02 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:1.0:1787191342.479364:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xdf:0x0](ffff936b4898f448) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191342.000000000, mtime 1787191342.000000000, ctime 1787191342.000000000 00010000:00010000:1.0:1787191342.479384:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa58 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4606bed expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191342.479401:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xdf:0x0]: losing layout lock 00010000:00010000:1.0:1787191342.479429:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa58 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606bed expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.479436:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191342.479439:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483aa58 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606bed expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1787191342.479454:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 36, max 7 00000100:00100000:1.0:1787191342.479459:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453abb80 x1874004626790272/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787191342.479474:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626790272:192.168.202.101@tcp:36:bash.0 00000100:00100000:1.0:1787191342.479507:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787191342.484544:0:57938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626790016:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191342.484579:0:57938:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483aa66 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xdf:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c17 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.484595:0:57938:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483aa66 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xdf:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606c17 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.484607:0:57938:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483aa66 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xdf:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c17 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191342.484620:0:57938:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x200002b, status=0 req@ffff936b51d1ea00 x1874004626790016/t8589937096(8589937096) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191342.484642:0:57938:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1ea00 x1874004626790016/t8589937096(8589937096) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191342.484655:0:57938:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483aa66 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdf:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c17 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191342.484668:0:57938:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483aa66 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdf:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c17 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.484680:0:57938:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/223 (0 0) 00000080:00200000:1.0:1787191342.484686:0:57938:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xdf:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787191342.484755:0:57938:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xdf:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:1.0:1787191342.484761:0:57938:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdf:0x0](ffff936b4898f448) for lock 0xe5129dc88483aa66 00000080:00010000:1.0:1787191342.484767:0:57938:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483aa66 from it ffffa3fb422dbbf0 00010000:00010000:1.0:1787191342.484771:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483aa66 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdf:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606c17 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.484780:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483aa66 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdf:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606c17 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000002:00100000:1.0:1787191342.484810:0:57938:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1ea00 x1874004626790016/t8589937096(8589937096) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191342.484951:0:57938:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xdf:0x0](ffff936b4898f448), inode mode 81a4 mask 4 00000080:00200000:1.0:1787191342.484960:0:57938:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xdf:0x0](ffff936b4898f448), xattr lov 00000080:00200008:1.0:1787191342.484982:0:57938:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xdf:0x0](ffff936b4898f448), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191342.484988:0:57938:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xdf:0x0](ffff936b4898f448),name=f70.sanity-flr 00000002:00010000:1.0:1787191342.485002:0:57938:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xdf:0x0]) in obj [0x200000405:0xdf:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191342.485009:0:57938:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 30 res 8589935621/223 (0 0) 00010000:00010000:1.0:1787191342.485060:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483aa6d lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.485068:0:57938:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483aa6d lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.485078:0:57938:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483aa6d lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57938 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191342.485096:0:57938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626790400:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191342.485357:0:57938:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:1.0:1787191342.485484:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626790272:192.168.202.101@tcp:36:bash.0 00000080:00200000:1.0:1787191342.485509:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:1.0:1787191342.485515:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdf:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:1.0:1787191342.485526:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xdf:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:1.0:1787191342.485532:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdf:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191342.485535:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xdf:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:1.0:1787191342.485542:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xdf:0x0](ffff936b4898f448) 00000002:00010000:1.0:1787191342.485547:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xdf:0x0]) in obj [0x200000405:0xdf:0x0], intent: layout flags 02 00010000:00010000:1.0:1787191342.485559:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483aa66 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdf:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4606c17 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191342.485574:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xdf:0x0]: losing layout lock 00010000:00010000:1.0:1787191342.485596:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483aa66 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xdf:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606c17 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.485602:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191342.485605:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483aa66 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xdf:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606c17 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.485620:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483aa74 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xdf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.485642:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483aa74 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191342.485651:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191342.485657:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9c00 x1874004626790656/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191342.485665:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483aa74 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191342.485678:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626790656:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191342.485705:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787191342.489223:0:57938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626790400:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191342.489251:0:57938:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483aa6d lrc: 4/1,0 mode: --/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c33 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.489263:0:57938:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483aa6d lrc: 4/1,0 mode: --/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c33 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.489276:0:57938:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483aa6d lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606c33 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.489289:0:57938:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483aa6d lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c33 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.489302:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483aa6d lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606c33 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.489318:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483aa6d lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606c33 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.489326:0:57938:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483aa6d lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606c33 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191342.489339:0:57938:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b453ab100 x1874004626790400/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/976 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191342.489351:0:57938:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483aa6d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c33 expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191342.489365:0:57938:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483aa6d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c33 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.489377:0:57938:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/223 (0 0) 00000080:00200000:1.0:1787191342.489383:0:57938:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xdf:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787191342.489453:0:57938:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xdf:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:1.0:1787191342.489459:0:57938:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdf:0x0](ffff936b4898f448) for lock 0xe5129dc88483aa6d 00000080:00010000:1.0:1787191342.489464:0:57938:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xdf:0x0](ffff936b4898f448) 00000080:00010000:1.0:1787191342.489468:0:57938:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483aa6d from it ffffa3fb422dbcd8 00010000:00010000:1.0:1787191342.489471:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483aa6d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606c33 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.489481:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483aa6d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606c33 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191342.489519:0:57938:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdf:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:1.0:1787191342.489529:0:57938:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdf:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191342.489533:0:57938:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191342.489536:0:57938:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xdf:0x0] 00000008:00010000:1.0:1787191342.489553:0:57938:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191342.489556:0:57938:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b44ca8130, osc lock ffff936b46837db0, flags 0x400000400001002 00010000:00010000:1.0:1787191342.489600:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa7b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.489611:0:57938:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa7b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.489621:0:57938:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b453ab100 x1874004626790784/t0(0) o101->lustre-OST0000-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191342.491196:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626790784:192.168.202.101@tcp:101:lfs.0 00000020:00200000:1.0:1787191342.491515:0:57938:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:2.0:1787191342.496056:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191342.496615:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634924032 00000100:00100000:3.0:1787191342.496627:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634924032 00000100:00100000:3.0:1787191342.496701:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1450 00000100:00100000:3.0:1787191342.496712:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634924032:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191342.496733:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483aa6d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4606c33 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191342.496826:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191342.496870:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634924032:12345-192.168.202.101@tcp:104: Request processed in 160us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191342.496878:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1450 00010000:00010000:1.0:1787191342.497229:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191342.497237:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483aa6d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4606c33 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.497246:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030000 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191342.497252:0:43384:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483aa6d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4606c33 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.497261:0:43384:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483aa6d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4606c33 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.497270:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483aa6d lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4606c33 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191342.497294:0:43384:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xdf:0x0]: losing layout lock 00010000:00010000:1.0:1787191342.497345:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483aa6d lrc: 2/0,0 mode: --/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4606c33 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.497353:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191342.497386:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483aa6d lrc: 1/0,0 mode: --/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4606c33 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1787191342.497405:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626790912:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787191342.497407:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483aa6d lrc: 0/0,0 mode: --/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4606c33 expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.497429:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191342.497431:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191342.497433:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191342.498634:0:2390:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa7b lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.498656:0:2390:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa7b lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c48 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.498669:0:2390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa7b lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606c48 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.498681:0:2390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa7b lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c48 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191342.498697:0:2390:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa7b lrc: 5/2,0 mode: PR/PR res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606c48 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1787191342.498708:0:2390:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1787191342.498780:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa7b lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606c48 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.498790:0:2390:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa7b lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606c48 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.498799:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa7b lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606c48 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.498808:0:2390:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa7b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606c48 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1787191342.498825:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626790784:192.168.202.101@tcp:101:lfs.0 00000080:00200000:2.0:1787191342.501955:0:57938:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xdf:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191342.501968:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51655030 (ffff936b465cc998/0) at cl_lock_release():245 00000020:00010000:2.0:1787191342.501973:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51655030 (ffff936b465cc998/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.501977:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b44ca8130 (ffff936b465cca28/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.501982:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51655030 (ffff936b465cc998/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191342.501986:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b44ca8130 (ffff936b465cc998/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191342.502002:0:57938:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdf:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:2.0:1787191342.502032:0:57938:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/223 (0 0) 00000080:00010000:2.0:1787191342.502044:0:57938:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xdf:0x0](ffff936b4898f448) 00000002:00010000:2.0:1787191342.502056:0:57938:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xdf:0x0]) in obj [0x200000405:0xdf:0x0], intent: layout flags 0 00010000:00010000:2.0:1787191342.502105:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483aa82 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.502117:0:57938:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483aa82 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.502127:0:57938:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483aa82 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57938 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191342.502152:0:57938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626791040:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191342.502258:0:57938:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.505066:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626790912:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191342.511360:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191342.511391:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191342.511413:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191342.511511:0:40921:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787191342.511538:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634924800 00000100:00100000:1.0:1787191342.511539:0:57938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626791040:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191342.511546:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634924800 00010000:00010000:1.0:1787191342.511573:0:57938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483aa82 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606c4f expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.511588:0:57938:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483aa82 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c4f expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191342.511598:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634924672 00000100:00100000:3.0:1787191342.511602:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634924672 00000100:00100000:3.0:1787191342.511621:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1451 00000100:00100000:3.0:1787191342.511641:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8419:x1874004634924800:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191342.511657:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000008d07e5df/0xe5129dc88483aa19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4606b14 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191342.511732:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191342.511739:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8419:x1874004634924800:12345-192.168.202.101@tcp:104: Request processed in 110us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191342.511758:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1451 00000100:00100000:3.0:1787191342.511776:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1452 00000100:00100000:3.0:1787191342.511781:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b4121e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634924672:12345-192.168.202.101@tcp:105: 00010000:00010000:3.0:1787191342.511789:0:40921:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483aa82 lrc: 5/1,0 mode: --/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c4f expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.511797:0:40921:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483aa82 lrc: 5/1,0 mode: --/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c4f expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.511807:0:40921:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483aa82 lrc: 5/1,0 mode: --/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606c4f expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.511815:0:40921:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483aa82 lrc: 5/1,0 mode: CR/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10080000000000 nid: local remote: 0x7130d520e4606c4f expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.511823:0:40921:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483aa82 lrc: 6/1,0 mode: CR/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10080000000000 nid: local remote: 0x7130d520e4606c4f expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.511858:0:40921:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483aa82 lrc: 6/1,0 mode: CR/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x80000000000 nid: local remote: 0x7130d520e4606c4f expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.511864:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191342.511871:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000008d07e5df/0xe5129dc88483aa19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4606b14 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191342.511879:0:40921:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b51185800) 00010000:00010000:1.0:1787191342.511889:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51185c00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191342.511896:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000008d07e5df/0xe5129dc88483aa19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e4606b14 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1787191342.511906:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b4121e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634924672:12345-192.168.202.101@tcp:105: Request processed in 123us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191342.511915:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1452 00010000:00010000:1.0:1787191342.511939:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000008d07e5df/0xe5129dc88483aa19 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4606b14 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.511950:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191342.511971:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000008d07e5df/0xe5129dc88483aa19 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4606b14 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.511980:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000008d07e5df/0xe5129dc88483aa19 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4606b14 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.512000:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191342.512002:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191342.512004:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191342.512030:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626791168:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787191342.512112:0:57938:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483aa82 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c4f expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.512123:0:57938:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483aa82 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c4f expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191342.512138:0:57938:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b513b9500 x1874004626791040/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/344 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191342.512151:0:57938:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483aa82 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c4f expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.512163:0:57938:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/223 (0 0) 00000080:00200000:1.0:1787191342.512168:0:57938:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xdf:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191342.512182:0:57938:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdf:0x0](ffff936b4898f448) for lock 0xe5129dc88483aa82 00000080:00010000:1.0:1787191342.512190:0:57938:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483aa82 from it ffffa3fb422dbbc8 00010000:00010000:1.0:1787191342.512195:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483aa82 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606c4f expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.512204:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483aa82 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c4f expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.512238:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483aa82 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c4f expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.512248:0:57938:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483aa82 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c4f expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:1.0:1787191342.512256:0:57938:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xdf:0x0](000000005ee70b41) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483aa82 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c4f expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1787191342.512292:0:57938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626791296:192.168.202.101@tcp:49:lfs.0 00000100:00100000:1.0:1787191342.512333:0:57938:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.512477:0:40919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634924928 00000100:00100000:0.0:1787191342.512482:0:40919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634924928 00000100:00100000:0.0:1787191342.512611:0:40919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 38 00000100:00100000:0.0:1787191342.512619:0:40919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:8420:x1874004634924928:12345-192.168.202.101@tcp:104: 00010000:00010000:0.0:1787191342.512629:0:40919:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a971 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4606915 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.512718:0:40919:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787191342.512724:0:40919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:LOV_OSC_UUID+4:8420:x1874004634924928:12345-192.168.202.101@tcp:104: Request processed in 107us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787191342.512731:0:40919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 38 00010000:00010000:2.0:1787191342.512793:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787191342.512800:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a971 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4606915 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.512808:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b6a608800 already unused, calling callback (ffffffffc1208790) 00010000:00010000:2.0:1787191342.512812:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a971 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4606915 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.512862:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a971 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4606915 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.512871:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191342.512887:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a971 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4606915 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.512895:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000003280ccba/0xe5129dc88483a971 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4606915 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.512910:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191342.512913:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191342.512914:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191342.512925:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626791424:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191342.513363:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191342.513432:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634925568 00000100:00100000:3.0:1787191342.513437:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634925568 00000100:00100000:3.0:1787191342.513595:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1453 00000100:00100000:3.0:1787191342.513604:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:37089:x1874004634925568:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191342.513613:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aa27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4606b30 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191342.513663:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191342.513669:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:37089:x1874004634925568:12345-192.168.202.101@tcp:104: Request processed in 67us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191342.513675:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1453 00010000:00010000:1.0:1787191342.513732:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191342.513739:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aa27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4606b30 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.513752:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030600 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191342.513757:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aa27 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e4606b30 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.513788:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aa27 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4606b30 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.513794:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191342.513808:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aa27 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4606b30 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.513815:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aa27 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4606b30 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.513854:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191342.513856:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191342.513858:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191342.513868:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787191342.513878:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626791552:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191342.514532:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191342.514621:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634925696 00000100:00100000:3.0:1787191342.514627:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634925696 00000100:00100000:3.0:1787191342.514689:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1454 00000100:00100000:3.0:1787191342.514698:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8422:x1874004634925696:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191342.514708:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:3.0:1787191342.514794:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191342.514800:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8422:x1874004634925696:12345-192.168.202.101@tcp:104: Request processed in 104us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191342.514807:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1454 00010000:00010000:1.0:1787191342.514952:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191342.514959:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:1.0:1787191342.514967:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51fe1e00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191342.514972:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:1.0:1787191342.515003:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:1.0:1787191342.515011:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191342.515035:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:1.0:1787191342.515042:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000530485f8/0xe5129dc88483a9da lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4606a50 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:1.0:1787191342.515058:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191342.515060:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191342.515062:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191342.515367:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787191342.515382:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626791680:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191342.516951:0:57570:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589937099 gen 1 00000100:00100000:1.0:1787191342.516982:0:57570:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b513b8700 x1874004626789504/t8589937094(8589937094) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787191342.516993:0:57570:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b51d1ea00 x1874004626790016/t8589937096(8589937096) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787191342.517007:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626790656:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191342.517036:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483aa74 lrc: 4/0,1 mode: --/EX res: [0x200000405:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c41 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.517047:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483aa74 lrc: 4/0,1 mode: --/CR res: [0x200000405:0xdf:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c41 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.517065:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483aa74 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xdf:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606c41 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.517076:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483aa74 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xdf:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c41 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.517088:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483aa74 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xdf:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606c41 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.517107:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483aa74 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xdf:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606c41 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.517310:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483aa74 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xdf:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606c41 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191342.517325:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b453a9c00 x1874004626790656/t8589937099(8589937099) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191342.517343:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483aa74 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdf:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c41 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191342.517355:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483aa74 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdf:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c41 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.517366:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/223 (0 0) 00000080:00200000:1.0:1787191342.517372:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xdf:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191342.517384:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdf:0x0](ffff936b4898f448) for lock 0xe5129dc88483aa74 00000080:00010000:1.0:1787191342.517392:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483aa74 from it ffffa3fb41cab930 00010000:00010000:1.0:1787191342.517395:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483aa74 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdf:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606c41 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.517404:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483aa74 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdf:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c41 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191342.517420:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:1.0:1787191342.517427:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdf:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00000100:00100000:3.0:1787191342.517606:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626791424:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191342.517730:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626791168:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191342.517749:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626791552:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191342.521440:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626791680:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191342.524406:0:57938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626791296:192.168.202.101@tcp:49:lfs.0 00010000:00010000:1.0:1787191342.524480:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483aa82 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606c4f expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.524496:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483aa82 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c4f expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191342.524547:0:57938:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdf:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1787191342.524556:0:57938:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdf:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191342.524559:0:57938:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191342.524564:0:57938:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191342.524608:0:57938:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191342.524627:0:57938:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdf:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:1.0:1787191342.524652:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483aa82 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c4f expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.524665:0:57938:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483aa82 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c4f expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:1.0:1787191342.524679:0:57938:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xdf:0x0](000000005ee70b41) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483aa82 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c4f expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191342.524699:0:57938:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdf:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1787191342.524704:0:57938:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdf:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191342.524706:0:57938:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191342.524708:0:57938:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191342.524724:0:57938:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191342.524731:0:57938:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdf:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:1.0:1787191342.524743:0:57938:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa7b lrc: 1/0,0 mode: PR/PR res: [0x280000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606c48 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191342.524815:0:57938:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xdf:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:1.0:1787191342.524821:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483aa82 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606c4f expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.524829:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483aa82 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606c4f expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191342.525147:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483aa82 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606c4f expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191342.525157:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483aa82 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606c4f expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00010000:2.0:1787191342.525165:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xdf:0x0](000000005ee70b41) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483aa82 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606c4f expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191342.525175:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483aa82 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606c4f expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191342.525182:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483aa82 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606c4f expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00020000:00200000:2.0:1787191342.525195:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xdf:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:2.0:1787191342.525199:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdf:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191342.525201:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191342.525208:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191342.525221:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191342.525224:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:2.0:1787191342.525237:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:2.0:1787191342.525241:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b5338f0f0, osc lock ffff936b44e63c80, flags 0x80000000 00000008:00010000:2.0:1787191342.525245:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:2.0:1787191342.525247:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b5338f130, osc lock ffff936b44e63b50, flags 0x80000000 00010000:00010000:2.0:1787191342.525257:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b52377800 type 11 mode 2 res 10737419265/468 (0 1048575) 00010000:00010000:2.0:1787191342.525291:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.525299:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.525310:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191342.525330:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626791808:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191342.525425:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338ff00 going to sleep for 11 seconds 00000080:00200000:1.0:1787191342.529699:0:57938:0:(vvp_io.c:397:vvp_io_fini()) [0x200000405:0xdf:0x0] layout changed from 3 to 4. 00000080:00200000:1.0:1787191342.529714:0:57938:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdf:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00020000:00200000:1.0:1787191342.529727:0:57938:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdf:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 1, mirror count: 2 00020000:00200000:1.0:1787191342.529731:0:57938:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191342.529735:0:57938:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xdf:0x0] 00000008:00010000:1.0:1787191342.529758:0:57938:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191342.529762:0:57938:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b44ca89b0, osc lock ffff936b468364c0, flags 0x400000400001002 00010000:00010000:1.0:1787191342.529785:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa7b lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606c48 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.529804:0:57938:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa7b lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606c48 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000008:00010000:1.0:1787191342.529820:0:57938:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa7b lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606c48 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1787191342.529851:0:57938:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191342.529856:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa7b lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606c48 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.529867:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa7b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606c48 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1787191342.529883:0:57938:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191342.529895:0:57938:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xdf:0x0] updating i_size 0 i_blocks 0 00000020:00010000:1.0:1787191342.529900:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51655030 (ffff936b465cc998/0) at cl_lock_release():245 00000020:00010000:1.0:1787191342.529904:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51655030 (ffff936b465cc998/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191342.529907:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b44ca89b0 (ffff936b465cc098/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191342.529911:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51655030 (ffff936b465cc998/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191342.529914:0:57938:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b44ca89b0 (ffff936b465cc998/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191342.529925:0:57938:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdf:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1787191342.529968:0:57938:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xdf:0x0](ffff936b4898f448), flags 154000 00000002:00100000:1.0:1787191342.530042:0:57938:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1ea00 x1874004626790016/t8589937096(8589937096) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191342.530054:0:57938:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191342.530060:0:57938:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453aa680 x1874004626792064/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191342.530083:0:57938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626792064:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191342.530525:0:57938:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:3.0:1787191342.532221:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191342.532679:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634925824 00000100:00100000:3.0:1787191342.532688:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634925824 00000100:00100000:3.0:1787191342.532745:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1455 00000100:00100000:3.0:1787191342.532755:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30511:x1874004634925824:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191342.532772:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa7b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000010000 nid: local remote: 0x7130d520e4606c48 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191342.533481:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191342.533490:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30511:x1874004634925824:12345-192.168.202.101@tcp:104: Request processed in 736us (1440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191342.533499:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1455 00000100:00100000:0.0:1787191342.534413:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626791808:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191342.534439:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e4606c72 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.534458:0:57570:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4606c72 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.534466:0:57570:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4606c72 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191342.534598:0:57938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626792064:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191342.534626:0:57938:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1ea00 x1874004626790016/t8589937096(8589937096) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191342.534702:0:57938:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191342.534719:0:57938:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191342.534734:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191342.534751:0:57938:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191342.534758:0:57938:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191342.534764:0:57938:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191342.534767:0:57938:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191342.534774:0:57938:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422dbbf8 00010000:00010000:3.0:1787191342.534777:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191342.534786:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191342.534799:0:57938:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191342.534805:0:57938:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191342.534810:0:57938:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191342.534823:0:57938:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b483e6900, open_flags d902, mode 0 opened 0 00000080:00200000:3.0:1787191342.534828:0:57938:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:3.0:1787191342.534878:0:57938:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154403 00010000:00010000:3.0:1787191342.534924:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483aa90 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.534932:0:57938:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483aa90 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57938 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191342.534942:0:57938:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191342.534949:0:57938:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1ea00 x1874004626792320/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191342.534958:0:57938:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483aa90 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57938 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191342.534979:0:57938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626792320:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191342.535593:0:57938:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c540 going to sleep for 11 seconds 00010000:00010000:1.0:1787191342.536313:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191342.536321:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa7b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000010000 nid: local remote: 0x7130d520e4606c48 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.536332:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030400 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191342.536338:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa7b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800428400010000 nid: local remote: 0x7130d520e4606c48 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191342.536361:0:40929:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdf:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1787191342.536375:0:40929:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdf:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1787191342.536419:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa7b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400010020 nid: local remote: 0x7130d520e4606c48 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.536427:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191342.536448:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa7b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400010020 nid: local remote: 0x7130d520e4606c48 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.536456:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000011a3f661/0xe5129dc88483aa7b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400010020 nid: local remote: 0x7130d520e4606c48 expref: -99 pid: 57938 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.536469:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191342.536471:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191342.536473:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191342.536488:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626792448:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191342.539445:0:57938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626792320:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191342.539473:0:57938:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483aa90 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c8e expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.539495:0:57938:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483aa90 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c8e expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.539504:0:57938:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483aa90 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c8e expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.539515:0:57938:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483aa90 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606c8e expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.539527:0:57938:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483aa90 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c8e expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.539539:0:57938:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483aa90 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606c8e expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.539547:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483aa90 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606c8e expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.539554:0:57938:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483aa90 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606c8e expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191342.539564:0:57938:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b51d1ea00 x1874004626792320/t8589937101(8589937101) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191342.539578:0:57938:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1ea00 x1874004626792320/t8589937101(8589937101) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191342.539591:0:57938:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483aa90 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c8e expref: -99 pid: 57938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191342.539605:0:57938:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483aa90 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c8e expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.539616:0:57938:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/223 (0 0) 00000080:00200000:2.0:1787191342.539623:0:57938:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191342.539675:0:57938:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xdf:0x0](ffff936b4898f448): rc = 0 00000080:00200000:2.0:1787191342.539691:0:57938:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xdf:0x0]: layout version change: 4 -> 4 00000080:00010000:2.0:1787191342.539696:0:57938:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdf:0x0](ffff936b4898f448) for lock 0xe5129dc88483aa90 00000080:00010000:2.0:1787191342.539712:0:57938:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xdf:0x0](ffff936b4898f448) 00000080:00200008:2.0:1787191342.539727:0:57938:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xdf:0x0](ffff936b4898f448), flags 154402 00000002:00100000:2.0:1787191342.539750:0:57938:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1ea00 x1874004626792320/t8589937101(8589937101) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191342.539790:0:57938:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1ea00 x1874004626792320/t8589937101(8589937101) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191342.539799:0:57938:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191342.539804:0:57938:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb100 x1874004626792704/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191342.539823:0:57938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626792704:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191342.541472:0:57938:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f840 going to sleep for 11 seconds 00000100:00100000:3.0:1787191342.541697:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191342.541730:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634925952 00000100:00100000:3.0:1787191342.541737:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634925952 00000100:00100000:3.0:1787191342.541783:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1456 00000100:00100000:3.0:1787191342.541793:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:37090:x1874004634925952:12345-192.168.202.101@tcp:105: 00010000:00010000:3.0:1787191342.541810:0:40922:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4606c72 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.541824:0:40922:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4606c72 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.543778:0:40922:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e4606c72 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.543795:0:40922:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080080020000 nid: local remote: 0x7130d520e4606c72 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.543805:0:40922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080080020000 nid: local remote: 0x7130d520e4606c72 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.543816:0:40922:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80080020000 nid: local remote: 0x7130d520e4606c72 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.543873:0:40922:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b51184800) 00000100:00100000:3.0:1787191342.543936:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:37090:x1874004634925952:12345-192.168.202.101@tcp:105: Request processed in 2141us (2239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191342.543958:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1456 00010000:00010000:2.0:1787191342.544955:0:57570:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4606c72 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.544971:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4606c72 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.544988:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e4606c72 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1787191342.545002:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080020000 nid: local remote: 0x7130d520e4606c72 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.545026:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4606c72 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.545035:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4606c72 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.545128:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000019f0f7ea/0xe5129dc88483aa97 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.545138:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000019f0f7ea/0xe5129dc88483aa97 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.545149:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000019f0f7ea/0xe5129dc88483aa97 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191342.545171:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626792832:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191342.545241:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f300 going to sleep for 11 seconds 00000100:00100000:3.0:1787191342.546156:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626793088:192.168.202.101@tcp:400:kworker.0 00000100:00100000:3.0:1787191342.546211:0:2392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787191342.546217:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:95df428c-87a4-4fae-83fd-e31aed0d69bf:2392:1874004626792960:192.168.202.101@tcp:400:kworker.0 00000100:00100000:1.0:1787191342.547493:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626792448:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191342.550928:0:57938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626792704:192.168.202.101@tcp:35:lfs.0 00000002:00100000:2.0:1787191342.550965:0:57938:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1ea00 x1874004626792320/t8589937101(8589937101) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1787191342.551064:0:57938:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483aa90 from it ffff936b466f4ba0 00010000:00010000:2.0:1787191342.551075:0:57938:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483aa90 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606c8e expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.551089:0:57938:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483aa90 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606c8e expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191342.551124:0:57938:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xdf:0x0](ffff936b4898f448), inode mode 81a4 mask 46 00000080:00200080:2.0:1787191342.551178:0:57938:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xdf:0x0](ffff936b4898f448) cmd=800466af arg=7ffcf9e8edbc 00000080:00200080:2.0:1787191342.551196:0:57938:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xdf:0x0](ffff936b4898f448) cmd=80086601 arg=7ffcf9e8ed58 00000100:00100000:2.0:1787191342.551241:0:57938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626793216:192.168.202.101@tcp:33:lfs.0 00000100:00100000:2.0:1787191342.551316:0:57938:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f840 going to sleep for 11 seconds 00000100:00100000:2.0:1787191342.553421:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:95df428c-87a4-4fae-83fd-e31aed0d69bf:2392:1874004626792960:192.168.202.101@tcp:400:kworker.0 00000100:00100000:1.0:1787191342.553591:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626792832:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191342.553610:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000019f0f7ea/0xe5129dc88483aa97 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606c9c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.553630:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000019f0f7ea/0xe5129dc88483aa97 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4606c9c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.553644:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000019f0f7ea/0xe5129dc88483aa97 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4606c9c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.553659:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000019f0f7ea/0xe5129dc88483aa97 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4606c9c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191342.553673:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000019f0f7ea/0xe5129dc88483aa97 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4606c9c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.553685:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000019f0f7ea/0xe5129dc88483aa97 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606c9c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.553693:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000019f0f7ea/0xe5129dc88483aa97 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606c9c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191342.553790:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626793344:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191342.553995:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626793472:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191342.555532:0:57938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57938:1874004626793216:192.168.202.101@tcp:33:lfs.0 00000080:00200080:1.0:1787191342.555573:0:57938:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xdf:0x0](ffff936b4898f448) cmd=c00c66f3 arg=7ffcf9e8ed44 00000080:00200008:1.0:1787191342.555673:0:57938:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xdf:0x0](ffff936b4898f448), flags 154002 00000100:00100000:2.0:1787191342.556899:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626793088:192.168.202.101@tcp:400:kworker.0 00000100:00100000:1.0:1787191342.557826:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626793472:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191342.557891:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626793344:192.168.202.101@tcp:10:bash.0 00000080:00200000:2.0:1787191342.558007:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xdf:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191342.558024:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b497c94e8 (ffff936b465cc908/0) at cl_lock_release():245 00000020:00010000:2.0:1787191342.558028:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b497c94e8 (ffff936b465cc908/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.558033:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b5338f0f0 (ffff936b465cca28/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191342.558045:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4606c72 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.558070:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606c72 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191342.558085:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b5338f130 (ffff936b465cc878/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191342.558090:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000019f0f7ea/0xe5129dc88483aa97 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606c9c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.558108:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000019f0f7ea/0xe5129dc88483aa97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606c9c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191342.558248:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b497c94e8 (ffff936b465cc908/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191342.558252:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b5338f0f0 (ffff936b465cc908/1) at cl_lock_fini():72 00000020:00010000:2.0:1787191342.558256:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b5338f130 (ffff936b465cc908/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191342.558274:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdf:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191342.558308:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xdf:0x0](ffff936b4898f448) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191342.000000000, mtime 1787191342.000000000, ctime 1787191342.000000000, rc 0 00000080:00200008:2.0:1787191342.558385:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xdf:0x0], ppos: 0, count: 5 00000080:00200000:2.0:1787191342.558398:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191342.558403:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:2.0:1787191342.558407:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:2.0:1787191342.558412:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1787191342.558418:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@00000000122a9c57[0x110, 1, [0x200000405:0xdf:0x0] hash] 00000020:00200000:2.0:1787191342.558420:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:2.0:1787191342.558424:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdf:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:2.0:1787191342.558435:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xdf:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:2.0:1787191342.558440:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdf:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191342.558443:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1787191342.558447:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1787191342.558454:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:2.0:1787191342.558458:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1787191342.558473:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:2.0:1787191342.558486:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1787191342.558490:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d11b0, osc lock ffff936b44e63b50, flags 0x0 00010000:00010000:2.0:1787191342.558506:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606c72 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.558520:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606c72 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.558531:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4606c72 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.558545:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4606c72 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.558553:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4606c72 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191342.558563:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:2.0:1787191342.558571:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191342.558609:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:2.0:1787191342.558618:0:57570:0:(rw26.c:927:ll_write_end()) page@000000009ea96d08[3 00000000a53a9bb9 2 1 0000000004f6bc01 0 0 0] 00000080:00200000:2.0:1787191342.558621:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @00000000f2b7c4b8 17ffffc0001001 3:0 ffff936b43a1eee0 0 lru 00000080:00200000:2.0:1787191342.558628:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@0000000078f81f22 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000a2a44f55 00000000f5ddd5d2 > 3< 0 0 > 4< 0 0 8 420421632 - | - - - - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1787191342.558630:0:57570:0:(rw26.c:927:ll_write_end()) end page@000000009ea96d08 00000080:00200000:2.0:1787191342.558631:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:2.0:1787191342.558635:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:2.0:1787191342.558653:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 00000000270a98fb ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606c72 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191342.558672:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b4898f5f8, count 1, dirtied 1 00000080:00200000:2.0:1787191342.558677:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:2.0:1787191342.558680:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:2.0:1787191342.558693:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b497c95d8 (ffff936b465cc878/0) at cl_lock_release():245 00000020:00010000:2.0:1787191342.558695:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b497c95d8 (ffff936b465cc878/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.558698:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d11b0 (ffff936b465cca28/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191342.558702:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4606c72 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.558717:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606c72 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:2.0:1787191342.558726:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b497c95d8 (ffff936b465cc878/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191342.558729:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d11b0 (ffff936b465cc878/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191342.558735:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:2.0:1787191342.558739:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1787191342.558744:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdf:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191342.558748:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:2.0:1787191342.558753:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xdf:0x0] updating i_size 5 i_blocks 0 00000080:00200000:2.0:1787191342.558757:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:2.0:1787191342.558772:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xdf:0x0](ffff936b4898f448), flags 100001 00000002:00100000:2.0:1787191342.558823:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513b8700 x1874004626789504/t8589937094(8589937094) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191342.558910:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191342.558916:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9180 x1874004626793728/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191342.558936:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626793728:192.168.202.101@tcp:35:bash.0 00000100:00100000:2.0:1787191342.559052:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191342.569972:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626793728:192.168.202.101@tcp:35:bash.0 00000002:00100000:3.0:1787191342.570010:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513b8700 x1874004626789504/t8589937094(8589937094) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191342.577852:0:57944:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191342.577880:0:57944:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.577896:0:57944:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.577911:0:57944:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.577920:0:57944:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191342.577928:0:57944:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191342.577931:0:57944:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191342.577939:0:57944:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422fbb58 00010000:00010000:2.0:1787191342.577943:0:57944:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.577951:0:57944:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.577965:0:57944:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.577973:0:57944:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191342.577978:0:57944:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.577982:0:57944:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=8 00000080:00200008:2.0:1787191342.577987:0:57944:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xdf:0x0](ffff936b4898f448), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191342.577992:0:57944:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xdf:0x0](ffff936b4898f448),name=f70.sanity-flr 00000002:00010000:2.0:1787191342.578003:0:57944:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xdf:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.578011:0:57944:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483aa90 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606c8e expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.578033:0:57944:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483aa90 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606c8e expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191342.578040:0:57944:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191342.578045:0:57944:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xdf:0x0](ffff936b4898f448) 00000080:00010000:2.0:1787191342.578047:0:57944:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xdf:0x0](ffff936b4898f448) for lock 0xe5129dc88483aa90 00000080:00010000:2.0:1787191342.578051:0:57944:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483aa90 from it ffffa3fb422fbcb8 00010000:00010000:2.0:1787191342.578055:0:57944:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483aa90 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606c8e expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.578063:0:57944:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483aa90 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606c8e expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191342.578084:0:57944:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdf:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:2.0:1787191342.578095:0:57944:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdf:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191342.578099:0:57944:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191342.578102:0:57944:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xdf:0x0] 00000008:00010000:2.0:1787191342.578121:0:57944:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191342.578125:0:57944:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d11b0, osc lock ffff936b44e63b50, flags 0x400000400001002 00010000:00010000:2.0:1787191342.578141:0:57944:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606c72 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191342.578153:0:57944:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606c72 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:2.0:1787191342.578165:0:57944:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191342.578169:0:57944:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4606c72 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191342.578177:0:57944:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606c72 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:2.0:1787191342.578188:0:57944:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191342.578198:0:57944:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xdf:0x0] updating i_size 5 i_blocks 0 00000020:00010000:2.0:1787191342.578204:0:57944:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51657c20 (ffff936b465cc878/0) at cl_lock_release():245 00000020:00010000:2.0:1787191342.578207:0:57944:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51657c20 (ffff936b465cc878/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.578210:0:57944:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d11b0 (ffff936b465cca28/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.578214:0:57944:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51657c20 (ffff936b465cc878/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191342.578216:0:57944:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d11b0 (ffff936b465cc878/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191342.578228:0:57944:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdf:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191342.578251:0:57944:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191342.578259:0:57944:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.578266:0:57944:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.578274:0:57944:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.578279:0:57944:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191342.578283:0:57944:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191342.578286:0:57944:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191342.578289:0:57944:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422fbc10 00010000:00010000:2.0:1787191342.578292:0:57944:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.578299:0:57944:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.578307:0:57944:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.578310:0:57944:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191342.578313:0:57944:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.578318:0:57944:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:2.0:1787191342.578322:0:57944:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:2.0:1787191342.578326:0:57944:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:2.0:1787191342.578348:0:57944:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483aa74 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdf:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4606c41 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191342.578361:0:57944:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xdf:0x0]: losing layout lock 00010000:00010000:2.0:1787191342.578373:0:57944:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483aa82 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4606c4f expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:2.0:1787191342.578381:0:57944:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xdf:0x0]: losing layout lock 00010000:00010000:2.0:1787191342.578385:0:57944:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483aa90 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4606c8e expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191342.578392:0:57944:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xdf:0x0]: losing layout lock 00010000:00010000:2.0:1787191342.578399:0:57944:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483aa5f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4606c02 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.578442:0:57944:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483aa74 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xdf:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4606c41 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.578450:0:57944:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483aa82 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606c4f expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191342.578456:0:57944:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483aa90 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606c8e expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191342.578463:0:57944:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483aa5f lrc: 1/0,0 mode: --/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4606c02 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.578468:0:57944:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 4 locks packed 00010000:00010000:2.0:1787191342.578472:0:57944:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483aa74 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xdf:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4606c41 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.578485:0:57944:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483aa82 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xdf:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606c4f expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191342.578493:0:57944:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483aa90 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606c8e expref: -99 pid: 57938 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191342.578502:0:57944:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483aa5f lrc: 0/0,0 mode: --/PR res: [0x200000405:0xdf:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4606c02 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:2.0:1787191342.578522:0:57944:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1787191342.578535:0:57944:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bbb80 x1874004626793984/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 512/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787191342.578558:0:57944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57944:1874004626793984:192.168.202.101@tcp:36:rm.0 00000100:00100000:2.0:1787191342.578646:0:57944:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f3c0 going to sleep for 11 seconds 00000080:00200000:0.0:1787191342.584144:0:57943:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191342.584180:0:57943:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.584197:0:57943:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.584213:0:57943:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.584221:0:57943:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191342.584228:0:57943:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191342.584232:0:57943:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191342.584239:0:57943:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42163bf8 00010000:00010000:0.0:1787191342.584243:0:57943:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.584252:0:57943:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.584267:0:57943:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.584276:0:57943:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191342.584282:0:57943:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:3.0:1787191342.586673:0:57944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57944:1874004626793984:192.168.202.101@tcp:36:rm.0 00000080:00200000:3.0:1787191342.586747:0:57944:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xdf:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1787191342.586759:0:57944:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xdf:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191342.586763:0:57944:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:3.0:1787191342.586769:0:57944:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1787191342.586781:0:57944:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000008:00010000:3.0:1787191342.586799:0:57944:0:(osc_cache.c:1183:osc_extent_make_ready()) ### extent: 00000000270a98fb ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606c72 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1787191342.586825:0:57944:0:(osc_cache.c:917:osc_extent_finish()) ### extent: 00000000270a98fb ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606c72 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1787191342.586916:0:57944:0:(osc_cache.c:497:__osc_extent_remove()) ### extent: 00000000270a98fb ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606c72 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787191342.586938:0:57944:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xdf:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191342.586978:0:57944:0:(llite_lib.c:2066:ll_clear_inode()) VFS Op:inode=[0x200000405:0xdf:0x0](ffff936b4898f448) 00000008:00010000:3.0:1787191342.587005:0:57944:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 5 blocks 0 [cma]time 1787191342 1787191342 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4606c72 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:3.0:1787191342.587038:0:57944:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191342 1787191342 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000019f0f7ea/0xe5129dc88483aa97 lrc: 1/0,0 mode: PW/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606c9c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191342.587088:0:57943:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b51e77380, open_flags d900, mode 0 opened 0 00000080:00200000:0.0:1787191342.587095:0:57943:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:0.0:1787191342.587115:0:57943:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:0.0:1787191342.587174:0:57943:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483aa9e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.587185:0:57943:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483aa9e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57943 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191342.587196:0:57943:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191342.587204:0:57943:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477800 x1874004626794240/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191342.587212:0:57943:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483aa9e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57943 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.587231:0:57943:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57943:1874004626794240:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191342.587404:0:57943:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.591366:0:57943:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57943:1874004626794240:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191342.591390:0:57943:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483aa9e lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.591404:0:57943:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483aa9e lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.591411:0:57943:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483aa9e lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.591418:0:57943:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483aa9e lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.591427:0:57943:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483aa9e lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.591433:0:57943:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b47a7f200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191342.591437:0:57943:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483aa9e lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.591445:0:57943:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483aa9e lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.591452:0:57943:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483aa9e lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.591458:0:57943:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191342.591464:0:57943:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483aa9e lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.591470:0:57943:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483aa9e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57943 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.591493:0:57943:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x7, status=0 req@ffff936b6a477800 x1874004626794240/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/608 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191342.591508:0:57943:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191342.591761:0:57943:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191342.591779:0:57943:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.591789:0:57943:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.591801:0:57943:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.591808:0:57943:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191342.591813:0:57943:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191342.591817:0:57943:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191342.591822:0:57943:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42163b58 00010000:00010000:0.0:1787191342.591826:0:57943:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.592948:0:57943:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.592967:0:57943:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.592976:0:57943:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191342.592982:0:57943:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.592992:0:57943:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=9 00000080:00200000:0.0:1787191342.592996:0:57943:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:0.0:1787191342.593025:0:57943:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:0.0:1787191342.593148:0:57943:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aaa5 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.593157:0:57943:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aaa5 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.593167:0:57943:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aaa5 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57943 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.593188:0:57943:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57943:1874004626794368:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191342.593261:0:57943:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00000080:00200000:3.0:1787191342.597442:0:57945:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191342.597476:0:57945:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191342.597493:0:57945:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191342.597513:0:57945:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191342.597522:0:57945:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191342.597531:0:57945:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191342.597535:0:57945:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191342.597542:0:57945:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421abb58 00010000:00010000:3.0:1787191342.597546:0:57945:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191342.597555:0:57945:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191342.597572:0:57945:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191342.597579:0:57945:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:3.0:1787191342.597585:0:57945:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:0.0:1787191342.598359:0:57943:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57943:1874004626794368:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191342.598378:0:57943:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aaa5 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.598389:0:57943:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aaa5 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.598395:0:57943:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aaa5 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.598401:0:57943:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aaa5 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.598408:0:57943:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aaa5 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.598414:0:57943:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b47a7f800 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191342.598418:0:57943:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aaa5 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.598424:0:57943:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aaa5 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.598430:0:57943:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aaa5 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.598436:0:57943:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191342.598443:0:57943:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aaa5 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57943 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.598449:0:57943:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aaa5 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57943 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.598474:0:57943:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b6a477800 x1874004626794368/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191342.598487:0:57943:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191342.598584:0:57945:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:3.0:1787191342.598589:0:57945:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:3.0:1787191342.598607:0:57945:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1787191342.598651:0:57945:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483aaac lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.598659:0:57945:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483aaac lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.598668:0:57945:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483aaac lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191342.598687:0:57945:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57945:1874004626794496:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191342.598799:0:57945:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787191342.606458:0:57945:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57945:1874004626794496:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191342.606482:0:57945:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483aaac lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.606495:0:57945:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483aaac lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.606503:0:57945:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483aaac lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.606510:0:57945:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483aaac lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.606521:0:57945:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483aaac lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.606527:0:57945:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9ae00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191342.606532:0:57945:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483aaac lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.606539:0:57945:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483aaac lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.606546:0:57945:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483aaac lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.606553:0:57945:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191342.606559:0:57945:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483aaac lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.606565:0:57945:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483aaac lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191342.606586:0:57945:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b51d1c380 x1874004626794496/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191342.606601:0:57945:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191342.606680:0:57945:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191342.606694:0:57945:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191342.606704:0:57945:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191342.606728:0:57945:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191342.606737:0:57945:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191342.606742:0:57945:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191342.606745:0:57945:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191342.606751:0:57945:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421abbe8 00010000:00010000:3.0:1787191342.606755:0:57945:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191342.606763:0:57945:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191342.606778:0:57945:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191342.606786:0:57945:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000080:00200000:3.0:1787191342.606791:0:57945:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191342.606800:0:57945:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:3.0:1787191342.606804:0:57945:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:3.0:1787191342.606816:0:57945:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1787191342.607426:0:57945:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483aab3 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.607437:0:57945:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483aab3 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1787191342.607495:0:57946:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191342.607506:0:57946:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191342.607514:0:57946:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191342.607516:0:57945:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483aab3 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.607523:0:57946:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191342.607529:0:57946:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191342.607533:0:57946:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191342.607535:0:57946:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000100:00100000:3.0:1787191342.607537:0:57945:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57945:1874004626794624:192.168.202.101@tcp:101:lfs.0 00000080:00010000:1.0:1787191342.607540:0:57946:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4228bbf8 00010000:00010000:1.0:1787191342.607543:0:57946:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191342.607554:0:57946:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191342.607564:0:57946:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191342.607568:0:57946:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191342.607571:0:57946:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:3.0:1787191342.607608:0:57945:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787191342.612514:0:57945:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57945:1874004626794624:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191342.612535:0:57945:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483aab3 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.612549:0:57945:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483aab3 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.612555:0:57945:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483aab3 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.612562:0:57945:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483aab3 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.612572:0:57945:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483aab3 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.612579:0:57945:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9b600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191342.612583:0:57945:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483aab3 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.612590:0:57945:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483aab3 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.612597:0:57945:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483aab3 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.612604:0:57945:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191342.612610:0:57945:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483aab3 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.612616:0:57945:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483aab3 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191342.612641:0:57945:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b51d1c380 x1874004626794624/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191342.612656:0:57945:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191342.612765:0:57945:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191342.612780:0:57945:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191342.612791:0:57945:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191342.612803:0:57945:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191342.612809:0:57945:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191342.612814:0:57945:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191342.612817:0:57945:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191342.612823:0:57945:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421abb58 00010000:00010000:3.0:1787191342.612827:0:57945:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191342.612872:0:57945:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191342.612888:0:57945:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191342.612896:0:57945:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:3.0:1787191342.612906:0:57945:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:3.0:1787191342.612921:0:57945:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:3.0:1787191342.612935:0:57945:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191342.612943:0:57945:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 97 lru_type: 1 00010000:00010000:3.0:1787191342.612951:0:57945:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 97 lru_type: 1 00000002:00010000:3.0:1787191342.612960:0:57945:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191342.612999:0:57945:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483aaba lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.613007:0:57945:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483aaba lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.613027:0:57945:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483aaba lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191342.613049:0:57945:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57945:1874004626794752:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191342.613269:0:57945:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c180 going to sleep for 11 seconds 00000080:00200000:1.0:1787191342.613595:0:57946:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b44d05380, open_flags d900, mode 0 opened 0 00000080:00200000:1.0:1787191342.613604:0:57946:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:1.0:1787191342.613620:0:57946:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:1.0:1787191342.613654:0:57946:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483aac1 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.613661:0:57946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483aac1 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57946 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191342.613669:0:57946:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191342.613677:0:57946:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9500 x1874004626795008/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191342.613686:0:57946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483aac1 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57946 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191342.613698:0:57946:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57946:1874004626795008:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191342.613825:0:57946:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.616548:0:57945:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57945:1874004626794752:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191342.616571:0:57945:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483aaba lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606d1a expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.616584:0:57945:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483aaba lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606d1a expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.616597:0:57945:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483aaba lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606d1a expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.616607:0:57945:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483aaba lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606d1a expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.616619:0:57945:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483aaba lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606d1a expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.616627:0:57945:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483aaba lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606d1a expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.616635:0:57945:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483aaba lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606d1a expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.616647:0:57945:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b51d1c380 x1874004626794752/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191342.616662:0:57945:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483aaba lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606d1a expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.616672:0:57945:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:0.0:1787191342.616680:0:57945:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483aaba lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606d1a expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.616689:0:57945:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483aaba lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606d1a expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:0.0:1787191342.616715:0:57945:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.616726:0:57945:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 194 lru_type: 1 00010000:00010000:0.0:1787191342.616736:0:57945:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 194 lru_type: 1 00010000:00010000:0.0:1787191342.616744:0:57945:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 194 lru_type: 1 00010000:00010000:0.0:1787191342.616751:0:57945:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 195 lru_type: 1 00000080:00200000:0.0:1787191342.616765:0:57945:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191342.616774:0:57945:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:0.0:1787191342.616778:0:57945:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:0.0:1787191342.616784:0:57945:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb421abcb8 00010000:00010000:0.0:1787191342.616788:0:57945:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 97 lru_type: 1 00010000:00010000:0.0:1787191342.616796:0:57945:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 98 lru_type: 1 00000002:00010000:0.0:1787191342.616811:0:57945:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.616818:0:57945:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483aaba lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606d1a expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.616826:0:57945:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483aaba lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606d1a expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.616914:0:57945:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483aaba lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606d1a expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.616922:0:57945:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483aaba lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606d1a expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:0.0:1787191342.616931:0:57945:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.616937:0:57945:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 195 lru_type: 1 00010000:00010000:0.0:1787191342.616945:0:57945:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 195 lru_type: 1 00010000:00010000:0.0:1787191342.616952:0:57945:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 195 lru_type: 1 00010000:00010000:0.0:1787191342.616965:0:57945:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 196 lru_type: 1 00000080:00200008:0.0:1787191342.617530:0:57945:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1787191342.617538:0:57945:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191342.617553:0:57945:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.617562:0:57945:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.617572:0:57945:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.617578:0:57945:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191342.617584:0:57945:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191342.617587:0:57945:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191342.617592:0:57945:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421abcb8 00010000:00010000:0.0:1787191342.617595:0:57945:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.617602:0:57945:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.617724:0:57945:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191342.617734:0:57945:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.617740:0:57945:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.617755:0:57945:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.617761:0:57945:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191342.617766:0:57945:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191342.617768:0:57945:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191342.617772:0:57945:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421abb58 00010000:00010000:0.0:1787191342.617775:0:57945:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.617782:0:57945:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.617791:0:57945:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.617798:0:57945:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:0.0:1787191342.617803:0:57945:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:3.0:1787191342.622230:0:57946:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57946:1874004626795008:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191342.622253:0:57946:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483aac1 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.622267:0:57946:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483aac1 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.622273:0:57946:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483aac1 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.622280:0:57946:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483aac1 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.622292:0:57946:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483aac1 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.622298:0:57946:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191342.622303:0:57946:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483aac1 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.622309:0:57946:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483aac1 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.622317:0:57946:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483aac1 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.622324:0:57946:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191342.622330:0:57946:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483aac1 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.622337:0:57946:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483aac1 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57946 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191342.622355:0:57946:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x7, status=0 req@ffff936b453a9500 x1874004626795008/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/608 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191342.622372:0:57946:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1787191342.622411:0:57946:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483aaba lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606d1a expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191342.622425:0:57946:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483aaba lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606d1a expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:3.0:1787191342.622434:0:57946:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483aaba from it ffffa3fb4228b9a0 00010000:00010000:3.0:1787191342.622438:0:57946:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483aaba lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606d1a expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191342.622441:0:57945:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=8 00010000:00010000:3.0:1787191342.622445:0:57946:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483aaba lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606d1a expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191342.622487:0:57945:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191342.622502:0:57945:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.622512:0:57945:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.622520:0:57945:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.622526:0:57945:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191342.622531:0:57945:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191342.622535:0:57945:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191342.622540:0:57945:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421abbf8 00010000:00010000:0.0:1787191342.622543:0:57945:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.622549:0:57945:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.622566:0:57945:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.622572:0:57945:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191342.622576:0:57945:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.622581:0:57945:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:0.0:1787191342.622583:0:57945:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:0.0:1787191342.622588:0:57945:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b42f3b800, open_flags a141, mode 81b6 opened 0 00000080:00200000:0.0:1787191342.622596:0:57945:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:0.0:1787191342.622614:0:57945:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xe1:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:0.0:1787191342.622625:0:57945:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483aaba lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4606d1a expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1787191342.622661:0:57946:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191342.622669:0:57946:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.622670:0:57945:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483aaba lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4606d1a expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191342.622676:0:57945:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191342.622676:0:57946:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.622679:0:57945:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483aaba lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4606d1a expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191342.622685:0:57946:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191342.622690:0:57946:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191342.622694:0:57946:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191342.622696:0:57946:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191342.622700:0:57946:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4228bb58 00010000:00010000:3.0:1787191342.622702:0:57946:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.622707:0:57945:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aac8 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.622718:0:57945:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aac8 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.622722:0:57946:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000020:00100000:0.0:1787191342.622728:0:57945:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000080:00200000:3.0:1787191342.622731:0:57946:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000100:00100000:0.0:1787191342.622734:0:57945:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477800 x1874004626795264/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000080:00200000:3.0:1787191342.622735:0:57946:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191342.622738:0:57946:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00010000:00010000:0.0:1787191342.622744:0:57945:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aac8 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.622764:0:57945:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57945:1874004626795264:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191342.622900:0:57945:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.631773:0:57945:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57945:1874004626795264:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191342.631801:0:57945:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aac8 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606d4b expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.631830:0:57945:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aac8 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606d4b expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.631856:0:57945:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aac8 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606d4b expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.631868:0:57945:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aac8 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606d4b expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.631879:0:57945:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aac8 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606d4b expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.631897:0:57945:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aac8 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606d4b expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.631904:0:57945:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aac8 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606d4b expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.631911:0:57945:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aac8 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606d4b expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.631923:0:57945:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b6a477800 x1874004626795264/t8589937105(8589937105) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191342.631936:0:57945:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477800 x1874004626795264/t8589937105(8589937105) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191342.631948:0:57945:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aac8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606d4b expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.631957:0:57945:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/225 (0 0) 00000080:00200000:0.0:1787191342.631964:0:57945:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191342.631976:0:57945:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:0.0:1787191342.632002:0:57945:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xe1:0x0](ffff936b5396c2c8) 00000080:00200000:0.0:1787191342.632009:0:57945:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xe1:0x0], updating i_size 0 00000080:00200000:0.0:1787191342.632066:0:57945:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe1:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1787191342.632072:0:57945:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xe1:0x0](ffff936b5396c2c8) 00000080:00010000:0.0:1787191342.632076:0:57945:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe1:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483aac8 00000080:00010000:0.0:1787191342.632086:0:57945:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe1:0x0](ffff936b5396c2c8) 00000080:00200008:0.0:1787191342.632103:0:57945:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe1:0x0](ffff936b5396c2c8), flags 120501 00000002:00100000:0.0:1787191342.632126:0:57945:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477800 x1874004626795264/t8589937105(8589937105) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191342.632162:0:57945:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483aac8 from it ffff936b530f5720 00010000:00010000:0.0:1787191342.632167:0:57945:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aac8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606d4b expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.632177:0:57945:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aac8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606d4b expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191342.632201:0:57945:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe1:0x0](ffff936b5396c2c8), inode mode 81a4 mask 40 00000080:00200000:0.0:1787191342.632276:0:57945:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe1:0x0](ffff936b5396c2c8), inode mode 81a4 mask 2 00000080:00200000:0.0:1787191342.632286:0:57945:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xe1:0x0](ffff936b5396c2c8), xattr lov 00000002:00010000:0.0:1787191342.632304:0:57945:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe1:0x0]) in obj [0x200000405:0xe1:0x0], intent: open flags 040000002 00010000:00010000:0.0:1787191342.632351:0:57945:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483aacf lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.632359:0:57945:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483aacf lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191342.632369:0:57945:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191342.632376:0:57945:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474a80 x1874004626795520/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191342.632386:0:57945:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483aacf lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.632405:0:57945:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57945:1874004626795520:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191342.632586:0:57945:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00000080:00200000:3.0:1787191342.633054:0:57946:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=9 00000080:00200008:3.0:1787191342.633068:0:57946:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe1:0x0](ffff936b5396c2c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191342.633074:0:57946:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe1:0x0](ffff936b5396c2c8),name=f70.sanity-flr 00000002:00010000:3.0:1787191342.633091:0:57946:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe1:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191342.633111:0:57946:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aac8 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606d4b expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191342.633122:0:57946:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aac8 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606d4b expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191342.633129:0:57946:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191342.633134:0:57946:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe1:0x0](ffff936b5396c2c8) 00000080:00010000:3.0:1787191342.633137:0:57946:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe1:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483aac8 00000080:00010000:3.0:1787191342.633141:0:57946:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483aac8 from it ffffa3fb4228bcb8 00010000:00010000:3.0:1787191342.633144:0:57946:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aac8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606d4b expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191342.633150:0:57946:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aac8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606d4b expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000100:00100000:2.0:1787191342.639371:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191342.639448:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634926080 00000100:00100000:3.0:1787191342.639459:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634926080 00000100:00100000:3.0:1787191342.639510:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1457 00000100:00100000:3.0:1787191342.639521:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634926080:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191342.639538:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aac8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4606d4b expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191342.639613:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191342.639620:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634926080:12345-192.168.202.101@tcp:104: Request processed in 102us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191342.639628:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1457 00010000:00010000:0.0:1787191342.639730:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191342.639738:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aac8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4606d4b expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191342.639747:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b47a7f800 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191342.639753:0:40930:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aac8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4606d4b expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191342.639762:0:40930:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aac8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4606d4b expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191342.639772:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aac8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4606d4b expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191342.639794:0:40930:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe1:0x0]: losing layout lock 00010000:00010000:0.0:1787191342.639879:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aac8 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4606d4b expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191342.639888:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191342.639906:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aac8 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4606d4b expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191342.639913:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aac8 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4606d4b expref: -99 pid: 57945 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191342.639926:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191342.639927:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191342.639929:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191342.639991:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626795648:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191342.649576:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626795648:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191342.649581:0:57945:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57945:1874004626795520:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191342.649602:0:57945:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483aacf lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.649617:0:57945:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483aacf lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.649625:0:57945:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483aacf lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.649633:0:57945:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483aacf lrc: 3/0,0 mode: --/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.649646:0:57945:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483aacf lrc: 4/0,0 mode: --/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.649652:0:57945:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b47a7f200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191342.649656:0:57945:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483aacf lrc: 4/0,0 mode: --/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.649663:0:57945:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483aacf lrc: 4/0,0 mode: --/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.649672:0:57945:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483aacf lrc: 5/0,0 mode: --/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.649678:0:57945:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191342.649684:0:57945:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483aacf lrc: 3/0,0 mode: --/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.649690:0:57945:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483aacf lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57945 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.649719:0:57945:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b6a474a80 x1874004626795520/t8589937106(8589937106) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191342.649733:0:57945:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474a80 x1874004626795520/t8589937106(8589937106) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191342.649750:0:57945:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xe1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787191342.649800:0:57945:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe1:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1787191342.649808:0:57945:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe1:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191342.649872:0:57945:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xe1:0x0], updating i_size 0 00000002:00100000:0.0:1787191342.649892:0:57945:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474a80 x1874004626795520/t8589937106(8589937106) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191342.649931:0:57945:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a474a80 x1874004626795520/t8589937106(8589937106) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191342.649940:0:57945:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191342.649946:0:57945:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475880 x1874004626795904/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191342.649967:0:57945:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57945:1874004626795904:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191342.650041:0:57945:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.654931:0:57945:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57945:1874004626795904:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191342.654968:0:57945:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a474a80 x1874004626795520/t8589937106(8589937106) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1787191342.655044:0:57945:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe1:0x0](ffff936b5396c2c8), flags 100001 00000080:00200000:3.0:1787191342.655075:0:57946:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191342.655089:0:57946:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00000002:00100000:0.0:1787191342.655101:0:57945:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a477800 x1874004626795264/t8589937105(8589937105) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191342.655112:0:57945:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191342.655117:0:57945:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a476300 x1874004626796160/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191342.655138:0:57945:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57945:1874004626796160:192.168.202.101@tcp:35:lfs.0 00010000:00010000:3.0:1787191342.655158:0:57946:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191342.655171:0:57946:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191342.655179:0:57946:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191342.655184:0:57946:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191342.655188:0:57946:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191342.655195:0:57946:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4228bbf8 00010000:00010000:3.0:1787191342.655198:0:57946:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000100:00100000:0.0:1787191342.655204:0:57945:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00010000:00010000:3.0:1787191342.655208:0:57946:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191342.655224:0:57946:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191342.655231:0:57946:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191342.655236:0:57946:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191342.655250:0:57946:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b46081080, open_flags d902, mode 0 opened 0 00000080:00200000:3.0:1787191342.655256:0:57946:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:3.0:1787191342.655271:0:57946:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154403 00010000:00010000:3.0:1787191342.655310:0:57946:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483aad6 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.655318:0:57946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483aad6 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57946 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191342.655327:0:57946:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:3.0:1787191342.655332:0:57946:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1fb80 x1874004626796416/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191342.655341:0:57946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483aad6 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57946 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191342.655352:0:57946:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57946:1874004626796416:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191342.655471:0:57946:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787191342.662342:0:57946:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57946:1874004626796416:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191342.662369:0:57946:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483aad6 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606d83 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.662397:0:57946:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483aad6 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606d83 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.662405:0:57946:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483aad6 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606d83 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.662416:0:57946:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483aad6 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606d83 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.662428:0:57946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483aad6 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606d83 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.662440:0:57946:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483aad6 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606d83 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.662449:0:57946:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483aad6 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606d83 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.662456:0:57946:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483aad6 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606d83 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191342.662467:0:57946:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b51d1fb80 x1874004626796416/t8589937108(8589937108) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191342.662485:0:57946:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1fb80 x1874004626796416/t8589937108(8589937108) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191342.662497:0:57946:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483aad6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606d83 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191342.662510:0:57946:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483aad6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606d83 expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.662519:0:57946:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/225 (0 0) 00000080:00200000:1.0:1787191342.662526:0:57946:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191342.662573:0:57946:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xe1:0x0](ffff936b5396c2c8): rc = 0 00000100:00100000:0.0:1787191342.662605:0:57945:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57945:1874004626796160:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191342.662628:0:57945:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a477800 x1874004626795264/t8589937105(8589937105) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191342.662655:0:57946:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe1:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:1.0:1787191342.662661:0:57946:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe1:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483aad6 00000080:00010000:1.0:1787191342.662672:0:57946:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe1:0x0](ffff936b5396c2c8) 00000080:00200008:1.0:1787191342.662685:0:57946:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe1:0x0](ffff936b5396c2c8), flags 154402 00000002:00100000:1.0:1787191342.662701:0:57946:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1fb80 x1874004626796416/t8589937108(8589937108) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191342.662743:0:57946:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483aad6 from it ffff936b466f4960 00010000:00010000:1.0:1787191342.662747:0:57946:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483aad6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606d83 expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.662756:0:57946:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483aad6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606d83 expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191342.662777:0:57946:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe1:0x0](ffff936b5396c2c8), inode mode 81a4 mask 46 00000080:00200000:1.0:1787191342.662875:0:57946:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe1:0x0](ffff936b5396c2c8), inode mode 81a4 mask 4 00000080:00200000:1.0:1787191342.662882:0:57946:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xe1:0x0](ffff936b5396c2c8), xattr lov 00000080:00200008:1.0:1787191342.662907:0:57946:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe1:0x0](ffff936b5396c2c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191342.663029:0:57946:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe1:0x0](ffff936b5396c2c8),name=f70.sanity-flr 00000002:00010000:1.0:1787191342.663052:0:57946:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe1:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191342.663061:0:57946:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483aad6 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606d83 expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.663072:0:57946:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483aad6 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606d83 expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191342.663080:0:57946:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191342.663085:0:57946:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe1:0x0](ffff936b5396c2c8) 00000080:00010000:1.0:1787191342.663089:0:57946:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe1:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483aad6 00000080:00010000:1.0:1787191342.663092:0:57946:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483aad6 from it ffffa3fb4228bcd8 00010000:00010000:1.0:1787191342.663096:0:57946:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483aad6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606d83 expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.663169:0:57946:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483aad6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606d83 expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191342.663187:0:57946:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe1:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:1.0:1787191342.663197:0:57946:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe1:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191342.663200:0:57946:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191342.663203:0:57946:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe1:0x0] 00000008:00010000:1.0:1787191342.663222:0:57946:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191342.663226:0:57946:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b62893db0, osc lock ffff936b468364c0, flags 0x400000400001002 00000008:00010000:1.0:1787191342.663232:0:57946:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191342.663233:0:57946:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b62893df0, osc lock ffff936b46836f70, flags 0x400000400001002 00010000:00010000:1.0:1787191342.663275:0:57946:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aadd lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.663286:0:57946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aadd lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.663301:0:57946:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b453a8000 x1874004626796544/t0(0) o101->lustre-OST0000-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191342.663347:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626796544:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191342.663499:0:57946:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483aae4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.663509:0:57946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483aae4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.663518:0:57946:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b453a9880 x1874004626796672/t0(0) o101->lustre-OST0001-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:1.0:1787191342.663536:0:57946:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 2 items remaining. 00000100:00100000:1.0:1787191342.663546:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626796672:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191342.668159:0:2390:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483aae4 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.668187:0:2390:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483aae4 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606d91 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.668202:0:2390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483aae4 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606d91 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.668214:0:2390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483aae4 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606d91 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191342.668230:0:2390:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483aae4 lrc: 5/2,0 mode: PR/PR res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606d91 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1787191342.668241:0:2390:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191342.668246:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483aae4 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606d91 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.668255:0:2390:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483aae4 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606d91 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.668263:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483aae4 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606d91 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.668271:0:2390:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483aae4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606d91 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1787191342.668290:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626796672:192.168.202.101@tcp:101:lfs.0 00000080:00200000:0.0:1787191342.668778:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191342.668801:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.668814:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.668827:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.668865:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191342.668873:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191342.668876:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191342.668884:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:0.0:1787191342.668887:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.668895:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.668905:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.668913:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191342.668918:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.668924:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:0.0:1787191342.668930:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe1:0x0](ffff936b5396c2c8), inode mode 81a4 mask 42 00000080:00200008:0.0:1787191342.668937:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe1:0x0](ffff936b5396c2c8), flags 101101 00000002:00010000:0.0:1787191342.668964:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xe1:0x0], intent: getxattr flags 0 00010000:00010000:0.0:1787191342.669001:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483aaeb lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.669009:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483aaeb lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.669032:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483aaeb lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.669054:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626796800:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191342.669125:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00010000:00010000:1.0:1787191342.669675:0:2389:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aadd lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.669689:0:2389:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aadd lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606d98 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.669698:0:2389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aadd lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606d98 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.669708:0:2389:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aadd lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606d98 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191342.669720:0:2389:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aadd lrc: 5/2,0 mode: PR/PR res: [0x280000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606d98 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1787191342.669730:0:2389:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1787191342.669741:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aadd lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606d98 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.669749:0:2389:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aadd lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606d98 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.669755:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aadd lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606d98 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.669763:0:2389:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aadd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606d98 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1787191342.669774:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626796544:192.168.202.101@tcp:101:lfs.0 00000080:00200000:3.0:1787191342.671240:0:57946:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe1:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1787191342.671250:0:57946:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51655030 (ffff936b465cc998/0) at cl_lock_release():245 00000020:00010000:3.0:1787191342.671254:0:57946:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51655030 (ffff936b465cc998/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191342.672008:0:57946:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62893db0 (ffff936b465cc098/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191342.672023:0:57946:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62893df0 (ffff936b465ccea8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191342.672026:0:57946:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51655030 (ffff936b465cc998/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191342.672033:0:57946:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62893db0 (ffff936b465cc998/1) at cl_lock_fini():72 00000020:00010000:3.0:1787191342.672037:0:57946:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62893df0 (ffff936b465cc998/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191342.672082:0:57946:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe1:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:0.0:1787191342.673270:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626796800:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191342.673295:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483aaeb lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606da6 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.673311:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483aaeb lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606da6 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.673328:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483aaeb lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606da6 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.673342:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b6a475180 x1874004626796800/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191342.673353:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483aaeb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606da6 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.673364:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/225 (0 0) 00000080:00200000:0.0:1787191342.673370:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xe1:0x0] suppgids 0 -1: rc 0 00000080:00010000:0.0:1787191342.673393:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe1:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483aaeb 00000080:00010000:0.0:1787191342.673400:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483aaeb from it ffffa3fb41caba38 00010000:00010000:0.0:1787191342.673404:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483aaeb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606da6 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.673413:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483aaeb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606da6 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:0.0:1787191342.673445:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xe1:0x0](ffff936b5396c2c8) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191342.000000000, mtime 1787191342.000000000, ctime 1787191342.000000000 00010000:00010000:0.0:1787191342.673473:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483aad6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4606d83 expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191342.673490:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe1:0x0]: losing layout lock 00010000:00010000:0.0:1787191342.673525:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483aad6 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606d83 expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191342.673537:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191342.673539:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483aad6 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606d83 expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000020:00100000:0.0:1787191342.673558:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1787191342.673564:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475180 x1874004626797056/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787191342.673585:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626797056:192.168.202.101@tcp:36:bash.0 00000100:00100000:0.0:1787191342.673644:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00000080:00200000:2.0:1787191342.683952:0:57946:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191342.683981:0:57946:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.683997:0:57946:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.684010:0:57946:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.684029:0:57946:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191342.684037:0:57946:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191342.684041:0:57946:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191342.684048:0:57946:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4228bb58 00010000:00010000:2.0:1787191342.684052:0:57946:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.684061:0:57946:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.684076:0:57946:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.684084:0:57946:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191342.684089:0:57946:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.684104:0:57946:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=9 00000080:00200000:2.0:1787191342.684108:0:57946:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191342.684119:0:57946:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191342.684166:0:57946:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483aaf2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.684174:0:57946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483aaf2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.684184:0:57946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483aaf2 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57946 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191342.684206:0:57946:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57946:1874004626797184:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191342.684266:0:57946:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f600 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.684414:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626797056:192.168.202.101@tcp:36:bash.0 00000080:00200000:0.0:1787191342.684444:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:0.0:1787191342.684449:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe1:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00010000:00010000:0.0:1787191342.684459:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/225 (0 0) 00000080:00010000:0.0:1787191342.684466:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xe1:0x0](ffff936b5396c2c8) 00000002:00010000:0.0:1787191342.684470:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe1:0x0]) in obj [0x200000405:0xe1:0x0], intent: layout flags 0 00010000:00010000:0.0:1787191342.684488:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aaf9 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.684496:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aaf9 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.684502:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aaf9 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.684513:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626797312:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191342.684535:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.690948:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626797312:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191342.690980:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aaf9 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606dbb expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.690994:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aaf9 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606dbb expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.691008:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b6a476a00 x1874004626797312/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191342.691031:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aaf9 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606dbb expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191342.691045:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aaf9 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606dbb expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.691056:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/225 (0 0) 00000080:00200000:0.0:1787191342.691062:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xe1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191342.691080:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe1:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483aaf9 00000080:00010000:0.0:1787191342.691088:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483aaf9 from it ffffa3fb41cab8c8 00010000:00010000:0.0:1787191342.691093:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aaf9 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606dbb expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.691102:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aaf9 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606dbb expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.691129:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aaf9 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606dbb expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.691146:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aaf9 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606dbb expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1787191342.691155:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xe1:0x0](0000000089668027) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aaf9 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606dbb expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191342.691198:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe1:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:0.0:1787191342.691203:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aaf9 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606dbb expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.691211:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aaf9 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606dbb expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:0.0:1787191342.691226:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xe1:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:0.0:1787191342.691234:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe1:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191342.691238:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xe1:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:0.0:1787191342.691247:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xe1:0x0](ffff936b5396c2c8) 00000002:00010000:0.0:1787191342.691256:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe1:0x0]) in obj [0x200000405:0xe1:0x0], intent: layout flags 02 00010000:00010000:0.0:1787191342.691270:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aaf9 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4606dbb expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191342.691283:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe1:0x0]: losing layout lock 00010000:00010000:0.0:1787191342.691313:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aaf9 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606dbb expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191342.691320:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191342.691323:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aaf9 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606dbb expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191342.691348:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483ab00 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xe1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.691356:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483ab00 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xe1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191342.691367:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191342.691375:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a476a00 x1874004626797568/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191342.691384:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483ab00 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xe1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.691404:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626797568:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191342.691481:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.692053:0:57946:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57946:1874004626797184:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191342.692065:0:57946:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483aaf2 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606dd0 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.692083:0:57946:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483aaf2 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606dd0 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.692091:0:57946:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483aaf2 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606dd0 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.692099:0:57946:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483aaf2 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606dd0 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.692113:0:57946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483aaf2 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606dd0 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.692123:0:57946:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483aaf2 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606dd0 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.692131:0:57946:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483aaf2 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606dd0 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.692138:0:57946:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483aaf2 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606dd0 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.692148:0:57946:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b513b8700 x1874004626797184/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/976 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191342.692157:0:57946:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483aaf2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606dd0 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191342.692169:0:57946:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483aaf2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606dd0 expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.692176:0:57946:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/225 (0 0) 00000080:00200000:0.0:1787191342.692181:0:57946:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191342.692211:0:57946:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xe1:0x0](ffff936b5396c2c8): rc = 0 00000080:00200000:0.0:1787191342.692223:0:57946:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe1:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:0.0:1787191342.692228:0:57946:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe1:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483aaf2 00000080:00010000:0.0:1787191342.692240:0:57946:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe1:0x0](ffff936b5396c2c8) 00000080:00010000:0.0:1787191342.692244:0:57946:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483aaf2 from it ffffa3fb4228bb20 00010000:00010000:0.0:1787191342.692248:0:57946:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483aaf2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606dd0 expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.692256:0:57946:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483aaf2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606dd0 expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200008:0.0:1787191342.692292:0:57946:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe1:0x0](ffff936b5396c2c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191342.692298:0:57946:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe1:0x0](ffff936b5396c2c8),name=f70.sanity-flr 00000002:00010000:0.0:1787191342.692313:0:57946:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe1:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.692320:0:57946:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483aaf2 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606dd0 expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.692328:0:57946:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483aaf2 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606dd0 expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191342.692334:0:57946:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191342.692339:0:57946:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe1:0x0](ffff936b5396c2c8) 00000080:00010000:0.0:1787191342.692341:0:57946:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe1:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483aaf2 00000080:00010000:0.0:1787191342.692345:0:57946:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483aaf2 from it ffffa3fb4228bcb8 00010000:00010000:0.0:1787191342.692347:0:57946:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483aaf2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606dd0 expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.692354:0:57946:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483aaf2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606dd0 expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191342.692371:0:57946:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe1:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1787191342.692379:0:57946:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe1:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191342.692383:0:57946:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191342.692386:0:57946:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe1:0x0] 00000008:00010000:0.0:1787191342.692403:0:57946:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191342.692406:0:57946:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f99b70, osc lock ffff936b50b62ab0, flags 0x400000400001002 00000008:00010000:0.0:1787191342.692436:0:57946:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191342.692438:0:57946:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f99bb0, osc lock ffff936b50b63430, flags 0x400000400001002 00010000:00010000:0.0:1787191342.692451:0:57946:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aadd lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606d98 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.692461:0:57946:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aadd lrc: 2/1,0 mode: PR/PR res: [0x280000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606d98 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:0.0:1787191342.692472:0:57946:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191342.692475:0:57946:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aadd lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606d98 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.692483:0:57946:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aadd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606d98 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191342.692499:0:57946:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483aae4 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606d91 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.692507:0:57946:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483aae4 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606d91 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:0.0:1787191342.692515:0:57946:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191342.692517:0:57946:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483aae4 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606d91 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.692526:0:57946:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483aae4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606d91 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:0.0:1787191342.692534:0:57946:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191342.692542:0:57946:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe1:0x0] updating i_size 0 i_blocks 0 00000020:00010000:0.0:1787191342.692546:0:57946:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509ba060 (ffff936b47a17b48/0) at cl_lock_release():245 00000020:00010000:0.0:1787191342.692548:0:57946:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509ba060 (ffff936b47a17b48/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191342.692552:0:57946:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99b70 (ffff936b47a17cf8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191342.692555:0:57946:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99bb0 (ffff936b47a17908/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191342.692558:0:57946:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509ba060 (ffff936b47a17b48/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191342.692560:0:57946:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99b70 (ffff936b47a17b48/1) at cl_lock_fini():72 00000020:00010000:0.0:1787191342.692564:0:57946:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99bb0 (ffff936b47a17b48/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191342.692572:0:57946:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe1:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1787191342.692630:0:57946:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe1:0x0](ffff936b5396c2c8), flags 154002 00000080:00200000:0.0:1787191342.692672:0:57946:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191342.692680:0:57946:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.692687:0:57946:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.692696:0:57946:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.692702:0:57946:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191342.692707:0:57946:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191342.692709:0:57946:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191342.692714:0:57946:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4228bbf8 00010000:00010000:0.0:1787191342.692716:0:57946:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.692723:0:57946:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.692732:0:57946:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.692737:0:57946:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191342.692742:0:57946:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.692745:0:57946:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:0.0:1787191342.692749:0:57946:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe1:0x0](ffff936b5396c2c8), inode mode 81a4 mask 44 00000080:00200008:0.0:1787191342.692755:0:57946:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe1:0x0](ffff936b5396c2c8), flags 154400 00000002:00010000:0.0:1787191342.692767:0:57946:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe1:0x0]) in obj [0x200000405:0xe1:0x0], intent: open flags 0104240114401 00010000:00010000:0.0:1787191342.692796:0:57946:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483ab07 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.692803:0:57946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483ab07 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57946 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191342.692812:0:57946:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:0.0:1787191342.692818:0:57946:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475c00 x1874004626797824/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191342.692827:0:57946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483ab07 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57946 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.692864:0:57946:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57946:1874004626797824:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191342.693375:0:57946:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191342.697407:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191342.697816:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634926208 00000100:00100000:3.0:1787191342.697824:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634926208 00000100:00100000:3.0:1787191342.698342:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1458 00000100:00100000:3.0:1787191342.698353:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634926208:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191342.698372:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483aaf2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4606dd0 expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191342.698451:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191342.698458:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634926208:12345-192.168.202.101@tcp:104: Request processed in 107us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191342.698466:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1458 00010000:00010000:1.0:1787191342.698511:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191342.698518:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483aaf2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4606dd0 expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.698532:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51184a00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191342.698537:0:57627:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483aaf2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4606dd0 expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.698546:0:57627:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483aaf2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4606dd0 expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.698555:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483aaf2 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4606dd0 expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191342.698578:0:57627:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe1:0x0]: losing layout lock 00010000:00010000:1.0:1787191342.698627:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483aaf2 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4606dd0 expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.698633:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191342.698666:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483aaf2 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4606dd0 expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.698673:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483aaf2 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4606dd0 expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.698687:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191342.698689:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191342.698690:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191342.698698:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787191342.698711:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626797952:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191342.707863:0:57946:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57946:1874004626797824:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191342.707898:0:57946:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483ab07 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606dec expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.708000:0:57946:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483ab07 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606dec expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.708038:0:57946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483ab07 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606dec expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.708055:0:57946:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x200002b, status=0 req@ffff936b6a475c00 x1874004626797824/t8589937112(8589937112) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191342.708070:0:57946:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475c00 x1874004626797824/t8589937112(8589937112) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191342.708086:0:57946:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483ab07 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606dec expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.708109:0:57946:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/225 (0 0) 00000080:00200000:0.0:1787191342.708116:0:57946:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xe1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191342.708168:0:57946:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe1:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483ab07 00000080:00010000:0.0:1787191342.708174:0:57946:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ab07 from it ffffa3fb4228bbf0 00010000:00010000:0.0:1787191342.708178:0:57946:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483ab07 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606dec expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.708189:0:57946:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483ab07 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606dec expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00100000:0.0:1787191342.708214:0:57946:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475c00 x1874004626797824/t8589937112(8589937112) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191342.708336:0:57946:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe1:0x0](ffff936b5396c2c8), inode mode 81a4 mask 4 00000080:00200000:0.0:1787191342.708344:0:57946:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xe1:0x0](ffff936b5396c2c8), xattr lov 00000080:00200008:0.0:1787191342.708368:0:57946:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe1:0x0](ffff936b5396c2c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191342.708375:0:57946:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe1:0x0](ffff936b5396c2c8),name=f70.sanity-flr 00000002:00010000:0.0:1787191342.708387:0:57946:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe1:0x0]) in obj [0x200000405:0xe1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.708393:0:57946:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 30 res 8589935621/225 (0 0) 00010000:00010000:0.0:1787191342.708436:0:57946:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483ab0e lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.708444:0:57946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483ab0e lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.708453:0:57946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483ab0e lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57946 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.708471:0:57946:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57946:1874004626798080:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191342.708535:0:57946:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787191342.710123:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626797952:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191342.715427:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191342.715472:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:1.0:1787191342.715543:0:40920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634927488 00000100:00100000:1.0:1787191342.715552:0:40920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634927488 00000100:00100000:1.0:1787191342.715612:0:40920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 39 00000100:00100000:1.0:1787191342.715624:0:40920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:30511:x1874004634927488:12345-192.168.202.101@tcp:104: 00010000:00010000:1.0:1787191342.715641:0:40920:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080030000 nid: local remote: 0x7130d520e4606c72 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191342.715719:0:40920:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787191342.715726:0:40920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:30511:x1874004634927488:12345-192.168.202.101@tcp:104: Request processed in 105us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787191342.715733:0:40920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 39 00010000:00010000:1.0:1787191342.715755:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191342.715761:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080030000 nid: local remote: 0x7130d520e4606c72 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191342.715770:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51184800 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191342.715775:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428480030000 nid: local remote: 0x7130d520e4606c72 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191342.715815:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480030020 nid: local remote: 0x7130d520e4606c72 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191342.715822:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191342.715863:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480030020 nid: local remote: 0x7130d520e4606c72 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191342.715873:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000007d3980bf/0xe5129dc88483aa89 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480030020 nid: local remote: 0x7130d520e4606c72 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191342.715895:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191342.715897:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191342.715898:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191342.715905:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787191342.715928:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626798208:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191342.716811:0:40921:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787191342.716824:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634927360 00000100:00100000:3.0:1787191342.716829:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634927360 00000100:00100000:3.0:1787191342.716899:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1459 00000100:00100000:3.0:1787191342.716906:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b4121f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30353:x1874004634927360:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191342.716984:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000019f0f7ea/0xe5129dc88483aa97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4606c9c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191342.717042:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191342.717048:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b4121f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30353:x1874004634927360:12345-192.168.202.101@tcp:104: Request processed in 142us (1630us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191342.717055:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1459 00010000:00010000:1.0:1787191342.718144:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191342.718155:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000019f0f7ea/0xe5129dc88483aa97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4606c9c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.718166:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51184000 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191342.718172:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000019f0f7ea/0xe5129dc88483aa97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4606c9c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.718215:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000019f0f7ea/0xe5129dc88483aa97 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4606c9c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.718223:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191342.718246:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000019f0f7ea/0xe5129dc88483aa97 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4606c9c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.718253:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000019f0f7ea/0xe5129dc88483aa97 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4606c9c expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.718272:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191342.718274:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191342.718275:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191342.718298:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626798336:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191342.724647:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626798336:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191342.725060:0:57570:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589937113 gen 1 00000100:00100000:0.0:1787191342.725141:0:57570:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b51d1fb80 x1874004626796416/t8589937108(8589937108) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787191342.725158:0:57570:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b6a475c00 x1874004626797824/t8589937112(8589937112) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787191342.725166:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626797568:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191342.725186:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483ab00 lrc: 4/0,1 mode: --/EX res: [0x200000405:0xe1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606dde expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.725199:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483ab00 lrc: 4/0,1 mode: --/CR res: [0x200000405:0xe1:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606dde expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.725208:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483ab00 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606dde expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.725216:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483ab00 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606dde expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.725226:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483ab00 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606dde expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.725231:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483ab00 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606dde expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.725236:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483ab00 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606dde expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.725241:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b6a476a00 x1874004626797568/t8589937113(8589937113) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191342.725254:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483ab00 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606dde expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191342.725262:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483ab00 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606dde expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.725274:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/225 (0 0) 00000080:00200000:0.0:1787191342.725278:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xe1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191342.725287:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe1:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483ab00 00000080:00010000:0.0:1787191342.725293:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ab00 from it ffffa3fb41cab930 00010000:00010000:0.0:1787191342.725295:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483ab00 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606dde expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.725301:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483ab00 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606dde expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191342.725314:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:0.0:1787191342.725320:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe1:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:0.0:1787191342.725329:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483ab00 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606dde expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.725337:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483ab00 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606dde expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1787191342.725342:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xe1:0x0](0000000089668027) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483ab00 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606dde expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.725369:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483ab00 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606dde expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.725374:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483ab00 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606dde expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191342.725386:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe1:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191342.725392:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe1:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191342.725395:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191342.725400:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:0.0:1787191342.725446:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe1:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:0.0:1787191342.725457:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483ab00 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606dde expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191342.725465:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483ab00 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606dde expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:0.0:1787191342.725472:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xe1:0x0](0000000089668027) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483ab00 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606dde expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191342.725489:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe1:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191342.725493:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe1:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191342.725495:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191342.725497:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:0.0:1787191342.725521:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe1:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:0.0:1787191342.725548:0:57570:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aadd lrc: 1/0,0 mode: PR/PR res: [0x280000401:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606d98 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000008:00010000:0.0:1787191342.725560:0:57570:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483aae4 lrc: 1/0,0 mode: PR/PR res: [0x2c0000401:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606d91 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191342.725609:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe1:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:0.0:1787191342.725612:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483ab00 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606dde expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191342.725618:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483ab00 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606dde expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00020000:00200000:0.0:1787191342.725626:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xe1:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:0.0:1787191342.725628:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe1:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191342.725630:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191342.725634:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191342.725640:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191342.725643:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:0.0:1787191342.725650:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:0.0:1787191342.725653:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f99630, osc lock ffff936b50b63430, flags 0x80000000 00000008:00010000:0.0:1787191342.725655:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:0.0:1787191342.725656:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f99670, osc lock ffff936b50b62ab0, flags 0x80000000 00010000:00010000:0.0:1787191342.725685:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483ab15 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.725691:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483ab15 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.725697:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483ab15 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.725713:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626798464:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191342.725770:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787191342.725886:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626798208:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191342.726612:0:57946:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57946:1874004626798080:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191342.726626:0:57946:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483ab0e lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606e01 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.726636:0:57946:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483ab0e lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606e01 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.726645:0:57946:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483ab0e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606e01 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.726655:0:57946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483ab0e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606e01 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.726665:0:57946:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483ab0e lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606e01 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.726672:0:57946:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483ab0e lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606e01 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.726679:0:57946:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483ab0e lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606e01 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.726690:0:57946:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b6a477b80 x1874004626798080/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/976 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191342.726702:0:57946:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483ab0e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606e01 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.726716:0:57946:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/225 (0 0) 00000080:00200000:0.0:1787191342.726722:0:57946:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xe1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191342.726755:0:57946:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe1:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483ab0e 00000080:00010000:0.0:1787191342.726761:0:57946:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe1:0x0](ffff936b5396c2c8) 00000080:00010000:0.0:1787191342.726763:0:57946:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ab0e from it ffffa3fb4228bcd8 00010000:00010000:0.0:1787191342.726767:0:57946:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483ab0e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606e01 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.726775:0:57946:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483ab0e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606e01 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191342.726800:0:57946:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe1:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1787191342.726807:0:57946:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe1:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191342.726810:0:57946:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191342.726813:0:57946:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe1:0x0] 00000008:00010000:0.0:1787191342.726824:0:57946:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191342.726827:0:57946:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee6930, osc lock ffff936b50b631d0, flags 0x400000400001002 00010000:00010000:0.0:1787191342.726853:0:57946:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b52373000 type 11 mode 6 res 11811161089/473 (0 1048575) 00010000:00010000:0.0:1787191342.726877:0:57946:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483ab1c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.726885:0:57946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483ab1c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.726899:0:57946:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b6a477b80 x1874004626798592/t0(0) o101->lustre-OST0001-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:0.0:1787191342.726935:0:57946:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:1.0:1787191342.726962:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626798592:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191342.729466:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626798464:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191342.729489:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483ab15 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606e24 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.729507:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483ab15 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4606e24 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.729520:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483ab15 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4606e24 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.729534:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483ab15 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4606e24 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191342.729546:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483ab15 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4606e24 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.729558:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483ab15 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606e24 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.729566:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483ab15 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606e24 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.729638:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483ab23 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.729653:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483ab23 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.729663:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483ab23 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.729680:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626798720:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191342.730389:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787191342.732206:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191342.734413:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634927616 00000100:00100000:3.0:1787191342.734425:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634927616 00000100:00100000:3.0:1787191342.734527:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1460 00000100:00100000:3.0:1787191342.734538:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:37089:x1874004634927616:12345-192.168.202.101@tcp:106: 00010000:00010000:3.0:1787191342.734556:0:40922:0:(ldlm_lockd.c:2541:ldlm_callback_handler()) ### glimpse ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483ab15 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606e24 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.734570:0:40922:0:(ldlm_lockd.c:2123:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483ab15 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606e24 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00010000:3.0:1787191342.734615:0:40922:0:(cl_object.c:322:cl_object_glimpse()) header@00000000551929f2[0x110, 1, [0x200000405:0xe1:0x0] hash] 00000020:00010000:3.0:1787191342.734617:0:40922:0:(cl_object.c:322:cl_object_glimpse()) size: 0 mtime: 1787191342 atime: 1787191342 ctime: 1787191342 blocks: 0 00000020:00010000:3.0:1787191342.734621:0:40922:0:(cl_object.c:322:cl_object_glimpse()) header@0000000049960bce[0x110, 2, [0x2c0000401:0x1d9:0x0] hash] 00000020:00010000:3.0:1787191342.734623:0:40922:0:(cl_object.c:322:cl_object_glimpse()) size: 0 mtime: 1787191342 atime: 1787191342 ctime: 1787191342 blocks: 0 00000100:00100000:3.0:1787191342.734681:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:37089:x1874004634927616:12345-192.168.202.101@tcp:106: Request processed in 145us (2484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191342.734689:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1460 00000100:00100000:0.0:1787191342.735333:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626798720:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191342.735354:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483ab23 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606e32 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.735371:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483ab23 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4606e32 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.735384:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483ab23 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4606e32 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.735398:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483ab23 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4606e32 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191342.735411:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483ab23 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4606e32 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.735422:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483ab23 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606e32 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.735431:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483ab23 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606e32 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191342.735694:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626798976:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191342.735759:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787191342.735766:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626798848:192.168.202.101@tcp:10:bash.0 00010000:00010000:1.0:1787191342.742491:0:2390:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483ab1c lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.742516:0:2390:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483ab1c lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.742530:0:2390:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483ab1c lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.742539:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483ab1c lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.742547:0:2390:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483ab1c lrc: 5/1,0 mode: --/PR res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191342.742561:0:2390:0:(osc_lock.c:187:osc_lock_lvb_update()) ### no dlm lock: acquired size 0, setting rss=0; leaving kms=0, end=18446744073709551615 00000020:00200000:1.0:1787191342.742568:0:2390:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1787191342.742718:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483ab1c lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.742727:0:2390:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483ab1c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.742736:0:2390:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483ab1c lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.742742:0:2390:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b47a7e600 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191342.742748:0:2390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483ab1c lrc: 5/0,0 mode: --/PR res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.742759:0:2390:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191342.742766:0:2390:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483ab1c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.742774:0:2390:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483ab1c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191342.742795:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626798592:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191342.742872:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626798848:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191342.742889:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626798976:192.168.202.101@tcp:10:bash.0 00000080:00200000:3.0:1787191342.743039:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe1:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1787191342.743046:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894998 (ffff936b47a17128/0) at cl_lock_release():245 00000020:00010000:3.0:1787191342.743050:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894998 (ffff936b47a17128/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191342.743056:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99630 (ffff936b47a17b48/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191342.743063:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483ab15 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606e24 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.743074:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483ab15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606e24 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1787191342.743090:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99670 (ffff936b47a17908/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191342.743095:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483ab23 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606e32 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.743116:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483ab23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606e32 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1787191342.743125:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894998 (ffff936b47a17128/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191342.743129:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99630 (ffff936b47a17128/1) at cl_lock_fini():72 00000020:00010000:3.0:1787191342.743134:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99670 (ffff936b47a17128/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191342.743180:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe1:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191342.743202:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xe1:0x0](ffff936b5396c2c8) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191342.000000000, mtime 1787191342.000000000, ctime 1787191342.000000000, rc 0 00000080:00200008:3.0:1787191342.743292:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xe1:0x0], ppos: 0, count: 5 00000080:00200000:3.0:1787191342.743305:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:3.0:1787191342.743310:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:3.0:1787191342.743315:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:3.0:1787191342.743319:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:3.0:1787191342.743325:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@00000000551929f2[0x110, 1, [0x200000405:0xe1:0x0] hash] 00000020:00200000:3.0:1787191342.743327:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:3.0:1787191342.743331:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe1:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:3.0:1787191342.743344:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xe1:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:3.0:1787191342.743349:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe1:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191342.743352:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:3.0:1787191342.743356:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1787191342.743364:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:3.0:1787191342.743368:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1787191342.743383:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:3.0:1787191342.743397:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:3.0:1787191342.743403:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667eb0, osc lock ffff936b44f65690, flags 0x0 00010000:00010000:3.0:1787191342.743418:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483ab15 lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606e24 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191342.743430:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483ab15 lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606e24 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191342.743440:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483ab15 lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606e24 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191342.743454:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483ab15 lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606e24 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191342.743461:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483ab15 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606e24 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191342.743471:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:3.0:1787191342.743480:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:3.0:1787191342.743519:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:3.0:1787191342.743526:0:57570:0:(rw26.c:927:ll_write_end()) page@00000000d9afe429[3 000000006213f2a4 2 1 00000000239c7fe2 0 0 0] 00000080:00200000:3.0:1787191342.743530:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @00000000fa95e344 17ffffc0001001 3:0 ffff936b50842b60 0 lru 00000080:00200000:3.0:1787191342.743538:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@0000000059d15d8a 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000ef00a996 00000000fb8354e6 > 3< 0 0 > 4< 0 0 8 484638720 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1787191342.743540:0:57570:0:(rw26.c:927:ll_write_end()) end page@00000000d9afe429 00000080:00200000:3.0:1787191342.743542:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1787191342.743546:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:3.0:1787191342.743564:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 000000001df35395 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483ab15 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606e24 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191342.743582:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b5396c478, count 1, dirtied 1 00000080:00200000:3.0:1787191342.743727:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:3.0:1787191342.743729:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:3.0:1787191342.743744:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894f38 (ffff936b47a172d8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191342.743747:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894f38 (ffff936b47a172d8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191342.743750:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667eb0 (ffff936b465cc008/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191342.743754:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483ab15 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606e24 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191342.743767:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483ab15 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606e24 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:3.0:1787191342.743777:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894f38 (ffff936b47a172d8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191342.743780:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667eb0 (ffff936b47a172d8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191342.743785:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:3.0:1787191342.743789:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1787191342.743795:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe1:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191342.743798:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:3.0:1787191342.743804:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe1:0x0] updating i_size 5 i_blocks 0 00000080:00200000:3.0:1787191342.743808:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:3.0:1787191342.743826:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe1:0x0](ffff936b5396c2c8), flags 100001 00000002:00100000:3.0:1787191342.743985:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1fb80 x1874004626796416/t8589937108(8589937108) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191342.743997:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191342.744002:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1c000 x1874004626799232/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191342.744034:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626799232:192.168.202.101@tcp:35:bash.0 00000100:00100000:3.0:1787191342.744110:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ccc0 going to sleep for 11 seconds 00000080:00200000:0.0:1787191342.745326:0:57946:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe1:0x0] updating i_size 5 i_blocks 0 00000020:00010000:0.0:1787191342.745335:0:57946:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509bb780 (ffff936b47a17008/0) at cl_lock_release():245 00000020:00010000:0.0:1787191342.745339:0:57946:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509bb780 (ffff936b47a17008/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191342.745344:0:57946:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee6930 (ffff936b47a17ea8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191342.745347:0:57946:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509bb780 (ffff936b47a17008/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191342.745350:0:57946:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee6930 (ffff936b47a17008/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191342.745361:0:57946:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe1:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1787191342.745397:0:57946:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe1:0x0](ffff936b5396c2c8), flags 154000 00010000:00010000:0.0:1787191342.745421:0:57946:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483ab07 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606dec expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191342.745475:0:57946:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191342.745491:0:57946:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.745501:0:57946:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.745511:0:57946:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.745519:0:57946:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191342.745525:0:57946:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191342.745528:0:57946:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191342.745534:0:57946:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4228bbf8 00010000:00010000:0.0:1787191342.745538:0:57946:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.745545:0:57946:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.745558:0:57946:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.745564:0:57946:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191342.745570:0:57946:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.745583:0:57946:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b42f3ad80, open_flags d902, mode 0 opened 0 00000080:00200000:0.0:1787191342.745655:0:57946:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:0.0:1787191342.745672:0:57946:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154403 00010000:00010000:0.0:1787191342.745722:0:57946:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483ab2a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.745730:0:57946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483ab2a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57946 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191342.745741:0:57946:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:0.0:1787191342.745752:0:57946:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a476300 x1874004626799488/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191342.745762:0:57946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483ab2a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57946 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.745777:0:57946:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57946:1874004626799488:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191342.746033:0:57946:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.749073:0:57946:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57946:1874004626799488:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191342.749098:0:57946:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483ab2a lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606e4e expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.749121:0:57946:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483ab2a lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606e4e expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.749130:0:57946:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483ab2a lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606e4e expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.749141:0:57946:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483ab2a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606e4e expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.749152:0:57946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483ab2a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606e4e expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.749165:0:57946:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483ab2a lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606e4e expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.749173:0:57946:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483ab2a lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606e4e expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.749180:0:57946:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483ab2a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606e4e expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.749192:0:57946:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b6a476300 x1874004626799488/t8589937114(8589937114) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191342.749205:0:57946:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a476300 x1874004626799488/t8589937114(8589937114) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191342.749218:0:57946:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483ab2a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606e4e expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191342.749233:0:57946:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483ab2a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606e4e expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.749243:0:57946:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/225 (0 0) 00000080:00200000:0.0:1787191342.749248:0:57946:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191342.749298:0:57946:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xe1:0x0](ffff936b5396c2c8): rc = 0 00000080:00200000:0.0:1787191342.749314:0:57946:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe1:0x0]: layout version change: 4 -> 4 00000080:00010000:0.0:1787191342.749320:0:57946:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe1:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483ab2a 00000080:00010000:0.0:1787191342.749334:0:57946:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe1:0x0](ffff936b5396c2c8) 00000080:00200008:0.0:1787191342.749349:0:57946:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe1:0x0](ffff936b5396c2c8), flags 154402 00000002:00100000:0.0:1787191342.749378:0:57946:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a476300 x1874004626799488/t8589937114(8589937114) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191342.749430:0:57946:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ab2a from it ffff936b530f5720 00010000:00010000:0.0:1787191342.749435:0:57946:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483ab2a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606e4e expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.749444:0:57946:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483ab2a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606e4e expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191342.749481:0:57946:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe1:0x0](ffff936b5396c2c8), inode mode 81a4 mask 46 00000100:00100000:1.0:1787191342.749523:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626799232:192.168.202.101@tcp:35:bash.0 00000002:00100000:1.0:1787191342.749542:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1fb80 x1874004626796416/t8589937108(8589937108) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200080:0.0:1787191342.749795:0:57946:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe1:0x0](ffff936b5396c2c8) cmd=800466af arg=7ffcb6209a8c 00000080:00200080:0.0:1787191342.749810:0:57946:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe1:0x0](ffff936b5396c2c8) cmd=80086601 arg=7ffcb6209a28 00000100:00100000:0.0:1787191342.749872:0:57946:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57946:1874004626799616:192.168.202.101@tcp:33:lfs.0 00000100:00100000:0.0:1787191342.749935:0:57946:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00000080:00200000:2.0:1787191342.753769:0:57947:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191342.753794:0:57947:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.753807:0:57947:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.753820:0:57947:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.753825:0:57947:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191342.753847:0:57947:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191342.753851:0:57947:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191342.753858:0:57947:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421abb58 00010000:00010000:2.0:1787191342.753863:0:57947:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.753872:0:57947:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.753885:0:57947:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.753891:0:57947:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191342.753895:0:57947:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.753898:0:57947:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=8 00000080:00200008:2.0:1787191342.753902:0:57947:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe1:0x0](ffff936b5396c2c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191342.753906:0:57947:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe1:0x0](ffff936b5396c2c8),name=f70.sanity-flr 00000002:00010000:2.0:1787191342.753917:0:57947:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe1:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.753925:0:57947:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483ab0e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606e01 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.753933:0:57947:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483ab0e lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606e01 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191342.753940:0:57947:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191342.753944:0:57947:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe1:0x0](ffff936b5396c2c8) 00000080:00010000:2.0:1787191342.753947:0:57947:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe1:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483ab0e 00000080:00010000:2.0:1787191342.753951:0:57947:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ab0e from it ffffa3fb421abcb8 00010000:00010000:2.0:1787191342.753954:0:57947:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483ab0e lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606e01 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.753962:0:57947:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483ab0e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606e01 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191342.753981:0:57947:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe1:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:2.0:1787191342.753990:0:57947:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe1:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191342.753992:0:57947:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191342.753995:0:57947:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe1:0x0] 00000008:00010000:2.0:1787191342.754010:0:57947:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191342.754024:0:57947:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d16b0, osc lock ffff936b44e63b50, flags 0x400000400001002 00010000:00010000:2.0:1787191342.754044:0:57947:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483ab15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606e24 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191342.754057:0:57947:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483ab15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606e24 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:2.0:1787191342.754069:0:57947:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191342.754072:0:57947:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483ab15 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4606e24 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191342.754085:0:57947:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483ab15 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606e24 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:2.0:1787191342.754095:0:57947:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191342.754104:0:57947:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe1:0x0] updating i_size 5 i_blocks 0 00000020:00010000:2.0:1787191342.754109:0:57947:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51657c20 (ffff936b465cc878/0) at cl_lock_release():245 00000020:00010000:2.0:1787191342.754112:0:57947:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51657c20 (ffff936b465cc878/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.754115:0:57947:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d16b0 (ffff936b465cca28/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.754119:0:57947:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51657c20 (ffff936b465cc878/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191342.754122:0:57947:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d16b0 (ffff936b465cc878/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191342.754133:0:57947:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe1:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191342.754157:0:57947:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191342.754166:0:57947:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.754172:0:57947:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.754181:0:57947:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.754188:0:57947:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191342.754192:0:57947:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191342.754195:0:57947:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191342.754199:0:57947:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421abc10 00010000:00010000:2.0:1787191342.754202:0:57947:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.754214:0:57947:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.754222:0:57947:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.754226:0:57947:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191342.754229:0:57947:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.754234:0:57947:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:2.0:1787191342.754237:0:57947:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:2.0:1787191342.754241:0:57947:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00000100:00100000:0.0:1787191342.754246:0:57946:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57946:1874004626799616:192.168.202.101@tcp:33:lfs.0 00010000:00010000:2.0:1787191342.754264:0:57947:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483ab00 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4606dde expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200080:0.0:1787191342.754278:0:57946:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe1:0x0](ffff936b5396c2c8) cmd=c00c66f3 arg=7ffcb6209a14 00000080:00200000:2.0:1787191342.754278:0:57947:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe1:0x0]: losing layout lock 00010000:00010000:2.0:1787191342.754289:0:57947:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483ab07 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4606dec expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:0.0:1787191342.754291:0:57946:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe1:0x0]) in obj [0x200000405:0xe1:0x0], intent: open flags 01004040000002 00000002:00100000:2.0:1787191342.754322:0:57947:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a475c00 x1874004626797824/t8589937112(8589937112) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1787191342.754325:0:57946:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f000/0xe5129dc88483ab31 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x10000000000000 pid: 57946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.754333:0:57946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f000/0xe5129dc88483ab31 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x0 pid: 57946 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191342.754334:0:57947:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191342.754339:0:57947:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8380 x1874004626800000/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00100000:0.0:1787191342.754342:0:57946:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:0.0:1787191342.754347:0:57946:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475880 x1874004626800128/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191342.754354:0:57946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f000/0xe5129dc88483ab31 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x81000000000000 pid: 57946 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191342.754360:0:57947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57947:1874004626800000:192.168.202.101@tcp:35:rm.0 00000100:00100000:0.0:1787191342.754363:0:57946:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57946:1874004626800128:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191342.754487:0:57947:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f600 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.754608:0:57946:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787191342.756673:0:57947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57947:1874004626800000:192.168.202.101@tcp:35:rm.0 00000002:00100000:1.0:1787191342.756700:0:57947:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a475c00 x1874004626797824/t8589937112(8589937112) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1787191342.756739:0:57947:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483ab2a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4606e4e expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191342.756753:0:57947:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe1:0x0]: losing layout lock 00010000:00010000:1.0:1787191342.756760:0:57947:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483ab0e lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4606e01 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.756766:0:57947:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483aaeb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4606da6 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.756801:0:57947:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483ab00 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xe1:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606dde expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191342.756806:0:57947:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483ab07 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4606dec expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.756810:0:57947:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483ab2a lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606e4e expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.756814:0:57947:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483ab0e lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4606e01 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.756817:0:57947:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483aaeb lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4606da6 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.756824:0:57947:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 5 locks packed 00010000:00010000:1.0:1787191342.756827:0:57947:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483ab00 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe1:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606dde expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191342.756871:0:57947:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483ab07 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4606dec expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.756878:0:57947:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483ab2a lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606e4e expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.756887:0:57947:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483ab0e lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4606e01 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.756896:0:57947:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483aaeb lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4606da6 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1787191342.756909:0:57947:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1787191342.756921:0:57947:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8000 x1874004626800384/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 520/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787191342.756937:0:57947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8000 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57947:1874004626800384:192.168.202.101@tcp:36:rm.0 00000100:00100000:1.0:1787191342.756985:0:57947:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.758859:0:57946:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57946:1874004626800128:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191342.758883:0:57946:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f000/0xe5129dc88483ab31 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4606e63 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.758894:0:57946:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f000/0xe5129dc88483ab31 lrc: 4/1,0 mode: --/PW res: [0x200000405:0xe1:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4606e63 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.758904:0:57946:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f000/0xe5129dc88483ab31 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0xe1:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4606e63 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.758924:0:57946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f000/0xe5129dc88483ab31 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0xe1:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4606e63 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.758936:0:57946:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f000/0xe5129dc88483ab31 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0xe1:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4606e63 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.758944:0:57946:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f000/0xe5129dc88483ab31 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0xe1:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4606e63 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.758951:0:57946:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f000/0xe5129dc88483ab31 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0xe1:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4606e63 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.758962:0:57946:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x600002b, status=0 req@ffff936b6a475880 x1874004626800128/t8589937117(8589937117) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191342.758974:0:57946:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475880 x1874004626800128/t8589937117(8589937117) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191342.758988:0:57946:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f000/0xe5129dc88483ab31 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xe1:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4606e63 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.758997:0:57946:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 2 res 8589935621/225 (0 0) 00000080:00200000:0.0:1787191342.759003:0:57946:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xe1:0x0] suppgids 0 0: rc 0 00000002:00100000:0.0:1787191342.759031:0:57946:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475880 x1874004626800128/t8589937117(8589937117) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191342.759039:0:57946:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe1:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483ab31 00000080:00010000:0.0:1787191342.759045:0:57946:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ab31 from it ffffa3fb4228bcc0 00010000:00010000:0.0:1787191342.759048:0:57946:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f000/0xe5129dc88483ab31 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xe1:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4606e63 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.759060:0:57946:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f000/0xe5129dc88483ab31 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0xe1:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4606e63 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00200080:0.0:1787191342.759118:0:57946:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe1:0x0](ffff936b5396c2c8) cmd=c00c66f3 arg=189d510 00010000:00010000:0.0:1787191342.759156:0:57946:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f000/0xe5129dc88483ab31 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0xe1:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x81008000000000 nid: local remote: 0x7130d520e4606e63 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.759168:0:57946:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f000/0xe5129dc88483ab31 lrc: 0/0,0 mode: --/PW res: [0x200000405:0xe1:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x85809400000000 nid: local remote: 0x7130d520e4606e63 expref: -99 pid: 57946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.759182:0:57946:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a475880 x1874004626800128/t8589937117(8589937117) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191342.759189:0:57946:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:0.0:1787191342.759193:0:57946:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474a80 x1874004626800640/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191342.759207:0:57946:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57946:1874004626800640:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191342.759259:0:57946:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787191342.761757:0:57947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8000 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57947:1874004626800384:192.168.202.101@tcp:36:rm.0 00000100:00100000:0.0:1787191342.762080:0:57946:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57946:1874004626800640:192.168.202.101@tcp:35:lfs.0 00000080:00020000:0.0:1787191342.762089:0:57946:0:(file.c:251:ll_close_inode_openhandle()) lustre-clilmv-ffff936b581fb000: inode [0x200000405:0xe1:0x0] mdc close failed: rc = -1 00000002:00100000:0.0:1787191342.762199:0:57946:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a475880 x1874004626800128/t8589937117(8589937117) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191342.762235:0:57946:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xe1:0x0](ffff936b5396c2c8) 00000002:00010000:0.0:1787191342.762245:0:57946:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe1:0x0]) in obj [0x200000405:0xe1:0x0], intent: layout flags 0 00010000:00010000:0.0:1787191342.762304:0:57946:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff400/0xe5129dc88483ab38 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.762315:0:57946:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff400/0xe5129dc88483ab38 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.762325:0:57946:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff400/0xe5129dc88483ab38 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57946 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.762345:0:57946:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57946:1874004626800768:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191342.762567:0:57946:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.763989:0:57946:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57946:1874004626800768:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191342.764023:0:57946:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff400/0xe5129dc88483ab38 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606e8d expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.764036:0:57946:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff400/0xe5129dc88483ab38 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606e8d expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.764048:0:57946:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b6a475880 x1874004626800768/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191342.764057:0:57946:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff400/0xe5129dc88483ab38 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606e8d expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191342.764067:0:57946:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff400/0xe5129dc88483ab38 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606e8d expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.764077:0:57946:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/225 (0 0) 00000080:00200000:0.0:1787191342.764083:0:57946:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xe1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191342.764097:0:57946:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe1:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483ab38 00000080:00010000:0.0:1787191342.764165:0:57946:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ab38 from it ffffa3fb4228bbc8 00010000:00010000:0.0:1787191342.764170:0:57946:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff400/0xe5129dc88483ab38 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606e8d expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.764180:0:57946:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff400/0xe5129dc88483ab38 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606e8d expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.764203:0:57946:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff400/0xe5129dc88483ab38 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606e8d expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.764213:0:57946:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff400/0xe5129dc88483ab38 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606e8d expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1787191342.764221:0:57946:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xe1:0x0](0000000089668027) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff400/0xe5129dc88483ab38 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606e8d expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191342.764263:0:57946:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe1:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:0.0:1787191342.764268:0:57946:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff400/0xe5129dc88483ab38 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606e8d expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.764275:0:57946:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff400/0xe5129dc88483ab38 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606e8d expref: -99 pid: 57946 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200008:0.0:1787191342.764373:0:57946:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe1:0x0](ffff936b5396c2c8), flags 154002 00000002:00100000:0.0:1787191342.764410:0:57946:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a476300 x1874004626799488/t8589937114(8589937114) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191342.764421:0:57946:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191342.764426:0:57946:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475880 x1874004626801024/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191342.764446:0:57946:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57946:1874004626801024:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191342.766243:0:57946:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00000080:00200000:2.0:1787191342.772776:0:57948:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191342.772809:0:57948:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.772826:0:57948:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.772865:0:57948:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.772873:0:57948:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191342.772882:0:57948:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191342.772886:0:57948:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191342.772895:0:57948:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422fbb58 00010000:00010000:2.0:1787191342.772899:0:57948:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.772908:0:57948:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.772925:0:57948:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.772933:0:57948:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:2.0:1787191342.772939:0:57948:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.772958:0:57948:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:2.0:1787191342.772963:0:57948:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191342.772977:0:57948:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00000100:00100000:0.0:1787191342.772987:0:57946:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57946:1874004626801024:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191342.773022:0:57946:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a476300 x1874004626799488/t8589937114(8589937114) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1787191342.773037:0:57948:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483ab3f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.773044:0:57948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483ab3f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1787191342.773073:0:57946:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe1:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00020000:00200000:0.0:1787191342.773084:0:57946:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe1:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191342.773087:0:57946:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191342.773092:0:57946:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00010000:00010000:2.0:1787191342.773127:0:57948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483ab3f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191342.773154:0:57948:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57948:1874004626801152:192.168.202.101@tcp:101:lfs.0 00020000:00200000:0.0:1787191342.773163:0:57946:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000008:00010000:0.0:1787191342.773182:0:57946:0:(osc_cache.c:1183:osc_extent_make_ready()) ### extent: 000000001df35395 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483ab15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606e24 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1787191342.773205:0:57946:0:(osc_cache.c:917:osc_extent_finish()) ### extent: 000000001df35395 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483ab15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606e24 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:2.0:1787191342.773226:0:57948:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f3c0 going to sleep for 11 seconds 00000008:00010000:0.0:1787191342.773227:0:57946:0:(osc_cache.c:497:__osc_extent_remove()) ### extent: 000000001df35395 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483ab15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606e24 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191342.773250:0:57946:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe1:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191342.773287:0:57946:0:(llite_lib.c:2066:ll_clear_inode()) VFS Op:inode=[0x200000405:0xe1:0x0](ffff936b5396c2c8) 00000008:00010000:0.0:1787191342.773312:0:57946:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 5 blocks 0 [cma]time 1787191342 1787191342 1787191342 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483ab15 lrc: 1/0,0 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606e24 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1787191342.773339:0:57946:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191342 1787191342 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483ab23 lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4606e32 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:2.0:1787191342.776620:0:57948:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57948:1874004626801152:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191342.776644:0:57948:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483ab3f lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.776658:0:57948:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483ab3f lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.776666:0:57948:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483ab3f lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.776670:0:57948:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483ab3f lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.776676:0:57948:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483ab3f lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.776680:0:57948:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51185200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191342.776683:0:57948:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483ab3f lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.776688:0:57948:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483ab3f lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.776693:0:57948:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483ab3f lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.776697:0:57948:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191342.776704:0:57948:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483ab3f lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.776708:0:57948:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483ab3f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191342.776725:0:57948:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513b9500 x1874004626801152/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191342.776736:0:57948:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191342.776808:0:57948:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191342.776819:0:57948:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.776827:0:57948:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.776854:0:57948:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.777023:0:57948:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191342.777028:0:57948:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191342.777031:0:57948:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191342.777037:0:57948:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422fbbe8 00010000:00010000:2.0:1787191342.777040:0:57948:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.777111:0:57948:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.777125:0:57948:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.777132:0:57948:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000080:00200000:2.0:1787191342.777138:0:57948:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.777149:0:57948:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:2.0:1787191342.777153:0:57948:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191342.777164:0:57948:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191342.777206:0:57948:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483ab46 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.777214:0:57948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483ab46 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.777223:0:57948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483ab46 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191342.777240:0:57948:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57948:1874004626801280:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191342.777296:0:57948:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191342.781777:0:57948:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57948:1874004626801280:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191342.781796:0:57948:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483ab46 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.781806:0:57948:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483ab46 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.781811:0:57948:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483ab46 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.781816:0:57948:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483ab46 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.781822:0:57948:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483ab46 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.781829:0:57948:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51185400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191342.781851:0:57948:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483ab46 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.781859:0:57948:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483ab46 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.781866:0:57948:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483ab46 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.781873:0:57948:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191342.781879:0:57948:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483ab46 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.781885:0:57948:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483ab46 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191342.781901:0:57948:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513b9500 x1874004626801280/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191342.781912:0:57948:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191342.781997:0:57948:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191342.782009:0:57948:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.782030:0:57948:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.782040:0:57948:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.782044:0:57948:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191342.782102:0:57948:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191342.782107:0:57948:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191342.782113:0:57948:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422fbb58 00010000:00010000:2.0:1787191342.782116:0:57948:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.782125:0:57948:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.782139:0:57948:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.782146:0:57948:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:2.0:1787191342.782155:0:57948:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:2.0:1787191342.782159:0:57948:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:2.0:1787191342.782168:0:57948:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.782175:0:57948:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 98 lru_type: 1 00010000:00010000:2.0:1787191342.782180:0:57948:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 98 lru_type: 1 00000002:00010000:2.0:1787191342.782186:0:57948:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.782215:0:57948:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ab4d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.782220:0:57948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ab4d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.782226:0:57948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ab4d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191342.782243:0:57948:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57948:1874004626801408:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191342.782305:0:57948:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191342.786196:0:57948:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57948:1874004626801408:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191342.786222:0:57948:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ab4d lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606ecc expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.786235:0:57948:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ab4d lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606ecc expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.786244:0:57948:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ab4d lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606ecc expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.786252:0:57948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ab4d lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606ecc expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.786262:0:57948:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ab4d lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606ecc expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.786267:0:57948:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ab4d lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606ecc expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.786272:0:57948:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ab4d lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606ecc expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191342.786279:0:57948:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b513b9500 x1874004626801408/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191342.786294:0:57948:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ab4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606ecc expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.786301:0:57948:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:2.0:1787191342.786307:0:57948:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ab4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606ecc expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.786312:0:57948:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ab4d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606ecc expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:2.0:1787191342.786332:0:57948:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.786340:0:57948:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 196 lru_type: 1 00010000:00010000:2.0:1787191342.786348:0:57948:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 196 lru_type: 1 00010000:00010000:2.0:1787191342.786353:0:57948:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 196 lru_type: 1 00010000:00010000:2.0:1787191342.786357:0:57948:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 197 lru_type: 1 00000080:00200000:2.0:1787191342.786365:0:57948:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1787191342.786372:0:57948:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:2.0:1787191342.786375:0:57948:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:2.0:1787191342.786379:0:57948:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb422fbcb8 00010000:00010000:2.0:1787191342.786383:0:57948:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 98 lru_type: 1 00010000:00010000:2.0:1787191342.786388:0:57948:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 99 lru_type: 1 00000002:00010000:2.0:1787191342.786411:0:57948:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.786419:0:57948:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ab4d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606ecc expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.786427:0:57948:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ab4d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606ecc expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.786435:0:57948:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ab4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606ecc expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.786442:0:57948:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ab4d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606ecc expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:2.0:1787191342.786450:0:57948:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.786455:0:57948:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 197 lru_type: 1 00010000:00010000:2.0:1787191342.786463:0:57948:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 197 lru_type: 1 00010000:00010000:2.0:1787191342.786470:0:57948:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 197 lru_type: 1 00010000:00010000:2.0:1787191342.786481:0:57948:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 198 lru_type: 1 00000080:00200008:2.0:1787191342.786886:0:57948:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:2.0:1787191342.786891:0:57948:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191342.786903:0:57948:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.786908:0:57948:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.786917:0:57948:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.786923:0:57948:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191342.786927:0:57948:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191342.786929:0:57948:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191342.786933:0:57948:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422fbcb8 00010000:00010000:2.0:1787191342.786936:0:57948:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.786943:0:57948:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.787042:0:57948:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000080:00200000:1.0:1787191342.787792:0:57949:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191342.787804:0:57949:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191342.787811:0:57949:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191342.787819:0:57949:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191342.787823:0:57949:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191342.787827:0:57949:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191342.787851:0:57949:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191342.787858:0:57949:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42163bf8 00010000:00010000:1.0:1787191342.787862:0:57949:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191342.787870:0:57949:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191342.787881:0:57949:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191342.787888:0:57949:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191342.787893:0:57949:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191342.787903:0:57949:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b52231500, open_flags d900, mode 0 opened 0 00000080:00200000:1.0:1787191342.787910:0:57949:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:1.0:1787191342.787924:0:57949:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:1.0:1787191342.787972:0:57949:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ab54 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.787980:0:57949:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ab54 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57949 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191342.787991:0:57949:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191342.787999:0:57949:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453aad80 x1874004626801664/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191342.788007:0:57949:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ab54 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57949 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191342.788044:0:57949:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57949:1874004626801664:192.168.202.101@tcp:101:lfs.0 00000002:00010000:2.0:1787191342.788080:0:57948:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.788088:0:57948:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.788114:0:57948:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.788119:0:57948:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191342.788124:0:57948:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191342.788127:0:57948:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191342.788131:0:57948:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422fbb58 00010000:00010000:2.0:1787191342.788134:0:57948:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.788142:0:57948:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.788152:0:57948:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.788158:0:57948:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191342.788162:0:57948:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:1.0:1787191342.788270:0:57949:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:1.0:1787191342.790547:0:57949:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57949:1874004626801664:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191342.790570:0:57949:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ab54 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.790584:0:57949:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ab54 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.790591:0:57949:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ab54 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.790598:0:57949:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ab54 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.790607:0:57949:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ab54 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.790614:0:57949:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191342.790619:0:57949:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ab54 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.790626:0:57949:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ab54 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.790634:0:57949:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ab54 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.790642:0:57949:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191342.790649:0:57949:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ab54 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57949 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.790656:0:57949:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ab54 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57949 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191342.790675:0:57949:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x7, status=0 req@ffff936b453aad80 x1874004626801664/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/608 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191342.790689:0:57949:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1787191342.790725:0:57949:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ab4d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606ecc expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191342.790734:0:57948:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00010000:00010000:1.0:1787191342.790737:0:57949:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ab4d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606ecc expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191342.790740:0:57948:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000080:00010000:1.0:1787191342.790744:0:57949:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ab4d from it ffffa3fb421639a0 00010000:00010000:1.0:1787191342.790748:0:57949:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ab4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606ecc expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.790754:0:57949:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ab4d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606ecc expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000002:00010000:2.0:1787191342.790758:0:57948:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191342.790794:0:57948:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483ab5b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.790801:0:57948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483ab5b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.790810:0:57948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483ab5b lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191342.790860:0:57948:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57948:1874004626801792:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191342.790988:0:57948:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f3c0 going to sleep for 11 seconds 00000080:00200000:1.0:1787191342.791029:0:57949:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191342.791044:0:57949:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191342.791346:0:57949:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191342.791361:0:57949:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191342.791368:0:57949:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191342.791374:0:57949:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191342.791378:0:57949:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191342.791383:0:57949:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42163b58 00010000:00010000:1.0:1787191342.791387:0:57949:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191342.791394:0:57949:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191342.791405:0:57949:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191342.791412:0:57949:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191342.791418:0:57949:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191342.791421:0:57949:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=9 00000100:00100000:2.0:1787191342.794549:0:57948:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57948:1874004626801792:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191342.794573:0:57948:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483ab5b lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.794587:0:57948:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483ab5b lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.794595:0:57948:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483ab5b lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.794601:0:57948:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483ab5b lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.794609:0:57948:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483ab5b lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.794616:0:57948:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51185200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191342.794620:0:57948:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483ab5b lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.794627:0:57948:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483ab5b lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.794634:0:57948:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483ab5b lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.794642:0:57948:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191342.794649:0:57948:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483ab5b lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.794655:0:57948:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483ab5b lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191342.794673:0:57948:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513b9500 x1874004626801792/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191342.794688:0:57948:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1787191342.794717:0:57948:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ab4d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606ecc expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191342.794731:0:57948:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ab4d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606ecc expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00010000:2.0:1787191342.794739:0:57948:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ab4d from it ffffa3fb422fb930 00010000:00010000:2.0:1787191342.794743:0:57948:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ab4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606ecc expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191342.794751:0:57948:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ab4d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606ecc expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 1 00000080:00200000:2.0:1787191342.794825:0:57948:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191342.794861:0:57948:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.794870:0:57948:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.794877:0:57948:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.794888:0:57948:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191342.794893:0:57948:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191342.794896:0:57948:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191342.794900:0:57948:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422fbbf8 00010000:00010000:2.0:1787191342.794903:0:57948:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.794911:0:57948:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.794920:0:57948:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.794926:0:57948:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191342.794931:0:57948:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.794937:0:57948:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:2.0:1787191342.794946:0:57948:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:2.0:1787191342.794952:0:57948:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b51c6a000, open_flags a141, mode 81b6 opened 0 00000080:00200000:2.0:1787191342.794961:0:57948:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:2.0:1787191342.794980:0:57948:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xe2:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:2.0:1787191342.794990:0:57948:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ab4d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4606ecc expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 1 00010000:00010000:2.0:1787191342.795051:0:57948:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ab4d lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4606ecc expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 1 00010000:00010000:2.0:1787191342.795058:0:57948:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191342.795061:0:57948:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ab4d lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4606ecc expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 1 00010000:00010000:2.0:1787191342.795090:0:57948:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ab62 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.795218:0:57948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ab62 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191342.795230:0:57948:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191342.795236:0:57948:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9500 x1874004626802048/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191342.795246:0:57948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ab62 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191342.795265:0:57948:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57948:1874004626802048:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191342.795369:0:57948:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.802728:0:57948:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57948:1874004626802048:192.168.202.101@tcp:101:lfs.0 00000080:00200000:1.0:1787191342.802745:0:57950:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00010000:00010000:0.0:1787191342.802755:0:57948:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ab62 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606f12 expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191342.802770:0:57950:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.802781:0:57948:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ab62 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606f12 expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.802784:0:57950:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.802790:0:57948:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ab62 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606f12 expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.802795:0:57950:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.802800:0:57948:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ab62 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606f12 expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1787191342.802802:0:57950:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191342.802809:0:57950:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00010000:00010000:0.0:1787191342.802810:0:57948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ab62 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606f12 expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00010000:1.0:1787191342.802813:0:57950:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191342.802818:0:57950:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42303bf8 00010000:00010000:0.0:1787191342.802821:0:57948:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ab62 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606f12 expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.802822:0:57950:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.802829:0:57948:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ab62 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606f12 expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.802902:0:57948:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ab62 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606f12 expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.802927:0:57950:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191342.802943:0:57950:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191342.802951:0:57950:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191342.802957:0:57950:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000002:00100000:0.0:1787191342.802981:0:57948:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b513b9500 x1874004626802048/t8589937121(8589937121) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191342.802993:0:57948:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9500 x1874004626802048/t8589937121(8589937121) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191342.803002:0:57948:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ab62 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606f12 expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.803008:0:57948:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/226 (0 0) 00000080:00200000:0.0:1787191342.803022:0:57948:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191342.803030:0:57948:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:0.0:1787191342.803052:0:57948:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xe2:0x0](ffff936b5396c2c8) 00000080:00200000:0.0:1787191342.803058:0:57948:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xe2:0x0], updating i_size 0 00000080:00200000:0.0:1787191342.803089:0:57948:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe2:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1787191342.803094:0:57948:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xe2:0x0](ffff936b5396c2c8) 00000080:00010000:0.0:1787191342.803098:0:57948:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe2:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483ab62 00000080:00010000:0.0:1787191342.803105:0:57948:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe2:0x0](ffff936b5396c2c8) 00000080:00200008:0.0:1787191342.803116:0:57948:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe2:0x0](ffff936b5396c2c8), flags 120501 00000002:00100000:0.0:1787191342.803132:0:57948:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9500 x1874004626802048/t8589937121(8589937121) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191342.803162:0:57948:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ab62 from it ffff936b60dc45a0 00010000:00010000:0.0:1787191342.803167:0:57948:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ab62 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606f12 expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.803175:0:57948:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ab62 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606f12 expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191342.803191:0:57948:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe2:0x0](ffff936b5396c2c8), inode mode 81a4 mask 40 00000080:00200000:0.0:1787191342.803245:0:57948:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe2:0x0](ffff936b5396c2c8), inode mode 81a4 mask 2 00000080:00200000:0.0:1787191342.803254:0:57948:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xe2:0x0](ffff936b5396c2c8), xattr lov 00000002:00010000:0.0:1787191342.803266:0:57948:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe2:0x0]) in obj [0x200000405:0xe2:0x0], intent: open flags 040000002 00010000:00010000:0.0:1787191342.803307:0:57948:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ab69 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.803313:0:57948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ab69 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191342.803320:0:57948:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191342.803324:0:57948:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475880 x1874004626802304/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191342.803330:0:57948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ab69 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.803344:0:57948:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57948:1874004626802304:192.168.202.101@tcp:101:lfs.0 00000080:00200000:1.0:1787191342.803743:0:57950:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:1.0:1787191342.803749:0:57950:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe2:0x0](ffff936b5396c2c8), inode mode 81a4 mask 44 00000080:00200008:1.0:1787191342.803753:0:57950:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe2:0x0](ffff936b5396c2c8), flags 154400 00000002:00010000:1.0:1787191342.803763:0:57950:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe2:0x0]) in obj [0x200000405:0xe2:0x0], intent: open flags 0100240114401 00010000:00010000:1.0:1787191342.803781:0:57950:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483ab70 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.803785:0:57950:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483ab70 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57950 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191342.803790:0:57950:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:1.0:1787191342.803794:0:57950:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453aad80 x1874004626802560/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191342.803799:0:57950:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483ab70 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191342.803807:0:57950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57950:1874004626802560:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191342.804089:0:57950:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893300 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.804193:0:57948:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787191342.807362:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191342.807465:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634927744 00000100:00100000:2.0:1787191342.807473:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634927744 00000100:00100000:2.0:1787191342.807527:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1461 00000100:00100000:2.0:1787191342.807537:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634927744:12345-192.168.202.101@tcp:104: 00000100:00100000:3.0:1787191342.807555:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00010000:00010000:2.0:1787191342.807556:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483ab70 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e4606f27 expref: -99 pid: 57950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191342.807578:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634927872 00000100:00100000:3.0:1787191342.807581:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634927872 00000100:00100000:3.0:1787191342.807600:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1462 00000100:00100000:3.0:1787191342.807605:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+6:6505:x1874004634927872:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191342.807614:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ab62 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4606f12 expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.807653:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787191342.807660:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+6:6505:x1874004634927744:12345-192.168.202.101@tcp:104: Request processed in 125us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191342.807667:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1461 00010000:00010000:3.0:1787191342.807929:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787191342.807936:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634927872:12345-192.168.202.101@tcp:104: Request processed in 330us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191342.807943:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1462 00010000:00010000:2.0:1787191342.807972:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787191342.807979:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483ab70 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e4606f27 expref: -99 pid: 57950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.807987:0:57627:0:(ldlm_lockd.c:1935:ldlm_handle_bl_callback()) Lock ffff936b40030200 is referenced, will be cancelled later 00010000:00010000:2.0:1787191342.807990:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483ab70 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x1/0x8 rrc: 4 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4606f27 expref: -99 pid: 57950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.807997:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787191342.808000:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ab62 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4606f12 expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.808006:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51184400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191342.808042:0:57627:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ab62 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4606f12 expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.808116:0:57627:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ab62 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4606f12 expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.808125:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ab62 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4606f12 expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191342.808151:0:57627:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe2:0x0]: losing layout lock 00010000:00010000:0.0:1787191342.808167:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191342.808192:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ab62 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4606f12 expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.808198:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191342.808220:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ab62 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4606f12 expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.808233:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ab62 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4606f12 expref: -99 pid: 57948 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1787191342.808242:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626802688:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787191342.808246:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191342.808247:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191342.808249:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191342.809503:0:57950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57950:1874004626802560:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191342.809529:0:57950:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483ab70 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x1/0x8 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4606f27 expref: -99 pid: 57950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.809541:0:57950:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483ab70 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x8 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4606f27 expref: -99 pid: 57950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.809550:0:57950:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483ab70 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x8 rrc: 3 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e4606f27 expref: -99 pid: 57950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.809559:0:57950:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483ab70 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x8 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4606f27 expref: -99 pid: 57950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.809568:0:57950:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483ab70 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x8 rrc: 3 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e4606f27 expref: -99 pid: 57950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.809573:0:57950:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483ab70 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x8 rrc: 3 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e4606f27 expref: -99 pid: 57950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.809578:0:57950:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483ab70 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x8 rrc: 3 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e4606f27 expref: -99 pid: 57950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191342.809585:0:57950:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b453aad80 x1874004626802560/t8589937122(8589937122) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191342.809601:0:57950:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453aad80 x1874004626802560/t8589937122(8589937122) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191342.809609:0:57950:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483ab70 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x8 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4606f27 expref: -99 pid: 57950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.809616:0:57950:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/226 (0 0) 00000080:00200000:1.0:1787191342.809620:0:57950:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xe2:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787191342.809635:0:57950:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xe2:0x0], updating i_size 0 00000080:00200000:1.0:1787191342.809647:0:57950:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe2:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:1.0:1787191342.809650:0:57950:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe2:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483ab70 00000080:00010000:1.0:1787191342.809655:0:57950:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ab70 from it ffffa3fb42303bf0 00010000:00010000:1.0:1787191342.809657:0:57950:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483ab70 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x8 rrc: 3 type: IBT gid 0 flags: 0x10420400000000 nid: local remote: 0x7130d520e4606f27 expref: -99 pid: 57950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.809661:0:57950:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483ab70 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x8 rrc: 3 type: IBT gid 0 flags: 0x10420400000000 nid: local remote: 0x7130d520e4606f27 expref: -99 pid: 57950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.809681:0:57950:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000002:00100000:1.0:1787191342.809697:0:57950:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453aad80 x1874004626802560/t8589937122(8589937122) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1787191342.809707:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191342.809713:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483ab70 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x8 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4606f27 expref: -99 pid: 57950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.809720:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191342.809723:0:43384:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483ab70 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4606f27 expref: -99 pid: 57950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.809730:0:43384:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483ab70 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4606f27 expref: -99 pid: 57950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.809738:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483ab70 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4606f27 expref: -99 pid: 57950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1787191342.809750:0:43384:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe2:0x0]: losing layout lock 00010000:00010000:0.0:1787191342.809781:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483ab70 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4606f27 expref: -99 pid: 57950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.809787:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191342.809822:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483ab70 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4606f27 expref: -99 pid: 57950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.809845:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483ab70 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4606f27 expref: -99 pid: 57950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.809859:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191342.809861:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191342.809863:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:0.0:1787191342.810996:0:57950:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe2:0x0](ffff936b5396c2c8), inode mode 81a4 mask 4 00000080:00200000:0.0:1787191342.811008:0:57950:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xe2:0x0](ffff936b5396c2c8), xattr lov 00000080:00200008:0.0:1787191342.811058:0:57950:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe2:0x0](ffff936b5396c2c8), flags 154000 00000002:00100000:0.0:1787191342.811122:0:57950:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453aad80 x1874004626802560/t8589937122(8589937122) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191342.811134:0:57950:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:0.0:1787191342.811140:0:57950:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477800 x1874004626803072/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191342.811159:0:57950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57950:1874004626803072:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191342.811225:0:57950:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787191342.812715:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626802816:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191342.813867:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626802688:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191342.816000:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626802816:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191342.817222:0:57950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57950:1874004626803072:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191342.817317:0:57950:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453aad80 x1874004626802560/t8589937122(8589937122) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191342.817537:0:57950:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191342.817555:0:57950:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191342.817571:0:57950:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191342.817590:0:57950:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191342.817597:0:57950:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191342.817603:0:57950:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191342.817607:0:57950:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191342.817614:0:57950:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42303bf8 00010000:00010000:1.0:1787191342.817618:0:57950:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191342.817627:0:57950:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191342.817642:0:57950:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191342.817649:0:57950:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191342.817654:0:57950:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191342.817668:0:57950:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b42a0e780, open_flags d900, mode 0 opened 0 00000080:00200000:1.0:1787191342.817675:0:57950:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:1.0:1787191342.817688:0:57950:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:1.0:1787191342.817740:0:57950:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ab77 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.817749:0:57950:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ab77 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57950 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191342.817759:0:57950:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:1.0:1787191342.817766:0:57950:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8e00 x1874004626803328/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191342.817776:0:57950:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ab77 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191342.817796:0:57950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57950:1874004626803328:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191342.818199:0:57950:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893900 going to sleep for 11 seconds 00000100:00100000:1.0:1787191342.819268:0:57948:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57948:1874004626802304:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191342.819284:0:57948:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ab69 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.819295:0:57948:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ab69 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.819302:0:57948:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ab69 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.819309:0:57948:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ab69 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.819319:0:57948:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ab69 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.819326:0:57948:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b413ffc00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191342.819330:0:57948:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ab69 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.819338:0:57948:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ab69 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.819345:0:57948:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ab69 lrc: 5/0,0 mode: --/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.819351:0:57948:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191342.819356:0:57948:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ab69 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.819362:0:57948:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ab69 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57948 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191342.819383:0:57948:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b6a475880 x1874004626802304/t8589937124(8589937124) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191342.819395:0:57948:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475880 x1874004626802304/t8589937124(8589937124) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191342.819410:0:57948:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xe2:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787191342.819546:0:57948:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe2:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1787191342.819555:0:57948:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe2:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191342.819604:0:57948:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xe2:0x0], updating i_size 0 00000002:00100000:1.0:1787191342.819620:0:57948:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475880 x1874004626802304/t8589937124(8589937124) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191342.819651:0:57948:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a475880 x1874004626802304/t8589937124(8589937124) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191342.819661:0:57948:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191342.819666:0:57948:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9f80 x1874004626803584/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191342.819684:0:57948:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57948:1874004626803584:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191342.819742:0:57948:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628933c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.821708:0:57948:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57948:1874004626803584:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191342.821732:0:57948:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a475880 x1874004626802304/t8589937124(8589937124) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1787191342.821778:0:57948:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe2:0x0](ffff936b5396c2c8), flags 100001 00000002:00100000:0.0:1787191342.821810:0:57948:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513b9500 x1874004626802048/t8589937121(8589937121) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191342.821817:0:57948:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191342.821821:0:57948:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474e00 x1874004626803840/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191342.821902:0:57948:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57948:1874004626803840:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191342.822064:0:57950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57950:1874004626803328:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191342.822080:0:57950:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ab77 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606f5f expref: -99 pid: 57950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.822103:0:57950:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ab77 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606f5f expref: -99 pid: 57950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.822117:0:57950:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ab77 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606f5f expref: -99 pid: 57950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.822124:0:57950:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ab77 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606f5f expref: -99 pid: 57950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.822131:0:57950:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ab77 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606f5f expref: -99 pid: 57950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.822140:0:57950:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ab77 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606f5f expref: -99 pid: 57950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.822145:0:57950:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ab77 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606f5f expref: -99 pid: 57950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.822149:0:57950:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ab77 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606f5f expref: -99 pid: 57950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191342.822155:0:57950:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b453a8e00 x1874004626803328/t8589937125(8589937125) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191342.822162:0:57950:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8e00 x1874004626803328/t8589937125(8589937125) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191342.822170:0:57950:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ab77 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606f5f expref: -99 pid: 57950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191342.822179:0:57950:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ab77 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606f5f expref: -99 pid: 57950 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.822185:0:57950:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/226 (0 0) 00000080:00200000:1.0:1787191342.822189:0:57950:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191342.822220:0:57950:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xe2:0x0](ffff936b5396c2c8): rc = 0 00000080:00200000:1.0:1787191342.822229:0:57950:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe2:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:1.0:1787191342.822233:0:57950:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe2:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483ab77 00000080:00010000:1.0:1787191342.822242:0:57950:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe2:0x0](ffff936b5396c2c8) 00000080:00200008:1.0:1787191342.822250:0:57950:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe2:0x0](ffff936b5396c2c8), flags 154400 00000002:00100000:1.0:1787191342.822262:0:57950:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8e00 x1874004626803328/t8589937125(8589937125) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191342.822297:0:57950:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ab77 from it ffff936b5339fd80 00010000:00010000:1.0:1787191342.822300:0:57950:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ab77 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606f5f expref: -99 pid: 57950 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.822306:0:57950:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ab77 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606f5f expref: -99 pid: 57950 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191342.822323:0:57950:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe2:0x0](ffff936b5396c2c8), inode mode 81a4 mask 44 00000080:00200000:1.0:1787191342.822377:0:57950:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe2:0x0](ffff936b5396c2c8), inode mode 81a4 mask 4 00000080:00200000:1.0:1787191342.822382:0:57950:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xe2:0x0](ffff936b5396c2c8), xattr lov 00000080:00200008:1.0:1787191342.822409:0:57950:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe2:0x0](ffff936b5396c2c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191342.822416:0:57950:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe2:0x0](ffff936b5396c2c8),name=f70.sanity-flr 00000002:00010000:1.0:1787191342.822433:0:57950:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe2:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191342.822440:0:57950:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ab77 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606f5f expref: -99 pid: 57950 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.822451:0:57950:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ab77 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606f5f expref: -99 pid: 57950 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191342.822470:0:57950:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191342.822475:0:57950:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe2:0x0](ffff936b5396c2c8) 00000080:00010000:1.0:1787191342.822478:0:57950:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe2:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483ab77 00000080:00010000:1.0:1787191342.822483:0:57950:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ab77 from it ffffa3fb42303cd8 00010000:00010000:1.0:1787191342.822486:0:57950:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ab77 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606f5f expref: -99 pid: 57950 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.822493:0:57950:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ab77 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606f5f expref: -99 pid: 57950 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191342.822512:0:57950:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe2:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:1.0:1787191342.822522:0:57950:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe2:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191342.822524:0:57950:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191342.822527:0:57950:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe2:0x0] 00000008:00010000:1.0:1787191342.822541:0:57950:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191342.822543:0:57950:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b62893930, osc lock ffff936b468371d0, flags 0x400000400001002 00000008:00010000:1.0:1787191342.822547:0:57950:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191342.822549:0:57950:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b62893970, osc lock ffff936b46837560, flags 0x400000400001002 00010000:00010000:1.0:1787191342.822578:0:57950:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483ab7e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57950 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.822589:0:57950:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483ab7e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57950 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.822599:0:57950:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b453a9880 x1874004626803968/t0(0) o101->lustre-OST0001-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191342.822646:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787191342.822658:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626803968:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191342.822741:0:57950:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483ab85 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57950 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.822749:0:57950:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483ab85 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57950 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.822758:0:57950:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b453a9500 x1874004626804096/t0(0) o101->lustre-OST0000-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:1.0:1787191342.822774:0:57950:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 2 items remaining. 00000100:00100000:1.0:1787191342.822785:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626804096:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191342.823567:0:57948:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99b40 going to sleep for 11 seconds 00010000:00010000:1.0:1787191342.825651:0:2389:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483ab85 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57950 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.825679:0:2389:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483ab85 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606f74 expref: -99 pid: 57950 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.825693:0:2389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483ab85 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606f74 expref: -99 pid: 57950 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.825707:0:2389:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483ab85 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606f74 expref: -99 pid: 57950 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191342.825720:0:2389:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483ab85 lrc: 5/2,0 mode: PR/PR res: [0x280000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606f74 expref: -99 pid: 57950 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1787191342.825729:0:2389:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191342.825732:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483ab85 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606f74 expref: -99 pid: 57950 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.825737:0:2389:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483ab85 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606f74 expref: -99 pid: 57950 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.825742:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483ab85 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606f74 expref: -99 pid: 57950 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.825747:0:2389:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483ab85 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606f74 expref: -99 pid: 57950 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1787191342.825760:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626804096:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191342.825774:0:2389:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483ab7e lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57950 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.825783:0:2389:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483ab7e lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606f6d expref: -99 pid: 57950 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.825788:0:2389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483ab7e lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606f6d expref: -99 pid: 57950 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.825793:0:2389:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483ab7e lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606f6d expref: -99 pid: 57950 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191342.825798:0:2389:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483ab7e lrc: 5/2,0 mode: PR/PR res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606f6d expref: -99 pid: 57950 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1787191342.825803:0:2389:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1787191342.825819:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483ab7e lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606f6d expref: -99 pid: 57950 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.825824:0:2389:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483ab7e lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606f6d expref: -99 pid: 57950 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.825828:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483ab7e lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4606f6d expref: -99 pid: 57950 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.825852:0:2389:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483ab7e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606f6d expref: -99 pid: 57950 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1787191342.825862:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626803968:192.168.202.101@tcp:101:lfs.0 00000080:00200000:0.0:1787191342.825952:0:57950:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe2:0x0] updating i_size 0 i_blocks 0 00000020:00010000:0.0:1787191342.825957:0:57950:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b516572e0 (ffff936b465ccab8/0) at cl_lock_release():245 00000020:00010000:0.0:1787191342.825959:0:57950:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b516572e0 (ffff936b465ccab8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191342.825963:0:57950:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62893930 (ffff936b465cc2d8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191342.825966:0:57950:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62893970 (ffff936b465cc5a8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191342.825968:0:57950:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b516572e0 (ffff936b465ccab8/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191342.825970:0:57950:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62893930 (ffff936b465ccab8/1) at cl_lock_fini():72 00000020:00010000:0.0:1787191342.825973:0:57950:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62893970 (ffff936b465ccab8/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191342.825985:0:57950:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe2:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1787191342.826088:0:57950:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe2:0x0](ffff936b5396c2c8), flags 154000 00000002:00100000:0.0:1787191342.826155:0:57950:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a8e00 x1874004626803328/t8589937125(8589937125) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191342.826171:0:57950:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:0.0:1787191342.826176:0:57950:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a476d80 x1874004626804352/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191342.826197:0:57950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57950:1874004626804352:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191342.826199:0:57948:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57948:1874004626803840:192.168.202.101@tcp:35:lfs.0 00000002:00100000:2.0:1787191342.826216:0:57948:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513b9500 x1874004626802048/t8589937121(8589937121) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787191342.826262:0:57950:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99000 going to sleep for 11 seconds 00000080:00200000:3.0:1787191342.827821:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191342.828161:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.828176:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.828192:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.828200:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191342.828209:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191342.828212:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191342.828219:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:2.0:1787191342.828223:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.828231:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.828246:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.828253:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191342.828257:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.828264:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:2.0:1787191342.828269:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe2:0x0](ffff936b5396c2c8), inode mode 81a4 mask 42 00000080:00200008:2.0:1787191342.828277:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe2:0x0](ffff936b5396c2c8), flags 101101 00000002:00010000:2.0:1787191342.828292:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe2:0x0]) in obj [0x200000405:0xe2:0x0], intent: open|creat flags 04240101102 00010000:00010000:2.0:1787191342.828301:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ab77 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4606f5f expref: -99 pid: 57950 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191342.828315:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe2:0x0]: losing layout lock 00010000:00010000:2.0:1787191342.828348:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ab77 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606f5f expref: -99 pid: 57950 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191342.828353:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191342.828355:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ab77 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606f5f expref: -99 pid: 57950 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191342.828380:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ab8c lrc: 3/0,1 mode: --/CW res: [0x200000405:0xe2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.828385:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ab8c lrc: 3/0,1 mode: --/CW res: [0x200000405:0xe2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191342.828798:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191342.828812:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb800 x1874004626804608/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191342.828822:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ab8c lrc: 3/0,1 mode: --/CW res: [0x200000405:0xe2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.828860:0:57950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57950:1874004626804352:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191342.828903:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626804608:192.168.202.101@tcp:101:bash.0 00000002:00100000:0.0:1787191342.829078:0:57950:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a8e00 x1874004626803328/t8589937125(8589937125) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191342.829147:0:57950:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191342.829157:0:57950:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.829167:0:57950:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.829177:0:57950:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000100:00100000:2.0:1787191342.829180:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f0c0 going to sleep for 11 seconds 00000080:00200000:0.0:1787191342.829183:0:57950:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191342.829188:0:57950:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191342.829191:0:57950:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191342.829195:0:57950:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42303bf8 00010000:00010000:0.0:1787191342.829199:0:57950:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.829212:0:57950:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.829222:0:57950:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.829227:0:57950:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191342.829231:0:57950:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.829242:0:57950:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b42f3ad80, open_flags d902, mode 0 opened 0 00000080:00200000:0.0:1787191342.829249:0:57950:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:0.0:1787191342.829262:0:57950:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154403 00010000:00010000:0.0:1787191342.829292:0:57950:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ab93 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.829300:0:57950:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ab93 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57950 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191342.829308:0:57950:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:0.0:1787191342.829313:0:57950:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a476d80 x1874004626804864/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191342.829320:0:57950:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ab93 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57950 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.829328:0:57950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57950:1874004626804864:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191342.829440:0:57950:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99000 going to sleep for 11 seconds 00000100:00100000:2.0:1787191342.831713:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626804608:192.168.202.101@tcp:101:bash.0 00010000:00010000:2.0:1787191342.831739:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ab8c lrc: 4/0,1 mode: --/CW res: [0x200000405:0xe2:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606f82 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.831755:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ab8c lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xe2:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606f82 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.831766:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ab8c lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xe2:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606f82 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191342.831780:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x200002b, status=0 req@ffff936b513bb800 x1874004626804608/t8589937129(8589937129) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191342.831793:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bb800 x1874004626804608/t8589937129(8589937129) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191342.831806:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ab8c lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xe2:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606f82 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191342.831820:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ab8c lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xe2:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606f82 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.832043:0:57950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57950:1874004626804864:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191342.832051:0:57950:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ab93 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.832060:0:57950:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ab93 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.832064:0:57950:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ab93 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.832069:0:57950:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ab93 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.832074:0:57950:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ab93 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.832078:0:57950:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b413ffa00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191342.832081:0:57950:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ab93 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.832086:0:57950:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ab93 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.832090:0:57950:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ab93 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.832094:0:57950:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191342.832098:0:57950:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ab93 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57950 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.832112:0:57950:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ab93 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57950 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.832126:0:57950:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b6a476d80 x1874004626804864/t8589937130(8589937130) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191342.832136:0:57950:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a476d80 x1874004626804864/t8589937130(8589937130) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191342.832144:0:57950:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191342.832184:0:57950:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xe2:0x0](ffff936b5396c2c8): rc = 0 00000080:00010000:0.0:1787191342.832187:0:57950:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe2:0x0](ffff936b5396c2c8) for lock 0x0 00000080:00200008:0.0:1787191342.832205:0:57950:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe2:0x0](ffff936b5396c2c8), flags 154402 00000002:00100000:0.0:1787191342.832222:0:57950:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a476d80 x1874004626804864/t8589937130(8589937130) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191342.832267:0:57950:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe2:0x0](ffff936b5396c2c8), inode mode 81a4 mask 46 00000080:00200080:0.0:1787191342.832341:0:57950:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe2:0x0](ffff936b5396c2c8) cmd=800466af arg=7ffe5e99379c 00000080:00200080:0.0:1787191342.832353:0:57950:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe2:0x0](ffff936b5396c2c8) cmd=80086601 arg=7ffe5e993738 00000100:00100000:0.0:1787191342.832389:0:57950:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57950:1874004626804992:192.168.202.101@tcp:33:lfs.0 00000100:00100000:0.0:1787191342.832452:0:57950:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99000 going to sleep for 11 seconds 00010000:00010000:2.0:1787191342.832606:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 8 res 8589935621/226 (0 0) 00000080:00200000:2.0:1787191342.832613:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000405:0xe2:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1787191342.832649:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe2:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:2.0:1787191342.832656:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe2:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483ab8c 00000080:00010000:2.0:1787191342.832661:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ab8c from it ffffa3fb41cabbf0 00010000:00010000:2.0:1787191342.832665:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ab8c lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xe2:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606f82 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.832673:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ab8c lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xe2:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606f82 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000002:00100000:2.0:1787191342.832700:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bb800 x1874004626804608/t8589937129(8589937129) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191342.832724:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513bb800 x1874004626804608/t8589937129(8589937129) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191342.832733:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191342.832738:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9c00 x1874004626805248/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191342.832750:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626805248:192.168.202.101@tcp:35:bash.0 00000100:00100000:2.0:1787191342.832785:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.835255:0:57950:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57950:1874004626804992:192.168.202.101@tcp:33:lfs.0 00000080:00200080:0.0:1787191342.835295:0:57950:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe2:0x0](ffff936b5396c2c8) cmd=c00c66f3 arg=7ffe5e993724 00000100:00100000:2.0:1787191342.835297:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626805248:192.168.202.101@tcp:35:bash.0 00000002:00100000:2.0:1787191342.835319:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513bb800 x1874004626804608/t8589937129(8589937129) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191342.835388:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xe2:0x0], intent: getxattr flags 0 00010000:00010000:2.0:1787191342.835431:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ab9a lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.835441:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ab9a lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.835455:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ab9a lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191342.835474:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626805376:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191342.835571:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f0c0 going to sleep for 11 seconds 00000080:00200008:0.0:1787191342.835611:0:57950:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe2:0x0](ffff936b5396c2c8), flags 154002 00010000:00010000:0.0:1787191342.835628:0:57950:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ab8c lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xe2:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606f82 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000100:00100000:2.0:1787191342.838643:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626805376:192.168.202.101@tcp:101:bash.0 00010000:00010000:2.0:1787191342.838669:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ab9a lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606fba expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.838686:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ab9a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606fba expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.838698:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ab9a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606fba expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191342.838713:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b513bb800 x1874004626805376/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191342.838723:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ab9a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606fba expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.838732:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/226 (0 0) 00000080:00200000:2.0:1787191342.838737:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xe2:0x0] suppgids 0 -1: rc 0 00000080:00010000:2.0:1787191342.838757:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe2:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483ab9a 00000080:00010000:2.0:1787191342.838764:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ab9a from it ffffa3fb41caba38 00010000:00010000:2.0:1787191342.838766:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ab9a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606fba expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.838777:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ab9a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606fba expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:2.0:1787191342.838807:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xe2:0x0](ffff936b5396c2c8) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191342.000000000, mtime 1787191342.000000000, ctime 1787191342.000000000 00010000:00010000:2.0:1787191342.838827:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ab8c lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xe2:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4606f82 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191342.838895:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe2:0x0]: losing layout lock 00010000:00010000:2.0:1787191342.838931:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ab8c lrc: 1/0,0 mode: --/CW res: [0x200000405:0xe2:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606f82 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191342.838938:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191342.838941:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ab8c lrc: 0/0,0 mode: --/CW res: [0x200000405:0xe2:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606f82 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000020:00100000:2.0:1787191342.838959:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1787191342.838966:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb800 x1874004626805632/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787191342.838987:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626805632:192.168.202.101@tcp:36:bash.0 00000100:00100000:2.0:1787191342.839069:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191342.843239:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626805632:192.168.202.101@tcp:36:bash.0 00000080:00200000:2.0:1787191342.843285:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:2.0:1787191342.843291:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe2:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00010000:00010000:2.0:1787191342.843309:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/226 (0 0) 00000080:00010000:2.0:1787191342.843320:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xe2:0x0](ffff936b5396c2c8) 00000002:00010000:2.0:1787191342.843330:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe2:0x0]) in obj [0x200000405:0xe2:0x0], intent: layout flags 0 00010000:00010000:2.0:1787191342.843377:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483aba1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.843388:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483aba1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.843507:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483aba1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191342.843527:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626805760:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191342.843603:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191342.845702:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626805760:192.168.202.101@tcp:101:bash.0 00010000:00010000:2.0:1787191342.845730:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483aba1 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606fc8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.845745:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483aba1 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606fc8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191342.845759:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b513b9c00 x1874004626805760/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191342.845769:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483aba1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606fc8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191342.845782:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483aba1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606fc8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.845795:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/226 (0 0) 00000080:00200000:2.0:1787191342.845801:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xe2:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1787191342.845817:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe2:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483aba1 00000080:00010000:2.0:1787191342.845825:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483aba1 from it ffffa3fb41cab8c8 00010000:00010000:2.0:1787191342.845829:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483aba1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606fc8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.846031:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483aba1 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606fc8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.846056:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483aba1 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606fc8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.846067:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483aba1 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606fc8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:2.0:1787191342.846075:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xe2:0x0](0000000089668027) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483aba1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606fc8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191342.846117:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe2:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:2.0:1787191342.846123:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483aba1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4606fc8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.846130:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483aba1 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4606fc8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:2.0:1787191342.846146:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xe2:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:2.0:1787191342.846154:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe2:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191342.846158:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xe2:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:2.0:1787191342.846166:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xe2:0x0](ffff936b5396c2c8) 00000002:00010000:2.0:1787191342.846175:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe2:0x0]) in obj [0x200000405:0xe2:0x0], intent: layout flags 02 00010000:00010000:2.0:1787191342.846188:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483aba1 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4606fc8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191342.846201:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe2:0x0]: losing layout lock 00010000:00010000:2.0:1787191342.846228:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483aba1 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606fc8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191342.846234:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191342.846237:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483aba1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4606fc8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191342.846256:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483aba8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xe2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.846263:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483aba8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xe2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191342.846274:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191342.846280:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9c00 x1874004626806016/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191342.846289:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483aba8 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xe2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191342.846306:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626806016:192.168.202.101@tcp:101:bash.0 00000080:00200000:1.0:1787191342.846373:0:57951:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000100:00100000:2.0:1787191342.846374:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f0c0 going to sleep for 11 seconds 00000002:00010000:1.0:1787191342.846385:0:57951:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191342.846394:0:57951:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191342.846404:0:57951:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191342.846410:0:57951:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191342.846418:0:57951:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191342.846422:0:57951:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191342.846426:0:57951:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421abbf8 00010000:00010000:1.0:1787191342.846429:0:57951:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191342.846436:0:57951:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191342.846446:0:57951:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191342.847006:0:57951:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191342.847024:0:57951:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191342.847038:0:57951:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b42a0ea80, open_flags d900, mode 0 opened 0 00000080:00200000:1.0:1787191342.847045:0:57951:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:1.0:1787191342.847060:0:57951:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:1.0:1787191342.847158:0:57951:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483abaf lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.847166:0:57951:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483abaf lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57951 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191342.847174:0:57951:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:1.0:1787191342.847182:0:57951:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9880 x1874004626806272/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191342.847191:0:57951:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483abaf lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191342.847206:0:57951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57951:1874004626806272:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191342.847390:0:57951:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191342.850467:0:57951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57951:1874004626806272:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191342.850487:0:57951:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483abaf lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.850500:0:57951:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483abaf lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.850507:0:57951:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483abaf lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.850514:0:57951:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483abaf lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.850522:0:57951:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483abaf lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.850532:0:57951:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191342.850542:0:57951:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483abaf lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.850549:0:57951:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483abaf lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.850555:0:57951:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483abaf lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.850561:0:57951:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191342.850568:0:57951:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483abaf lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.850575:0:57951:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483abaf lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57951 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191342.850598:0:57951:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b453a9880 x1874004626806272/t8589937135(8589937135) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191342.850611:0:57951:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9880 x1874004626806272/t8589937135(8589937135) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191342.850627:0:57951:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191342.850724:0:57951:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe2:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1787191342.850733:0:57951:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe2:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191342.850736:0:57951:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191342.850742:0:57951:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:1.0:1787191342.850795:0:57951:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe2:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:1.0:1787191342.850828:0:57951:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483ab7e lrc: 1/0,0 mode: PR/PR res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606f6d expref: -99 pid: 57950 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000008:00010000:1.0:1787191342.851067:0:57951:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483ab85 lrc: 1/0,0 mode: PR/PR res: [0x280000401:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4606f74 expref: -99 pid: 57950 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191342.851188:0:57951:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xe2:0x0](ffff936b5396c2c8): rc = 0 00000080:00010000:1.0:1787191342.851194:0:57951:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe2:0x0](ffff936b5396c2c8) for lock 0x0 00000080:00200008:1.0:1787191342.851217:0:57951:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe2:0x0](ffff936b5396c2c8), flags 154400 00000002:00100000:1.0:1787191342.851239:0:57951:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9880 x1874004626806272/t8589937135(8589937135) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191342.851294:0:57951:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe2:0x0](ffff936b5396c2c8), inode mode 81a4 mask 44 00000080:00200000:1.0:1787191342.851387:0:57951:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe2:0x0](ffff936b5396c2c8), inode mode 81a4 mask 4 00000080:00200000:1.0:1787191342.851395:0:57951:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xe2:0x0](ffff936b5396c2c8), xattr lov 00000080:00200008:1.0:1787191342.851424:0:57951:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe2:0x0](ffff936b5396c2c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191342.851430:0:57951:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe2:0x0](ffff936b5396c2c8),name=f70.sanity-flr 00000002:00010000:1.0:1787191342.851443:0:57951:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe2:0x0]) in obj [0x200000405:0xe2:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191342.851513:0:57951:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 30 res 8589935621/226 (0 0) 00010000:00010000:1.0:1787191342.851556:0:57951:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.851564:0:57951:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.851574:0:57951:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191342.851594:0:57951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57951:1874004626806400:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191342.851716:0:57951:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191342.854071:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191342.854116:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191342.854128:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634928512 00000100:00100000:2.0:1787191342.854138:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634928512 00000100:00100000:3.0:1787191342.854140:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191342.854157:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634928640 00000100:00100000:3.0:1787191342.854160:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634928640 00000100:00100000:3.0:1787191342.854182:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634929280 00000100:00100000:3.0:1787191342.854184:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634929280 00000100:00100000:2.0:1787191342.854189:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1463 00000100:00100000:2.0:1787191342.854197:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+5:30511:x1874004634928640:12345-192.168.202.101@tcp:104: 00000100:00100000:3.0:1787191342.854197:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1464 00000100:00100000:3.0:1787191342.854202:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+5:30510:x1874004634928512:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191342.854215:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483aae4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4606d91 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191342.854215:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483ab15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4606e24 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191342.854285:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787191342.854586:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+5:30510:x1874004634928512:12345-192.168.202.101@tcp:104: Request processed in 382us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191342.854594:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1464 00000100:00100000:3.0:1787191342.854613:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1465 00000100:00100000:3.0:1787191342.854621:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30353:x1874004634929280:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191342.854629:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aadd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4606d98 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191342.854719:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:1.0:1787191342.854722:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:2.0:1787191342.854726:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:30511:x1874004634928640:12345-192.168.202.101@tcp:104: Request processed in 529us (609us total) trans 0 rc 0/0 00010000:00010000:1.0:1787191342.854730:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483ab15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4606e24 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:2.0:1787191342.854731:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1463 00010000:00010000:1.0:1787191342.854738:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b47a7f800 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191342.854744:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483ab15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4606e24 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191342.854788:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483ab15 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4606e24 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191342.854796:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191342.854816:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483ab15 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4606e24 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191342.854825:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483ab15 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4606e24 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191342.854867:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787191342.854958:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191342.854964:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30353:x1874004634929280:12345-192.168.202.101@tcp:104: Request processed in 345us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191342.854971:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1465 00010000:00010000:2.0:1787191342.855331:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787191342.855337:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aadd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4606d98 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191342.855346:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030600 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191342.855349:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483aae4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4606d91 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191342.855350:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aadd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e4606d98 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.855357:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030000 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191342.855361:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483aae4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e4606d91 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191342.855378:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aadd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4606d98 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.855383:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483aae4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4606d91 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191342.855386:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191342.855389:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191342.855395:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483aae4 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4606d91 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.855403:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000a492e8b8/0xe5129dc88483aae4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4606d91 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.855418:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191342.855419:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aadd lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4606d98 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.855420:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191342.855422:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191342.855427:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aadd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4606d98 expref: -99 pid: 57946 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000100:00100000:1.0:1787191342.855437:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626806784:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787191342.855440:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191342.855442:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191342.855443:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191342.855449:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787191342.855459:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626806656:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191342.855553:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787191342.855560:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626806528:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787191342.856060:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191342.856075:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191342.856183:0:51131:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787191342.856194:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634929408 00000100:00100000:3.0:1787191342.856200:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634929408 00000100:00100000:3.0:1787191342.856242:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1466 00000100:00100000:3.0:1787191342.856252:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b4121e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8422:x1874004634929408:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191342.856264:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483ab23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4606e32 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191342.856313:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191342.856319:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b4121e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8422:x1874004634929408:12345-192.168.202.101@tcp:104: Request processed in 69us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191342.856326:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1466 00010000:00010000:0.0:1787191342.856390:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191342.856397:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483ab23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4606e32 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.856410:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b4801e600 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191342.856414:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483ab23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4606e32 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.856445:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483ab23 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4606e32 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.856523:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191342.856549:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483ab23 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4606e32 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.856558:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483ab23 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4606e32 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.856573:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191342.856575:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191342.856577:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191342.856586:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787191342.856596:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626806912:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191342.858233:0:57570:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589937135 gen 1 00000100:00100000:1.0:1787191342.858328:0:57570:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b6a476d80 x1874004626804864/t8589937130(8589937130) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787191342.858345:0:57570:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b453a9880 x1874004626806272/t8589937135(8589937135) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787191342.858357:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626806016:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191342.858374:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483aba8 lrc: 4/0,1 mode: --/EX res: [0x200000405:0xe2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606fd6 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.858386:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483aba8 lrc: 4/0,1 mode: --/CR res: [0x200000405:0xe2:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606fd6 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.858397:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483aba8 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xe2:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606fd6 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.858408:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483aba8 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xe2:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606fd6 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.858420:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483aba8 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xe2:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606fd6 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.858429:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483aba8 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xe2:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606fd6 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.858436:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483aba8 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe2:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606fd6 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191342.858445:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b513b9c00 x1874004626806016/t8589937134(8589937134) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787191342.859108:0:57951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57951:1874004626806400:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191342.859122:0:57951:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.859132:0:57951:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.859142:0:57951:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.859151:0:57951:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.859162:0:57951:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.859170:0:57951:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.859177:0:57951:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191342.859187:0:57951:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b453a9500 x1874004626806400/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/976 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191342.859198:0:57951:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191342.859213:0:57951:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.859225:0:57951:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/226 (0 0) 00000080:00200000:3.0:1787191342.859231:0:57951:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xe2:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1787191342.859296:0:57951:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe2:0x0]: layout version change: 4294967294 -> 4 00000080:00010000:3.0:1787191342.859302:0:57951:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe2:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483abb6 00000080:00010000:3.0:1787191342.859309:0:57951:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe2:0x0](ffff936b5396c2c8) 00000080:00010000:3.0:1787191342.859312:0:57951:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483abb6 from it ffffa3fb421abcd8 00010000:00010000:3.0:1787191342.859316:0:57951:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.859326:0:57951:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191342.859357:0:57951:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe2:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:3.0:1787191342.859367:0:57951:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe2:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191342.859370:0:57951:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191342.859374:0:57951:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe2:0x0] 00000008:00010000:3.0:1787191342.859391:0:57951:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191342.859394:0:57951:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667db0, osc lock ffff936b44f65690, flags 0x400000400001002 00010000:00010000:3.0:1787191342.859436:0:57951:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483abbd lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57951 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.859446:0:57951:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483abbd lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57951 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.859468:0:57951:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b51d1ca80 x1874004626807040/t0(0) o101->lustre-OST0000-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191342.859525:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626807040:192.168.202.101@tcp:101:lfs.0 00000020:00200000:3.0:1787191342.859614:0:57951:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000002:00010000:1.0:1787191342.861078:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483aba8 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe2:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606fd6 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191342.861151:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483aba8 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe2:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606fd6 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.861168:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/226 (0 0) 00000080:00200000:1.0:1787191342.861174:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xe2:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191342.861189:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe2:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483aba8 00000080:00010000:1.0:1787191342.861195:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483aba8 from it ffffa3fb41cab930 00010000:00010000:1.0:1787191342.861199:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483aba8 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe2:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4606fd6 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.861208:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483aba8 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe2:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4606fd6 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191342.861224:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:1.0:1787191342.861229:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe2:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00020000:00200000:1.0:1787191342.861239:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xe2:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:1.0:1787191342.861243:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe2:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191342.861246:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191342.861255:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191342.861272:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191342.861276:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:1.0:1787191342.861288:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:1.0:1787191342.861291:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b628931b0, osc lock ffff936b46836000, flags 0x80000000 00000008:00010000:1.0:1787191342.861295:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:1.0:1787191342.861296:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b628931f0, osc lock ffff936b46836e40, flags 0x80000000 00010000:00010000:1.0:1787191342.861306:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b52377800 type 11 mode 2 res 10737419265/472 (0 1048575) 00010000:00010000:1.0:1787191342.861336:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.861346:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.861356:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191342.861376:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626807168:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191342.861592:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893000 going to sleep for 11 seconds 00000100:00100000:2.0:1787191342.861783:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626806656:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191342.862042:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626806528:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191342.862051:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626806784:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191342.866816:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626806912:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787191342.867709:0:2391:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483abbd lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57951 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.867733:0:2391:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483abbd lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e460702a expref: -99 pid: 57951 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.867748:0:2391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483abbd lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460702a expref: -99 pid: 57951 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.867762:0:2391:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483abbd lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e460702a expref: -99 pid: 57951 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191342.867777:0:2391:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483abbd lrc: 5/2,0 mode: PR/PR res: [0x280000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460702a expref: -99 pid: 57951 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1787191342.867789:0:2391:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:3.0:1787191342.868078:0:2391:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483abbd lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460702a expref: -99 pid: 57951 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.868088:0:2391:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483abbd lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460702a expref: -99 pid: 57951 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.868284:0:2391:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483abbd lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460702a expref: -99 pid: 57951 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.868297:0:2391:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483abbd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460702a expref: -99 pid: 57951 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1787191342.868318:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626807040:192.168.202.101@tcp:101:lfs.0 00000080:00200000:1.0:1787191342.868392:0:57951:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe2:0x0] updating i_size 0 i_blocks 0 00000020:00010000:1.0:1787191342.868398:0:57951:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509ba2b0 (ffff936b47a172d8/0) at cl_lock_release():245 00000020:00010000:1.0:1787191342.868401:0:57951:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509ba2b0 (ffff936b47a172d8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191342.868406:0:57951:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667db0 (ffff936b465cc008/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191342.868411:0:57951:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509ba2b0 (ffff936b47a172d8/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191342.868414:0:57951:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667db0 (ffff936b47a172d8/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191342.868427:0:57951:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe2:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1787191342.868550:0:57951:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe2:0x0](ffff936b5396c2c8), flags 154000 00000002:00100000:1.0:1787191342.868612:0:57951:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a9880 x1874004626806272/t8589937135(8589937135) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191342.868624:0:57951:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191342.868629:0:57951:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453aad80 x1874004626807424/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191342.868651:0:57951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57951:1874004626807424:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191342.868743:0:57951:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628939c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191342.868824:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191342.869240:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634929536 00000100:00100000:3.0:1787191342.869247:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634929536 00000100:00100000:3.0:1787191342.869334:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1467 00000100:00100000:3.0:1787191342.869345:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:37089:x1874004634929536:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191342.869359:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483abbd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000010000 nid: local remote: 0x7130d520e460702a expref: -99 pid: 57951 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191342.869416:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191342.869423:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:37089:x1874004634929536:12345-192.168.202.101@tcp:104: Request processed in 80us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191342.869430:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1467 00010000:00010000:1.0:1787191342.869482:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191342.869489:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483abbd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000010000 nid: local remote: 0x7130d520e460702a expref: -99 pid: 57951 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.869503:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9bc00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191342.869510:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483abbd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800428400010000 nid: local remote: 0x7130d520e460702a expref: -99 pid: 57951 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191342.869526:0:40929:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe2:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00000080:00200000:1.0:1787191342.869538:0:40929:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe2:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1787191342.869573:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483abbd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400010020 nid: local remote: 0x7130d520e460702a expref: -99 pid: 57951 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.869580:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191342.869607:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483abbd lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400010020 nid: local remote: 0x7130d520e460702a expref: -99 pid: 57951 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.869615:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000982aec58/0xe5129dc88483abbd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400010020 nid: local remote: 0x7130d520e460702a expref: -99 pid: 57951 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.869629:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191342.869631:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191342.869632:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191342.869640:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787191342.869650:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626807552:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191342.870652:0:57951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57951:1874004626807424:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191342.870681:0:57951:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a9880 x1874004626806272/t8589937135(8589937135) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191342.870983:0:57951:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191342.871002:0:57951:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191342.871026:0:57951:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191342.871040:0:57951:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191342.871048:0:57951:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191342.871055:0:57951:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191342.871059:0:57951:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191342.871067:0:57951:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421abb58 00010000:00010000:1.0:1787191342.871071:0:57951:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191342.871079:0:57951:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191342.871094:0:57951:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191342.871282:0:57951:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191342.871288:0:57951:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191342.871302:0:57951:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=9 00000080:00200000:1.0:1787191342.871306:0:57951:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191342.871318:0:57951:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191342.871362:0:57951:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abcb lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.871372:0:57951:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abcb lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.871381:0:57951:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abcb lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191342.871397:0:57951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57951:1874004626807680:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191342.871451:0:57951:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628939c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191342.872371:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191342.872398:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634929664 00000100:00100000:3.0:1787191342.872405:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634929664 00000100:00100000:3.0:1787191342.872450:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1468 00000100:00100000:3.0:1787191342.872471:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:6491:x1874004634929664:12345-192.168.202.101@tcp:105: 00010000:00010000:3.0:1787191342.872484:0:51131:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.872496:0:51131:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.872505:0:51131:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.872516:0:51131:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080000000000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.872531:0:51131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080000000000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.872541:0:51131:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000000000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.872556:0:51131:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b4801f000) 00000100:00100000:3.0:1787191342.872595:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:6491:x1874004634929664:12345-192.168.202.101@tcp:105: Request processed in 125us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191342.872602:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1468 00000100:00100000:1.0:1787191342.872949:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626807168:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191342.872965:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.872979:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000020000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191342.872991:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000020000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.873003:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.873021:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.873075:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483abd2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.873084:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483abd2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.873241:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483abd2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191342.873260:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626807808:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191342.873306:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893000 going to sleep for 11 seconds 00000100:00100000:1.0:1787191342.874200:0:57951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57951:1874004626807680:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191342.874215:0:57951:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abcb lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460704d expref: -99 pid: 57951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.874235:0:57951:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abcb lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460704d expref: -99 pid: 57951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.874244:0:57951:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abcb lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460704d expref: -99 pid: 57951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.874253:0:57951:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abcb lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460704d expref: -99 pid: 57951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.874262:0:57951:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abcb lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460704d expref: -99 pid: 57951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.874272:0:57951:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abcb lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460704d expref: -99 pid: 57951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.874285:0:57951:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abcb lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460704d expref: -99 pid: 57951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.874292:0:57951:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abcb lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460704d expref: -99 pid: 57951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191342.874304:0:57951:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b453aad80 x1874004626807680/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/976 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191342.874315:0:57951:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abcb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460704d expref: -99 pid: 57951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191342.874326:0:57951:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abcb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460704d expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.874338:0:57951:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.874348:0:57951:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.874356:0:57951:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abcb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460704d expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.874362:0:57951:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abcb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x7130d520e460704d expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.874373:0:57951:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abcb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x7130d520e460704d expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.874396:0:57951:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000080:00200000:1.0:1787191342.874403:0:57951:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191342.874449:0:57951:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xe2:0x0](ffff936b5396c2c8): rc = 0 00010000:00010000:2.0:1787191342.874542:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787191342.874549:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abcb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x7130d520e460704d expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.874557:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b4801f200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191342.874561:0:57627:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abcb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x7130d520e460704d expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.874570:0:57627:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abcb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x7130d520e460704d expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.874579:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abcb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e460704d expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.874594:0:57627:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.874625:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abcb lrc: 2/0,0 mode: --/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e460704d expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.874632:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787191342.874683:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626807936:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00200000:1.0:1787191342.874765:0:57951:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe2:0x0]: layout version change: 4 -> 4 00000080:00010000:1.0:1787191342.874772:0:57951:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe2:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483abb6 00000080:00010000:1.0:1787191342.874785:0:57951:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe2:0x0](ffff936b5396c2c8) 00000080:00010000:1.0:1787191342.874788:0:57951:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483abb6 from it ffffa3fb421abb20 00010000:00010000:1.0:1787191342.874791:0:57951:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.874802:0:57951:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200008:1.0:1787191342.874881:0:57951:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe2:0x0](ffff936b5396c2c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191342.874889:0:57951:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe2:0x0](ffff936b5396c2c8),name=f70.sanity-flr 00000002:00010000:1.0:1787191342.874909:0:57951:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe2:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191342.874917:0:57951:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.874925:0:57951:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191342.874931:0:57951:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191342.874937:0:57951:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe2:0x0](ffff936b5396c2c8) 00000080:00010000:1.0:1787191342.874940:0:57951:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe2:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483abb6 00000080:00010000:1.0:1787191342.874944:0:57951:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483abb6 from it ffffa3fb421abcb8 00010000:00010000:1.0:1787191342.874947:0:57951:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191342.874954:0:57951:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191342.874972:0:57951:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe2:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:1.0:1787191342.874982:0:57951:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe2:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191342.874986:0:57951:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191342.874989:0:57951:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe2:0x0] 00000008:00010000:1.0:1787191342.875008:0:57951:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191342.875021:0:57951:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b44ca8230, osc lock ffff936b46836850, flags 0x400000400001002 00010000:00010000:1.0:1787191342.875035:0:57951:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.875045:0:57951:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1787191342.875056:0:57951:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191342.875060:0:57951:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 7/0,2 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.875067:0:57951:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1787191342.875079:0:57951:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191342.875091:0:57951:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe2:0x0] updating i_size 0 i_blocks 0 00000020:00010000:1.0:1787191342.875095:0:57951:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509ba2b0 (ffff936b47a172d8/0) at cl_lock_release():245 00000020:00010000:1.0:1787191342.875098:0:57951:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509ba2b0 (ffff936b47a172d8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191342.875101:0:57951:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b44ca8230 (ffff936b465cc008/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191342.875105:0:57951:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509ba2b0 (ffff936b47a172d8/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191342.875107:0:57951:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b44ca8230 (ffff936b47a172d8/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191342.875116:0:57951:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe2:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191342.875155:0:57951:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191342.875165:0:57951:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191342.875173:0:57951:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191342.875181:0:57951:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191342.875188:0:57951:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191342.875192:0:57951:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191342.875194:0:57951:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191342.875198:0:57951:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421abbf8 00010000:00010000:1.0:1787191342.875201:0:57951:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191342.875209:0:57951:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191342.875223:0:57951:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191342.875228:0:57951:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191342.875233:0:57951:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191342.875236:0:57951:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:1.0:1787191342.875240:0:57951:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe2:0x0](ffff936b5396c2c8), inode mode 81a4 mask 46 00000080:00200008:1.0:1787191342.875248:0:57951:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe2:0x0](ffff936b5396c2c8), flags 154402 00000080:00200000:1.0:1787191342.875348:0:57951:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe2:0x0](ffff936b5396c2c8), inode mode 81a4 mask 4 00000080:00200000:1.0:1787191342.875355:0:57951:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xe2:0x0](ffff936b5396c2c8), xattr lov 00000080:00200008:1.0:1787191342.875380:0:57951:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe2:0x0](ffff936b5396c2c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191342.875385:0:57951:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe2:0x0](ffff936b5396c2c8),name=f70.sanity-flr 00000002:00010000:1.0:1787191342.875394:0:57951:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe2:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191342.875400:0:57951:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191342.875410:0:57951:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191342.875416:0:57951:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191342.875421:0:57951:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe2:0x0](ffff936b5396c2c8) 00000080:00010000:1.0:1787191342.875423:0:57951:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe2:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483abb6 00000080:00010000:1.0:1787191342.875428:0:57951:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483abb6 from it ffffa3fb421abcd8 00010000:00010000:1.0:1787191342.875431:0:57951:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191342.875438:0:57951:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1787191342.875630:0:57951:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe2:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:1.0:1787191342.875635:0:57951:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe2:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191342.875637:0:57951:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191342.875638:0:57951:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe2:0x0] 00000008:00010000:1.0:1787191342.875645:0:57951:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191342.875646:0:57951:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b44ca8230, osc lock ffff936b46836850, flags 0x400000400001002 00010000:00010000:1.0:1787191342.875653:0:57951:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.875660:0:57951:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1787191342.875665:0:57951:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191342.875667:0:57951:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 7/0,2 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.875672:0:57951:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1787191342.875676:0:57951:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191342.875679:0:57951:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe2:0x0] updating i_size 0 i_blocks 0 00000020:00010000:1.0:1787191342.875680:0:57951:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509ba2b0 (ffff936b47a172d8/0) at cl_lock_release():245 00000020:00010000:1.0:1787191342.875682:0:57951:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509ba2b0 (ffff936b47a172d8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191342.875683:0:57951:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b44ca8230 (ffff936b465cc008/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191342.875685:0:57951:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509ba2b0 (ffff936b47a172d8/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191342.875686:0:57951:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b44ca8230 (ffff936b47a172d8/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191342.875691:0:57951:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe2:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200080:1.0:1787191342.875759:0:57951:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe2:0x0](ffff936b5396c2c8) cmd=c00c66f3 arg=234e2e0 00010000:00010000:2.0:1787191342.875953:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abcb lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e460704d expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.875963:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abcb lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e460704d expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.875977:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191342.875978:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191342.875980:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200008:1.0:1787191342.876028:0:57951:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe2:0x0](ffff936b5396c2c8), flags 154002 00000100:00100000:1.0:1787191342.877317:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626807552:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191342.877369:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626807808:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191342.877387:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483abd2 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607054 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.877405:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483abd2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4607054 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.877416:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483abd2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4607054 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.877429:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483abd2 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4607054 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191342.877442:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483abd2 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4607054 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.877466:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483abd2 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607054 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.877474:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483abd2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607054 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191342.877574:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626808064:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191342.877626:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787191342.877632:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626808192:192.168.202.101@tcp:10:bash.0 00000100:00100000:3.0:1787191342.885372:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626807936:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191342.886578:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626808064:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191342.886970:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626808192:192.168.202.101@tcp:10:bash.0 00000080:00200000:2.0:1787191342.887395:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe2:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191342.887403:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b497c95d8 (ffff936b465cc878/0) at cl_lock_release():245 00000020:00010000:2.0:1787191342.887406:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b497c95d8 (ffff936b465cc878/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.887411:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b628931b0 (ffff936b465ccf38/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191342.887422:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.887437:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191342.887453:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b628931f0 (ffff936b465cc6c8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191342.887459:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483abd2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607054 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.887473:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483abd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607054 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191342.887481:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b497c95d8 (ffff936b465cc878/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191342.887484:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b628931b0 (ffff936b465cc878/1) at cl_lock_fini():72 00000020:00010000:2.0:1787191342.887489:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b628931f0 (ffff936b465cc878/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191342.887529:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe2:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191342.887552:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xe2:0x0](ffff936b5396c2c8) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191342.000000000, mtime 1787191342.000000000, ctime 1787191342.000000000, rc 0 00000080:00200008:2.0:1787191342.887626:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xe2:0x0], ppos: 0, count: 5 00000080:00200000:2.0:1787191342.887638:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191342.887643:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:2.0:1787191342.887649:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:2.0:1787191342.887653:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1787191342.887659:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@00000000551929f2[0x110, 1, [0x200000405:0xe2:0x0] hash] 00000020:00200000:2.0:1787191342.887661:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:2.0:1787191342.887665:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe2:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191342.887677:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xe2:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:2.0:1787191342.887682:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe2:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191342.887685:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1787191342.887689:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1787191342.887696:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:2.0:1787191342.887699:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1787191342.887713:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:2.0:1787191342.887725:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1787191342.887730:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d11b0, osc lock ffff936b44e63b50, flags 0x0 00010000:00010000:2.0:1787191342.887746:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.887764:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.887775:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.887784:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.887791:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191342.887801:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:2.0:1787191342.887808:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191342.887861:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:2.0:1787191342.887869:0:57570:0:(rw26.c:927:ll_write_end()) page@000000005b9025cd[3 000000006213f2a4 2 1 00000000631ca0a8 0 0 0] 00000080:00200000:2.0:1787191342.888052:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @000000009efa476f 17ffffc0001001 3:0 ffff936b43a1e380 0 lru 00000080:00200000:2.0:1787191342.888060:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@000000004f95520a 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000a2a44f55 00000000f5ddd5d2 > 3< 0 0 > 4< 0 0 8 420392960 - | - - - - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1787191342.888063:0:57570:0:(rw26.c:927:ll_write_end()) end page@000000005b9025cd 00000080:00200000:2.0:1787191342.888064:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:2.0:1787191342.888068:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:2.0:1787191342.888086:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 000000002e4c590e ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191342.888164:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b5396c478, count 1, dirtied 1 00000080:00200000:2.0:1787191342.888169:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:2.0:1787191342.888172:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:2.0:1787191342.888186:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b497c9218 (ffff936b465ccf38/0) at cl_lock_release():245 00000020:00010000:2.0:1787191342.888189:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b497c9218 (ffff936b465ccf38/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191342.888192:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d11b0 (ffff936b465cca28/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191342.888197:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.888206:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:2.0:1787191342.888216:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b497c9218 (ffff936b465ccf38/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191342.888219:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d11b0 (ffff936b465ccf38/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191342.888225:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:2.0:1787191342.888229:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1787191342.888235:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe2:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191342.888238:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:2.0:1787191342.888243:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe2:0x0] updating i_size 5 i_blocks 0 00000080:00200000:2.0:1787191342.888247:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:2.0:1787191342.888264:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe2:0x0](ffff936b5396c2c8), flags 100001 00000002:00100000:2.0:1787191342.888323:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a476d80 x1874004626804864/t8589937130(8589937130) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191342.888334:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191342.888340:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513ba680 x1874004626808448/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191342.888360:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626808448:192.168.202.101@tcp:35:bash.0 00000100:00100000:2.0:1787191342.888470:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f300 going to sleep for 11 seconds 00000080:00200000:0.0:1787191342.889353:0:57952:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191342.889372:0:57952:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.889384:0:57952:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.889396:0:57952:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.889403:0:57952:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191342.889409:0:57952:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191342.889413:0:57952:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191342.889419:0:57952:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42303bf8 00010000:00010000:0.0:1787191342.889423:0:57952:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.889431:0:57952:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.889442:0:57952:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.889448:0:57952:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191342.889453:0:57952:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.889457:0:57952:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:0.0:1787191342.889459:0:57952:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe2:0x0](ffff936b5396c2c8), inode mode 81a4 mask 44 00000080:00200008:0.0:1787191342.889463:0:57952:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe2:0x0](ffff936b5396c2c8), flags 154400 00000002:00010000:0.0:1787191342.889477:0:57952:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe2:0x0]) in obj [0x200000405:0xe2:0x0], intent: open flags 0104240114401 00010000:00010000:0.0:1787191342.889514:0:57952:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483abd9 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.889521:0:57952:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483abd9 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57952 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191342.889534:0:57952:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:0.0:1787191342.889543:0:57952:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477480 x1874004626808704/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191342.889550:0:57952:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483abd9 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57952 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.889565:0:57952:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57952:1874004626808704:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191342.889745:0:57952:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99000 going to sleep for 11 seconds 00000100:00100000:2.0:1787191342.890618:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626808448:192.168.202.101@tcp:35:bash.0 00000002:00100000:2.0:1787191342.890644:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a476d80 x1874004626804864/t8589937130(8589937130) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191342.896545:0:57953:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191342.896575:0:57953:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.896591:0:57953:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.896607:0:57953:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.896616:0:57953:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191342.896623:0:57953:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191342.896626:0:57953:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191342.896635:0:57953:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422fbb58 00010000:00010000:0.0:1787191342.896639:0:57953:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.896647:0:57953:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.896662:0:57953:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.896671:0:57953:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:0.0:1787191342.896677:0:57953:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.896680:0:57953:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=8 00000080:00200008:0.0:1787191342.896685:0:57953:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe2:0x0](ffff936b5396c2c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191342.896690:0:57953:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe2:0x0](ffff936b5396c2c8),name=f70.sanity-flr 00000002:00010000:0.0:1787191342.896702:0:57953:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe2:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.896710:0:57953:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000100:00100000:1.0:1787191342.896715:0:57952:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57952:1874004626808704:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191342.896718:0:57953:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1787191342.896724:0:57953:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191342.896727:0:57953:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe2:0x0](ffff936b5396c2c8) 00000080:00010000:0.0:1787191342.896730:0:57953:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe2:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483abb6 00000080:00010000:0.0:1787191342.896733:0:57953:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483abb6 from it ffffa3fb422fbcb8 00010000:00010000:1.0:1787191342.896735:0:57952:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483abd9 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe2:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607062 expref: -99 pid: 57952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.896736:0:57953:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191342.896744:0:57953:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00010000:00010000:1.0:1787191342.896748:0:57952:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483abd9 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe2:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607062 expref: -99 pid: 57952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.896757:0:57952:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483abd9 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe2:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607062 expref: -99 pid: 57952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00200000:0.0:1787191342.896764:0:57953:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe2:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00000002:00100000:1.0:1787191342.896769:0:57952:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x200002b, status=0 req@ffff936b6a477480 x1874004626808704/t8589937138(8589937138) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00020000:00200000:0.0:1787191342.896775:0:57953:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe2:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191342.896778:0:57953:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191342.896781:0:57953:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe2:0x0] 00000002:00100000:1.0:1787191342.896781:0:57952:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477480 x1874004626808704/t8589937138(8589937138) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191342.896792:0:57952:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483abd9 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe2:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607062 expref: -99 pid: 57952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191342.896800:0:57953:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191342.896803:0:57953:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee6430, osc lock ffff936b50b631d0, flags 0x400000400001002 00000002:00010000:1.0:1787191342.896808:0:57952:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483abd9 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe2:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607062 expref: -99 pid: 57952 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.896815:0:57952:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/226 (0 0) 00010000:00010000:0.0:1787191342.896818:0:57953:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191342.896819:0:57952:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xe2:0x0] suppgids 0 0: rc 0 00010000:00010000:0.0:1787191342.896828:0:57953:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191342.897195:0:57952:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe2:0x0]: layout version change: 4 -> 4 00000080:00010000:1.0:1787191342.897201:0:57952:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe2:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483abd9 00000080:00010000:1.0:1787191342.897205:0:57952:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483abd9 from it ffffa3fb42303bf0 00010000:00010000:1.0:1787191342.897209:0:57952:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483abd9 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe2:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607062 expref: -99 pid: 57952 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.897217:0:57952:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483abd9 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe2:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607062 expref: -99 pid: 57952 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00200000:0.0:1787191342.897231:0:57953:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191342.897235:0:57953:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000002:00100000:1.0:1787191342.897238:0:57952:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477480 x1874004626808704/t8589937138(8589937138) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1787191342.897245:0:57953:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:0.0:1787191342.897255:0:57953:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191342.897315:0:57953:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe2:0x0] updating i_size 5 i_blocks 0 00000020:00010000:0.0:1787191342.897322:0:57953:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b516572e0 (ffff936b465ccab8/0) at cl_lock_release():245 00000020:00010000:0.0:1787191342.897325:0:57953:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b516572e0 (ffff936b465ccab8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191342.897328:0:57953:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee6430 (ffff936b465cc5a8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191342.897332:0:57953:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b516572e0 (ffff936b465ccab8/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191342.897336:0:57953:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee6430 (ffff936b465ccab8/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191342.897347:0:57953:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe2:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191342.897350:0:57952:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe2:0x0](ffff936b5396c2c8), inode mode 81a4 mask 4 00000080:00200000:1.0:1787191342.897356:0:57952:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xe2:0x0](ffff936b5396c2c8), xattr lov 00000080:00200000:0.0:1787191342.897371:0:57953:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191342.897378:0:57953:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00000080:00200008:1.0:1787191342.897379:0:57952:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe2:0x0](ffff936b5396c2c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191342.897383:0:57952:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe2:0x0](ffff936b5396c2c8),name=f70.sanity-flr 00010000:00010000:0.0:1787191342.897385:0:57953:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.897405:0:57953:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.897417:0:57953:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191342.897421:0:57953:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191342.897424:0:57953:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191342.897428:0:57953:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422fbc10 00010000:00010000:0.0:1787191342.897430:0:57953:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.897438:0:57953:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.897447:0:57953:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000002:00010000:1.0:1787191342.897450:0:57952:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe2:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00000080:00200000:0.0:1787191342.897451:0:57953:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:0.0:1787191342.897455:0:57953:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00010000:00010000:1.0:1787191342.897458:0:57952:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00000080:00200000:0.0:1787191342.897461:0:57953:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:0.0:1787191342.897464:0:57953:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00010000:00010000:1.0:1787191342.897466:0:57952:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00000080:00200000:0.0:1787191342.897468:0:57953:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00200000:1.0:1787191342.897474:0:57952:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191342.897479:0:57952:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe2:0x0](ffff936b5396c2c8) 00000080:00010000:1.0:1787191342.897481:0:57952:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe2:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483abb6 00000080:00010000:1.0:1787191342.897484:0:57952:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483abb6 from it ffffa3fb42303cd8 00010000:00010000:1.0:1787191342.897487:0:57952:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00010000:00010000:0.0:1787191342.897488:0:57953:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483abd9 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe2:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4607062 expref: -99 pid: 57952 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.897495:0:57952:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00010000:00010000:0.0:1787191342.897504:0:57953:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 7 lru_type: 1 00000080:00200000:1.0:1787191342.897507:0:57952:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe2:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:1.0:1787191342.897512:0:57952:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe2:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191342.897515:0:57952:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00010000:00010000:0.0:1787191342.897517:0:57953:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483aba8 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe2:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4606fd6 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000001:00010000:1.0:1787191342.897517:0:57952:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe2:0x0] 00010000:00010000:0.0:1787191342.897524:0:57953:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 8 lru_type: 1 00000008:00010000:1.0:1787191342.897525:0:57952:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191342.897527:0:57952:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b44ca8230, osc lock ffff936b46836850, flags 0x400000400001002 00010000:00010000:1.0:1787191342.897536:0:57952:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191342.897539:0:57953:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ab9a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4606fba expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.897545:0:57952:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:1.0:1787191342.897553:0:57952:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191342.897556:0:57952:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191342.897567:0:57952:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191342.897574:0:57953:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483abd9 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xe2:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607062 expref: -99 pid: 57952 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00200000:1.0:1787191342.897575:0:57952:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191342.897579:0:57952:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe2:0x0] updating i_size 5 i_blocks 0 00010000:00010000:0.0:1787191342.897581:0:57953:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483aba8 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xe2:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4606fd6 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1787191342.897582:0:57952:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509ba2b0 (ffff936b47a172d8/0) at cl_lock_release():245 00000020:00010000:1.0:1787191342.897585:0:57952:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509ba2b0 (ffff936b47a172d8/0) at cl_lock_cancel():142 00010000:00010000:0.0:1787191342.897588:0:57953:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ab9a lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4606fba expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.897594:0:57953:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:0.0:1787191342.897597:0:57953:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483abd9 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe2:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607062 expref: -99 pid: 57952 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.897608:0:57953:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483aba8 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe2:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4606fd6 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.897617:0:57953:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ab9a lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4606fba expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1787191342.897632:0:57953:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1787191342.897638:0:57953:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475500 x1874004626808960/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00010000:1.0:1787191342.897655:0:57952:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b44ca8230 (ffff936b465cc008/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191342.897659:0:57952:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509ba2b0 (ffff936b47a172d8/0) at cl_lock_fini():72 00000100:00100000:0.0:1787191342.897660:0:57953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57953:1874004626808960:192.168.202.101@tcp:36:rm.0 00000020:00010000:1.0:1787191342.897661:0:57952:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b44ca8230 (ffff936b47a172d8/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191342.897667:0:57952:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe2:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1787191342.897697:0:57952:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe2:0x0](ffff936b5396c2c8), flags 154000 00000002:00100000:1.0:1787191342.897726:0:57952:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a477480 x1874004626808704/t8589937138(8589937138) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191342.897734:0:57952:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:1.0:1787191342.897738:0:57952:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453aad80 x1874004626809216/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191342.897740:0:57953:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99000 going to sleep for 11 seconds 00000100:00100000:1.0:1787191342.897750:0:57952:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57952:1874004626809216:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191342.897775:0:57952:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893000 going to sleep for 11 seconds 00000100:00100000:2.0:1787191342.899700:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191342.899752:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634929792 00000100:00100000:3.0:1787191342.899759:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634929792 00000100:00100000:1.0:1787191342.899768:0:57952:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57952:1874004626809216:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191342.899793:0:57952:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a477480 x1874004626808704/t8589937138(8589937138) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787191342.899810:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1469 00000100:00100000:3.0:1787191342.899818:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634929792:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191342.899899:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 8 lru_type: 1 00010000:00010000:3.0:1787191342.900061:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191342.900069:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634929792:12345-192.168.202.101@tcp:104: Request processed in 251us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191342.900076:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1469 00010000:00010000:0.0:1787191342.900119:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191342.900125:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 8 lru_type: 1 00010000:00010000:0.0:1787191342.900133:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191342.900138:0:40930:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 8 lru_type: 1 00010000:00010000:0.0:1787191342.900146:0:40930:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 8 lru_type: 1 00010000:00010000:0.0:1787191342.900154:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 8 lru_type: 1 00000080:00200000:0.0:1787191342.900173:0:40930:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe2:0x0]: losing layout lock 00010000:00010000:0.0:1787191342.900208:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 8 lru_type: 1 00010000:00010000:0.0:1787191342.900215:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191342.900235:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 8 lru_type: 1 00010000:00010000:0.0:1787191342.900243:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483abb6 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe2:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607023 expref: -99 pid: 57951 timeout: 0 lvb_type: 3 lru_score: 8 lru_type: 1 00010000:00010000:0.0:1787191342.900260:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191342.900262:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191342.900263:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:1.0:1787191342.900588:0:57952:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191342.900740:0:57952:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191342.900749:0:57952:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191342.900758:0:57952:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191342.900763:0:57952:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191342.900767:0:57952:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191342.900769:0:57952:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191342.900773:0:57952:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42303b58 00010000:00010000:1.0:1787191342.900775:0:57952:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191342.900781:0:57952:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191342.900789:0:57952:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191342.900794:0:57952:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191342.900799:0:57952:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:1.0:1787191342.900817:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626809344:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191342.903325:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626809344:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191342.904131:0:57953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57953:1874004626808960:192.168.202.101@tcp:36:rm.0 00000080:00200000:0.0:1787191342.904489:0:57953:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe2:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00020000:00200000:0.0:1787191342.904502:0:57953:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe2:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191342.904506:0:57953:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191342.904512:0:57953:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191342.904522:0:57953:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000008:00010000:0.0:1787191342.904540:0:57953:0:(osc_cache.c:1183:osc_extent_make_ready()) ### extent: 000000002e4c590e ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1787191342.904549:0:57952:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=9 00000080:00200000:1.0:1787191342.904554:0:57952:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000008:00010000:0.0:1787191342.904567:0:57953:0:(osc_cache.c:917:osc_extent_finish()) ### extent: 000000002e4c590e ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000002:00010000:1.0:1787191342.904575:0:57952:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00000008:00010000:0.0:1787191342.904586:0:57953:0:(osc_cache.c:497:__osc_extent_remove()) ### extent: 000000002e4c590e ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1787191342.904608:0:57953:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe2:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191342.904649:0:57953:0:(llite_lib.c:2066:ll_clear_inode()) VFS Op:inode=[0x200000405:0xe2:0x0](ffff936b5396c2c8) 00000008:00010000:0.0:1787191342.904677:0:57953:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 5 blocks 0 [cma]time 1787191342 1787191342 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000008:00010000:0.0:1787191342.904698:0:57953:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191342 1787191342 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483abd2 lrc: 1/0,0 mode: PW/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607054 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.904829:0:57952:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abe0 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.904982:0:57952:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abe0 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.904993:0:57952:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abe0 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57952 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191342.905027:0:57952:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57952:1874004626809472:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191342.905195:0:57952:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893000 going to sleep for 11 seconds 00000100:00100000:1.0:1787191342.912516:0:57952:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57952:1874004626809472:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191342.912538:0:57952:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abe0 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.912552:0:57952:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abe0 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.912558:0:57952:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abe0 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.912565:0:57952:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abe0 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.912573:0:57952:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abe0 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.912580:0:57952:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b4801f200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191342.912653:0:57952:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abe0 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.912663:0:57952:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abe0 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.912672:0:57952:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abe0 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.912680:0:57952:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191342.912687:0:57952:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abe0 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.912694:0:57952:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abe0 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57952 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191342.912717:0:57952:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b453aad80 x1874004626809472/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191342.912731:0:57952:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191342.915332:0:57954:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191342.915359:0:57954:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.915373:0:57954:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.915388:0:57954:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.915396:0:57954:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191342.915404:0:57954:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191342.915407:0:57954:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191342.915415:0:57954:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421abb58 00010000:00010000:0.0:1787191342.915419:0:57954:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.915428:0:57954:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.915443:0:57954:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.915451:0:57954:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:0.0:1787191342.915456:0:57954:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.915466:0:57954:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:0.0:1787191342.915470:0:57954:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:0.0:1787191342.915483:0:57954:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:0.0:1787191342.915532:0:57954:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483abe7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.915539:0:57954:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483abe7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.915548:0:57954:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483abe7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.915573:0:57954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57954:1874004626809600:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191342.915699:0:57954:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99000 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.920223:0:57954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57954:1874004626809600:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191342.920244:0:57954:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483abe7 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.920258:0:57954:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483abe7 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.920265:0:57954:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483abe7 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.920272:0:57954:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483abe7 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.920281:0:57954:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483abe7 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.920287:0:57954:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b413ffa00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191342.920291:0:57954:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483abe7 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.920298:0:57954:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483abe7 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.920305:0:57954:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483abe7 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.920311:0:57954:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191342.920318:0:57954:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483abe7 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.920324:0:57954:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483abe7 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.920343:0:57954:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b6a475f80 x1874004626809600/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191342.920359:0:57954:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191342.920443:0:57954:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191342.920457:0:57954:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.920466:0:57954:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.920478:0:57954:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.920485:0:57954:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191342.920489:0:57954:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191342.920493:0:57954:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191342.920498:0:57954:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421abbe8 00010000:00010000:0.0:1787191342.920501:0:57954:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.920509:0:57954:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.920521:0:57954:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.920527:0:57954:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000080:00200000:0.0:1787191342.920532:0:57954:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.920542:0:57954:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:0.0:1787191342.920546:0:57954:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:0.0:1787191342.920555:0:57954:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:0.0:1787191342.920599:0:57954:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483abee lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.920606:0:57954:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483abee lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.920616:0:57954:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483abee lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.920634:0:57954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57954:1874004626809728:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191342.920697:0:57954:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99000 going to sleep for 11 seconds 00000080:00200000:1.0:1787191342.928142:0:57955:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191342.928175:0:57955:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191342.928191:0:57955:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191342.928208:0:57955:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191342.928216:0:57955:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191342.928224:0:57955:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191342.928228:0:57955:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191342.928235:0:57955:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4230bbf8 00010000:00010000:1.0:1787191342.928239:0:57955:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191342.928253:0:57955:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191342.928270:0:57955:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191342.928278:0:57955:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191342.928283:0:57955:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:0.0:1787191342.929390:0:57954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57954:1874004626809728:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191342.929408:0:57954:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483abee lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.929419:0:57954:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483abee lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.929426:0:57954:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483abee lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.929433:0:57954:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483abee lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.929441:0:57954:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483abee lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.929450:0:57954:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b413ff200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191342.929454:0:57954:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483abee lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.929459:0:57954:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483abee lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.929463:0:57954:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483abee lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.929467:0:57954:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191342.929472:0:57954:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483abee lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.929476:0:57954:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483abee lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.929502:0:57954:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b6a475f80 x1874004626809728/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191342.929513:0:57954:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191342.929578:0:57954:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191342.929587:0:57954:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.929595:0:57954:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.929606:0:57954:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.929612:0:57954:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191342.929617:0:57954:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191342.929620:0:57954:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191342.929625:0:57954:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421abb58 00010000:00010000:0.0:1787191342.929628:0:57954:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.929637:0:57954:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.929649:0:57954:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.929654:0:57954:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:0.0:1787191342.929660:0:57954:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1787191342.929663:0:57954:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:0.0:1787191342.929672:0:57954:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.929678:0:57954:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 99 lru_type: 1 00010000:00010000:0.0:1787191342.929683:0:57954:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 99 lru_type: 1 00000002:00010000:0.0:1787191342.929691:0:57954:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.929721:0:57954:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483abf5 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.929725:0:57954:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483abf5 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.929732:0:57954:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483abf5 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.929749:0:57954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57954:1874004626809856:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191342.929896:0:57954:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99000 going to sleep for 11 seconds 00000080:00200000:1.0:1787191342.930480:0:57955:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b60796300, open_flags d900, mode 0 opened 0 00000080:00200000:1.0:1787191342.930490:0:57955:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:1.0:1787191342.930506:0:57955:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:1.0:1787191342.930543:0:57955:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abfc lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.930550:0:57955:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abfc lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57955 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191342.930559:0:57955:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191342.930567:0:57955:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453aad80 x1874004626810112/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191342.930577:0:57955:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abfc lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57955 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191342.930596:0:57955:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57955:1874004626810112:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191342.930729:0:57955:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893000 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.933287:0:57954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57954:1874004626809856:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191342.933311:0:57954:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483abf5 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46070d9 expref: -99 pid: 57954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.933323:0:57954:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483abf5 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46070d9 expref: -99 pid: 57954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.933336:0:57954:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483abf5 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46070d9 expref: -99 pid: 57954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.933347:0:57954:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483abf5 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46070d9 expref: -99 pid: 57954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.933360:0:57954:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483abf5 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46070d9 expref: -99 pid: 57954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.933368:0:57954:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483abf5 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46070d9 expref: -99 pid: 57954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.933376:0:57954:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483abf5 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46070d9 expref: -99 pid: 57954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.933387:0:57954:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b6a475f80 x1874004626809856/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787191342.934138:0:57955:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57955:1874004626810112:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191342.934152:0:57955:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abfc lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.934166:0:57955:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abfc lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.934172:0:57955:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abfc lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57955 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191342.934189:0:57954:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483abf5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46070d9 expref: -99 pid: 57954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.934600:0:57955:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abfc lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x10206400000000 pid: 57955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.934608:0:57955:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abfc lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x206400000000 pid: 57955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.934609:0:57954:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:1.0:1787191342.934614:0:57955:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b4801f200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191342.934619:0:57954:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483abf5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46070d9 expref: -99 pid: 57954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.934619:0:57955:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abfc lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.934629:0:57954:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483abf5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46070d9 expref: -99 pid: 57954 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.934632:0:57955:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abfc lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 4 type: IBT flags: 0x206400000000 pid: 57955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.934639:0:57955:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abfc lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.934645:0:57955:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191342.934650:0:57955:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abfc lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57955 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191342.934657:0:57954:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191342.934657:0:57955:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483abfc lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57955 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.934668:0:57954:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 198 lru_type: 1 00000002:00100000:1.0:1787191342.934674:0:57955:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x7, status=0 req@ffff936b453aad80 x1874004626810112/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/608 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1787191342.934679:0:57954:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 198 lru_type: 1 00010000:00010000:0.0:1787191342.934688:0:57954:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 198 lru_type: 1 00000080:00200000:1.0:1787191342.934691:0:57955:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1787191342.934695:0:57954:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 199 lru_type: 1 00000080:00200000:0.0:1787191342.934705:0:57954:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191342.934712:0:57954:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:1.0:1787191342.934712:0:57955:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483abf5 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46070d9 expref: -99 pid: 57954 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1787191342.934716:0:57954:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00010000:00010000:1.0:1787191342.934720:0:57955:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483abf5 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46070d9 expref: -99 pid: 57954 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1787191342.934721:0:57954:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb421abcb8 00010000:00010000:0.0:1787191342.934725:0:57954:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 99 lru_type: 1 00000080:00010000:1.0:1787191342.934727:0:57955:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483abf5 from it ffffa3fb4230b9a0 00010000:00010000:1.0:1787191342.934730:0:57955:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483abf5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46070d9 expref: -99 pid: 57954 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.934733:0:57954:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 100 lru_type: 1 00010000:00010000:1.0:1787191342.934738:0:57955:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483abf5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46070d9 expref: -99 pid: 57954 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:0.0:1787191342.934746:0:57954:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.934751:0:57954:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483abf5 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46070d9 expref: -99 pid: 57954 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191342.934757:0:57954:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483abf5 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46070d9 expref: -99 pid: 57954 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191342.934763:0:57954:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483abf5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46070d9 expref: -99 pid: 57954 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191342.934769:0:57954:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483abf5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46070d9 expref: -99 pid: 57954 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000002:00010000:0.0:1787191342.934777:0:57954:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.934781:0:57954:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 199 lru_type: 1 00010000:00010000:0.0:1787191342.934788:0:57954:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 199 lru_type: 1 00010000:00010000:0.0:1787191342.934795:0:57954:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 199 lru_type: 1 00010000:00010000:0.0:1787191342.934805:0:57954:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 200 lru_type: 1 00000080:00200000:1.0:1787191342.935108:0:57955:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191342.935122:0:57955:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191342.935129:0:57955:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191342.935137:0:57955:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191342.935144:0:57955:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191342.935149:0:57955:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191342.935151:0:57955:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191342.935156:0:57955:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4230bb58 00010000:00010000:1.0:1787191342.935159:0:57955:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191342.935166:0:57955:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191342.935175:0:57955:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191342.935250:0:57955:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191342.935256:0:57955:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191342.935260:0:57955:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=9 00000080:00200008:0.0:1787191342.935756:0:57954:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1787191342.935762:0:57954:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191342.935771:0:57954:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.935780:0:57954:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.935790:0:57954:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.935796:0:57954:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191342.935800:0:57954:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191342.935803:0:57954:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191342.935807:0:57954:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421abcb8 00010000:00010000:0.0:1787191342.935810:0:57954:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.935817:0:57954:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.936020:0:57954:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191342.936029:0:57954:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.936035:0:57954:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.936048:0:57954:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.936053:0:57954:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191342.936057:0:57954:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191342.936059:0:57954:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191342.936062:0:57954:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421abb58 00010000:00010000:0.0:1787191342.936065:0:57954:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.936071:0:57954:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.936079:0:57954:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.936083:0:57954:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:0.0:1787191342.936086:0:57954:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.936089:0:57954:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=8 00000080:00200000:0.0:1787191342.936169:0:57954:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191342.936178:0:57954:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.936184:0:57954:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.936193:0:57954:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.936198:0:57954:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191342.936202:0:57954:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191342.936205:0:57954:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191342.936208:0:57954:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421abbf8 00010000:00010000:0.0:1787191342.936211:0:57954:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.936218:0:57954:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.936226:0:57954:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.936230:0:57954:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191342.936233:0:57954:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.936238:0:57954:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:0.0:1787191342.936241:0:57954:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:0.0:1787191342.936245:0:57954:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b62ae8600, open_flags a141, mode 81b6 opened 0 00000080:00200000:0.0:1787191342.936254:0:57954:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:0.0:1787191342.936273:0:57954:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xe3:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:0.0:1787191342.936284:0:57954:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483abf5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e46070d9 expref: -99 pid: 57954 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191342.936328:0:57954:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483abf5 lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46070d9 expref: -99 pid: 57954 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191342.936333:0:57954:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191342.936335:0:57954:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483abf5 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46070d9 expref: -99 pid: 57954 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191342.936359:0:57954:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ac03 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.936366:0:57954:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ac03 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191342.936374:0:57954:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191342.936382:0:57954:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475f80 x1874004626810368/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191342.936388:0:57954:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ac03 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.937023:0:57954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57954:1874004626810368:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191342.937159:0:57954:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99000 going to sleep for 11 seconds 00000080:00200000:0.0:1787191342.945765:0:57956:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191342.945795:0:57956:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.945810:0:57956:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.945826:0:57956:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.945860:0:57956:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191342.945868:0:57956:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191342.945872:0:57956:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191342.945879:0:57956:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42313bf8 00010000:00010000:0.0:1787191342.945884:0:57956:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.945892:0:57956:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.945910:0:57956:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.945918:0:57956:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191342.945924:0:57956:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:3.0:1787191342.946361:0:57954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57954:1874004626810368:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191342.946381:0:57954:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ac03 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607103 expref: -99 pid: 57954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.946404:0:57954:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ac03 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607103 expref: -99 pid: 57954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.946413:0:57954:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ac03 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607103 expref: -99 pid: 57954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.946423:0:57954:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ac03 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607103 expref: -99 pid: 57954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.946433:0:57954:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ac03 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607103 expref: -99 pid: 57954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.946445:0:57954:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ac03 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607103 expref: -99 pid: 57954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.946452:0:57954:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ac03 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607103 expref: -99 pid: 57954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.946459:0:57954:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ac03 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607103 expref: -99 pid: 57954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191342.946471:0:57954:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b6a475f80 x1874004626810368/t8589937141(8589937141) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191342.946483:0:57954:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475f80 x1874004626810368/t8589937141(8589937141) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191342.946495:0:57954:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ac03 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607103 expref: -99 pid: 57954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.946504:0:57954:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/227 (0 0) 00000080:00200000:3.0:1787191342.946509:0:57954:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191342.946518:0:57954:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:3.0:1787191342.946543:0:57954:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xe3:0x0](ffff936b489aec08) 00000080:00200000:3.0:1787191342.946549:0:57954:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xe3:0x0], updating i_size 0 00000080:00200000:3.0:1787191342.946579:0:57954:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe3:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:3.0:1787191342.946597:0:57954:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xe3:0x0](ffff936b489aec08) 00000080:00010000:3.0:1787191342.946601:0:57954:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe3:0x0](ffff936b489aec08) for lock 0xe5129dc88483ac03 00000080:00010000:3.0:1787191342.946608:0:57954:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe3:0x0](ffff936b489aec08) 00000080:00200008:3.0:1787191342.946619:0:57954:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe3:0x0](ffff936b489aec08), flags 120501 00000002:00100000:3.0:1787191342.946636:0:57954:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475f80 x1874004626810368/t8589937141(8589937141) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1787191342.946665:0:57954:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ac03 from it ffff936b530f5e40 00010000:00010000:3.0:1787191342.946669:0:57954:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ac03 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607103 expref: -99 pid: 57954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.946677:0:57954:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ac03 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607103 expref: -99 pid: 57954 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191342.946692:0:57954:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe3:0x0](ffff936b489aec08), inode mode 81a4 mask 40 00000080:00200000:3.0:1787191342.946748:0:57954:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe3:0x0](ffff936b489aec08), inode mode 81a4 mask 2 00000080:00200000:3.0:1787191342.946758:0:57954:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xe3:0x0](ffff936b489aec08), xattr lov 00000002:00010000:3.0:1787191342.946773:0:57954:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe3:0x0]) in obj [0x200000405:0xe3:0x0], intent: open flags 040000002 00010000:00010000:3.0:1787191342.946817:0:57954:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ac0a lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.946824:0:57954:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ac0a lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191342.946864:0:57954:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191342.947043:0:57954:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1c700 x1874004626810624/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191342.947053:0:57954:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ac0a lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191342.947073:0:57954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57954:1874004626810624:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191342.947246:0:57954:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ce40 going to sleep for 11 seconds 00000080:00200000:0.0:1787191342.947773:0:57956:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:0.0:1787191342.947782:0:57956:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe3:0x0](ffff936b489aec08), inode mode 81a4 mask 44 00000080:00200008:0.0:1787191342.947788:0:57956:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe3:0x0](ffff936b489aec08), flags 154400 00000002:00010000:0.0:1787191342.947804:0:57956:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe3:0x0]) in obj [0x200000405:0xe3:0x0], intent: open flags 0100240114401 00010000:00010000:0.0:1787191342.948434:0:57956:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ac11 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.948444:0:57956:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ac11 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57956 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191342.948455:0:57956:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:0.0:1787191342.948464:0:57956:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a476680 x1874004626810880/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191342.948472:0:57956:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ac11 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.948488:0:57956:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57956:1874004626810880:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191342.948767:0:57956:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787191342.949762:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191342.951297:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634929920 00000100:00100000:3.0:1787191342.951307:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634929920 00000100:00100000:3.0:1787191342.951365:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1470 00000100:00100000:3.0:1787191342.951376:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634929920:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191342.951392:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ac03 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4607103 expref: -99 pid: 57954 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191342.951616:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191342.951623:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634929920:12345-192.168.202.101@tcp:104: Request processed in 250us (1865us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191342.951630:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1470 00010000:00010000:0.0:1787191342.951819:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191342.951826:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ac03 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4607103 expref: -99 pid: 57954 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.952111:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b413ffa00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191342.952117:0:43384:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ac03 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4607103 expref: -99 pid: 57954 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.952129:0:43384:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ac03 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4607103 expref: -99 pid: 57954 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.952138:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ac03 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4607103 expref: -99 pid: 57954 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191342.952160:0:43384:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe3:0x0]: losing layout lock 00010000:00010000:0.0:1787191342.952203:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ac03 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607103 expref: -99 pid: 57954 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.952210:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787191342.952265:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626811008:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787191342.952406:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ac03 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607103 expref: -99 pid: 57954 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.952415:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ac03 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607103 expref: -99 pid: 57954 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.952429:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191342.952431:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191342.952432:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191342.952722:0:57956:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57956:1874004626810880:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191342.952736:0:57956:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ac11 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.952746:0:57956:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ac11 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.952751:0:57956:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ac11 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.952757:0:57956:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ac11 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.952763:0:57956:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ac11 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.952767:0:57956:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b413fe800 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191342.952770:0:57956:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ac11 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.952776:0:57956:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ac11 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.952782:0:57956:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ac11 lrc: 5/0,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.952787:0:57956:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191342.952791:0:57956:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ac11 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.952797:0:57956:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ac11 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57956 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191342.952813:0:57956:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b6a476680 x1874004626810880/t8589937142(8589937142) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191342.952858:0:57956:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a476680 x1874004626810880/t8589937142(8589937142) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191342.952871:0:57956:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xe3:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1787191342.952888:0:57956:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xe3:0x0], updating i_size 0 00000002:00100000:3.0:1787191342.952917:0:57956:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a476680 x1874004626810880/t8589937142(8589937142) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191342.953064:0:57956:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe3:0x0](ffff936b489aec08), inode mode 81a4 mask 4 00000080:00200000:3.0:1787191342.953074:0:57956:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xe3:0x0](ffff936b489aec08), xattr lov 00000080:00200008:3.0:1787191342.953127:0:57956:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe3:0x0](ffff936b489aec08), flags 154000 00000002:00100000:3.0:1787191342.953165:0:57956:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a476680 x1874004626810880/t8589937142(8589937142) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191342.953174:0:57956:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:3.0:1787191342.953180:0:57956:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1dc00 x1874004626811264/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191342.953197:0:57956:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57956:1874004626811264:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191342.953248:0:57956:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c540 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.954256:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626811008:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191342.957142:0:57954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57954:1874004626810624:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191342.957163:0:57954:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ac0a lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.957176:0:57954:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ac0a lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.957183:0:57954:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ac0a lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.957190:0:57954:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ac0a lrc: 3/0,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.957199:0:57954:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ac0a lrc: 4/0,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.957205:0:57954:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9a600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191342.957210:0:57954:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ac0a lrc: 4/0,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.957217:0:57954:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ac0a lrc: 4/0,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.957224:0:57954:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ac0a lrc: 5/0,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.957231:0:57954:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191342.957237:0:57954:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ac0a lrc: 3/0,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.957243:0:57954:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ac0a lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57954 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191342.957267:0:57954:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b51d1c700 x1874004626810624/t8589937143(8589937143) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191342.957282:0:57954:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1c700 x1874004626810624/t8589937143(8589937143) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191342.957298:0:57954:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xe3:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1787191342.957343:0:57954:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe3:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1787191342.957352:0:57954:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe3:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191342.957395:0:57954:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xe3:0x0], updating i_size 0 00000002:00100000:3.0:1787191342.957412:0:57954:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1c700 x1874004626810624/t8589937143(8589937143) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191342.957447:0:57954:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1c700 x1874004626810624/t8589937143(8589937143) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191342.957456:0:57954:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191342.957461:0:57954:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1ed80 x1874004626811520/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191342.957483:0:57954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ed80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57954:1874004626811520:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191342.957629:0:57954:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191342.958359:0:57956:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57956:1874004626811264:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191342.958377:0:57956:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a476680 x1874004626810880/t8589937142(8589937142) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191342.958561:0:57956:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191342.958577:0:57956:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191342.958652:0:57956:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191342.958668:0:57956:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191342.958676:0:57956:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191342.958682:0:57956:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191342.958686:0:57956:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191342.958693:0:57956:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42313bf8 00010000:00010000:3.0:1787191342.958697:0:57956:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191342.958706:0:57956:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191342.958721:0:57956:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191342.958728:0:57956:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191342.958734:0:57956:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191342.958746:0:57956:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b46080a80, open_flags d900, mode 0 opened 0 00000080:00200000:3.0:1787191342.958753:0:57956:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:3.0:1787191342.958768:0:57956:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:3.0:1787191342.958808:0:57956:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483ac18 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.958817:0:57956:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483ac18 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57956 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191342.958826:0:57956:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:3.0:1787191342.958994:0:57956:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1e680 x1874004626811776/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191342.959005:0:57956:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483ac18 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191342.959031:0:57956:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1e680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57956:1874004626811776:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191342.959277:0:57956:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c540 going to sleep for 11 seconds 00000100:00100000:3.0:1787191342.961549:0:57956:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1e680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57956:1874004626811776:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191342.961574:0:57956:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483ac18 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607150 expref: -99 pid: 57956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.961663:0:57956:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483ac18 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607150 expref: -99 pid: 57956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.961671:0:57956:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483ac18 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607150 expref: -99 pid: 57956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.961683:0:57956:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483ac18 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607150 expref: -99 pid: 57956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.961693:0:57956:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483ac18 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607150 expref: -99 pid: 57956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.961708:0:57956:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483ac18 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607150 expref: -99 pid: 57956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.961716:0:57956:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483ac18 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607150 expref: -99 pid: 57956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.961724:0:57956:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483ac18 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607150 expref: -99 pid: 57956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191342.961736:0:57956:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b51d1e680 x1874004626811776/t8589937145(8589937145) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191342.961750:0:57956:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1e680 x1874004626811776/t8589937145(8589937145) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191342.961764:0:57956:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483ac18 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607150 expref: -99 pid: 57956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191342.961775:0:57956:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483ac18 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607150 expref: -99 pid: 57956 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191342.961784:0:57956:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/227 (0 0) 00000080:00200000:3.0:1787191342.961791:0:57956:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191342.962348:0:57956:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xe3:0x0](ffff936b489aec08): rc = 0 00000080:00200000:0.0:1787191342.962466:0:57956:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe3:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:0.0:1787191342.962473:0:57956:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe3:0x0](ffff936b489aec08) for lock 0xe5129dc88483ac18 00000080:00010000:0.0:1787191342.962484:0:57956:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe3:0x0](ffff936b489aec08) 00000080:00200008:0.0:1787191342.962495:0:57956:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe3:0x0](ffff936b489aec08), flags 154400 00000002:00100000:0.0:1787191342.962514:0:57956:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1e680 x1874004626811776/t8589937145(8589937145) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191342.962552:0:57956:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ac18 from it ffff936b466f4cc0 00010000:00010000:0.0:1787191342.962556:0:57956:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483ac18 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607150 expref: -99 pid: 57956 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.962563:0:57956:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483ac18 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607150 expref: -99 pid: 57956 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191342.962581:0:57956:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe3:0x0](ffff936b489aec08), inode mode 81a4 mask 44 00000080:00200000:0.0:1787191342.962644:0:57956:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe3:0x0](ffff936b489aec08), inode mode 81a4 mask 4 00000080:00200000:0.0:1787191342.962649:0:57956:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xe3:0x0](ffff936b489aec08), xattr lov 00000080:00200008:0.0:1787191342.962675:0:57956:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe3:0x0](ffff936b489aec08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191342.962679:0:57956:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe3:0x0](ffff936b489aec08),name=f70.sanity-flr 00000002:00010000:0.0:1787191342.962694:0:57956:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe3:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.962702:0:57956:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483ac18 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607150 expref: -99 pid: 57956 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.962710:0:57956:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483ac18 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607150 expref: -99 pid: 57956 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191342.962714:0:57956:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191342.962718:0:57956:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe3:0x0](ffff936b489aec08) 00000080:00010000:0.0:1787191342.962720:0:57956:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe3:0x0](ffff936b489aec08) for lock 0xe5129dc88483ac18 00000080:00010000:0.0:1787191342.962722:0:57956:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ac18 from it ffffa3fb42313cd8 00010000:00010000:0.0:1787191342.962724:0:57956:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483ac18 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607150 expref: -99 pid: 57956 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.962732:0:57956:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483ac18 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607150 expref: -99 pid: 57956 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191342.962745:0:57956:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe3:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1787191342.962753:0:57956:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe3:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191342.962755:0:57956:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191342.962758:0:57956:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe3:0x0] 00000008:00010000:0.0:1787191342.962772:0:57956:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191342.962775:0:57956:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f99db0, osc lock ffff936b50b631d0, flags 0x400000400001002 00000008:00010000:0.0:1787191342.962781:0:57956:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191342.962783:0:57956:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f99df0, osc lock ffff936b50b63db0, flags 0x400000400001002 00010000:00010000:0.0:1787191342.962826:0:57956:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483ac1f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57956 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.962870:0:57956:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483ac1f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57956 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.962880:0:57956:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b6a474380 x1874004626811904/t0(0) o101->lustre-OST0000-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191342.962927:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626811904:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191342.963045:0:57956:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ac26 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57956 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.963053:0:57956:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ac26 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57956 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.963068:0:57956:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b6a477480 x1874004626812032/t0(0) o101->lustre-OST0001-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:0.0:1787191342.963094:0:57956:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 2 items remaining. 00000100:00100000:0.0:1787191342.963227:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626812032:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191342.965201:0:2390:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483ac1f lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57956 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.965224:0:2390:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483ac1f lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e460715e expref: -99 pid: 57956 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.965238:0:2390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483ac1f lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460715e expref: -99 pid: 57956 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.965248:0:2390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483ac1f lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e460715e expref: -99 pid: 57956 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191342.965259:0:2390:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483ac1f lrc: 5/2,0 mode: PR/PR res: [0x280000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460715e expref: -99 pid: 57956 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1787191342.965266:0:2390:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191342.965270:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483ac1f lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460715e expref: -99 pid: 57956 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.965274:0:2390:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483ac1f lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460715e expref: -99 pid: 57956 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.965280:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483ac1f lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460715e expref: -99 pid: 57956 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.965285:0:2390:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483ac1f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460715e expref: -99 pid: 57956 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1787191342.965298:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626811904:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191342.965956:0:57954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ed80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57954:1874004626811520:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191342.965979:0:57954:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1c700 x1874004626810624/t8589937143(8589937143) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1787191342.966038:0:57954:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe3:0x0](ffff936b489aec08), flags 100001 00000002:00100000:0.0:1787191342.966093:0:57954:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a475f80 x1874004626810368/t8589937141(8589937141) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191342.966113:0:57954:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191342.966119:0:57954:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474380 x1874004626812288/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191342.966139:0:57954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57954:1874004626812288:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191342.966206:0:57954:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00010000:00010000:0.0:1787191342.967380:0:2389:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ac26 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57956 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.967401:0:2389:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ac26 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607165 expref: -99 pid: 57956 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.967415:0:2389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ac26 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607165 expref: -99 pid: 57956 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.967427:0:2389:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ac26 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607165 expref: -99 pid: 57956 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191342.967441:0:2389:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ac26 lrc: 5/2,0 mode: PR/PR res: [0x2c0000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607165 expref: -99 pid: 57956 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1787191342.967452:0:2389:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1787191342.967473:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ac26 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4607165 expref: -99 pid: 57956 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.967482:0:2389:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ac26 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4607165 expref: -99 pid: 57956 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.967489:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ac26 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4607165 expref: -99 pid: 57956 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.967498:0:2389:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ac26 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607165 expref: -99 pid: 57956 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191342.967560:0:57956:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe3:0x0] updating i_size 0 i_blocks 0 00000020:00010000:1.0:1787191342.967567:0:57956:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51656bf0 (ffff936b465cccf8/0) at cl_lock_release():245 00000020:00010000:1.0:1787191342.967570:0:57956:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51656bf0 (ffff936b465cccf8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191342.967575:0:57956:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99db0 (ffff936b465ccab8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191342.967580:0:57956:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99df0 (ffff936b465cc5a8/1) at cl_lock_cancel():142 00000100:00100000:0.0:1787191342.967608:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626812032:192.168.202.101@tcp:101:lfs.0 00000020:00010000:1.0:1787191342.967665:0:57956:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51656bf0 (ffff936b465cccf8/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191342.967669:0:57956:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99db0 (ffff936b465cccf8/1) at cl_lock_fini():72 00000020:00010000:1.0:1787191342.967673:0:57956:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99df0 (ffff936b465cccf8/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191342.967686:0:57956:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe3:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:3.0:1787191342.967686:0:57954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57954:1874004626812288:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191342.967708:0:57954:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a475f80 x1874004626810368/t8589937141(8589937141) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1787191342.967734:0:57956:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe3:0x0](ffff936b489aec08), flags 154000 00000002:00100000:1.0:1787191342.967769:0:57956:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1e680 x1874004626811776/t8589937145(8589937145) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191342.967777:0:57956:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191342.967782:0:57956:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453aad80 x1874004626812544/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191342.967799:0:57956:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57956:1874004626812544:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191342.967977:0:57956:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893000 going to sleep for 11 seconds 00000100:00100000:1.0:1787191342.969601:0:57956:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57956:1874004626812544:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191342.969625:0:57956:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1e680 x1874004626811776/t8589937145(8589937145) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191342.970208:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191342.970226:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.970241:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.970251:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.970257:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191342.970262:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191342.970265:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191342.970270:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:0.0:1787191342.970273:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.970279:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.970289:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.970293:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191342.970297:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.970301:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:0.0:1787191342.970305:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe3:0x0](ffff936b489aec08), inode mode 81a4 mask 42 00000080:00200008:0.0:1787191342.970310:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe3:0x0](ffff936b489aec08), flags 101101 00000002:00010000:0.0:1787191342.970322:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe3:0x0]) in obj [0x200000405:0xe3:0x0], intent: open|creat flags 04240101102 00010000:00010000:0.0:1787191342.970331:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483ac18 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4607150 expref: -99 pid: 57956 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191342.970348:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe3:0x0]: losing layout lock 00010000:00010000:0.0:1787191342.970375:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483ac18 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607150 expref: -99 pid: 57956 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191342.970380:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191342.970382:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483ac18 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607150 expref: -99 pid: 57956 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191342.970406:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ac2d lrc: 3/0,1 mode: --/CW res: [0x200000405:0xe3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.970410:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ac2d lrc: 3/0,1 mode: --/CW res: [0x200000405:0xe3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191342.970418:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191342.970422:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477480 x1874004626812800/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191342.970429:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ac2d lrc: 3/0,1 mode: --/CW res: [0x200000405:0xe3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.970442:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626812800:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191342.970536:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000080:00200000:0.0:1787191342.970563:0:57956:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191342.970571:0:57956:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191342.970578:0:57956:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.970587:0:57956:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.970594:0:57956:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191342.970598:0:57956:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191342.970601:0:57956:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191342.970604:0:57956:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42313bf8 00010000:00010000:0.0:1787191342.970607:0:57956:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191342.970614:0:57956:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191342.970623:0:57956:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.970627:0:57956:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191342.970631:0:57956:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191342.970642:0:57956:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b5258e180, open_flags d902, mode 0 opened 0 00000080:00200000:0.0:1787191342.970649:0:57956:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:0.0:1787191342.970662:0:57956:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154403 00010000:00010000:0.0:1787191342.970686:0:57956:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ac34 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.970694:0:57956:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ac34 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57956 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191342.970702:0:57956:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:0.0:1787191342.970707:0:57956:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a476d80 x1874004626813056/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191342.970715:0:57956:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ac34 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.970727:0:57956:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57956:1874004626813056:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191342.971225:0:57956:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.975347:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626812800:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191342.975375:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ac2d lrc: 4/0,1 mode: --/CW res: [0x200000405:0xe3:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607181 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.975390:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ac2d lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xe3:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607181 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.975572:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ac2d lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xe3:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607181 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.975588:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x200002b, status=0 req@ffff936b6a477480 x1874004626812800/t8589937149(8589937149) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191342.975602:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477480 x1874004626812800/t8589937149(8589937149) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191342.975615:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ac2d lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xe3:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607181 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191342.975629:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ac2d lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xe3:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607181 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.975640:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 8 res 8589935621/227 (0 0) 00000080:00200000:0.0:1787191342.975646:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000405:0xe3:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787191342.975707:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe3:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:0.0:1787191342.975713:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe3:0x0](ffff936b489aec08) for lock 0xe5129dc88483ac2d 00000080:00010000:0.0:1787191342.975720:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ac2d from it ffffa3fb41cabbf0 00010000:00010000:0.0:1787191342.975724:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ac2d lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xe3:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607181 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.975734:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ac2d lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xe3:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607181 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000002:00100000:0.0:1787191342.975762:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477480 x1874004626812800/t8589937149(8589937149) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191342.975853:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xe3:0x0], intent: getxattr flags 0 00010000:00010000:0.0:1787191342.975895:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adee00/0xe5129dc88483ac3b lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.975903:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adee00/0xe5129dc88483ac3b lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191342.976093:0:57956:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57956:1874004626813056:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191342.976103:0:57956:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ac34 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.976111:0:57956:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ac34 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.976117:0:57956:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ac34 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.976123:0:57956:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ac34 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.976130:0:57956:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ac34 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.976137:0:57956:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b413ffc00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191342.976141:0:57956:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ac34 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.976148:0:57956:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ac34 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.976154:0:57956:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ac34 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.976161:0:57956:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191342.976166:0:57956:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ac34 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.976170:0:57956:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ac34 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57956 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191342.976184:0:57956:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b6a476d80 x1874004626813056/t8589937150(8589937150) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191342.976193:0:57956:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a476d80 x1874004626813056/t8589937150(8589937150) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191342.976202:0:57956:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191342.976227:0:57956:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xe3:0x0](ffff936b489aec08): rc = 0 00000080:00010000:1.0:1787191342.976232:0:57956:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe3:0x0](ffff936b489aec08) for lock 0x0 00000080:00200008:1.0:1787191342.976248:0:57956:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe3:0x0](ffff936b489aec08), flags 154402 00000002:00100000:1.0:1787191342.976261:0:57956:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a476d80 x1874004626813056/t8589937150(8589937150) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191342.976278:0:57956:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a476d80 x1874004626813056/t8589937150(8589937150) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191342.976285:0:57956:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191342.976288:0:57956:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453aad80 x1874004626813440/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191342.976302:0:57956:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57956:1874004626813440:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191342.976356:0:57956:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893000 going to sleep for 11 seconds 00010000:00010000:0.0:1787191342.976521:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adee00/0xe5129dc88483ac3b lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.976535:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626813184:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191342.976573:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191342.978160:0:57956:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57956:1874004626813440:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191342.978184:0:57956:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a476d80 x1874004626813056/t8589937150(8589937150) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191342.978247:0:57956:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe3:0x0](ffff936b489aec08), inode mode 81a4 mask 46 00000080:00200080:1.0:1787191342.978322:0:57956:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe3:0x0](ffff936b489aec08) cmd=800466af arg=7ffc426a683c 00000080:00200080:1.0:1787191342.978334:0:57956:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe3:0x0](ffff936b489aec08) cmd=80086601 arg=7ffc426a67d8 00000100:00100000:1.0:1787191342.978359:0:57956:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57956:1874004626813568:192.168.202.101@tcp:33:lfs.0 00000100:00100000:1.0:1787191342.978401:0:57956:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893000 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.979343:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626813184:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191342.979361:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adee00/0xe5129dc88483ac3b lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46071ab expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.979377:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adee00/0xe5129dc88483ac3b lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46071ab expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.979459:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adee00/0xe5129dc88483ac3b lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46071ab expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.979475:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b6a474e00 x1874004626813184/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191342.979484:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adee00/0xe5129dc88483ac3b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46071ab expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.979494:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/227 (0 0) 00000080:00200000:0.0:1787191342.979499:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xe3:0x0] suppgids 0 -1: rc 0 00000080:00010000:0.0:1787191342.979520:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe3:0x0](ffff936b489aec08) for lock 0xe5129dc88483ac3b 00000080:00010000:0.0:1787191342.979527:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ac3b from it ffffa3fb41caba38 00010000:00010000:0.0:1787191342.979531:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adee00/0xe5129dc88483ac3b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46071ab expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.979541:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adee00/0xe5129dc88483ac3b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46071ab expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:0.0:1787191342.979573:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xe3:0x0](ffff936b489aec08) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191342.000000000, mtime 1787191342.000000000, ctime 1787191342.000000000 00010000:00010000:0.0:1787191342.979599:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ac2d lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xe3:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4607181 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191342.979620:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe3:0x0]: losing layout lock 00010000:00010000:0.0:1787191342.979653:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ac2d lrc: 1/0,0 mode: --/CW res: [0x200000405:0xe3:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607181 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.979665:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191342.979668:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ac2d lrc: 0/0,0 mode: --/CW res: [0x200000405:0xe3:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607181 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1787191342.979689:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1787191342.979696:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474e00 x1874004626813824/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787191342.979713:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626813824:192.168.202.101@tcp:36:bash.0 00000100:00100000:1.0:1787191342.980140:0:57956:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57956:1874004626813568:192.168.202.101@tcp:33:lfs.0 00000080:00200080:1.0:1787191342.980166:0:57956:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe3:0x0](ffff936b489aec08) cmd=c00c66f3 arg=7ffc426a67c4 00000100:00100000:0.0:1787191342.980271:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000080:00200008:1.0:1787191342.980373:0:57956:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe3:0x0](ffff936b489aec08), flags 154002 00000100:00100000:0.0:1787191342.983506:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626813824:192.168.202.101@tcp:36:bash.0 00000080:00200000:0.0:1787191342.983549:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:0.0:1787191342.983557:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe3:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00010000:00010000:0.0:1787191342.983571:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/227 (0 0) 00000080:00010000:0.0:1787191342.983578:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xe3:0x0](ffff936b489aec08) 00000002:00010000:0.0:1787191342.984064:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe3:0x0]) in obj [0x200000405:0xe3:0x0], intent: layout flags 0 00010000:00010000:0.0:1787191342.984108:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ac42 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.984118:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ac42 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.984128:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ac42 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.984148:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626813952:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191342.984220:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191342.985993:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626813952:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191342.986028:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ac42 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46071b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.986043:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ac42 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46071b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191342.986056:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b6a475880 x1874004626813952/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191342.986067:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ac42 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46071b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191342.986077:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ac42 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46071b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.986086:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/227 (0 0) 00000080:00200000:0.0:1787191342.986091:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xe3:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191342.986109:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe3:0x0](ffff936b489aec08) for lock 0xe5129dc88483ac42 00000080:00010000:0.0:1787191342.986117:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ac42 from it ffffa3fb41cab8c8 00010000:00010000:0.0:1787191342.986121:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ac42 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46071b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.986131:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ac42 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46071b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.986153:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ac42 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46071b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.986168:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ac42 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46071b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1787191342.986176:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xe3:0x0](0000000089b06177) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ac42 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46071b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191342.986217:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe3:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:0.0:1787191342.986223:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ac42 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46071b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191342.986231:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ac42 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46071b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:0.0:1787191342.986247:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xe3:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:0.0:1787191342.986254:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe3:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191342.986257:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xe3:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:0.0:1787191342.986263:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xe3:0x0](ffff936b489aec08) 00000002:00010000:0.0:1787191342.986272:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe3:0x0]) in obj [0x200000405:0xe3:0x0], intent: layout flags 02 00010000:00010000:0.0:1787191342.986285:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ac42 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46071b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191342.986297:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe3:0x0]: losing layout lock 00010000:00010000:0.0:1787191342.986324:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ac42 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46071b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191342.986331:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191342.986334:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ac42 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46071b9 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191342.986354:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483ac49 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xe3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191342.986361:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483ac49 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xe3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191342.986371:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191342.986378:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475880 x1874004626814208/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191342.986387:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483ac49 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xe3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191342.986534:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626814208:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191342.986597:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000080:00200000:2.0:1787191342.992962:0:57957:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191342.992993:0:57957:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191342.993018:0:57957:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.993036:0:57957:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.993045:0:57957:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191342.993051:0:57957:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191342.993055:0:57957:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191342.993063:0:57957:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421abbf8 00010000:00010000:2.0:1787191342.993066:0:57957:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191342.993075:0:57957:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191342.993091:0:57957:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.993111:0:57957:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191342.993117:0:57957:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191342.993130:0:57957:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b494a5b00, open_flags d900, mode 0 opened 0 00000080:00200000:2.0:1787191342.993137:0:57957:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:2.0:1787191342.993152:0:57957:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:2.0:1787191342.994266:0:57957:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ac50 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57957 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.994278:0:57957:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ac50 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57957 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191342.994290:0:57957:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:2.0:1787191342.994303:0:57957:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb480 x1874004626814464/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191342.994312:0:57957:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ac50 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57957 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191342.994335:0:57957:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57957:1874004626814464:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191342.994497:0:57957:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f300 going to sleep for 11 seconds 00000100:00100000:3.0:1787191342.994737:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191342.994883:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191342.994906:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191342.994928:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191342.994964:0:40922:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787191342.994976:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634930560 00000100:00100000:3.0:1787191342.994983:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634930560 00000100:00100000:1.0:1787191342.995017:0:40920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634931328 00000100:00100000:1.0:1787191342.995022:0:40920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634931328 00000100:00100000:3.0:1787191342.995024:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634930688 00000100:00100000:3.0:1787191342.995026:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634930688 00000100:00100000:3.0:1787191342.995034:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634931200 00000100:00100000:3.0:1787191342.995036:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634931200 00000100:00100000:3.0:1787191342.995049:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1471 00000100:00100000:1.0:1787191342.995051:0:40920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 40 00000100:00100000:3.0:1787191342.995057:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+5:29543:x1874004634930560:12345-192.168.202.101@tcp:104: 00000100:00100000:1.0:1787191342.995058:0:40920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+5:8720:x1874004634931328:12345-192.168.202.101@tcp:104: 00010000:00010000:1.0:1787191342.995071:0:40920:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483ab7e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4606f6d expref: -99 pid: 57950 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191342.995071:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483ab85 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4606f74 expref: -99 pid: 57950 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.995119:0:40920:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787191342.995125:0:40920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+5:8720:x1874004634931328:12345-192.168.202.101@tcp:104: Request processed in 68us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787191342.995133:0:40920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 40 00010000:00010000:1.0:1787191342.995154:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191342.995159:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483ab7e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4606f6d expref: -99 pid: 57950 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.995172:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030800 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191342.995177:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483ab7e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e4606f6d expref: -99 pid: 57950 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.995215:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483ab7e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4606f6d expref: -99 pid: 57950 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.995222:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191342.995241:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483ab7e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4606f6d expref: -99 pid: 57950 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.995248:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483ab7e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4606f6d expref: -99 pid: 57950 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191342.995266:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191342.995268:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191342.995270:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191342.995281:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626814592:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191342.995714:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1472 00000100:00100000:2.0:1787191342.995724:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+5:37089:x1874004634930688:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191342.995733:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000030000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191342.996346:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191342.996355:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+5:29543:x1874004634930560:12345-192.168.202.101@tcp:104: Request processed in 1297us (1617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191342.996362:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1471 00000100:00100000:3.0:1787191342.996381:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1473 00000100:00100000:3.0:1787191342.996388:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b4121d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8422:x1874004634931200:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191342.996406:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483abd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4607054 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191342.996442:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787191342.996448:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b4121d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8422:x1874004634931200:12345-192.168.202.101@tcp:104: Request processed in 61us (1541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191342.996454:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1473 00010000:00010000:3.0:1787191342.996473:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787191342.996478:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483ab85 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4606f74 expref: -99 pid: 57950 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191342.996486:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40031a00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191342.996492:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483ab85 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e4606f74 expref: -99 pid: 57950 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191342.996521:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483ab85 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4606f74 expref: -99 pid: 57950 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191342.996529:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191342.996545:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483ab85 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4606f74 expref: -99 pid: 57950 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191342.996554:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000051dba75c/0xe5129dc88483ab85 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4606f74 expref: -99 pid: 57950 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191342.996573:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191342.996576:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483abd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4607054 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191342.996582:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b4801e600 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191342.996586:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483abd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4607054 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191342.996618:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483abd2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4607054 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191342.996625:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191342.996630:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483abd2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4607054 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191342.996637:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483abd2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4607054 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191342.996648:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191342.996650:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191342.996651:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191342.996658:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191342.996669:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626814720:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191342.996709:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787191342.996716:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626814848:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787191342.997127:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191342.997134:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:37089:x1874004634930688:12345-192.168.202.101@tcp:104: Request processed in 1412us (2251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191342.997142:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1472 00010000:00010000:1.0:1787191342.997148:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191342.997154:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000030000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191342.997162:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b4801f000 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191342.997166:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428400030000 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191342.997190:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191342.997197:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191342.997209:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191342.997217:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000092d58d0/0xe5129dc88483abc4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e4607031 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191342.997231:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191342.997233:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191342.997235:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191342.997242:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787191342.997250:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626814976:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191342.997936:0:57570:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589937154 gen 1 00000100:00100000:2.0:1787191342.998027:0:57570:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b6a477480 x1874004626812800/t8589937149(8589937149) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787191342.998050:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626814208:192.168.202.101@tcp:101:bash.0 00010000:00010000:2.0:1787191342.998065:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483ac49 lrc: 4/0,1 mode: --/EX res: [0x200000405:0xe3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46071c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.998074:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483ac49 lrc: 4/0,1 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46071c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.998086:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483ac49 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46071c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.998106:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483ac49 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46071c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.998119:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483ac49 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46071c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.998128:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483ac49 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46071c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.998136:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483ac49 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46071c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191342.998149:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b6a475880 x1874004626814208/t8589937154(8589937154) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191342.998168:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483ac49 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46071c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191342.998192:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483ac49 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46071c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.998201:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/227 (0 0) 00000080:00200000:2.0:1787191342.998206:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xe3:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1787191342.998220:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe3:0x0](ffff936b489aec08) for lock 0xe5129dc88483ac49 00000080:00010000:2.0:1787191342.998227:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ac49 from it ffffa3fb41cab930 00010000:00010000:2.0:1787191342.998230:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483ac49 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46071c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.998239:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483ac49 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46071c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191342.998252:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:2.0:1787191342.998258:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe3:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:2.0:1787191342.998270:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483ac49 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46071c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.998279:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483ac49 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46071c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:2.0:1787191342.998286:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xe3:0x0](0000000089b06177) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483ac49 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46071c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.998319:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483ac49 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46071c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191342.998331:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483ac49 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46071c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191342.998342:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe3:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191342.998350:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe3:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191342.998352:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191342.998358:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:2.0:1787191342.998386:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe3:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:2.0:1787191342.998395:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483ac49 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46071c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191342.998403:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483ac49 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46071c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:2.0:1787191342.998411:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xe3:0x0](0000000089b06177) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483ac49 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46071c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191342.998428:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe3:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191342.998433:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe3:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191342.998435:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191342.998438:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:2.0:1787191342.998449:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe3:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:2.0:1787191342.998478:0:57570:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483ac1f lrc: 1/0,0 mode: PR/PR res: [0x280000401:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460715e expref: -99 pid: 57956 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000008:00010000:2.0:1787191342.998495:0:57570:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ac26 lrc: 1/0,0 mode: PR/PR res: [0x2c0000401:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607165 expref: -99 pid: 57956 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191342.998552:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe3:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:2.0:1787191342.998557:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483ac49 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46071c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191342.998963:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483ac49 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46071c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00020000:00200000:2.0:1787191342.998978:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xe3:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:2.0:1787191342.998982:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe3:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191342.998985:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191342.998991:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191342.999001:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191342.999004:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:2.0:1787191342.999026:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:2.0:1787191342.999030:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b5338ff30, osc lock ffff936b44e63b50, flags 0x80000000 00000008:00010000:2.0:1787191342.999034:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:2.0:1787191342.999036:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b5338ff70, osc lock ffff936b44e63c80, flags 0x80000000 00010000:00010000:2.0:1787191342.999076:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.999086:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191342.999704:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191342.999727:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626815104:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191342.999732:0:57957:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57957:1874004626814464:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191342.999746:0:57957:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ac50 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46071ff expref: -99 pid: 57957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.999762:0:57957:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ac50 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46071ff expref: -99 pid: 57957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.999769:0:57957:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ac50 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46071ff expref: -99 pid: 57957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.999782:0:57957:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ac50 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46071ff expref: -99 pid: 57957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191342.999790:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f0c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787191342.999791:0:57957:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ac50 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46071ff expref: -99 pid: 57957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.999801:0:57957:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ac50 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46071ff expref: -99 pid: 57957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.999808:0:57957:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ac50 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46071ff expref: -99 pid: 57957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.999815:0:57957:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ac50 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46071ff expref: -99 pid: 57957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191342.999826:0:57957:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b513bb480 x1874004626814464/t8589937155(8589937155) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191342.999860:0:57957:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bb480 x1874004626814464/t8589937155(8589937155) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191342.999873:0:57957:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ac50 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46071ff expref: -99 pid: 57957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191342.999885:0:57957:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ac50 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46071ff expref: -99 pid: 57957 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191342.999893:0:57957:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/227 (0 0) 00000080:00200000:1.0:1787191342.999899:0:57957:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191342.999948:0:57957:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xe3:0x0](ffff936b489aec08): rc = 0 00000080:00200000:1.0:1787191342.999961:0:57957:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe3:0x0]: layout version change: 4 -> 4 00000080:00010000:1.0:1787191342.999967:0:57957:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe3:0x0](ffff936b489aec08) for lock 0xe5129dc88483ac50 00000080:00010000:1.0:1787191342.999980:0:57957:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe3:0x0](ffff936b489aec08) 00000080:00200008:1.0:1787191342.999993:0:57957:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe3:0x0](ffff936b489aec08), flags 154400 00000002:00100000:1.0:1787191343.000024:0:57957:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bb480 x1874004626814464/t8589937155(8589937155) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191343.000066:0:57957:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ac50 from it ffff936b60dc45a0 00010000:00010000:1.0:1787191343.000071:0:57957:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ac50 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46071ff expref: -99 pid: 57957 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.000079:0:57957:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ac50 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46071ff expref: -99 pid: 57957 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191343.000099:0:57957:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe3:0x0](ffff936b489aec08), inode mode 81a4 mask 44 00000080:00200000:1.0:1787191343.000197:0:57957:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe3:0x0](ffff936b489aec08), inode mode 81a4 mask 4 00000080:00200000:1.0:1787191343.000205:0:57957:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xe3:0x0](ffff936b489aec08), xattr lov 00000080:00200008:1.0:1787191343.000230:0:57957:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe3:0x0](ffff936b489aec08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191343.000237:0:57957:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe3:0x0](ffff936b489aec08),name=f70.sanity-flr 00000002:00010000:1.0:1787191343.000255:0:57957:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe3:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.000264:0:57957:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ac50 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46071ff expref: -99 pid: 57957 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.000274:0:57957:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ac50 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46071ff expref: -99 pid: 57957 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191343.000286:0:57957:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191343.000291:0:57957:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe3:0x0](ffff936b489aec08) 00000080:00010000:1.0:1787191343.000294:0:57957:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe3:0x0](ffff936b489aec08) for lock 0xe5129dc88483ac50 00000080:00010000:1.0:1787191343.000298:0:57957:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ac50 from it ffffa3fb421abcd8 00010000:00010000:1.0:1787191343.000301:0:57957:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ac50 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46071ff expref: -99 pid: 57957 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.000308:0:57957:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ac50 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46071ff expref: -99 pid: 57957 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191343.000325:0:57957:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe3:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00020000:00200000:1.0:1787191343.000333:0:57957:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe3:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191343.000336:0:57957:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191343.000339:0:57957:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe3:0x0] 00000008:00010000:1.0:1787191343.000352:0:57957:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191343.000355:0:57957:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b44ca8230, osc lock ffff936b46836850, flags 0x400000400001002 00010000:00010000:1.0:1787191343.000365:0:57957:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b52373000 type 11 mode 6 res 11811161089/477 (0 1048575) 00010000:00010000:1.0:1787191343.000388:0:57957:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483ac5e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57957 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.000396:0:57957:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483ac5e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57957 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.000406:0:57957:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b453aa300 x1874004626815232/t0(0) o101->lustre-OST0001-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:1.0:1787191343.000433:0:57957:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:1.0:1787191343.000451:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626815232:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191343.001716:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626814720:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191343.003026:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626814848:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191343.003759:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626814976:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191343.003770:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626814592:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191343.003778:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626815104:192.168.202.101@tcp:101:bash.0 00010000:00010000:2.0:1787191343.003796:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.003814:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.003826:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.004202:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1787191343.004213:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.004224:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.004231:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.004335:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000003a1344c/0xe5129dc88483ac65 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.004348:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000003a1344c/0xe5129dc88483ac65 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.004356:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000003a1344c/0xe5129dc88483ac65 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191343.004374:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626815360:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191343.004464:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191343.006008:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191343.006386:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634931584 00000100:00100000:3.0:1787191343.006402:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634931584 00000100:00100000:3.0:1787191343.006446:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1474 00000100:00100000:3.0:1787191343.006454:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8419:x1874004634931584:12345-192.168.202.101@tcp:106: 00010000:00010000:3.0:1787191343.006468:0:40922:0:(ldlm_lockd.c:2541:ldlm_callback_handler()) ### glimpse ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.006479:0:40922:0:(ldlm_lockd.c:2123:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00010000:3.0:1787191343.006502:0:40922:0:(cl_object.c:322:cl_object_glimpse()) header@000000004c0dc2bd[0x110, 1, [0x200000405:0xe3:0x0] hash] 00000020:00010000:3.0:1787191343.006504:0:40922:0:(cl_object.c:322:cl_object_glimpse()) size: 0 mtime: 1787191342 atime: 1787191342 ctime: 1787191342 blocks: 0 00000020:00010000:3.0:1787191343.006508:0:40922:0:(cl_object.c:322:cl_object_glimpse()) header@0000000062726c49[0x110, 2, [0x2c0000401:0x1dd:0x0] hash] 00000020:00010000:3.0:1787191343.006510:0:40922:0:(cl_object.c:322:cl_object_glimpse()) size: 0 mtime: 1787191342 atime: 1787191342 ctime: 1787191342 blocks: 0 00000100:00100000:3.0:1787191343.006548:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8419:x1874004634931584:12345-192.168.202.101@tcp:106: Request processed in 95us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191343.006555:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1474 00010000:00010000:1.0:1787191343.009634:0:2390:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483ac5e lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57957 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.009657:0:2390:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483ac5e lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57957 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.009670:0:2390:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483ac5e lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 57957 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.009678:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483ac5e lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 57957 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.009686:0:2390:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483ac5e lrc: 5/1,0 mode: --/PR res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 57957 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191343.009700:0:2390:0:(osc_lock.c:187:osc_lock_lvb_update()) ### no dlm lock: acquired size 0, setting rss=0; leaving kms=0, end=18446744073709551615 00000020:00200000:1.0:1787191343.009706:0:2390:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000100:00100000:2.0:1787191343.009716:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626815360:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191343.009727:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483ac5e lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 57957 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.009733:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000003a1344c/0xe5129dc88483ac65 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e460721b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.009735:0:2390:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483ac5e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 57957 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.009746:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000003a1344c/0xe5129dc88483ac65 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e460721b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.009749:0:2390:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483ac5e lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 57957 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.009756:0:2390:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b4801f200 already unused, calling callback (ffffffffc1208790) 00010000:00010000:2.0:1787191343.009758:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000003a1344c/0xe5129dc88483ac65 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e460721b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.009761:0:2390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483ac5e lrc: 5/0,0 mode: --/PR res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 57957 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.009767:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000003a1344c/0xe5129dc88483ac65 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e460721b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.009771:0:2390:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191343.009777:0:2390:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483ac5e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 57957 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.009785:0:2390:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483ac5e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 57957 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1787191343.009786:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000003a1344c/0xe5129dc88483ac65 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e460721b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.009801:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000003a1344c/0xe5129dc88483ac65 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460721b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.009802:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626815232:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191343.009808:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000003a1344c/0xe5129dc88483ac65 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460721b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1787191343.009937:0:57957:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe3:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1787191343.009944:0:57957:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51656bf0 (ffff936b465cccf8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191343.009947:0:57957:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51656bf0 (ffff936b465cccf8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191343.009953:0:57957:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b44ca8230 (ffff936b465cc5a8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191343.009956:0:57957:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51656bf0 (ffff936b465cccf8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191343.009959:0:57957:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b44ca8230 (ffff936b465cccf8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191343.009970:0:57957:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe3:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191343.010050:0:57957:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe3:0x0](ffff936b489aec08), flags 154000 00000002:00100000:3.0:1787191343.010092:0:57957:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513bb480 x1874004626814464/t8589937155(8589937155) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191343.010104:0:57957:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191343.010109:0:57957:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1c380 x1874004626815744/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191343.010118:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626815488:192.168.202.101@tcp:10:bash.0 00000100:00100000:3.0:1787191343.010132:0:57957:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57957:1874004626815744:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191343.010179:0:57957:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c240 going to sleep for 11 seconds 00000100:00100000:2.0:1787191343.010215:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787191343.010223:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626815872:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191343.012489:0:57957:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57957:1874004626815744:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191343.012524:0:57957:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513bb480 x1874004626814464/t8589937155(8589937155) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191343.012764:0:57957:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191343.012782:0:57957:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.012798:0:57957:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.012811:0:57957:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.012820:0:57957:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191343.012826:0:57957:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191343.012829:0:57957:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191343.012859:0:57957:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421abb58 00010000:00010000:1.0:1787191343.012865:0:57957:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.012874:0:57957:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.012890:0:57957:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191343.012897:0:57957:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191343.012902:0:57957:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191343.012906:0:57957:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=9 00000080:00200008:1.0:1787191343.012927:0:57957:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe3:0x0](ffff936b489aec08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191343.012933:0:57957:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe3:0x0](ffff936b489aec08),name=f70.sanity-flr 00000002:00010000:1.0:1787191343.012946:0:57957:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe3:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.012953:0:57957:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ac50 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46071ff expref: -99 pid: 57957 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191343.012963:0:57957:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ac50 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46071ff expref: -99 pid: 57957 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191343.012967:0:57957:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191343.012971:0:57957:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe3:0x0](ffff936b489aec08) 00000080:00010000:1.0:1787191343.012972:0:57957:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe3:0x0](ffff936b489aec08) for lock 0xe5129dc88483ac50 00000080:00010000:1.0:1787191343.012976:0:57957:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ac50 from it ffffa3fb421abcb8 00010000:00010000:1.0:1787191343.012978:0:57957:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ac50 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46071ff expref: -99 pid: 57957 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191343.012983:0:57957:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ac50 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46071ff expref: -99 pid: 57957 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191343.012999:0:57957:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe3:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:1.0:1787191343.013007:0:57957:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe3:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191343.013021:0:57957:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191343.013024:0:57957:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe3:0x0] 00000008:00010000:1.0:1787191343.013040:0:57957:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191343.013042:0:57957:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b44ca8430, osc lock ffff936b46836720, flags 0x400000400001002 00010000:00010000:1.0:1787191343.013054:0:57957:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.013062:0:57957:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1787191343.013071:0:57957:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191343.013074:0:57957:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 7/0,2 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.013079:0:57957:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1787191343.013083:0:57957:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191343.013091:0:57957:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe3:0x0] updating i_size 0 i_blocks 0 00000020:00010000:1.0:1787191343.013094:0:57957:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b516572e0 (ffff936b465ccab8/0) at cl_lock_release():245 00000020:00010000:1.0:1787191343.013096:0:57957:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b516572e0 (ffff936b465ccab8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.013097:0:57957:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b44ca8430 (ffff936b47a172d8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.013100:0:57957:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b516572e0 (ffff936b465ccab8/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191343.013110:0:57957:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b44ca8430 (ffff936b465ccab8/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191343.013116:0:57957:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe3:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191343.013135:0:57957:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191343.013140:0:57957:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.013144:0:57957:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.013149:0:57957:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.013153:0:57957:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191343.013156:0:57957:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191343.013157:0:57957:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191343.013159:0:57957:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb421abbf8 00010000:00010000:1.0:1787191343.013162:0:57957:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.013166:0:57957:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.013171:0:57957:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191343.013174:0:57957:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191343.013176:0:57957:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191343.013185:0:57957:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:1.0:1787191343.013188:0:57957:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe3:0x0](ffff936b489aec08), inode mode 81a4 mask 46 00000080:00200008:1.0:1787191343.013195:0:57957:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe3:0x0](ffff936b489aec08), flags 154402 00000080:00200000:1.0:1787191343.013261:0:57957:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe3:0x0](ffff936b489aec08), inode mode 81a4 mask 4 00000080:00200000:1.0:1787191343.013267:0:57957:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xe3:0x0](ffff936b489aec08), xattr lov 00000080:00200008:1.0:1787191343.013286:0:57957:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe3:0x0](ffff936b489aec08), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191343.013289:0:57957:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe3:0x0](ffff936b489aec08),name=f70.sanity-flr 00000002:00010000:1.0:1787191343.013296:0:57957:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe3:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.013300:0:57957:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ac50 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46071ff expref: -99 pid: 57957 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191343.013306:0:57957:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ac50 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46071ff expref: -99 pid: 57957 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191343.013310:0:57957:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191343.013313:0:57957:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe3:0x0](ffff936b489aec08) 00000080:00010000:1.0:1787191343.013314:0:57957:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe3:0x0](ffff936b489aec08) for lock 0xe5129dc88483ac50 00000080:00010000:1.0:1787191343.013317:0:57957:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ac50 from it ffffa3fb421abcd8 00010000:00010000:1.0:1787191343.013319:0:57957:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ac50 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46071ff expref: -99 pid: 57957 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191343.013323:0:57957:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ac50 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46071ff expref: -99 pid: 57957 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1787191343.013330:0:57957:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe3:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:1.0:1787191343.013334:0:57957:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe3:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191343.013335:0:57957:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191343.013337:0:57957:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe3:0x0] 00000008:00010000:1.0:1787191343.013342:0:57957:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191343.013343:0:57957:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b44ca8430, osc lock ffff936b46836720, flags 0x400000400001002 00010000:00010000:1.0:1787191343.013348:0:57957:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.013354:0:57957:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1787191343.013359:0:57957:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191343.013361:0:57957:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 7/0,2 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.013366:0:57957:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1787191343.013370:0:57957:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191343.013372:0:57957:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe3:0x0] updating i_size 0 i_blocks 0 00000020:00010000:1.0:1787191343.013374:0:57957:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b516572e0 (ffff936b465ccab8/0) at cl_lock_release():245 00000020:00010000:1.0:1787191343.013375:0:57957:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b516572e0 (ffff936b465ccab8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.013377:0:57957:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b44ca8430 (ffff936b47a172d8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.013378:0:57957:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b516572e0 (ffff936b465ccab8/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191343.013380:0:57957:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b44ca8430 (ffff936b465ccab8/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191343.013383:0:57957:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe3:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200080:1.0:1787191343.013443:0:57957:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe3:0x0](ffff936b489aec08) cmd=c00c66f3 arg=13af2e0 00000080:00200008:1.0:1787191343.013531:0:57957:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe3:0x0](ffff936b489aec08), flags 154002 00000100:00100000:2.0:1787191343.014170:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626815872:192.168.202.101@tcp:10:bash.0 00000100:00100000:2.0:1787191343.014201:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626815488:192.168.202.101@tcp:10:bash.0 00000080:00200000:0.0:1787191343.014278:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe3:0x0] updating i_size 0 i_blocks 0 00000020:00010000:0.0:1787191343.014284:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b497c9f38 (ffff936b465cc2d8/0) at cl_lock_release():245 00000020:00010000:0.0:1787191343.014287:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b497c9f38 (ffff936b465cc2d8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191343.014291:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b5338ff30 (ffff936b465ccf38/1) at cl_lock_cancel():142 00010000:00010000:0.0:1787191343.014297:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.014308:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:0.0:1787191343.014320:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b5338ff70 (ffff936b465cca28/1) at cl_lock_cancel():142 00010000:00010000:0.0:1787191343.014324:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000003a1344c/0xe5129dc88483ac65 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460721b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.014332:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000003a1344c/0xe5129dc88483ac65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460721b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:0.0:1787191343.014340:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b497c9f38 (ffff936b465cc2d8/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191343.014343:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b5338ff30 (ffff936b465cc2d8/1) at cl_lock_fini():72 00000020:00010000:0.0:1787191343.014346:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b5338ff70 (ffff936b465cc2d8/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191343.014360:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe3:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1787191343.014371:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xe3:0x0](ffff936b489aec08) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191342.000000000, mtime 1787191342.000000000, ctime 1787191342.000000000, rc 0 00000080:00200008:0.0:1787191343.014450:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xe3:0x0], ppos: 0, count: 5 00000080:00200000:0.0:1787191343.014463:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:0.0:1787191343.014468:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:0.0:1787191343.014473:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:0.0:1787191343.014482:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:0.0:1787191343.014488:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@000000004c0dc2bd[0x110, 1, [0x200000405:0xe3:0x0] hash] 00000020:00200000:0.0:1787191343.014490:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:0.0:1787191343.014493:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe3:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:0.0:1787191343.014504:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xe3:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:0.0:1787191343.014507:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe3:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191343.014510:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:0.0:1787191343.014513:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:0.0:1787191343.014520:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:0.0:1787191343.014523:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1787191343.014535:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:0.0:1787191343.014546:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:0.0:1787191343.014550:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee65b0, osc lock ffff936b50b62d10, flags 0x0 00010000:00010000:0.0:1787191343.014562:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.014577:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.014598:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.014606:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.014612:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191343.014623:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:0.0:1787191343.014631:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:0.0:1787191343.014702:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:0.0:1787191343.014709:0:57570:0:(rw26.c:927:ll_write_end()) page@00000000d042e8de[3 0000000030159242 2 1 0000000053a99842 0 0 0] 00000080:00200000:0.0:1787191343.014712:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @000000003e2d7897 17ffffc0001021 2:0 ffff936b522c40e0 0 lru 00000080:00200000:0.0:1787191343.014720:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@00000000ebe22f7f 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000ef00a996 0000000079fea6e5 > 3< 0 0 > 4< 0 0 8 484610048 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1787191343.014722:0:57570:0:(rw26.c:927:ll_write_end()) end page@00000000d042e8de 00000080:00200000:0.0:1787191343.014723:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:0.0:1787191343.014727:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:0.0:1787191343.014746:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 000000001511735c ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191343.014764:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b489aedb8, count 1, dirtied 1 00000080:00200000:0.0:1787191343.014767:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:0.0:1787191343.014782:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:0.0:1787191343.014795:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b497c9f38 (ffff936b465cc2d8/0) at cl_lock_release():245 00000020:00010000:0.0:1787191343.014797:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b497c9f38 (ffff936b465cc2d8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191343.014800:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee65b0 (ffff936b465cca28/1) at cl_lock_cancel():142 00010000:00010000:0.0:1787191343.014804:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.014812:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:0.0:1787191343.014821:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b497c9f38 (ffff936b465cc2d8/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191343.014823:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee65b0 (ffff936b465cc2d8/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191343.014847:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:0.0:1787191343.014852:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:0.0:1787191343.014857:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe3:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191343.014860:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:0.0:1787191343.014866:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe3:0x0] updating i_size 5 i_blocks 0 00000080:00200000:0.0:1787191343.014880:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:0.0:1787191343.014892:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe3:0x0](ffff936b489aec08), flags 100001 00000002:00100000:0.0:1787191343.014947:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a477480 x1874004626812800/t8589937149(8589937149) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191343.014958:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191343.014962:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477800 x1874004626816128/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191343.014978:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626816128:192.168.202.101@tcp:35:bash.0 00000100:00100000:0.0:1787191343.015058:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99840 going to sleep for 11 seconds 00000100:00100000:2.0:1787191343.019085:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626816128:192.168.202.101@tcp:35:bash.0 00000002:00100000:2.0:1787191343.019117:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a477480 x1874004626812800/t8589937149(8589937149) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191358 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191343.022223:0:57958:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191343.022253:0:57958:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.022271:0:57958:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.022289:0:57958:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.022297:0:57958:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191343.022305:0:57958:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191343.022308:0:57958:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191343.022316:0:57958:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4231bbf8 00010000:00010000:0.0:1787191343.022320:0:57958:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.022329:0:57958:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.022344:0:57958:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.022351:0:57958:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191343.022356:0:57958:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.022360:0:57958:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:0.0:1787191343.022363:0:57958:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe3:0x0](ffff936b489aec08), inode mode 81a4 mask 44 00000080:00200008:0.0:1787191343.022368:0:57958:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe3:0x0](ffff936b489aec08), flags 154400 00000002:00010000:0.0:1787191343.022381:0:57958:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe3:0x0]) in obj [0x200000405:0xe3:0x0], intent: open flags 0104240114401 00010000:00010000:0.0:1787191343.022426:0:57958:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ac6c lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.022435:0:57958:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ac6c lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57958 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191343.022450:0:57958:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191343.022463:0:57958:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474a80 x1874004626816384/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191343.022473:0:57958:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ac6c lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.022492:0:57958:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57958:1874004626816384:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191343.022788:0:57958:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000080:00200000:2.0:1787191343.023756:0:57959:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191343.023775:0:57959:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191343.023788:0:57959:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.023800:0:57959:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.023812:0:57959:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191343.023819:0:57959:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191343.023822:0:57959:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191343.023828:0:57959:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42323b58 00010000:00010000:2.0:1787191343.024067:0:57959:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.024076:0:57959:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.024089:0:57959:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191343.024096:0:57959:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191343.024100:0:57959:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191343.024104:0:57959:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=8 00000080:00200008:2.0:1787191343.024109:0:57959:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe3:0x0](ffff936b489aec08), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191343.024114:0:57959:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe3:0x0](ffff936b489aec08),name=f70.sanity-flr 00000002:00010000:2.0:1787191343.024127:0:57959:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe3:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191343.024135:0:57959:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ac50 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46071ff expref: -99 pid: 57957 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191343.024144:0:57959:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ac50 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46071ff expref: -99 pid: 57957 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:2.0:1787191343.024151:0:57959:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191343.024155:0:57959:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe3:0x0](ffff936b489aec08) 00000080:00010000:2.0:1787191343.024157:0:57959:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe3:0x0](ffff936b489aec08) for lock 0xe5129dc88483ac50 00000080:00010000:2.0:1787191343.024161:0:57959:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ac50 from it ffffa3fb42323cb8 00010000:00010000:2.0:1787191343.024164:0:57959:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ac50 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46071ff expref: -99 pid: 57957 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191343.024172:0:57959:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ac50 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46071ff expref: -99 pid: 57957 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:2.0:1787191343.024201:0:57959:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe3:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:2.0:1787191343.024212:0:57959:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe3:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191343.024215:0:57959:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191343.024218:0:57959:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe3:0x0] 00000008:00010000:2.0:1787191343.024237:0:57959:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191343.024241:0:57959:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1230, osc lock ffff936b44e62be0, flags 0x400000400001002 00010000:00010000:2.0:1787191343.024257:0:57959:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191343.024268:0:57959:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:2.0:1787191343.024279:0:57959:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191343.024283:0:57959:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191343.024289:0:57959:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:2.0:1787191343.024298:0:57959:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191343.024307:0:57959:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe3:0x0] updating i_size 5 i_blocks 0 00000020:00010000:2.0:1787191343.024314:0:57959:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b47c39030 (ffff936b47a17c68/0) at cl_lock_release():245 00000020:00010000:2.0:1787191343.024316:0:57959:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b47c39030 (ffff936b47a17c68/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191343.024319:0:57959:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1230 (ffff936b465cc518/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191343.024323:0:57959:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b47c39030 (ffff936b47a17c68/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191343.024325:0:57959:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1230 (ffff936b47a17c68/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191343.024335:0:57959:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe3:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191343.024356:0:57959:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191343.024364:0:57959:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191343.024371:0:57959:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.024378:0:57959:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.024384:0:57959:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191343.024388:0:57959:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191343.024391:0:57959:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191343.024394:0:57959:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42323c10 00010000:00010000:2.0:1787191343.024397:0:57959:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.024404:0:57959:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.024413:0:57959:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191343.024417:0:57959:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191343.024420:0:57959:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191343.024426:0:57959:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:2.0:1787191343.024429:0:57959:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:2.0:1787191343.024434:0:57959:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:2.0:1787191343.024452:0:57959:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483ac49 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46071c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191343.024462:0:57959:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe3:0x0]: losing layout lock 00010000:00010000:2.0:1787191343.024472:0:57959:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ac50 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46071ff expref: -99 pid: 57957 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00200000:2.0:1787191343.024476:0:57959:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe3:0x0]: losing layout lock 00010000:00010000:2.0:1787191343.024481:0:57959:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adee00/0xe5129dc88483ac3b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e46071ab expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.024512:0:57959:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483ac49 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46071c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191343.024517:0:57959:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ac50 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46071ff expref: -99 pid: 57957 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1787191343.024521:0:57959:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adee00/0xe5129dc88483ac3b lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46071ab expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.024524:0:57959:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:2.0:1787191343.024526:0:57959:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483ac49 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46071c7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191343.024532:0:57959:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ac50 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46071ff expref: -99 pid: 57957 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1787191343.024537:0:57959:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adee00/0xe5129dc88483ac3b lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46071ab expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:2.0:1787191343.024548:0:57959:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 36, max 7 00000100:00100000:2.0:1787191343.024557:0:57959:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9c00 x1874004626816640/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787191343.024571:0:57959:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57959:1874004626816640:192.168.202.101@tcp:36:rm.0 00000100:00100000:2.0:1787191343.024627:0:57959:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.026282:0:57958:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57958:1874004626816384:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191343.026299:0:57958:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ac6c lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607229 expref: -99 pid: 57958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.026309:0:57958:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ac6c lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607229 expref: -99 pid: 57958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.026316:0:57958:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ac6c lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607229 expref: -99 pid: 57958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.026325:0:57958:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x200002b, status=0 req@ffff936b6a474a80 x1874004626816384/t8589937159(8589937159) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191343.026334:0:57958:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474a80 x1874004626816384/t8589937159(8589937159) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191343.026342:0:57958:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ac6c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607229 expref: -99 pid: 57958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191343.026355:0:57958:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ac6c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607229 expref: -99 pid: 57958 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.026362:0:57958:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/227 (0 0) 00000080:00200000:0.0:1787191343.026366:0:57958:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xe3:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787191343.026414:0:57958:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe3:0x0]: layout version change: 4294967294 -> 4 00000080:00010000:0.0:1787191343.026419:0:57958:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe3:0x0](ffff936b489aec08) for lock 0xe5129dc88483ac6c 00000080:00010000:0.0:1787191343.026424:0:57958:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ac6c from it ffffa3fb4231bbf0 00010000:00010000:0.0:1787191343.026429:0:57958:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ac6c lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607229 expref: -99 pid: 57958 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.026438:0:57958:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ac6c lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607229 expref: -99 pid: 57958 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000002:00100000:0.0:1787191343.026460:0:57958:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474a80 x1874004626816384/t8589937159(8589937159) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191343.026566:0:57958:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe3:0x0](ffff936b489aec08), inode mode 81a4 mask 4 00000080:00200000:0.0:1787191343.026573:0:57958:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xe3:0x0](ffff936b489aec08), xattr lov 00000080:00200008:0.0:1787191343.026605:0:57958:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe3:0x0](ffff936b489aec08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191343.026609:0:57958:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe3:0x0](ffff936b489aec08),name=f70.sanity-flr 00000002:00010000:0.0:1787191343.026618:0:57958:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe3:0x0]) in obj [0x200000405:0xe3:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.026622:0:57958:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 30 res 8589935621/227 (0 0) 00010000:00010000:0.0:1787191343.026649:0:57958:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade400/0xe5129dc88483ac73 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.026654:0:57958:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade400/0xe5129dc88483ac73 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.026660:0:57958:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade400/0xe5129dc88483ac73 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.026672:0:57958:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57958:1874004626816768:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191343.026750:0:57958:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191343.027802:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191343.028037:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634931712 00000100:00100000:2.0:1787191343.028046:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634931712 00000100:00100000:2.0:1787191343.028102:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1475 00000100:00100000:2.0:1787191343.028111:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634931712:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191343.028125:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ac6c lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4607229 expref: -99 pid: 57958 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.028272:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191343.028280:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6506:x1874004634931712:12345-192.168.202.101@tcp:104: Request processed in 170us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191343.028287:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1475 00010000:00010000:1.0:1787191343.028763:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191343.028770:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ac6c lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4607229 expref: -99 pid: 57958 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.028784:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b43adf800 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191343.028789:0:40929:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ac6c lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0xd/0xd rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4607229 expref: -99 pid: 57958 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.028797:0:40929:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ac6c lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0xd/0xd rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4607229 expref: -99 pid: 57958 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.028806:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ac6c lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xe3:0x0].0x0 bits 0xd/0xd rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4607229 expref: -99 pid: 57958 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191343.028826:0:40929:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe3:0x0]: losing layout lock 00010000:00010000:1.0:1787191343.029439:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ac6c lrc: 2/0,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0xd/0xd rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607229 expref: -99 pid: 57958 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.029447:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191343.029480:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ac6c lrc: 1/0,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0xd/0xd rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607229 expref: -99 pid: 57958 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.029489:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ac6c lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0xd/0xd rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607229 expref: -99 pid: 57958 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.029504:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191343.029505:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191343.029507:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626816896:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787191343.029507:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191343.032046:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626816896:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191343.033867:0:57959:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57959:1874004626816640:192.168.202.101@tcp:36:rm.0 00000100:00100000:1.0:1787191343.034354:0:57958:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57958:1874004626816768:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191343.034370:0:57958:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade400/0xe5129dc88483ac73 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607253 expref: -99 pid: 57958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.034404:0:57958:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade400/0xe5129dc88483ac73 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607253 expref: -99 pid: 57958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.034415:0:57958:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade400/0xe5129dc88483ac73 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607253 expref: -99 pid: 57958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.034426:0:57958:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade400/0xe5129dc88483ac73 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607253 expref: -99 pid: 57958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.034438:0:57958:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade400/0xe5129dc88483ac73 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607253 expref: -99 pid: 57958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.034447:0:57958:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade400/0xe5129dc88483ac73 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607253 expref: -99 pid: 57958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.034454:0:57958:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade400/0xe5129dc88483ac73 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607253 expref: -99 pid: 57958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191343.034465:0:57958:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b6a476300 x1874004626816768/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/976 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191343.034475:0:57958:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade400/0xe5129dc88483ac73 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607253 expref: -99 pid: 57958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191343.034487:0:57958:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade400/0xe5129dc88483ac73 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607253 expref: -99 pid: 57958 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.034501:0:57958:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/227 (0 0) 00000080:00200000:1.0:1787191343.034507:0:57958:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xe3:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787191343.034559:0:57958:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe3:0x0]: layout version change: 4294967294 -> 4 00000080:00010000:1.0:1787191343.034564:0:57958:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe3:0x0](ffff936b489aec08) for lock 0xe5129dc88483ac73 00000080:00010000:1.0:1787191343.034570:0:57958:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe3:0x0](ffff936b489aec08) 00000080:00010000:1.0:1787191343.034573:0:57958:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ac73 from it ffffa3fb4231bcd8 00010000:00010000:1.0:1787191343.034577:0:57958:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade400/0xe5129dc88483ac73 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607253 expref: -99 pid: 57958 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.034585:0:57958:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade400/0xe5129dc88483ac73 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607253 expref: -99 pid: 57958 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191343.034616:0:57958:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe3:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:1.0:1787191343.034626:0:57958:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe3:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191343.034630:0:57958:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191343.034633:0:57958:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe3:0x0] 00000008:00010000:1.0:1787191343.034652:0:57958:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191343.034655:0:57958:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b44ca8430, osc lock ffff936b46836720, flags 0x400000400001002 00010000:00010000:1.0:1787191343.034671:0:57958:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191343.034685:0:57958:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:1.0:1787191343.034695:0:57958:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191343.034699:0:57958:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191343.034707:0:57958:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:1.0:1787191343.034716:0:57958:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191343.034724:0:57958:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe3:0x0] updating i_size 5 i_blocks 0 00000020:00010000:1.0:1787191343.034730:0:57958:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b516572e0 (ffff936b465ccab8/0) at cl_lock_release():245 00000020:00010000:1.0:1787191343.034732:0:57958:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b516572e0 (ffff936b465ccab8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.034735:0:57958:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b44ca8430 (ffff936b47a172d8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.034739:0:57958:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b516572e0 (ffff936b465ccab8/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191343.034741:0:57958:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b44ca8430 (ffff936b465ccab8/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191343.034750:0:57958:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe3:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1787191343.034793:0:57958:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe3:0x0](ffff936b489aec08), flags 154000 00000002:00100000:1.0:1787191343.034855:0:57958:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a474a80 x1874004626816384/t8589937159(8589937159) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191343.034866:0:57958:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191343.034872:0:57958:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453aad80 x1874004626817152/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191343.034892:0:57958:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57958:1874004626817152:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191343.034951:0:57958:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893000 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.038901:0:57958:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57958:1874004626817152:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191343.038995:0:57958:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a474a80 x1874004626816384/t8589937159(8589937159) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191343.039049:0:57958:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe3:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00020000:00200000:0.0:1787191343.039060:0:57958:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe3:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191343.039064:0:57958:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191343.039069:0:57958:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191343.039079:0:57958:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000008:00010000:0.0:1787191343.039206:0:57958:0:(osc_cache.c:1183:osc_extent_make_ready()) ### extent: 000000001511735c ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000008:00010000:0.0:1787191343.039233:0:57958:0:(osc_cache.c:917:osc_extent_finish()) ### extent: 000000001511735c ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000008:00010000:0.0:1787191343.039255:0:57958:0:(osc_cache.c:497:__osc_extent_remove()) ### extent: 000000001511735c ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1787191343.039284:0:57958:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe3:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191343.039320:0:57958:0:(llite_lib.c:2066:ll_clear_inode()) VFS Op:inode=[0x200000405:0xe3:0x0](ffff936b489aec08) 00000008:00010000:0.0:1787191343.039346:0:57958:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 5 blocks 0 [cma]time 1787191343 1787191343 1787191342 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 1/0,0 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000008:00010000:0.0:1787191343.039363:0:57958:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191342 1787191342 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000003a1344c/0xe5129dc88483ac65 lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460721b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191343.040157:0:57958:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191343.040176:0:57958:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.040186:0:57958:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.040196:0:57958:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.040202:0:57958:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191343.040208:0:57958:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191343.040210:0:57958:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191343.040216:0:57958:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4231bb58 00010000:00010000:0.0:1787191343.040219:0:57958:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.040228:0:57958:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.040242:0:57958:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.040249:0:57958:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191343.040255:0:57958:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.040266:0:57958:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=9 00000080:00200000:0.0:1787191343.040270:0:57958:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:0.0:1787191343.040282:0:57958:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:0.0:1787191343.040319:0:57958:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483ac7a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.040324:0:57958:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483ac7a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.040331:0:57958:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483ac7a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.040347:0:57958:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57958:1874004626817280:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191343.040421:0:57958:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.042620:0:57958:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57958:1874004626817280:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191343.042637:0:57958:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483ac7a lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.042649:0:57958:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483ac7a lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.042655:0:57958:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483ac7a lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.042661:0:57958:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483ac7a lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.042670:0:57958:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483ac7a lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.042676:0:57958:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b43adf600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191343.042680:0:57958:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483ac7a lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.042687:0:57958:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483ac7a lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.042694:0:57958:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483ac7a lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.042700:0:57958:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191343.042706:0:57958:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483ac7a lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.042712:0:57958:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483ac7a lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57958 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.042732:0:57958:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b6a474a80 x1874004626817280/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191343.042747:0:57958:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191343.050336:0:57960:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191343.050367:0:57960:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191343.050457:0:57960:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.050475:0:57960:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.050484:0:57960:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191343.050494:0:57960:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191343.050498:0:57960:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191343.050506:0:57960:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4232bb58 00010000:00010000:2.0:1787191343.050511:0:57960:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.050520:0:57960:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.050539:0:57960:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191343.050546:0:57960:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:2.0:1787191343.050552:0:57960:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191343.050560:0:57960:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:2.0:1787191343.050564:0:57960:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191343.050577:0:57960:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191343.050627:0:57960:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ac81 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.050636:0:57960:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ac81 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.050646:0:57960:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ac81 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191343.050670:0:57960:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57960:1874004626817408:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191343.050759:0:57960:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f3c0 going to sleep for 11 seconds 00000080:00200000:0.0:1787191343.053066:0:57961:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191343.053094:0:57961:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.053108:0:57961:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.053122:0:57961:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.053130:0:57961:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191343.053138:0:57961:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191343.053141:0:57961:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191343.053148:0:57961:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42333bf8 00010000:00010000:0.0:1787191343.053152:0:57961:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.053161:0:57961:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.053181:0:57961:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.053189:0:57961:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191343.053194:0:57961:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:0.0:1787191343.054904:0:57960:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57960:1874004626817408:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191343.055001:0:57960:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ac81 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.055020:0:57960:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ac81 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.055027:0:57960:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ac81 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.055034:0:57960:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ac81 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.055042:0:57960:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ac81 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.055049:0:57960:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51185800 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191343.055054:0:57960:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ac81 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.055061:0:57960:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ac81 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.055068:0:57960:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ac81 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.055074:0:57960:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191343.055081:0:57960:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ac81 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.055087:0:57960:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185800/0xe5129dc88483ac81 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.055310:0:57960:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513bb800 x1874004626817408/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191343.055326:0:57960:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191343.055453:0:57961:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b4971b500, open_flags d900, mode 0 opened 0 00000080:00200000:3.0:1787191343.055463:0:57961:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:3.0:1787191343.055482:0:57961:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:3.0:1787191343.055534:0:57961:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483ac88 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.055542:0:57961:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483ac88 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57961 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191343.055552:0:57961:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191343.055560:0:57961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1e300 x1874004626817664/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191343.055570:0:57961:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483ac88 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57961 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191343.055604:0:57961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57961:1874004626817664:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191343.055789:0:57961:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c540 going to sleep for 11 seconds 00000080:00200000:0.0:1787191343.056399:0:57960:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191343.056415:0:57960:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.056426:0:57960:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.056439:0:57960:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.056446:0:57960:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191343.056454:0:57960:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191343.056457:0:57960:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191343.056463:0:57960:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4232bbe8 00010000:00010000:0.0:1787191343.056467:0:57960:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.056476:0:57960:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.056488:0:57960:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.056493:0:57960:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000080:00200000:0.0:1787191343.056496:0:57960:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:3.0:1787191343.059163:0:57961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57961:1874004626817664:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191343.059192:0:57961:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483ac88 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.059205:0:57961:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483ac88 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.059212:0:57961:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483ac88 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.059219:0:57961:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483ac88 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.059228:0:57961:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483ac88 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.059234:0:57961:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9ae00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191343.059238:0:57961:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483ac88 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.059245:0:57961:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483ac88 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.059252:0:57961:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483ac88 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.059259:0:57961:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191343.059266:0:57961:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483ac88 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.059272:0:57961:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483ac88 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57961 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191343.059295:0:57961:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x7, status=0 req@ffff936b51d1e300 x1874004626817664/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/608 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191343.059309:0:57961:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191343.059540:0:57961:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191343.059554:0:57961:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191343.059563:0:57961:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191343.059571:0:57961:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191343.059575:0:57961:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191343.059579:0:57961:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191343.059581:0:57961:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191343.059586:0:57961:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42333b58 00010000:00010000:3.0:1787191343.059589:0:57961:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191343.059597:0:57961:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191343.059610:0:57961:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191343.059617:0:57961:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191343.059623:0:57961:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191343.059637:0:57961:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=9 00000080:00200000:3.0:1787191343.059640:0:57961:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:3.0:1787191343.059650:0:57961:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1787191343.059682:0:57961:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483ac8f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.059687:0:57961:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483ac8f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.059693:0:57961:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483ac8f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57961 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191343.059706:0:57961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57961:1874004626817792:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191343.059761:0:57961:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c540 going to sleep for 11 seconds 00000100:00100000:3.0:1787191343.061667:0:57961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57961:1874004626817792:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191343.061685:0:57961:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483ac8f lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.061693:0:57961:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483ac8f lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.061698:0:57961:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483ac8f lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.061702:0:57961:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483ac8f lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.061706:0:57961:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483ac8f lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.061713:0:57961:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9a000 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191343.061717:0:57961:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483ac8f lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.061721:0:57961:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483ac8f lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.061725:0:57961:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483ac8f lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.061729:0:57961:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191343.061733:0:57961:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483ac8f lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57961 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.061737:0:57961:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a000/0xe5129dc88483ac8f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57961 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191343.061750:0:57961:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b51d1e300 x1874004626817792/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191343.061760:0:57961:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191343.061805:0:57960:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:0.0:1787191343.061811:0:57960:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:0.0:1787191343.061828:0:57960:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:0.0:1787191343.061895:0:57960:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483ac96 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.061904:0:57960:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483ac96 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.061975:0:57960:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483ac96 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.061994:0:57960:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57960:1874004626817920:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191343.062069:0:57960:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.064120:0:57960:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57960:1874004626817920:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191343.064138:0:57960:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483ac96 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.064150:0:57960:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483ac96 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.064158:0:57960:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483ac96 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.064164:0:57960:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483ac96 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.064172:0:57960:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483ac96 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.064176:0:57960:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b43adf600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191343.064180:0:57960:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483ac96 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.064184:0:57960:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483ac96 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.064189:0:57960:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483ac96 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.064193:0:57960:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191343.064197:0:57960:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483ac96 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.064201:0:57960:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483ac96 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.064216:0:57960:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b6a474a80 x1874004626817920/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191343.064231:0:57960:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191343.064301:0:57960:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191343.064310:0:57960:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.064316:0:57960:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.064325:0:57960:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.064330:0:57960:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191343.064333:0:57960:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191343.064335:0:57960:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191343.064338:0:57960:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4232bb58 00010000:00010000:0.0:1787191343.064341:0:57960:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.064346:0:57960:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.064354:0:57960:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.064359:0:57960:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:0.0:1787191343.064365:0:57960:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1787191343.064368:0:57960:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:0.0:1787191343.064375:0:57960:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.064380:0:57960:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 100 lru_type: 1 00010000:00010000:0.0:1787191343.064405:0:57960:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 100 lru_type: 1 00000002:00010000:0.0:1787191343.064411:0:57960:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.064438:0:57960:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483ac9d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.064442:0:57960:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483ac9d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.064448:0:57960:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483ac9d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.064459:0:57960:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57960:1874004626818048:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191343.064509:0:57960:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.068359:0:57960:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57960:1874004626818048:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191343.068381:0:57960:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483ac9d lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46072d1 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.068393:0:57960:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483ac9d lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46072d1 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.068406:0:57960:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483ac9d lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46072d1 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.068418:0:57960:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483ac9d lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46072d1 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.068435:0:57960:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483ac9d lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46072d1 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.068444:0:57960:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483ac9d lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46072d1 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.068452:0:57960:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483ac9d lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46072d1 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.068462:0:57960:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b6a474a80 x1874004626818048/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191343.068476:0:57960:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483ac9d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46072d1 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.068485:0:57960:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:0.0:1787191343.068492:0:57960:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483ac9d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46072d1 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.068500:0:57960:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483ac9d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46072d1 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:0.0:1787191343.068524:0:57960:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.068534:0:57960:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 200 lru_type: 1 00010000:00010000:0.0:1787191343.068545:0:57960:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 200 lru_type: 1 00010000:00010000:0.0:1787191343.068554:0:57960:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 200 lru_type: 1 00010000:00010000:0.0:1787191343.068561:0:57960:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 201 lru_type: 1 00000080:00200000:0.0:1787191343.068571:0:57960:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191343.068578:0:57960:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:0.0:1787191343.068583:0:57960:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:0.0:1787191343.068588:0:57960:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb4232bcb8 00010000:00010000:0.0:1787191343.068592:0:57960:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 100 lru_type: 1 00010000:00010000:0.0:1787191343.068599:0:57960:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 101 lru_type: 1 00000002:00010000:0.0:1787191343.068611:0:57960:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.068616:0:57960:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483ac9d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46072d1 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.068624:0:57960:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483ac9d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46072d1 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.068631:0:57960:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483ac9d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46072d1 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.068638:0:57960:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483ac9d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46072d1 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:0.0:1787191343.068646:0:57960:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.068650:0:57960:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 201 lru_type: 1 00010000:00010000:0.0:1787191343.068658:0:57960:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 201 lru_type: 1 00010000:00010000:0.0:1787191343.068665:0:57960:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 201 lru_type: 1 00010000:00010000:0.0:1787191343.068671:0:57960:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 202 lru_type: 1 00000080:00200008:0.0:1787191343.071004:0:57960:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1787191343.071024:0:57960:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191343.071046:0:57960:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.071062:0:57960:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.071077:0:57960:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.071085:0:57960:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191343.071228:0:57960:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191343.071233:0:57960:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191343.071241:0:57960:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4232bcb8 00010000:00010000:0.0:1787191343.071245:0:57960:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.071255:0:57960:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.071356:0:57960:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191343.071364:0:57960:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.071371:0:57960:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.071380:0:57960:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.071503:0:57960:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191343.071508:0:57960:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191343.071511:0:57960:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191343.071515:0:57960:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4232bb58 00010000:00010000:0.0:1787191343.071519:0:57960:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.071527:0:57960:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.071536:0:57960:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.071543:0:57960:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:0.0:1787191343.071548:0:57960:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.071558:0:57960:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:0.0:1787191343.071562:0:57960:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:0.0:1787191343.071575:0:57960:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:0.0:1787191343.071688:0:57960:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf400/0xe5129dc88483aca4 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.071697:0:57960:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf400/0xe5129dc88483aca4 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.071706:0:57960:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf400/0xe5129dc88483aca4 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.071732:0:57960:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57960:1874004626818176:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191343.071975:0:57960:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000080:00200000:1.0:1787191343.072367:0:57962:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191343.072381:0:57962:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.072390:0:57962:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.072405:0:57962:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.072411:0:57962:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191343.072416:0:57962:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191343.072418:0:57962:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191343.072422:0:57962:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4233bbf8 00010000:00010000:1.0:1787191343.072425:0:57962:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.072432:0:57962:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.072441:0:57962:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191343.072446:0:57962:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191343.072450:0:57962:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:0.0:1787191343.074206:0:57960:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57960:1874004626818176:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191343.074221:0:57960:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf400/0xe5129dc88483aca4 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.074229:0:57960:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf400/0xe5129dc88483aca4 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.074234:0:57960:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf400/0xe5129dc88483aca4 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.074238:0:57960:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf400/0xe5129dc88483aca4 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.074243:0:57960:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf400/0xe5129dc88483aca4 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.074247:0:57960:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b43adf400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191343.074250:0:57960:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf400/0xe5129dc88483aca4 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.074255:0:57960:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf400/0xe5129dc88483aca4 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.074259:0:57960:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf400/0xe5129dc88483aca4 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.074263:0:57960:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191343.074267:0:57960:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf400/0xe5129dc88483aca4 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.074271:0:57960:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf400/0xe5129dc88483aca4 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.074283:0:57960:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b6a474a80 x1874004626818176/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191343.074294:0:57960:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1787191343.074344:0:57960:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483ac9d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46072d1 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.074353:0:57960:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483ac9d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46072d1 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191343.074375:0:57962:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b586e6c00, open_flags d900, mode 0 opened 0 00000080:00200000:1.0:1787191343.074381:0:57962:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:1.0:1787191343.074398:0:57962:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:1.0:1787191343.074443:0:57962:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483acab lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.074450:0:57962:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483acab lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57962 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191343.074460:0:57962:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191343.074466:0:57962:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9880 x1874004626818432/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191343.074475:0:57962:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483acab lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57962 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.074493:0:57962:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57962:1874004626818432:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191343.074644:0:57962:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893480 going to sleep for 11 seconds 00000080:00010000:0.0:1787191343.074762:0:57960:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ac9d from it ffffa3fb4232b930 00010000:00010000:0.0:1787191343.074768:0:57960:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483ac9d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46072d1 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.074777:0:57960:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483ac9d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46072d1 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191343.075100:0:57960:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191343.075113:0:57960:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.075121:0:57960:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.075130:0:57960:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.075136:0:57960:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191343.075141:0:57960:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191343.075144:0:57960:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191343.075149:0:57960:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4232bbf8 00010000:00010000:0.0:1787191343.075152:0:57960:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.075160:0:57960:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.075169:0:57960:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.075175:0:57960:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191343.075180:0:57960:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:1.0:1787191343.076674:0:57962:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57962:1874004626818432:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191343.076694:0:57962:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483acab lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.076706:0:57962:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483acab lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.076713:0:57962:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483acab lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.076720:0:57962:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483acab lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.076728:0:57962:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483acab lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.076734:0:57962:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b4801f200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191343.076738:0:57962:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483acab lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.076745:0:57962:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483acab lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.076752:0:57962:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483acab lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.076759:0:57962:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191343.076764:0:57962:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483acab lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.076769:0:57962:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f200/0xe5129dc88483acab lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57962 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191343.076786:0:57962:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x7, status=0 req@ffff936b453a9880 x1874004626818432/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/608 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191343.076798:0:57962:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1787191343.076820:0:57962:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483ac9d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46072d1 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191343.076866:0:57962:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483ac9d lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46072d1 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00010000:1.0:1787191343.076884:0:57962:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ac9d from it ffffa3fb4233b9a0 00010000:00010000:1.0:1787191343.076888:0:57962:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483ac9d lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46072d1 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191343.076896:0:57962:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483ac9d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46072d1 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1787191343.077158:0:57960:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:0.0:1787191343.077164:0:57960:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:0.0:1787191343.077170:0:57960:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b4971b500, open_flags a141, mode 81b6 opened 0 00000080:00200000:0.0:1787191343.077178:0:57960:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:0.0:1787191343.077196:0:57960:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xe4:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:0.0:1787191343.077204:0:57960:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483ac9d lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e46072d1 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191343.077260:0:57960:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483ac9d lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46072d1 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191343.077267:0:57960:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191343.077269:0:57960:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483ac9d lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46072d1 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191343.077300:0:57960:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483acb2 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.077306:0:57960:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483acb2 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191343.077315:0:57960:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191343.077321:0:57960:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474a80 x1874004626818688/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191343.077330:0:57960:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483acb2 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.077348:0:57960:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57960:1874004626818688:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191343.077457:0:57960:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000080:00200000:1.0:1787191343.077636:0:57962:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191343.077647:0:57962:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.077654:0:57962:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.077664:0:57962:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.077668:0:57962:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191343.077671:0:57962:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191343.077673:0:57962:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191343.077676:0:57962:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4233bb58 00010000:00010000:1.0:1787191343.077679:0:57962:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.077683:0:57962:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.077689:0:57962:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191343.077692:0:57962:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191343.077695:0:57962:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:0.0:1787191343.080101:0:57960:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57960:1874004626818688:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191343.080124:0:57960:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483acb2 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607317 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.080148:0:57960:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483acb2 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607317 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.080157:0:57960:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483acb2 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607317 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.080167:0:57960:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483acb2 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607317 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.080178:0:57960:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483acb2 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607317 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.080189:0:57960:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483acb2 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607317 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.080196:0:57960:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483acb2 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607317 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.080201:0:57960:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483acb2 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607317 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.080208:0:57960:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b6a474a80 x1874004626818688/t8589937162(8589937162) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191343.080217:0:57960:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474a80 x1874004626818688/t8589937162(8589937162) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191343.080224:0:57960:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483acb2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607317 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.080231:0:57960:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/228 (0 0) 00000080:00200000:0.0:1787191343.080236:0:57960:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191343.080245:0:57960:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:0.0:1787191343.080271:0:57960:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xe4:0x0](ffff936b5396c2c8) 00000080:00200000:0.0:1787191343.080275:0:57960:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xe4:0x0], updating i_size 0 00000080:00200000:0.0:1787191343.080301:0:57960:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe4:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1787191343.080304:0:57960:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xe4:0x0](ffff936b5396c2c8) 00000080:00010000:0.0:1787191343.080306:0:57960:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe4:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483acb2 00000080:00010000:0.0:1787191343.080312:0:57960:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe4:0x0](ffff936b5396c2c8) 00000080:00200008:0.0:1787191343.080324:0:57960:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe4:0x0](ffff936b5396c2c8), flags 120501 00000002:00100000:0.0:1787191343.080337:0:57960:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474a80 x1874004626818688/t8589937162(8589937162) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191343.080364:0:57960:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483acb2 from it ffff936b530f5a80 00010000:00010000:0.0:1787191343.080367:0:57960:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483acb2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607317 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.080374:0:57960:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483acb2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607317 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191343.080390:0:57960:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe4:0x0](ffff936b5396c2c8), inode mode 81a4 mask 40 00000080:00200000:0.0:1787191343.080463:0:57960:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe4:0x0](ffff936b5396c2c8), inode mode 81a4 mask 2 00000080:00200000:0.0:1787191343.080473:0:57960:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xe4:0x0](ffff936b5396c2c8), xattr lov 00000002:00010000:0.0:1787191343.080488:0:57960:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe4:0x0]) in obj [0x200000405:0xe4:0x0], intent: open flags 040000002 00010000:00010000:0.0:1787191343.080525:0:57960:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483acb9 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.080529:0:57960:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483acb9 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191343.080540:0:57960:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191343.080544:0:57960:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475c00 x1874004626818944/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191343.080550:0:57960:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483acb9 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.080563:0:57960:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57960:1874004626818944:192.168.202.101@tcp:101:lfs.0 00000080:00200000:1.0:1787191343.080784:0:57962:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=9 00000080:00200008:1.0:1787191343.080795:0:57962:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe4:0x0](ffff936b5396c2c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191343.080801:0:57962:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe4:0x0](ffff936b5396c2c8),name=f70.sanity-flr 00000002:00010000:1.0:1787191343.080815:0:57962:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe4:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.080823:0:57962:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483acb2 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607317 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.080901:0:57962:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483acb2 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607317 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191343.080990:0:57962:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191343.080994:0:57962:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe4:0x0](ffff936b5396c2c8) 00000080:00010000:1.0:1787191343.080997:0:57962:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe4:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483acb2 00000080:00010000:1.0:1787191343.081000:0:57962:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483acb2 from it ffffa3fb4233bcb8 00010000:00010000:1.0:1787191343.081002:0:57962:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483acb2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607317 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.081007:0:57962:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483acb2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607317 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000100:00100000:0.0:1787191343.081181:0:57960:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191343.083043:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191343.083086:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634931840 00000100:00100000:3.0:1787191343.083320:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634931840 00000100:00100000:3.0:1787191343.083444:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1476 00000100:00100000:3.0:1787191343.083454:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634931840:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191343.083477:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483acb2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4607317 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191343.083544:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191343.083551:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634931840:12345-192.168.202.101@tcp:104: Request processed in 99us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191343.083558:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1476 00010000:00010000:0.0:1787191343.083800:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191343.083806:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483acb2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4607317 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.083813:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b43adf600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191343.083816:0:57627:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483acb2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4607317 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.083822:0:57627:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483acb2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4607317 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.083827:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483acb2 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4607317 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191343.083877:0:57627:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe4:0x0]: losing layout lock 00010000:00010000:0.0:1787191343.083921:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483acb2 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607317 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.083928:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191343.083956:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483acb2 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607317 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.083964:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483acb2 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607317 expref: -99 pid: 57960 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.083978:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191343.083980:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191343.083982:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191343.083990:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787191343.084004:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626819072:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191343.086422:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626819072:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191343.086658:0:57960:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57960:1874004626818944:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191343.086670:0:57960:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483acb9 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.086681:0:57960:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483acb9 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.086685:0:57960:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483acb9 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.086690:0:57960:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483acb9 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.086695:0:57960:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483acb9 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.086699:0:57960:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b43ade800 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191343.086704:0:57960:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483acb9 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.086708:0:57960:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483acb9 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.086713:0:57960:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483acb9 lrc: 5/0,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.086717:0:57960:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191343.086721:0:57960:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483acb9 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.086724:0:57960:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483acb9 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57960 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.086740:0:57960:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b6a475c00 x1874004626818944/t8589937163(8589937163) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191343.086750:0:57960:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475c00 x1874004626818944/t8589937163(8589937163) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191343.086763:0:57960:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xe4:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787191343.086814:0:57960:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe4:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00000080:00200000:0.0:1787191343.086826:0:57960:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191343.086895:0:57960:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xe4:0x0], updating i_size 0 00000002:00100000:0.0:1787191343.086913:0:57960:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475c00 x1874004626818944/t8589937163(8589937163) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191343.086946:0:57960:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a475c00 x1874004626818944/t8589937163(8589937163) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191343.086956:0:57960:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191343.086961:0:57960:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477b80 x1874004626819328/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191343.086981:0:57960:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57960:1874004626819328:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191343.087063:0:57960:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.089004:0:57960:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57960:1874004626819328:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191343.089045:0:57960:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a475c00 x1874004626818944/t8589937163(8589937163) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1787191343.089110:0:57960:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe4:0x0](ffff936b5396c2c8), flags 100001 00000002:00100000:0.0:1787191343.089146:0:57960:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a474a80 x1874004626818688/t8589937162(8589937162) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191359 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191343.089153:0:57960:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191343.089157:0:57960:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a476300 x1874004626819584/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191343.089170:0:57960:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57960:1874004626819584:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191343.089218:0:57960:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000080:00200000:1.0:1787191343.089305:0:57962:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191343.089321:0:57962:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.089339:0:57962:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.089348:0:57962:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.089354:0:57962:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191343.089359:0:57962:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191343.089362:0:57962:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191343.089367:0:57962:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4233bbf8 00010000:00010000:1.0:1787191343.089369:0:57962:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.089376:0:57962:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.089400:0:57962:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191343.089407:0:57962:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191343.089413:0:57962:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191343.089426:0:57962:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b586e7c80, open_flags d902, mode 0 opened 0 00000080:00200000:1.0:1787191343.089433:0:57962:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:1.0:1787191343.089446:0:57962:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154403 00010000:00010000:1.0:1787191343.089485:0:57962:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f000/0xe5129dc88483acc0 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.089491:0:57962:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f000/0xe5129dc88483acc0 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57962 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191343.089497:0:57962:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:1.0:1787191343.089501:0:57962:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9880 x1874004626819840/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191343.089506:0:57962:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f000/0xe5129dc88483acc0 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57962 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.089514:0:57962:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57962:1874004626819840:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191343.089627:0:57962:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893480 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.091524:0:57960:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57960:1874004626819584:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191343.091551:0:57960:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a474a80 x1874004626818688/t8589937162(8589937162) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191343.092694:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191343.092718:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191343.092734:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.092747:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.092754:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191343.092760:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191343.092764:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191343.092782:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:2.0:1787191343.092786:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.092794:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.092808:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191343.092815:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191343.092820:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:1.0:1787191343.093336:0:57962:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57962:1874004626819840:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191343.093352:0:57962:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f000/0xe5129dc88483acc0 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460734f expref: -99 pid: 57962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.093372:0:57962:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f000/0xe5129dc88483acc0 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460734f expref: -99 pid: 57962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.093447:0:57962:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f000/0xe5129dc88483acc0 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460734f expref: -99 pid: 57962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.093458:0:57962:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f000/0xe5129dc88483acc0 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460734f expref: -99 pid: 57962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.093468:0:57962:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f000/0xe5129dc88483acc0 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460734f expref: -99 pid: 57962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.093480:0:57962:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f000/0xe5129dc88483acc0 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460734f expref: -99 pid: 57962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.093487:0:57962:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f000/0xe5129dc88483acc0 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460734f expref: -99 pid: 57962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.093494:0:57962:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f000/0xe5129dc88483acc0 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460734f expref: -99 pid: 57962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191343.093505:0:57962:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b453a9880 x1874004626819840/t8589937166(8589937166) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191343.093517:0:57962:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9880 x1874004626819840/t8589937166(8589937166) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191343.093530:0:57962:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f000/0xe5129dc88483acc0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460734f expref: -99 pid: 57962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191343.093543:0:57962:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f000/0xe5129dc88483acc0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460734f expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.093551:0:57962:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/228 (0 0) 00000080:00200000:1.0:1787191343.093556:0:57962:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191343.093600:0:57962:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xe4:0x0](ffff936b5396c2c8): rc = 0 00000080:00200000:1.0:1787191343.093616:0:57962:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe4:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:1.0:1787191343.093621:0:57962:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe4:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483acc0 00000080:00010000:1.0:1787191343.093631:0:57962:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe4:0x0](ffff936b5396c2c8) 00000080:00200008:1.0:1787191343.093642:0:57962:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe4:0x0](ffff936b5396c2c8), flags 154402 00000002:00100000:1.0:1787191343.093660:0:57962:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9880 x1874004626819840/t8589937166(8589937166) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191343.093707:0:57962:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483acc0 from it ffff936b5339fc00 00010000:00010000:1.0:1787191343.093711:0:57962:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f000/0xe5129dc88483acc0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460734f expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.093716:0:57962:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f000/0xe5129dc88483acc0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460734f expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191343.093729:0:57962:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe4:0x0](ffff936b5396c2c8), inode mode 81a4 mask 46 00000080:00200000:2.0:1787191343.093760:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:2.0:1787191343.093766:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe4:0x0](ffff936b5396c2c8), inode mode 81a4 mask 42 00000080:00200008:2.0:1787191343.093776:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe4:0x0](ffff936b5396c2c8), flags 101101 00000002:00010000:2.0:1787191343.093797:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xe4:0x0], intent: getxattr flags 0 00010000:00010000:2.0:1787191343.093827:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483acc7 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.093851:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483acc7 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.093861:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483acc7 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191343.093877:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626819968:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191343.093950:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f600 going to sleep for 11 seconds 00000080:00200000:1.0:1787191343.094311:0:57962:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe4:0x0](ffff936b5396c2c8), inode mode 81a4 mask 4 00000080:00200000:1.0:1787191343.094319:0:57962:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xe4:0x0](ffff936b5396c2c8), xattr lov 00000080:00200008:1.0:1787191343.094346:0:57962:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe4:0x0](ffff936b5396c2c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191343.094352:0:57962:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe4:0x0](ffff936b5396c2c8),name=f70.sanity-flr 00000002:00010000:1.0:1787191343.094367:0:57962:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe4:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.094375:0:57962:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f000/0xe5129dc88483acc0 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460734f expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.094459:0:57962:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f000/0xe5129dc88483acc0 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460734f expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191343.094467:0:57962:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191343.094472:0:57962:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe4:0x0](ffff936b5396c2c8) 00000080:00010000:1.0:1787191343.094475:0:57962:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe4:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483acc0 00000080:00010000:1.0:1787191343.094480:0:57962:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483acc0 from it ffffa3fb4233bcd8 00010000:00010000:1.0:1787191343.094484:0:57962:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f000/0xe5129dc88483acc0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460734f expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.094492:0:57962:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f000/0xe5129dc88483acc0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460734f expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191343.094511:0:57962:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe4:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:1.0:1787191343.094521:0:57962:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe4:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191343.094524:0:57962:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191343.094527:0:57962:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe4:0x0] 00000008:00010000:1.0:1787191343.094546:0:57962:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191343.094550:0:57962:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b628934b0, osc lock ffff936b46836720, flags 0x400000400001002 00000008:00010000:1.0:1787191343.094556:0:57962:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191343.094558:0:57962:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b628934f0, osc lock ffff936b46836d10, flags 0x400000400001002 00010000:00010000:1.0:1787191343.094593:0:57962:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483acce lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.094603:0:57962:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483acce lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.094618:0:57962:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b453ab100 x1874004626820096/t0(0) o101->lustre-OST0001-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191343.094673:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626820096:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191343.095087:0:57962:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483acd5 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.095108:0:57962:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483acd5 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.095118:0:57962:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b453aad80 x1874004626820224/t0(0) o101->lustre-OST0000-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191343.095274:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787191343.095283:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626820224:192.168.202.101@tcp:101:lfs.0 00000020:00200000:1.0:1787191343.095451:0:57962:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 2 items remaining. 00000100:00100000:0.0:1787191343.096443:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626819968:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191343.096462:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483acc7 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607364 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.096474:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483acc7 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607364 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.096484:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483acc7 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607364 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.096496:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b513b9880 x1874004626819968/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191343.096506:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483acc7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607364 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.096515:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/228 (0 0) 00000080:00200000:0.0:1787191343.096521:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xe4:0x0] suppgids 0 -1: rc 0 00000080:00010000:0.0:1787191343.096539:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe4:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483acc7 00000080:00010000:0.0:1787191343.096544:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483acc7 from it ffffa3fb41caba38 00010000:00010000:0.0:1787191343.096547:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483acc7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607364 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.096553:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483acc7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607364 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:0.0:1787191343.096579:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xe4:0x0](ffff936b5396c2c8) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191343.000000000, mtime 1787191343.000000000, ctime 1787191343.000000000 00010000:00010000:0.0:1787191343.096602:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f000/0xe5129dc88483acc0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e460734f expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191343.096619:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe4:0x0]: losing layout lock 00010000:00010000:0.0:1787191343.096648:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f000/0xe5129dc88483acc0 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460734f expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.096653:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191343.096655:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801f000/0xe5129dc88483acc0 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460734f expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000020:00100000:0.0:1787191343.096668:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1787191343.096672:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477800 x1874004626820480/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787191343.096684:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626820480:192.168.202.101@tcp:36:bash.0 00000100:00100000:0.0:1787191343.096722:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787191343.099470:0:2389:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483acce lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.099523:0:2389:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483acce lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e460736b expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.099537:0:2389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483acce lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460736b expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.099548:0:2389:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483acce lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e460736b expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191343.099568:0:2389:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483acce lrc: 5/2,0 mode: PR/PR res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460736b expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1787191343.099579:0:2389:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191343.099584:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483acce lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460736b expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.099592:0:2389:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483acce lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460736b expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.099600:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483acce lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460736b expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.099608:0:2389:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483acce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460736b expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1787191343.099659:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626820096:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191343.099795:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626820480:192.168.202.101@tcp:36:bash.0 00000080:00200000:0.0:1787191343.099984:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:0.0:1787191343.099991:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe4:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00010000:00010000:0.0:1787191343.100007:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/228 (0 0) 00000080:00010000:0.0:1787191343.100026:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xe4:0x0](ffff936b5396c2c8) 00000002:00010000:0.0:1787191343.100037:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe4:0x0]) in obj [0x200000405:0xe4:0x0], intent: layout flags 0 00010000:00010000:0.0:1787191343.100074:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acdc lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.100082:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acdc lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.100092:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acdc lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.100171:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626820608:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191343.100269:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787191343.102071:0:2389:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483acd5 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.102093:0:2389:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483acd5 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607379 expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.102106:0:2389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483acd5 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607379 expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.102117:0:2389:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483acd5 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607379 expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191343.102132:0:2389:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483acd5 lrc: 5/2,0 mode: PR/PR res: [0x280000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607379 expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1787191343.102143:0:2389:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1787191343.102162:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483acd5 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4607379 expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.102172:0:2389:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483acd5 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4607379 expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.102179:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483acd5 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4607379 expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.102189:0:2389:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483acd5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607379 expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1787191343.102206:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626820224:192.168.202.101@tcp:101:lfs.0 00000080:00200000:1.0:1787191343.102281:0:57962:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe4:0x0] updating i_size 0 i_blocks 0 00000020:00010000:1.0:1787191343.102286:0:57962:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b516572e0 (ffff936b465ccab8/0) at cl_lock_release():245 00000020:00010000:1.0:1787191343.102290:0:57962:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b516572e0 (ffff936b465ccab8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.102295:0:57962:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b628934b0 (ffff936b47a172d8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.102299:0:57962:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b628934f0 (ffff936b465cc008/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.102302:0:57962:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b516572e0 (ffff936b465ccab8/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191343.102305:0:57962:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b628934b0 (ffff936b465ccab8/1) at cl_lock_fini():72 00000020:00010000:1.0:1787191343.102309:0:57962:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b628934f0 (ffff936b465ccab8/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191343.102322:0:57962:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe4:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:0.0:1787191343.105098:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626820608:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191343.105125:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acdc lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607380 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.105138:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acdc lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607380 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.105158:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b6a477480 x1874004626820608/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191343.105168:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acdc lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607380 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191343.105180:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acdc lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607380 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.105192:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/228 (0 0) 00000080:00200000:0.0:1787191343.105197:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xe4:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191343.105214:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe4:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483acdc 00000080:00010000:0.0:1787191343.105221:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483acdc from it ffffa3fb41cab8c8 00010000:00010000:0.0:1787191343.105225:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acdc lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607380 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.105234:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acdc lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607380 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.105256:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acdc lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607380 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.105267:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acdc lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607380 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1787191343.105275:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xe4:0x0](0000000089668027) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acdc lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607380 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191343.105330:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe4:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:0.0:1787191343.105336:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acdc lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607380 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.105344:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acdc lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607380 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:0.0:1787191343.105373:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xe4:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:0.0:1787191343.105381:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe4:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191343.105384:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xe4:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:0.0:1787191343.105392:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xe4:0x0](ffff936b5396c2c8) 00000002:00010000:0.0:1787191343.105401:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe4:0x0]) in obj [0x200000405:0xe4:0x0], intent: layout flags 02 00010000:00010000:0.0:1787191343.105413:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acdc lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4607380 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191343.105426:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe4:0x0]: losing layout lock 00010000:00010000:0.0:1787191343.105453:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acdc lrc: 1/0,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607380 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.105460:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191343.105463:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acdc lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607380 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.105496:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ace3 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xe4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.105503:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ace3 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xe4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191343.105513:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191343.105519:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477480 x1874004626820864/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191343.105529:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ace3 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xe4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.105546:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626820864:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191343.105603:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787191343.105761:0:57962:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/228 (0 0) 00000080:00010000:1.0:1787191343.105768:0:57962:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xe4:0x0](ffff936b5396c2c8) 00000002:00010000:1.0:1787191343.105773:0:57962:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe4:0x0]) in obj [0x200000405:0xe4:0x0], intent: layout flags 0 00010000:00010000:1.0:1787191343.105793:0:57962:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483acea lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.105800:0:57962:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483acea lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.105808:0:57962:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483acea lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57962 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.105819:0:57962:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57962:1874004626820992:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191343.105881:0:57962:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893480 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.131527:0:57570:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589937169 gen 1 00000100:00100000:0.0:1787191343.131599:0:57570:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b453a9880 x1874004626819840/t8589937166(8589937166) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787191343.131616:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626820864:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191343.131635:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ace3 lrc: 4/0,1 mode: --/EX res: [0x200000405:0xe4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460738e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.131646:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ace3 lrc: 4/0,1 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460738e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.131657:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ace3 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460738e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.131668:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ace3 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460738e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.131681:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ace3 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460738e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.131690:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ace3 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460738e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.131697:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ace3 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460738e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.131705:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b6a477480 x1874004626820864/t8589937169(8589937169) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191343.131727:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ace3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460738e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191343.131737:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ace3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460738e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.131746:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/228 (0 0) 00000080:00200000:0.0:1787191343.131751:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xe4:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191343.131761:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe4:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483ace3 00000080:00010000:0.0:1787191343.131769:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ace3 from it ffffa3fb41cab930 00010000:00010000:0.0:1787191343.131784:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ace3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460738e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.131793:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ace3 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460738e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191343.131809:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:0.0:1787191343.131816:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe4:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00000100:00100000:1.0:1787191343.132150:0:57962:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57962:1874004626820992:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191343.132163:0:57962:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483acea lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607395 expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.132171:0:57962:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483acea lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607395 expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191343.132180:0:57962:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b453aa300 x1874004626820992/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191343.132187:0:57962:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483acea lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607395 expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191343.132197:0:57962:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483acea lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607395 expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.132206:0:57962:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ace3 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460738e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.132224:0:57962:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ace3 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460738e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.132233:0:57962:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483acea lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607395 expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.132240:0:57962:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483acea lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x7130d520e4607395 expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.132248:0:57962:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483acea lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x7130d520e4607395 expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.132272:0:57962:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000080:00200000:1.0:1787191343.132276:0:57962:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xe4:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191343.132285:0:57962:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe4:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483ace3 00000080:00010000:1.0:1787191343.132289:0:57962:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ace3 from it ffffa3fb4233bbc8 00010000:00010000:1.0:1787191343.132292:0:57962:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ace3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460738e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.132300:0:57962:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ace3 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460738e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191343.132496:0:57962:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ace3 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460738e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191343.132505:0:57962:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ace3 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460738e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:1.0:1787191343.132513:0:57962:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xe4:0x0](0000000089668027) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ace3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460738e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191343.132556:0:57962:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ace3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460738e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191343.132630:0:57962:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ace3 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460738e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191343.132646:0:57962:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe4:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00020000:00200000:1.0:1787191343.132657:0:57962:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe4:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191343.132660:0:57962:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00010000:00010000:3.0:1787191343.133271:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191343.133281:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483acea lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x7130d520e4607395 expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.133290:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b413fe800 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191343.133294:0:40930:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483acea lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x8/0x8 rrc: 4 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x7130d520e4607395 expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.133302:0:40930:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483acea lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x8/0x8 rrc: 4 type: IBT gid 0 flags: 0x400000000 nid: local remote: 0x7130d520e4607395 expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.133311:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483acea lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x8/0x8 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4607395 expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.133329:0:40930:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ace3 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460738e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191343.133593:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483acea lrc: 2/0,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x8/0x8 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4607395 expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.133601:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191343.133634:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483acea lrc: 1/0,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x8/0x8 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4607395 expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.133642:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483acea lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x8/0x8 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4607395 expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.133664:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191343.133666:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191343.133668:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191343.133678:0:2392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787191343.133697:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626821120:192.168.202.101@tcp:103:ldlm_bl.0 00020000:00200000:1.0:1787191343.133974:0:57962:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:2.0:1787191343.134097:0:57962:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:2.0:1787191343.134136:0:57962:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ace3 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460738e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191343.134146:0:57962:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ace3 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460738e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00010000:2.0:1787191343.134154:0:57962:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xe4:0x0](0000000089668027) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ace3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460738e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:2.0:1787191343.134182:0:57962:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe4:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191343.134188:0:57962:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe4:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191343.134190:0:57962:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191343.134192:0:57962:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:2.0:1787191343.134204:0:57962:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:2.0:1787191343.134230:0:57962:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483acce lrc: 1/0,0 mode: PR/PR res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460736b expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000008:00010000:2.0:1787191343.134245:0:57962:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483acd5 lrc: 1/0,0 mode: PR/PR res: [0x280000401:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607379 expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191343.134307:0:57962:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe4:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:2.0:1787191343.134313:0:57962:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ace3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460738e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191343.134322:0:57962:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ace3 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460738e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1787191343.134389:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ace3 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460738e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1787191343.134407:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ace3 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460738e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00000080:00010000:1.0:1787191343.134415:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xe4:0x0](0000000089668027) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ace3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460738e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1787191343.134424:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ace3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460738e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1787191343.134432:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ace3 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460738e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00020000:00200000:1.0:1787191343.134444:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xe4:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:1.0:1787191343.134450:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe4:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191343.134452:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191343.134460:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191343.134470:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191343.134473:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:1.0:1787191343.134485:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:1.0:1787191343.134490:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b62893cf0, osc lock ffff936b46836d10, flags 0x80000000 00000008:00010000:1.0:1787191343.134494:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:1.0:1787191343.134496:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b62893d30, osc lock ffff936b46836720, flags 0x80000000 00010000:00010000:1.0:1787191343.134529:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.134538:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.134548:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.134564:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626821248:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191343.134613:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893780 going to sleep for 11 seconds 00000080:00200000:2.0:1787191343.134742:0:57962:0:(vvp_io.c:397:vvp_io_fini()) [0x200000405:0xe4:0x0] layout changed from 3 to 4. 00000080:00200000:2.0:1787191343.134748:0:57962:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe4:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00020000:00200000:2.0:1787191343.134753:0:57962:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe4:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 1, mirror count: 2 00020000:00200000:2.0:1787191343.134756:0:57962:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191343.134758:0:57962:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe4:0x0] 00000008:00010000:2.0:1787191343.134768:0:57962:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191343.134770:0:57962:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1b30, osc lock ffff936b44e62be0, flags 0x400000400001002 00010000:00010000:2.0:1787191343.135006:0:57962:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b52377800 type 11 mode 6 res 10737419265/476 (0 1048575) 00010000:00010000:2.0:1787191343.135038:0:57962:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000009e00427e/0xe5129dc88483acf8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.135047:0:57962:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000009e00427e/0xe5129dc88483acf8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.135058:0:57962:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b513b8e00 x1874004626821376/t0(0) o101->lustre-OST0000-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:2.0:1787191343.135080:0:57962:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:2.0:1787191343.135096:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626821376:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191343.135227:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191343.135277:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191343.135343:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191343.135381:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191343.135407:0:51131:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787191343.135417:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634933248 00000100:00100000:3.0:1787191343.135423:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634933248 00000100:00100000:3.0:1787191343.135450:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634933376 00000100:00100000:3.0:1787191343.135453:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634933376 00000100:00100000:3.0:1787191343.135459:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634933120 00000100:00100000:3.0:1787191343.135461:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634933120 00000100:00100000:3.0:1787191343.135468:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634932992 00000100:00100000:3.0:1787191343.135470:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634932992 00000100:00100000:3.0:1787191343.135482:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1477 00000100:00100000:3.0:1787191343.136127:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+5:30353:x1874004634933248:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191343.136142:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ac26 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4607165 expref: -99 pid: 57956 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191343.136199:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191343.136206:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+5:30353:x1874004634933248:12345-192.168.202.101@tcp:104: Request processed in 87us (980us total) trans 0 rc 0/0 00010000:00010000:1.0:1787191343.136466:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191343.136474:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ac26 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4607165 expref: -99 pid: 57956 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.136487:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b413ffa00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191343.136493:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ac26 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e4607165 expref: -99 pid: 57956 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.136551:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ac26 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4607165 expref: -99 pid: 57956 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.136559:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191343.136589:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ac26 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4607165 expref: -99 pid: 57956 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.136606:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ac26 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4607165 expref: -99 pid: 57956 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.136626:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191343.136628:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191343.136634:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191343.136643:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787191343.136654:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626821504:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191343.137085:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1478 00000100:00100000:2.0:1787191343.137098:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+5:30510:x1874004634933376:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191343.137107:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191343.137176:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191343.137182:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+5:30510:x1874004634933376:12345-192.168.202.101@tcp:104: Request processed in 90us (1905us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191343.137189:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1478 00000100:00100000:3.0:1787191343.137204:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1477 00000100:00100000:2.0:1787191343.137216:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1479 00000100:00100000:2.0:1787191343.137226:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+5:29543:x1874004634933120:12345-192.168.202.101@tcp:104: 00000100:00100000:3.0:1787191343.137231:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1480 00010000:00010000:2.0:1787191343.137238:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483ac1f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e460715e expref: -99 pid: 57956 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1787191343.137245:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b4121c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+5:37089:x1874004634932992:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191343.137260:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000003a1344c/0xe5129dc88483ac65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e460721b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.137297:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787191343.137304:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191343.137316:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51185600 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191343.137320:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191343.137352:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191343.137358:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787191343.137414:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626821632:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787191343.137522:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191343.137537:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c6d069f/0xe5129dc88483ac57 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e460720d expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191343.137551:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787191343.137555:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483ac1f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e460715e expref: -99 pid: 57956 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.137561:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b413ff200 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191343.137565:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483ac1f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e460715e expref: -99 pid: 57956 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.137601:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191343.137607:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+5:29543:x1874004634933120:12345-192.168.202.101@tcp:104: Request processed in 384us (2264us total) trans 0 rc 0/0 00010000:00010000:3.0:1787191343.137609:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191343.137617:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1479 00000100:00100000:3.0:1787191343.137622:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b4121c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+5:37089:x1874004634932992:12345-192.168.202.101@tcp:104: Request processed in 379us (2237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191343.137632:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1480 00010000:00010000:3.0:1787191343.137665:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191343.137670:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000003a1344c/0xe5129dc88483ac65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e460721b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191343.137679:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51185200 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191343.137683:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000003a1344c/0xe5129dc88483ac65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e460721b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.137698:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483ac1f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e460715e expref: -99 pid: 57956 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191343.137706:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000003a1344c/0xe5129dc88483ac65 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e460721b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.137710:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191343.137717:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787191343.137736:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787191343.137744:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626821760:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787191343.137804:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000003a1344c/0xe5129dc88483ac65 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e460721b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191343.137812:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000003a1344c/0xe5129dc88483ac65 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e460721b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.137823:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191343.137960:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626821888:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787191343.138119:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483ac1f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e460715e expref: -99 pid: 57956 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.138128:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483ac1f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e460715e expref: -99 pid: 57956 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.138142:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191343.138143:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191343.138145:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191343.138451:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191343.138454:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191343.138456:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191343.138984:0:2392:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000009e00427e/0xe5129dc88483acf8 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.139001:0:2392:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000009e00427e/0xe5129dc88483acf8 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46073b8 expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.139030:0:2392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000009e00427e/0xe5129dc88483acf8 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46073b8 expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.139040:0:2392:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000009e00427e/0xe5129dc88483acf8 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46073b8 expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1787191343.139053:0:2392:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000009e00427e/0xe5129dc88483acf8 lrc: 5/2,0 mode: PR/PR res: [0x280000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46073b8 expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:2.0:1787191343.139063:0:2392:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:2.0:1787191343.139073:0:2392:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000009e00427e/0xe5129dc88483acf8 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46073b8 expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.139080:0:2392:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000009e00427e/0xe5129dc88483acf8 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46073b8 expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.139087:0:2392:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000009e00427e/0xe5129dc88483acf8 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46073b8 expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.139095:0:2392:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000009e00427e/0xe5129dc88483acf8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46073b8 expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:2.0:1787191343.139108:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626821376:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191343.139125:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626821120:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00200000:0.0:1787191343.139200:0:57962:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe4:0x0] updating i_size 0 i_blocks 0 00000020:00010000:0.0:1787191343.139206:0:57962:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b516572e0 (ffff936b465ccab8/0) at cl_lock_release():245 00000020:00010000:0.0:1787191343.139209:0:57962:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b516572e0 (ffff936b465ccab8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191343.139214:0:57962:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1b30 (ffff936b47a172d8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191343.139219:0:57962:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b516572e0 (ffff936b465ccab8/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191343.139222:0:57962:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1b30 (ffff936b465ccab8/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191343.139235:0:57962:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe4:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:3.0:1787191343.139256:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191343.139463:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634933504 00000100:00100000:2.0:1787191343.139469:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634933504 00000100:00100000:2.0:1787191343.139504:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1481 00000100:00100000:2.0:1787191343.139512:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8720:x1874004634933504:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191343.139522:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000009e00427e/0xe5129dc88483acf8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000010000 nid: local remote: 0x7130d520e46073b8 expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.139603:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191343.139609:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8720:x1874004634933504:12345-192.168.202.101@tcp:104: Request processed in 98us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191343.139615:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1481 00000080:00200000:0.0:1787191343.141025:0:57962:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191343.141053:0:57962:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.141068:0:57962:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.141082:0:57962:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.141090:0:57962:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191343.141098:0:57962:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191343.141101:0:57962:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191343.141106:0:57962:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4233bb58 00010000:00010000:0.0:1787191343.141110:0:57962:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.141117:0:57962:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.141130:0:57962:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.141136:0:57962:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191343.141142:0:57962:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.141156:0:57962:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=9 00000080:00200000:0.0:1787191343.141160:0:57962:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:0.0:1787191343.141171:0:57962:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:0.0:1787191343.141216:0:57962:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acff lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.141225:0:57962:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acff lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.141235:0:57962:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acff lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57962 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.141259:0:57962:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57962:1874004626822016:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191343.141331:0:57962:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787191343.141544:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191343.141553:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000009e00427e/0xe5129dc88483acf8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420000010000 nid: local remote: 0x7130d520e46073b8 expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.141562:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51185000 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191343.141568:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000009e00427e/0xe5129dc88483acf8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800428400010000 nid: local remote: 0x7130d520e46073b8 expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191343.141615:0:43384:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe4:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1787191343.141628:0:43384:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1787191343.141657:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000009e00427e/0xe5129dc88483acf8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400010020 nid: local remote: 0x7130d520e46073b8 expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.141664:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191343.141686:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000009e00427e/0xe5129dc88483acf8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400010020 nid: local remote: 0x7130d520e46073b8 expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.141693:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000009e00427e/0xe5129dc88483acf8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69400010020 nid: local remote: 0x7130d520e46073b8 expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.141709:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191343.141711:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191343.141712:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191343.141726:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626822144:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191343.144746:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626821504:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191343.144782:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626821760:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191343.144796:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626821632:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191343.145003:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626821888:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191343.146088:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626821248:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191343.146122:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.146135:0:57570:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.146144:0:57570:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.146386:0:57962:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57962:1874004626822016:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191343.147110:0:57962:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acff lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46073db expref: -99 pid: 57962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.147134:0:57962:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acff lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46073db expref: -99 pid: 57962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.147143:0:57962:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acff lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46073db expref: -99 pid: 57962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.147154:0:57962:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acff lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46073db expref: -99 pid: 57962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.147166:0:57962:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acff lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46073db expref: -99 pid: 57962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.147178:0:57962:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acff lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46073db expref: -99 pid: 57962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.147191:0:57962:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acff lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46073db expref: -99 pid: 57962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.147198:0:57962:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acff lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46073db expref: -99 pid: 57962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.147209:0:57962:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b6a477480 x1874004626822016/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/976 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191343.147220:0:57962:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acff lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46073db expref: -99 pid: 57962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191343.147233:0:57962:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acff lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46073db expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.147242:0:57962:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/228 (0 0) 00000080:00200000:0.0:1787191343.147248:0:57962:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191343.147295:0:57962:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xe4:0x0](ffff936b5396c2c8): rc = 0 00000080:00200000:0.0:1787191343.147310:0:57962:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe4:0x0]: layout version change: 4 -> 4 00000080:00010000:0.0:1787191343.147314:0:57962:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe4:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483acff 00000080:00010000:0.0:1787191343.147327:0:57962:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe4:0x0](ffff936b5396c2c8) 00000080:00010000:0.0:1787191343.147330:0:57962:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483acff from it ffffa3fb4233bb20 00010000:00010000:0.0:1787191343.147334:0:57962:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acff lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46073db expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.147342:0:57962:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acff lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46073db expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200008:0.0:1787191343.147387:0:57962:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe4:0x0](ffff936b5396c2c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191343.147394:0:57962:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe4:0x0](ffff936b5396c2c8),name=f70.sanity-flr 00000002:00010000:0.0:1787191343.147413:0:57962:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe4:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.147433:0:57962:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acff lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46073db expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.147445:0:57962:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acff lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46073db expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191343.147453:0:57962:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191343.147458:0:57962:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe4:0x0](ffff936b5396c2c8) 00000080:00010000:0.0:1787191343.147461:0:57962:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe4:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483acff 00000080:00010000:0.0:1787191343.147464:0:57962:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483acff from it ffffa3fb4233bcb8 00010000:00010000:0.0:1787191343.147468:0:57962:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acff lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46073db expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.147475:0:57962:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acff lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46073db expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000100:00100000:2.0:1787191343.147762:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000080:00200000:0.0:1787191343.147891:0:57962:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe4:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:0.0:1787191343.147903:0:57962:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe4:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191343.147906:0:57962:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000100:00100000:3.0:1787191343.148122:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634933632 00000100:00100000:3.0:1787191343.148130:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634933632 00000100:00100000:3.0:1787191343.148180:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1482 00000100:00100000:3.0:1787191343.148190:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:9508:x1874004634933632:12345-192.168.202.101@tcp:105: 00010000:00010000:3.0:1787191343.148201:0:40921:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.148238:0:40921:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.148249:0:40921:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.148259:0:40921:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080080020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.148268:0:40921:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080080020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.148277:0:40921:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80080020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.148306:0:40921:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b413ffc00) 00010000:00010000:1.0:1787191343.148330:0:57570:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.148342:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.148354:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191343.148367:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191343.148375:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:9508:x1874004634933632:12345-192.168.202.101@tcp:105: Request processed in 185us (613us total) trans 0 rc 0/0 00010000:00010000:1.0:1787191343.148381:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191343.148396:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1482 00010000:00010000:1.0:1787191343.148516:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.148574:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483ad06 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.148582:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483ad06 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.148591:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483ad06 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.148609:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626822272:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191343.148667:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893780 going to sleep for 11 seconds 00000001:00010000:0.0:1787191343.148796:0:57962:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe4:0x0] 00000008:00010000:0.0:1787191343.148815:0:57962:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191343.148818:0:57962:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee65b0, osc lock ffff936b50b62d10, flags 0x400000400001002 00010000:00010000:0.0:1787191343.148829:0:57962:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.149099:0:57962:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1787191343.149109:0:57962:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191343.149112:0:57962:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 7/0,2 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.149119:0:57962:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1787191343.149126:0:57962:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191343.149137:0:57962:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe4:0x0] updating i_size 0 i_blocks 0 00000020:00010000:0.0:1787191343.149140:0:57962:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b516572e0 (ffff936b465ccab8/0) at cl_lock_release():245 00000020:00010000:0.0:1787191343.149143:0:57962:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b516572e0 (ffff936b465ccab8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191343.149146:0:57962:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee65b0 (ffff936b47a172d8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191343.149150:0:57962:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b516572e0 (ffff936b465ccab8/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191343.149152:0:57962:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee65b0 (ffff936b465ccab8/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191343.149162:0:57962:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe4:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1787191343.149190:0:57962:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe4:0x0](ffff936b5396c2c8), flags 154002 00000080:00200000:0.0:1787191343.149239:0:57962:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191343.149252:0:57962:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.149261:0:57962:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.149270:0:57962:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.149276:0:57962:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191343.149282:0:57962:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191343.149285:0:57962:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191343.149290:0:57962:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4233bbf8 00010000:00010000:0.0:1787191343.149293:0:57962:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.149301:0:57962:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.149312:0:57962:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.149317:0:57962:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191343.149322:0:57962:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.149325:0:57962:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:0.0:1787191343.149329:0:57962:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe4:0x0](ffff936b5396c2c8), inode mode 81a4 mask 44 00000080:00200008:0.0:1787191343.149336:0:57962:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe4:0x0](ffff936b5396c2c8), flags 154400 00000002:00010000:0.0:1787191343.149350:0:57962:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe4:0x0]) in obj [0x200000405:0xe4:0x0], intent: open flags 0104240114401 00010000:00010000:0.0:1787191343.149380:0:57962:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483ad0d lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57962 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.149387:0:57962:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483ad0d lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57962 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191343.149398:0:57962:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191343.149405:0:57962:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477480 x1874004626822528/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191343.149414:0:57962:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483ad0d lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57962 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.149429:0:57962:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57962:1874004626822528:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191343.149563:0:57962:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.153778:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626822144:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191343.156799:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626822272:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191343.156825:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483ad06 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46073e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.156938:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483ad06 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e46073e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.156951:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483ad06 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e46073e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.156964:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483ad06 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e46073e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191343.156977:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483ad06 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e46073e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.156988:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483ad06 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46073e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.156996:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483ad06 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46073e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.157450:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626822656:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191343.157619:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787191343.157628:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626822784:192.168.202.101@tcp:10:bash.0 00000100:00100000:0.0:1787191343.160308:0:57962:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57962:1874004626822528:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191343.160336:0:57962:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483ad0d lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46073f0 expref: -99 pid: 57962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.160353:0:57962:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483ad0d lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46073f0 expref: -99 pid: 57962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.160366:0:57962:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483ad0d lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46073f0 expref: -99 pid: 57962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.160381:0:57962:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x200002b, status=0 req@ffff936b6a477480 x1874004626822528/t8589937170(8589937170) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191343.160394:0:57962:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477480 x1874004626822528/t8589937170(8589937170) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191343.160408:0:57962:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483ad0d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46073f0 expref: -99 pid: 57962 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191343.160422:0:57962:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483ad0d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46073f0 expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.160434:0:57962:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/228 (0 0) 00000080:00200000:0.0:1787191343.160440:0:57962:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xe4:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787191343.160515:0:57962:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe4:0x0]: layout version change: 4 -> 4 00000080:00010000:0.0:1787191343.160521:0:57962:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe4:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483ad0d 00000080:00010000:0.0:1787191343.160528:0:57962:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ad0d from it ffffa3fb4233bbf0 00010000:00010000:0.0:1787191343.160533:0:57962:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483ad0d lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46073f0 expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.160542:0:57962:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483ad0d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46073f0 expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000002:00100000:0.0:1787191343.160734:0:57962:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477480 x1874004626822528/t8589937170(8589937170) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191343.161221:0:57962:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe4:0x0](ffff936b5396c2c8), inode mode 81a4 mask 4 00000080:00200000:0.0:1787191343.161230:0:57962:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xe4:0x0](ffff936b5396c2c8), xattr lov 00000080:00200008:0.0:1787191343.161254:0:57962:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe4:0x0](ffff936b5396c2c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191343.161262:0:57962:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe4:0x0](ffff936b5396c2c8),name=f70.sanity-flr 00000002:00010000:0.0:1787191343.161282:0:57962:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe4:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.161293:0:57962:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acff lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46073db expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.161305:0:57962:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acff lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46073db expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191343.161313:0:57962:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191343.161319:0:57962:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe4:0x0](ffff936b5396c2c8) 00000080:00010000:0.0:1787191343.161322:0:57962:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe4:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483acff 00000080:00010000:0.0:1787191343.161327:0:57962:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483acff from it ffffa3fb4233bcd8 00010000:00010000:0.0:1787191343.161330:0:57962:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acff lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46073db expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.161338:0:57962:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acff lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46073db expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191343.161357:0:57962:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe4:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:0.0:1787191343.161366:0:57962:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe4:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191343.161369:0:57962:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191343.161372:0:57962:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe4:0x0] 00000008:00010000:0.0:1787191343.161390:0:57962:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191343.161393:0:57962:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee65b0, osc lock ffff936b50b62d10, flags 0x400000400001002 00010000:00010000:0.0:1787191343.161408:0:57962:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.161419:0:57962:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1787191343.161430:0:57962:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191343.161434:0:57962:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 7/0,2 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.161440:0:57962:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.161791:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626822656:192.168.202.101@tcp:10:bash.0 00000020:00200000:0.0:1787191343.162205:0:57962:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191343.162296:0:57962:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe4:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191343.162301:0:57962:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b516572e0 (ffff936b465ccab8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191343.162304:0:57962:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b516572e0 (ffff936b465ccab8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191343.162308:0:57962:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee65b0 (ffff936b47a172d8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191343.162312:0:57962:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b516572e0 (ffff936b465ccab8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191343.162314:0:57962:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee65b0 (ffff936b465ccab8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191343.162325:0:57962:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe4:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191343.162377:0:57962:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe4:0x0](ffff936b5396c2c8), flags 154000 00010000:00010000:2.0:1787191343.162396:0:57962:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483ad0d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46073f0 expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191343.162447:0:57962:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191343.162459:0:57962:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191343.162468:0:57962:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.162477:0:57962:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.162533:0:57962:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191343.162540:0:57962:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191343.162544:0:57962:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191343.162550:0:57962:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4233bbf8 00010000:00010000:2.0:1787191343.162553:0:57962:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.162561:0:57962:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.162641:0:57962:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191343.162648:0:57962:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191343.162654:0:57962:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191343.162658:0:57962:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:2.0:1787191343.162661:0:57962:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe4:0x0](ffff936b5396c2c8), inode mode 81a4 mask 46 00000080:00200008:2.0:1787191343.162668:0:57962:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe4:0x0](ffff936b5396c2c8), flags 154402 00000080:00200080:2.0:1787191343.162712:0:57962:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe4:0x0](ffff936b5396c2c8) cmd=800466af arg=7ffca389137c 00000080:00200080:2.0:1787191343.162726:0:57962:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe4:0x0](ffff936b5396c2c8) cmd=80086601 arg=7ffca3891318 00000100:00100000:2.0:1787191343.162765:0:57962:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57962:1874004626822912:192.168.202.101@tcp:33:lfs.0 00000100:00100000:2.0:1787191343.162953:0:57962:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f840 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.166326:0:57962:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57962:1874004626822912:192.168.202.101@tcp:33:lfs.0 00000080:00200080:0.0:1787191343.166363:0:57962:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe4:0x0](ffff936b5396c2c8) cmd=c00c66f3 arg=7ffca3891304 00000080:00200008:0.0:1787191343.166438:0:57962:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe4:0x0](ffff936b5396c2c8), flags 154002 00000100:00100000:1.0:1787191343.167222:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626822784:192.168.202.101@tcp:10:bash.0 00000080:00200000:2.0:1787191343.167381:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe4:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191343.167386:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b497c9f38 (ffff936b465cc2d8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191343.167389:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b497c9f38 (ffff936b465cc2d8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191343.167393:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62893cf0 (ffff936b465cc7e8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191343.167401:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.167412:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191343.167425:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62893d30 (ffff936b465cc3f8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191343.167428:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483ad06 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46073e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.167433:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483ad06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46073e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191343.167438:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b497c9f38 (ffff936b465cc2d8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191343.167439:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62893cf0 (ffff936b465cc2d8/1) at cl_lock_fini():72 00000020:00010000:2.0:1787191343.167442:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62893d30 (ffff936b465cc2d8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191343.167477:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe4:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191343.167500:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xe4:0x0](ffff936b5396c2c8) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191343.000000000, mtime 1787191343.000000000, ctime 1787191343.000000000, rc 0 00000080:00200008:2.0:1787191343.167578:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xe4:0x0], ppos: 0, count: 5 00000080:00200000:2.0:1787191343.167588:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191343.167592:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:2.0:1787191343.167597:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:2.0:1787191343.167600:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1787191343.167604:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@00000000551929f2[0x110, 1, [0x200000405:0xe4:0x0] hash] 00000020:00200000:2.0:1787191343.167606:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:2.0:1787191343.167610:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe4:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191343.167620:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xe4:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:2.0:1787191343.167624:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe4:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191343.167626:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1787191343.167629:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1787191343.167634:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:2.0:1787191343.167636:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1787191343.167648:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:2.0:1787191343.167661:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1787191343.167664:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1530, osc lock ffff936b44e631d0, flags 0x0 00010000:00010000:2.0:1787191343.167676:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.167685:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.167693:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.167698:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.167702:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191343.167709:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:2.0:1787191343.167715:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191343.167744:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:2.0:1787191343.167750:0:57570:0:(rw26.c:927:ll_write_end()) page@000000005b9025cd[3 000000006213f2a4 2 1 00000000239c7fe2 0 0 0] 00000080:00200000:2.0:1787191343.167752:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @00000000c426af58 17ffffc0001001 3:0 ffff936b43a1e380 0 lru 00000080:00200000:2.0:1787191343.167758:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@000000004f95520a 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000a2a44f55 0000000060a7a2dd > 3< 0 0 > 4< 0 0 8 420364288 - | - - - - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1787191343.167759:0:57570:0:(rw26.c:927:ll_write_end()) end page@000000005b9025cd 00000080:00200000:2.0:1787191343.167760:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:2.0:1787191343.167764:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:2.0:1787191343.167777:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 00000000008b88e6 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191343.167790:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b5396c478, count 1, dirtied 1 00000080:00200000:2.0:1787191343.167794:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:2.0:1787191343.167795:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:2.0:1787191343.167805:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894f38 (ffff936b47a172d8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191343.167807:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894f38 (ffff936b47a172d8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191343.167809:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1530 (ffff936b47a17c68/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191343.167812:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.167817:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:2.0:1787191343.167823:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894f38 (ffff936b47a172d8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191343.167825:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1530 (ffff936b47a172d8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191343.167829:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:2.0:1787191343.167850:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1787191343.167854:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe4:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191343.167856:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:2.0:1787191343.167859:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe4:0x0] updating i_size 5 i_blocks 0 00000080:00200000:2.0:1787191343.167862:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:2.0:1787191343.167873:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe4:0x0](ffff936b5396c2c8), flags 100001 00000002:00100000:2.0:1787191343.167915:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a9880 x1874004626819840/t8589937166(8589937166) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191343.167926:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191343.167930:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bbb80 x1874004626823168/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191343.167949:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626823168:192.168.202.101@tcp:35:bash.0 00000100:00100000:2.0:1787191343.168030:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.170528:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626823168:192.168.202.101@tcp:35:bash.0 00000002:00100000:0.0:1787191343.170636:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a9880 x1874004626819840/t8589937166(8589937166) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191343.177782:0:57964:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191343.177809:0:57964:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.177823:0:57964:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.177855:0:57964:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.177866:0:57964:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191343.177874:0:57964:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191343.177877:0:57964:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191343.177884:0:57964:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422fbb58 00010000:00010000:1.0:1787191343.177888:0:57964:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.177898:0:57964:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.177914:0:57964:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191343.177923:0:57964:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:1.0:1787191343.177929:0:57964:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191343.177933:0:57964:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=8 00000080:00200008:1.0:1787191343.177939:0:57964:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe4:0x0](ffff936b5396c2c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191343.177944:0:57964:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe4:0x0](ffff936b5396c2c8),name=f70.sanity-flr 00000002:00010000:1.0:1787191343.177955:0:57964:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe4:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.177962:0:57964:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acff lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46073db expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191343.177971:0:57964:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acff lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46073db expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191343.177983:0:57964:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191343.177987:0:57964:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe4:0x0](ffff936b5396c2c8) 00000080:00010000:1.0:1787191343.177990:0:57964:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe4:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483acff 00000080:00010000:1.0:1787191343.177994:0:57964:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483acff from it ffffa3fb422fbcb8 00010000:00010000:1.0:1787191343.177997:0:57964:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acff lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46073db expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191343.178005:0:57964:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acff lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46073db expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1787191343.178037:0:57964:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe4:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:1.0:1787191343.178050:0:57964:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe4:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191343.178053:0:57964:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191343.178056:0:57964:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe4:0x0] 00000008:00010000:1.0:1787191343.178076:0:57964:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191343.178080:0:57964:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b44ca8430, osc lock ffff936b46837a20, flags 0x400000400001002 00010000:00010000:1.0:1787191343.178095:0:57964:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191343.178107:0:57964:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1787191343.178117:0:57964:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191343.178120:0:57964:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191343.178132:0:57964:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:1.0:1787191343.178142:0:57964:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191343.178151:0:57964:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe4:0x0] updating i_size 5 i_blocks 0 00000020:00010000:1.0:1787191343.178156:0:57964:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51656060 (ffff936b465ccbd8/0) at cl_lock_release():245 00000020:00010000:1.0:1787191343.178160:0:57964:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51656060 (ffff936b465ccbd8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.178163:0:57964:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b44ca8430 (ffff936b465cc758/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.178167:0:57964:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51656060 (ffff936b465ccbd8/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191343.178169:0:57964:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b44ca8430 (ffff936b465ccbd8/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191343.178180:0:57964:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe4:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191343.178200:0:57964:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191343.178208:0:57964:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.178214:0:57964:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.178223:0:57964:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.178228:0:57964:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191343.178232:0:57964:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191343.178234:0:57964:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191343.178238:0:57964:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb422fbc10 00010000:00010000:1.0:1787191343.178240:0:57964:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.178252:0:57964:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.178260:0:57964:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191343.178263:0:57964:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:1.0:1787191343.178267:0:57964:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191343.178272:0:57964:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:1.0:1787191343.178276:0:57964:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:1.0:1787191343.178280:0:57964:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:1.0:1787191343.178303:0:57964:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483ad0d lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46073f0 expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000002:00100000:1.0:1787191343.178354:0:57964:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a477480 x1874004626822528/t8589937170(8589937170) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191343.178366:0:57964:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191343.178372:0:57964:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8e00 x1874004626823424/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191343.178393:0:57964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8e00 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57964:1874004626823424:192.168.202.101@tcp:35:rm.0 00000080:00200000:2.0:1787191343.178823:0:57963:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000100:00100000:1.0:1787191343.178916:0:57964:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893cc0 going to sleep for 11 seconds 00000002:00010000:2.0:1787191343.178944:0:57963:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191343.178960:0:57963:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.178971:0:57963:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.178979:0:57963:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191343.178984:0:57963:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191343.178987:0:57963:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191343.178992:0:57963:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42343bf8 00010000:00010000:2.0:1787191343.178995:0:57963:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.179004:0:57963:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.179023:0:57963:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191343.179028:0:57963:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191343.179032:0:57963:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191343.179036:0:57963:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:2.0:1787191343.179039:0:57963:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe4:0x0](ffff936b5396c2c8), inode mode 81a4 mask 44 00000080:00200008:2.0:1787191343.179044:0:57963:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe4:0x0](ffff936b5396c2c8), flags 154400 00000002:00010000:2.0:1787191343.179058:0:57963:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe4:0x0]) in obj [0x200000405:0xe4:0x0], intent: open flags 0104240114401 00010000:00010000:2.0:1787191343.179092:0:57963:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ad14 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x10000000000000 pid: 57963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.179100:0:57963:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ad14 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x0 pid: 57963 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191343.179110:0:57963:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:2.0:1787191343.179118:0:57963:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bad80 x1874004626823680/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191343.179128:0:57963:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ad14 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x0 pid: 57963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191343.179142:0:57963:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57963:1874004626823680:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191343.179323:0:57963:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f300 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.183735:0:57964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8e00 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57964:1874004626823424:192.168.202.101@tcp:35:rm.0 00000002:00100000:1.0:1787191343.183770:0:57964:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a477480 x1874004626822528/t8589937170(8589937170) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191343.183807:0:57964:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe4:0x0]: losing layout lock 00010000:00010000:1.0:1787191343.183829:0:57964:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ace3 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e460738e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00000080:00200000:1.0:1787191343.183852:0:57964:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe4:0x0]: losing layout lock 00010000:00010000:1.0:1787191343.183856:0:57964:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acff lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46073db expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1787191343.183862:0:57964:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe4:0x0]: losing layout lock 00010000:00010000:1.0:1787191343.183867:0:57964:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483acc7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4607364 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.184005:0:57964:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483ad0d lrc: 1/0,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46073f0 expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191343.184025:0:57964:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ace3 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460738e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00010000:00010000:1.0:1787191343.184031:0:57964:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acff lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46073db expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191343.184037:0:57964:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483acc7 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4607364 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.184042:0:57964:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 4 locks packed 00010000:00010000:1.0:1787191343.184045:0:57964:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483ad0d lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46073f0 expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191343.184056:0:57964:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ace3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460738e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00010000:00010000:1.0:1787191343.184065:0:57964:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483acff lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46073db expref: -99 pid: 57962 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191343.184074:0:57964:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483acc7 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4607364 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1787191343.184090:0:57964:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1787191343.184096:0:57964:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8e00 x1874004626823936/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 512/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787191343.184120:0:57964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8e00 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57964:1874004626823936:192.168.202.101@tcp:36:rm.0 00000100:00100000:1.0:1787191343.185258:0:57964:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.185438:0:57963:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57963:1874004626823680:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191343.185458:0:57963:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ad14 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607405 expref: -99 pid: 57963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.185472:0:57963:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ad14 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607405 expref: -99 pid: 57963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.185496:0:57963:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ad14 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607405 expref: -99 pid: 57963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.185511:0:57963:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x200002b, status=0 req@ffff936b513bad80 x1874004626823680/t8589937173(8589937173) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191343.185524:0:57963:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bad80 x1874004626823680/t8589937173(8589937173) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191343.185537:0:57963:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ad14 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607405 expref: -99 pid: 57963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191343.185550:0:57963:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ad14 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607405 expref: -99 pid: 57963 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.185560:0:57963:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/228 (0 0) 00000080:00200000:0.0:1787191343.185566:0:57963:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xe4:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787191343.185625:0:57963:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe4:0x0]: layout version change: 4294967294 -> 4 00000080:00010000:0.0:1787191343.185631:0:57963:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe4:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483ad14 00000080:00010000:0.0:1787191343.185637:0:57963:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ad14 from it ffffa3fb42343bf0 00010000:00010000:0.0:1787191343.185642:0:57963:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ad14 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607405 expref: -99 pid: 57963 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.185651:0:57963:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ad14 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607405 expref: -99 pid: 57963 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000002:00100000:0.0:1787191343.185679:0:57963:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bad80 x1874004626823680/t8589937173(8589937173) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191343.185821:0:57963:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe4:0x0](ffff936b5396c2c8), inode mode 81a4 mask 4 00000080:00200000:0.0:1787191343.185857:0:57963:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xe4:0x0](ffff936b5396c2c8), xattr lov 00000080:00200008:0.0:1787191343.185885:0:57963:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe4:0x0](ffff936b5396c2c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191343.185893:0:57963:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe4:0x0](ffff936b5396c2c8),name=f70.sanity-flr 00000002:00010000:0.0:1787191343.185907:0:57963:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe4:0x0]) in obj [0x200000405:0xe4:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.185915:0:57963:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 30 res 8589935621/228 (0 0) 00010000:00010000:0.0:1787191343.185949:0:57963:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf400/0xe5129dc88483ad1b lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.185957:0:57963:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf400/0xe5129dc88483ad1b lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.185967:0:57963:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf400/0xe5129dc88483ad1b lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.185984:0:57963:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57963:1874004626824064:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191343.186048:0:57963:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191343.190687:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191343.190735:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634933760 00000100:00100000:2.0:1787191343.190746:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634933760 00000100:00100000:2.0:1787191343.190801:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1483 00000100:00100000:2.0:1787191343.190814:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634933760:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191343.190988:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ad14 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4607405 expref: -99 pid: 57963 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.191114:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191343.191122:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634933760:12345-192.168.202.101@tcp:104: Request processed in 312us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191343.191133:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1483 00010000:00010000:0.0:1787191343.191266:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191343.191274:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ad14 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4607405 expref: -99 pid: 57963 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.191288:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51184600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191343.191293:0:57627:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ad14 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xd/0xd rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4607405 expref: -99 pid: 57963 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.191302:0:57627:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ad14 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xd/0xd rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4607405 expref: -99 pid: 57963 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.191311:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ad14 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xd/0xd rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4607405 expref: -99 pid: 57963 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191343.191332:0:57627:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe4:0x0]: losing layout lock 00010000:00010000:0.0:1787191343.191374:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ad14 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xd/0xd rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607405 expref: -99 pid: 57963 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.191382:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191343.191407:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ad14 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xd/0xd rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607405 expref: -99 pid: 57963 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.191415:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483ad14 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0xd/0xd rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607405 expref: -99 pid: 57963 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1787191343.191428:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626824192:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787191343.191432:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191343.191435:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191343.191437:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191343.197679:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626824192:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191343.198091:0:57963:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57963:1874004626824064:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191343.198108:0:57963:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf400/0xe5129dc88483ad1b lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460742f expref: -99 pid: 57963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.198122:0:57963:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf400/0xe5129dc88483ad1b lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460742f expref: -99 pid: 57963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.198130:0:57963:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf400/0xe5129dc88483ad1b lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460742f expref: -99 pid: 57963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.198137:0:57963:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf400/0xe5129dc88483ad1b lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460742f expref: -99 pid: 57963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.198150:0:57963:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf400/0xe5129dc88483ad1b lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460742f expref: -99 pid: 57963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.198156:0:57963:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf400/0xe5129dc88483ad1b lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460742f expref: -99 pid: 57963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.198161:0:57963:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf400/0xe5129dc88483ad1b lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460742f expref: -99 pid: 57963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.198167:0:57963:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b6a477b80 x1874004626824064/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/976 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191343.198175:0:57963:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf400/0xe5129dc88483ad1b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460742f expref: -99 pid: 57963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191343.198185:0:57963:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf400/0xe5129dc88483ad1b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460742f expref: -99 pid: 57963 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.198195:0:57963:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/228 (0 0) 00000080:00200000:0.0:1787191343.198201:0:57963:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xe4:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787191343.198255:0:57963:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe4:0x0]: layout version change: 4294967294 -> 4 00000080:00010000:0.0:1787191343.198261:0:57963:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe4:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483ad1b 00000080:00010000:0.0:1787191343.198265:0:57963:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe4:0x0](ffff936b5396c2c8) 00000080:00010000:0.0:1787191343.198267:0:57963:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ad1b from it ffffa3fb42343cd8 00010000:00010000:0.0:1787191343.198270:0:57963:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf400/0xe5129dc88483ad1b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460742f expref: -99 pid: 57963 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.198275:0:57963:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf400/0xe5129dc88483ad1b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460742f expref: -99 pid: 57963 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191343.198297:0:57963:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe4:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1787191343.198307:0:57963:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe4:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191343.198310:0:57963:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191343.198312:0:57963:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe4:0x0] 00000008:00010000:0.0:1787191343.198326:0:57963:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191343.198329:0:57963:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee65b0, osc lock ffff936b50b62720, flags 0x400000400001002 00010000:00010000:0.0:1787191343.198341:0:57963:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191343.198351:0:57963:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:0.0:1787191343.198360:0:57963:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191343.198363:0:57963:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191343.198368:0:57963:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:0.0:1787191343.198375:0:57963:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191343.198382:0:57963:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe4:0x0] updating i_size 5 i_blocks 0 00000020:00010000:0.0:1787191343.198386:0:57963:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51655280 (ffff936b465cca28/0) at cl_lock_release():245 00000020:00010000:0.0:1787191343.198389:0:57963:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51655280 (ffff936b465cca28/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191343.198391:0:57963:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee65b0 (ffff936b465ccf38/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191343.198393:0:57963:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51655280 (ffff936b465cca28/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191343.198395:0:57963:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee65b0 (ffff936b465cca28/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191343.198402:0:57963:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe4:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1787191343.198446:0:57963:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe4:0x0](ffff936b5396c2c8), flags 154000 00000002:00100000:0.0:1787191343.198490:0:57963:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513bad80 x1874004626823680/t8589937173(8589937173) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191343.198501:0:57963:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:0.0:1787191343.198506:0:57963:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477b80 x1874004626824448/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191343.198526:0:57963:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57963:1874004626824448:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191343.199714:0:57964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8e00 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57964:1874004626823936:192.168.202.101@tcp:36:rm.0 00000100:00100000:0.0:1787191343.199732:0:57963:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.204668:0:57963:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57963:1874004626824448:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191343.204704:0:57963:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513bad80 x1874004626823680/t8589937173(8589937173) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191343.204755:0:57963:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe4:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00020000:00200000:0.0:1787191343.204767:0:57963:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe4:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191343.204770:0:57963:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191343.204776:0:57963:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191343.204786:0:57963:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000008:00010000:0.0:1787191343.204806:0:57963:0:(osc_cache.c:1183:osc_extent_make_ready()) ### extent: 00000000008b88e6 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000008:00010000:0.0:1787191343.204855:0:57963:0:(osc_cache.c:917:osc_extent_finish()) ### extent: 00000000008b88e6 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000008:00010000:0.0:1787191343.204878:0:57963:0:(osc_cache.c:497:__osc_extent_remove()) ### extent: 00000000008b88e6 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1787191343.204902:0:57963:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191343.204940:0:57963:0:(llite_lib.c:2066:ll_clear_inode()) VFS Op:inode=[0x200000405:0xe4:0x0](ffff936b5396c2c8) 00000008:00010000:0.0:1787191343.204968:0:57963:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 5 blocks 0 [cma]time 1787191343 1787191343 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000008:00010000:0.0:1787191343.204991:0:57963:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191343 1787191343 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483ad06 lrc: 1/0,0 mode: PW/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46073e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191343.205233:0:57963:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191343.205250:0:57963:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.205263:0:57963:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.205274:0:57963:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.205281:0:57963:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191343.205287:0:57963:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191343.205290:0:57963:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191343.205296:0:57963:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42343b58 00010000:00010000:0.0:1787191343.205300:0:57963:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.205307:0:57963:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.205322:0:57963:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.205328:0:57963:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191343.205333:0:57963:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.205345:0:57963:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=9 00000080:00200000:0.0:1787191343.205349:0:57963:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:0.0:1787191343.205361:0:57963:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:0.0:1787191343.205399:0:57963:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483ad22 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.205405:0:57963:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483ad22 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.205411:0:57963:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483ad22 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.205425:0:57963:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57963:1874004626824576:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191343.205506:0:57963:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.209614:0:57963:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57963:1874004626824576:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191343.209634:0:57963:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483ad22 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.209649:0:57963:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483ad22 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.209656:0:57963:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483ad22 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.209663:0:57963:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483ad22 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.209672:0:57963:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483ad22 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.209678:0:57963:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b43adea00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191343.209684:0:57963:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483ad22 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.209691:0:57963:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483ad22 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.209699:0:57963:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483ad22 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.209706:0:57963:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191343.209712:0:57963:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483ad22 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.209718:0:57963:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483ad22 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57963 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.209744:0:57963:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b6a477b80 x1874004626824576/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191343.209760:0:57963:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191343.218524:0:57965:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191343.218557:0:57965:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191343.218573:0:57965:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.218588:0:57965:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.218596:0:57965:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191343.218605:0:57965:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191343.218609:0:57965:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191343.218616:0:57965:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4233bb58 00010000:00010000:2.0:1787191343.218620:0:57965:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.218629:0:57965:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.218644:0:57965:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191343.218651:0:57965:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:2.0:1787191343.218657:0:57965:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191343.218667:0:57965:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:2.0:1787191343.218672:0:57965:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191343.218683:0:57965:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191343.218730:0:57965:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483ad29 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.218743:0:57965:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483ad29 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.218752:0:57965:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483ad29 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191343.218778:0:57965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57965:1874004626824704:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191343.218893:0:57965:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787191343.224936:0:57965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57965:1874004626824704:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191343.224958:0:57965:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483ad29 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.224970:0:57965:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483ad29 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.224976:0:57965:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483ad29 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.224983:0:57965:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483ad29 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.224991:0:57965:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483ad29 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.224996:0:57965:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51184a00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191343.225000:0:57965:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483ad29 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.225025:0:57965:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483ad29 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.225034:0:57965:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483ad29 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.225040:0:57965:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191343.225048:0:57965:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483ad29 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.225055:0:57965:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483ad29 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191343.225078:0:57965:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513b9180 x1874004626824704/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191343.225102:0:57965:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191343.225180:0:57965:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191343.225193:0:57965:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191343.225203:0:57965:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.225216:0:57965:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.225224:0:57965:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191343.225229:0:57965:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191343.225232:0:57965:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191343.225237:0:57965:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4233bbe8 00010000:00010000:2.0:1787191343.225241:0:57965:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.225255:0:57965:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.225269:0:57965:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191343.225276:0:57965:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000080:00200000:2.0:1787191343.225281:0:57965:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191343.225288:0:57965:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:2.0:1787191343.225293:0:57965:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191343.225303:0:57965:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191343.225342:0:57965:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483ad30 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.225350:0:57965:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483ad30 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.225360:0:57965:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483ad30 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191343.225378:0:57965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57965:1874004626824832:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191343.225440:0:57965:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787191343.228239:0:57965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57965:1874004626824832:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191343.228261:0:57965:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483ad30 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.228275:0:57965:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483ad30 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.228286:0:57965:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483ad30 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.228292:0:57965:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483ad30 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.228299:0:57965:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483ad30 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.228304:0:57965:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51185200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191343.228307:0:57965:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483ad30 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.228314:0:57965:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483ad30 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.228319:0:57965:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483ad30 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.228326:0:57965:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191343.228332:0:57965:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483ad30 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.228338:0:57965:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483ad30 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191343.228357:0:57965:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513b9180 x1874004626824832/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191343.228368:0:57965:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191343.228439:0:57965:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191343.228450:0:57965:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191343.228458:0:57965:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.228466:0:57965:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.228471:0:57965:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191343.228475:0:57965:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191343.228477:0:57965:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191343.228480:0:57965:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4233bb58 00010000:00010000:2.0:1787191343.228482:0:57965:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.228500:0:57965:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.228511:0:57965:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191343.228517:0:57965:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:2.0:1787191343.228524:0:57965:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:2.0:1787191343.228527:0:57965:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:2.0:1787191343.228535:0:57965:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191343.228541:0:57965:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 101 lru_type: 1 00010000:00010000:2.0:1787191343.228546:0:57965:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 101 lru_type: 1 00000002:00010000:2.0:1787191343.228554:0:57965:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191343.228582:0:57965:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483ad37 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.228598:0:57965:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483ad37 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.228607:0:57965:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483ad37 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191343.228626:0:57965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57965:1874004626824960:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191343.228742:0:57965:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787191343.231229:0:57965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57965:1874004626824960:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191343.231252:0:57965:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483ad37 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607483 expref: -99 pid: 57965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.231265:0:57965:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483ad37 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607483 expref: -99 pid: 57965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.231276:0:57965:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483ad37 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607483 expref: -99 pid: 57965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.231287:0:57965:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483ad37 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607483 expref: -99 pid: 57965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.231299:0:57965:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483ad37 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607483 expref: -99 pid: 57965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.231312:0:57965:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483ad37 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607483 expref: -99 pid: 57965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.231319:0:57965:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483ad37 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607483 expref: -99 pid: 57965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191343.231330:0:57965:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b513b9180 x1874004626824960/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191343.231343:0:57965:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483ad37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607483 expref: -99 pid: 57965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.231354:0:57965:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:2.0:1787191343.231362:0:57965:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483ad37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607483 expref: -99 pid: 57965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.231371:0:57965:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483ad37 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607483 expref: -99 pid: 57965 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:2.0:1787191343.231394:0:57965:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191343.231404:0:57965:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 202 lru_type: 1 00010000:00010000:2.0:1787191343.231414:0:57965:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 202 lru_type: 1 00010000:00010000:2.0:1787191343.231423:0:57965:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 202 lru_type: 1 00010000:00010000:2.0:1787191343.231430:0:57965:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 203 lru_type: 1 00000080:00200000:2.0:1787191343.231442:0:57965:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1787191343.231452:0:57965:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:2.0:1787191343.231456:0:57965:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:2.0:1787191343.231461:0:57965:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb4233bcb8 00010000:00010000:2.0:1787191343.231464:0:57965:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 101 lru_type: 1 00010000:00010000:2.0:1787191343.231472:0:57965:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 102 lru_type: 1 00000002:00010000:2.0:1787191343.231496:0:57965:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191343.231502:0:57965:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483ad37 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607483 expref: -99 pid: 57965 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.231511:0:57965:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483ad37 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607483 expref: -99 pid: 57965 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.231518:0:57965:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483ad37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607483 expref: -99 pid: 57965 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.231526:0:57965:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483ad37 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607483 expref: -99 pid: 57965 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:2.0:1787191343.231534:0:57965:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191343.231540:0:57965:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 203 lru_type: 1 00010000:00010000:2.0:1787191343.231547:0:57965:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 203 lru_type: 1 00010000:00010000:2.0:1787191343.231554:0:57965:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 203 lru_type: 1 00010000:00010000:2.0:1787191343.231561:0:57965:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 204 lru_type: 1 00000080:00200008:2.0:1787191343.232111:0:57965:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:2.0:1787191343.232117:0:57965:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191343.232131:0:57965:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191343.232140:0:57965:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.232149:0:57965:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.232156:0:57965:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191343.232161:0:57965:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191343.232164:0:57965:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191343.232168:0:57965:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4233bcb8 00010000:00010000:2.0:1787191343.232171:0:57965:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.232186:0:57965:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.232289:0:57965:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191343.232298:0:57965:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191343.232305:0:57965:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.232313:0:57965:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.232319:0:57965:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191343.232323:0:57965:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191343.232325:0:57965:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191343.232329:0:57965:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4233bb58 00010000:00010000:2.0:1787191343.232332:0:57965:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.232339:0:57965:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.232348:0:57965:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191343.232354:0:57965:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191343.232359:0:57965:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191343.232367:0:57965:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:2.0:1787191343.232371:0:57965:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191343.232383:0:57965:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191343.232420:0:57965:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483ad3e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.232427:0:57965:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483ad3e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.232437:0:57965:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483ad3e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191343.232457:0:57965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57965:1874004626825088:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191343.232539:0:57965:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338ff00 going to sleep for 11 seconds 00000080:00200000:0.0:1787191343.233819:0:57966:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191343.234021:0:57966:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.234034:0:57966:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.234048:0:57966:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.234055:0:57966:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191343.234062:0:57966:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191343.234065:0:57966:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191343.234071:0:57966:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42333bf8 00010000:00010000:0.0:1787191343.234075:0:57966:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.234085:0:57966:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.234097:0:57966:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.234103:0:57966:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191343.234108:0:57966:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:2.0:1787191343.235229:0:57965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57965:1874004626825088:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191343.235245:0:57965:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483ad3e lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.235255:0:57965:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483ad3e lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.235261:0:57965:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483ad3e lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.235268:0:57965:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483ad3e lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.235274:0:57965:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483ad3e lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.235280:0:57965:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51185600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191343.235284:0:57965:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483ad3e lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.235293:0:57965:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483ad3e lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.235299:0:57965:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483ad3e lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.235306:0:57965:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191343.235311:0:57965:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483ad3e lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.235318:0:57965:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483ad3e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191343.235335:0:57965:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513b9180 x1874004626825088/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191343.235347:0:57965:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1787191343.235372:0:57965:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483ad37 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607483 expref: -99 pid: 57965 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191343.235384:0:57965:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483ad37 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607483 expref: -99 pid: 57965 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:2.0:1787191343.235391:0:57965:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ad37 from it ffffa3fb4233b930 00010000:00010000:2.0:1787191343.235395:0:57965:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483ad37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607483 expref: -99 pid: 57965 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191343.235403:0:57965:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483ad37 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607483 expref: -99 pid: 57965 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191343.235464:0:57965:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191343.235475:0:57965:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191343.235482:0:57965:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.235803:0:57965:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.235810:0:57965:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191343.235815:0:57965:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191343.235818:0:57965:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191343.235822:0:57965:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4233bbf8 00010000:00010000:2.0:1787191343.235825:0:57965:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.235914:0:57965:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.235925:0:57965:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191343.235931:0:57965:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191343.235935:0:57965:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.236026:0:57966:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:0.0:1787191343.236033:0:57966:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b589fb380, open_flags d900, mode 0 opened 0 00000080:00200000:0.0:1787191343.236207:0:57966:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191343.236219:0:57966:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.236226:0:57966:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.236236:0:57966:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.236243:0:57966:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191343.236247:0:57966:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191343.236250:0:57966:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191343.236254:0:57966:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42333b58 00010000:00010000:0.0:1787191343.236257:0:57966:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.236266:0:57966:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.236275:0:57966:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.236279:0:57966:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191343.236283:0:57966:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.236286:0:57966:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=9 00000080:00200000:2.0:1787191343.239959:0:57965:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:2.0:1787191343.239973:0:57965:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:2.0:1787191343.239982:0:57965:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b53066c00, open_flags a141, mode 81b6 opened 0 00000080:00200000:2.0:1787191343.239993:0:57965:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:2.0:1787191343.240031:0:57965:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xe5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:2.0:1787191343.240045:0:57965:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483ad37 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4607483 expref: -99 pid: 57965 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191343.240107:0:57965:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483ad37 lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4607483 expref: -99 pid: 57965 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191343.240115:0:57965:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191343.240118:0:57965:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483ad37 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4607483 expref: -99 pid: 57965 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191343.240150:0:57965:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483ad45 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.240158:0:57965:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483ad45 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191343.240169:0:57965:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191343.240180:0:57965:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9180 x1874004626825344/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191343.240190:0:57965:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483ad45 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191343.240209:0:57965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57965:1874004626825344:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191343.240394:0:57965:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338ff00 going to sleep for 11 seconds 00000080:00200000:0.0:1787191343.243754:0:57967:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191343.243783:0:57967:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.243798:0:57967:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.243813:0:57967:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.243822:0:57967:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191343.243829:0:57967:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191343.243859:0:57967:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191343.243866:0:57967:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42303bf8 00010000:00010000:0.0:1787191343.243869:0:57967:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.243878:0:57967:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.243892:0:57967:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.243900:0:57967:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191343.243905:0:57967:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:2.0:1787191343.249966:0:57965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57965:1874004626825344:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191343.249991:0:57965:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483ad45 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46074b4 expref: -99 pid: 57965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.250025:0:57965:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483ad45 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46074b4 expref: -99 pid: 57965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.250034:0:57965:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483ad45 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46074b4 expref: -99 pid: 57965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.250044:0:57965:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483ad45 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46074b4 expref: -99 pid: 57965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.250055:0:57965:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483ad45 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46074b4 expref: -99 pid: 57965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.250068:0:57965:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483ad45 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46074b4 expref: -99 pid: 57965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.250074:0:57965:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483ad45 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46074b4 expref: -99 pid: 57965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.250079:0:57965:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483ad45 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46074b4 expref: -99 pid: 57965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191343.250087:0:57965:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b513b9180 x1874004626825344/t8589937176(8589937176) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191343.250095:0:57965:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9180 x1874004626825344/t8589937176(8589937176) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191343.250104:0:57965:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483ad45 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46074b4 expref: -99 pid: 57965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.250110:0:57965:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/229 (0 0) 00000080:00200000:2.0:1787191343.250116:0:57965:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191343.250126:0:57965:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:2.0:1787191343.250150:0:57965:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88) 00000080:00200000:2.0:1787191343.250155:0:57965:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xe5:0x0], updating i_size 0 00000080:00200000:2.0:1787191343.250183:0:57965:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe5:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:2.0:1787191343.250186:0:57965:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) 00000080:00010000:2.0:1787191343.250188:0:57965:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) for lock 0xe5129dc88483ad45 00000080:00010000:2.0:1787191343.250195:0:57965:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) 00000080:00200008:2.0:1787191343.250208:0:57965:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe5:0x0](ffff936b4898ba88), flags 120501 00000002:00100000:2.0:1787191343.250223:0:57965:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9180 x1874004626825344/t8589937176(8589937176) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1787191343.250246:0:57965:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ad45 from it ffff936b60dc4360 00010000:00010000:2.0:1787191343.250249:0:57965:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483ad45 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46074b4 expref: -99 pid: 57965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.250256:0:57965:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483ad45 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46074b4 expref: -99 pid: 57965 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191343.250272:0:57965:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88), inode mode 81a4 mask 40 00000080:00200000:2.0:1787191343.250325:0:57965:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88), inode mode 81a4 mask 2 00000080:00200000:2.0:1787191343.250333:0:57965:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88), xattr lov 00000002:00010000:2.0:1787191343.250347:0:57965:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe5:0x0]) in obj [0x200000405:0xe5:0x0], intent: open flags 040000002 00010000:00010000:2.0:1787191343.250380:0:57965:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483ad4c lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.250384:0:57965:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483ad4c lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191343.250395:0:57965:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191343.250399:0:57965:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8700 x1874004626825600/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191343.250405:0:57965:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483ad4c lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191343.250420:0:57965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57965:1874004626825600:192.168.202.101@tcp:101:lfs.0 00000080:00200000:0.0:1787191343.250604:0:57967:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:0.0:1787191343.250610:0:57967:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88), inode mode 81a4 mask 44 00000080:00200008:0.0:1787191343.250614:0:57967:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe5:0x0](ffff936b4898ba88), flags 154400 00000002:00010000:0.0:1787191343.250623:0:57967:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe5:0x0]) in obj [0x200000405:0xe5:0x0], intent: open flags 0100240114401 00010000:00010000:0.0:1787191343.250643:0:57967:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483ad53 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.250650:0:57967:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483ad53 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57967 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191343.250656:0:57967:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:0.0:1787191343.250661:0:57967:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477b80 x1874004626825856/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191343.250669:0:57967:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483ad53 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.250682:0:57967:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57967:1874004626825856:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191343.250858:0:57965:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.251188:0:57967:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787191343.251764:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191343.253522:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191343.253575:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634933888 00000100:00100000:2.0:1787191343.253589:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634933888 00000100:00100000:2.0:1787191343.253637:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1484 00000100:00100000:2.0:1787191343.253647:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634933888:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191343.253665:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483ad45 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46074b4 expref: -99 pid: 57965 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.253730:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191343.253735:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634933888:12345-192.168.202.101@tcp:104: Request processed in 91us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191343.253741:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1484 00010000:00010000:1.0:1787191343.253991:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191343.253997:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483ad45 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46074b4 expref: -99 pid: 57965 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.254006:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51184a00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191343.254019:0:40930:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483ad45 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46074b4 expref: -99 pid: 57965 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.254027:0:40930:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483ad45 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46074b4 expref: -99 pid: 57965 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.254040:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483ad45 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e46074b4 expref: -99 pid: 57965 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191343.254058:0:40930:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe5:0x0]: losing layout lock 00010000:00010000:1.0:1787191343.254095:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483ad45 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46074b4 expref: -99 pid: 57965 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.254100:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191343.254116:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483ad45 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46074b4 expref: -99 pid: 57965 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.254121:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483ad45 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46074b4 expref: -99 pid: 57965 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.254130:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191343.254131:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191343.254132:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191343.254142:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626825984:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191343.254979:0:57967:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57967:1874004626825856:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191343.254994:0:57967:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483ad53 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46074d0 expref: -99 pid: 57967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.255002:0:57967:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483ad53 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46074d0 expref: -99 pid: 57967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.255021:0:57967:0:(ldlm_request.c:795:ldlm_cli_enqueue_fini()) ### enqueue reply includes blocking AST ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483ad53 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e46074d0 expref: -99 pid: 57967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.255031:0:57967:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483ad53 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e46074d0 expref: -99 pid: 57967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.255041:0:57967:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483ad53 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e46074d0 expref: -99 pid: 57967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.255053:0:57967:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483ad53 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e46074d0 expref: -99 pid: 57967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.255061:0:57967:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483ad53 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e46074d0 expref: -99 pid: 57967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.255069:0:57967:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483ad53 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e46074d0 expref: -99 pid: 57967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.255081:0:57967:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b6a477b80 x1874004626825856/t8589937177(8589937177) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191343.255090:0:57967:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477b80 x1874004626825856/t8589937177(8589937177) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191343.255098:0:57967:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483ad53 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e46074d0 expref: -99 pid: 57967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.255104:0:57967:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/229 (0 0) 00000080:00200000:0.0:1787191343.255108:0:57967:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xe5:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787191343.255122:0:57967:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xe5:0x0], updating i_size 0 00000080:00200000:0.0:1787191343.255131:0:57967:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe5:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1787191343.255134:0:57967:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) for lock 0xe5129dc88483ad53 00000080:00010000:0.0:1787191343.255138:0:57967:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ad53 from it ffffa3fb42303bf0 00010000:00010000:0.0:1787191343.255140:0:57967:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483ad53 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10420400000000 nid: local remote: 0x7130d520e46074d0 expref: -99 pid: 57967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.255145:0:57967:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483ad53 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10420400000000 nid: local remote: 0x7130d520e46074d0 expref: -99 pid: 57967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.255155:0:57967:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000002:00100000:0.0:1787191343.255164:0:57967:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477b80 x1874004626825856/t8589937177(8589937177) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191343.255299:0:57967:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88), inode mode 81a4 mask 4 00000080:00200000:0.0:1787191343.255305:0:57967:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88), xattr lov 00000080:00200008:0.0:1787191343.255334:0:57967:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe5:0x0](ffff936b4898ba88), flags 154000 00000002:00100000:0.0:1787191343.255363:0:57967:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a477b80 x1874004626825856/t8589937177(8589937177) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191359 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191343.255369:0:57967:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:0.0:1787191343.255373:0:57967:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474a80 x1874004626826240/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191343.255384:0:57967:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57967:1874004626826240:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191343.255460:0:57967:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99840 going to sleep for 11 seconds 00010000:00010000:1.0:1787191343.255507:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191343.255512:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483ad53 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46074d0 expref: -99 pid: 57967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.255517:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b43adea00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191343.255519:0:43384:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483ad53 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46074d0 expref: -99 pid: 57967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.255525:0:43384:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483ad53 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46074d0 expref: -99 pid: 57967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.255530:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483ad53 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e46074d0 expref: -99 pid: 57967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1787191343.255539:0:43384:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe5:0x0]: losing layout lock 00010000:00010000:1.0:1787191343.255556:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483ad53 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46074d0 expref: -99 pid: 57967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.255560:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191343.255581:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483ad53 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46074d0 expref: -99 pid: 57967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.255586:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483ad53 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46074d0 expref: -99 pid: 57967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.255593:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191343.255598:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191343.255600:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191343.255607:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787191343.255613:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626826368:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191343.256469:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626825984:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191343.258901:0:57965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57965:1874004626825600:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191343.258922:0:57965:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483ad4c lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.258935:0:57965:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483ad4c lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.258946:0:57965:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483ad4c lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.258953:0:57965:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483ad4c lrc: 3/0,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.258962:0:57965:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483ad4c lrc: 4/0,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.258968:0:57965:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51185c00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191343.258972:0:57965:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483ad4c lrc: 4/0,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.258979:0:57965:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483ad4c lrc: 4/0,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.258985:0:57965:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483ad4c lrc: 5/0,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.258993:0:57965:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191343.258998:0:57965:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483ad4c lrc: 3/0,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.259005:0:57965:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483ad4c lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57965 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191343.259037:0:57965:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b513b8700 x1874004626825600/t8589937179(8589937179) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191343.259050:0:57965:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b8700 x1874004626825600/t8589937179(8589937179) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191343.259068:0:57965:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xe5:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787191343.259153:0:57965:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1787191343.259161:0:57965:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191343.259208:0:57965:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xe5:0x0], updating i_size 0 00000002:00100000:1.0:1787191343.259227:0:57965:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b8700 x1874004626825600/t8589937179(8589937179) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191343.259266:0:57965:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513b8700 x1874004626825600/t8589937179(8589937179) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191343.259276:0:57965:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191343.259281:0:57965:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453aa680 x1874004626826624/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191343.259301:0:57965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57965:1874004626826624:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191343.259363:0:57965:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.259601:0:57967:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57967:1874004626826240:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191343.259617:0:57967:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a477b80 x1874004626825856/t8589937177(8589937177) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/608 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191343.259770:0:57967:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191343.259784:0:57967:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.259797:0:57967:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.259808:0:57967:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.259815:0:57967:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191343.259820:0:57967:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191343.259824:0:57967:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191343.259857:0:57967:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42303bf8 00010000:00010000:0.0:1787191343.259862:0:57967:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.259877:0:57967:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.259892:0:57967:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.259899:0:57967:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191343.259904:0:57967:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.259916:0:57967:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b6282fb00, open_flags d900, mode 0 opened 0 00000080:00200000:0.0:1787191343.259922:0:57967:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:0.0:1787191343.259935:0:57967:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:0.0:1787191343.259975:0:57967:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ad5a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.259983:0:57967:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ad5a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57967 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191343.259993:0:57967:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:0.0:1787191343.259999:0:57967:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475880 x1874004626826880/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191343.260015:0:57967:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ad5a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.260030:0:57967:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57967:1874004626826880:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191343.260259:0:57967:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99840 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.260781:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626826368:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191343.262492:0:57965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57965:1874004626826624:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191343.262522:0:57965:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513b8700 x1874004626825600/t8589937179(8589937179) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1787191343.262575:0:57965:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe5:0x0](ffff936b4898ba88), flags 100001 00000002:00100000:1.0:1787191343.262616:0:57965:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513b9180 x1874004626825344/t8589937176(8589937176) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191359 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191343.262626:0:57965:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191343.262631:0:57965:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9500 x1874004626827136/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191343.262651:0:57965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57965:1874004626827136:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191343.262855:0:57965:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.263315:0:57967:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57967:1874004626826880:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191343.263330:0:57967:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ad5a lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607501 expref: -99 pid: 57967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.263355:0:57967:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ad5a lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607501 expref: -99 pid: 57967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.263369:0:57967:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ad5a lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607501 expref: -99 pid: 57967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.263380:0:57967:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ad5a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607501 expref: -99 pid: 57967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.263389:0:57967:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ad5a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607501 expref: -99 pid: 57967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.263401:0:57967:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ad5a lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607501 expref: -99 pid: 57967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.263409:0:57967:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ad5a lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607501 expref: -99 pid: 57967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.263416:0:57967:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ad5a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607501 expref: -99 pid: 57967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.263425:0:57967:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b6a475880 x1874004626826880/t8589937181(8589937181) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191343.263436:0:57967:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475880 x1874004626826880/t8589937181(8589937181) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191343.263448:0:57967:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ad5a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607501 expref: -99 pid: 57967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191343.263460:0:57967:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ad5a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607501 expref: -99 pid: 57967 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.263469:0:57967:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/229 (0 0) 00000080:00200000:0.0:1787191343.263475:0:57967:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191343.263512:0:57967:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xe5:0x0](ffff936b4898ba88): rc = 0 00000080:00200000:0.0:1787191343.263525:0:57967:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe5:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:0.0:1787191343.263530:0:57967:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) for lock 0xe5129dc88483ad5a 00000080:00010000:0.0:1787191343.263541:0:57967:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) 00000080:00200008:0.0:1787191343.263551:0:57967:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe5:0x0](ffff936b4898ba88), flags 154400 00000002:00100000:0.0:1787191343.263566:0:57967:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475880 x1874004626826880/t8589937181(8589937181) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191343.263615:0:57967:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ad5a from it ffff936b530f5840 00010000:00010000:0.0:1787191343.263620:0:57967:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ad5a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607501 expref: -99 pid: 57967 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.263628:0:57967:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ad5a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607501 expref: -99 pid: 57967 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191343.263651:0:57967:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88), inode mode 81a4 mask 44 00000080:00200000:0.0:1787191343.263708:0:57967:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88), inode mode 81a4 mask 4 00000080:00200000:0.0:1787191343.263716:0:57967:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88), xattr lov 00000080:00200008:0.0:1787191343.263768:0:57967:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe5:0x0](ffff936b4898ba88), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191343.263775:0:57967:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88),name=f70.sanity-flr 00000002:00010000:0.0:1787191343.263792:0:57967:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.263799:0:57967:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ad5a lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607501 expref: -99 pid: 57967 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.263814:0:57967:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ad5a lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607501 expref: -99 pid: 57967 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191343.263821:0:57967:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191343.263827:0:57967:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) 00000100:00100000:1.0:1787191343.264283:0:57965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57965:1874004626827136:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191343.264301:0:57965:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513b9180 x1874004626825344/t8589937176(8589937176) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191343.265605:0:57967:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) for lock 0xe5129dc88483ad5a 00000080:00010000:0.0:1787191343.265621:0:57967:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ad5a from it ffffa3fb42303cd8 00010000:00010000:0.0:1787191343.265626:0:57967:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ad5a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607501 expref: -99 pid: 57967 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.265638:0:57967:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ad5a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607501 expref: -99 pid: 57967 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191343.265666:0:57967:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe5:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1787191343.265678:0:57967:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe5:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191343.265681:0:57967:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191343.265684:0:57967:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe5:0x0] 00000008:00010000:0.0:1787191343.265703:0:57967:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191343.265706:0:57967:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f99870, osc lock ffff936b50b62720, flags 0x400000400001002 00000008:00010000:0.0:1787191343.265712:0:57967:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191343.265714:0:57967:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f998b0, osc lock ffff936b50b63560, flags 0x400000400001002 00010000:00010000:0.0:1787191343.265757:0:57967:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483ad61 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.265768:0:57967:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483ad61 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.265787:0:57967:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b6a474e00 x1874004626827264/t0(0) o101->lustre-OST0000-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191343.265845:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787191343.265861:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626827264:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191343.265972:0:57967:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000ed9a6481/0xe5129dc88483ad68 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.265981:0:57967:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000ed9a6481/0xe5129dc88483ad68 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.265989:0:57967:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b6a474380 x1874004626827392/t0(0) o101->lustre-OST0001-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:0.0:1787191343.266005:0:57967:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 2 items remaining. 00000100:00100000:0.0:1787191343.266028:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626827392:192.168.202.101@tcp:101:lfs.0 00000080:00200000:2.0:1787191343.267461:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191343.267486:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191343.267500:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.267513:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.267526:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191343.267532:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191343.267535:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191343.267541:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:2.0:1787191343.267545:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.267552:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.267564:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191343.267571:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191343.267576:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191343.267583:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:2.0:1787191343.267588:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88), inode mode 81a4 mask 42 00000080:00200008:2.0:1787191343.267595:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe5:0x0](ffff936b4898ba88), flags 101101 00000002:00010000:2.0:1787191343.267611:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe5:0x0]) in obj [0x200000405:0xe5:0x0], intent: open|creat flags 04240101102 00010000:00010000:2.0:1787191343.267622:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ad5a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4607501 expref: -99 pid: 57967 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191343.267637:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe5:0x0]: losing layout lock 00010000:00010000:2.0:1787191343.267671:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ad5a lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607501 expref: -99 pid: 57967 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191343.267678:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191343.267680:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ad5a lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607501 expref: -99 pid: 57967 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191343.267718:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ad6f lrc: 3/0,1 mode: --/CW res: [0x200000405:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.267726:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ad6f lrc: 3/0,1 mode: --/CW res: [0x200000405:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191343.267735:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191343.267745:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bad80 x1874004626827648/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191343.267753:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ad6f lrc: 3/0,1 mode: --/CW res: [0x200000405:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191343.267769:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626827648:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191343.268243:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f0c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787191343.271966:0:2389:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000ed9a6481/0xe5129dc88483ad68 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.271993:0:2389:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000ed9a6481/0xe5129dc88483ad68 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607516 expref: -99 pid: 57967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.272018:0:2389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000ed9a6481/0xe5129dc88483ad68 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607516 expref: -99 pid: 57967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.272032:0:2389:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000ed9a6481/0xe5129dc88483ad68 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607516 expref: -99 pid: 57967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191343.272048:0:2389:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000ed9a6481/0xe5129dc88483ad68 lrc: 5/2,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607516 expref: -99 pid: 57967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1787191343.272060:0:2389:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191343.272065:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000ed9a6481/0xe5129dc88483ad68 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4607516 expref: -99 pid: 57967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.272073:0:2389:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000ed9a6481/0xe5129dc88483ad68 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4607516 expref: -99 pid: 57967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.272080:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000ed9a6481/0xe5129dc88483ad68 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4607516 expref: -99 pid: 57967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.272089:0:2389:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000ed9a6481/0xe5129dc88483ad68 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607516 expref: -99 pid: 57967 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1787191343.272108:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626827392:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191343.272128:0:2389:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483ad61 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.272138:0:2389:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483ad61 lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e460750f expref: -99 pid: 57967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.272152:0:2389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483ad61 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460750f expref: -99 pid: 57967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.272161:0:2389:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483ad61 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e460750f expref: -99 pid: 57967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191343.272170:0:2389:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483ad61 lrc: 5/2,0 mode: PR/PR res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460750f expref: -99 pid: 57967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1787191343.272178:0:2389:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1787191343.272190:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483ad61 lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460750f expref: -99 pid: 57967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.272198:0:2389:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483ad61 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460750f expref: -99 pid: 57967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.272205:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483ad61 lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e460750f expref: -99 pid: 57967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.272213:0:2389:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483ad61 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460750f expref: -99 pid: 57967 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1787191343.272223:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626827264:192.168.202.101@tcp:101:lfs.0 00000080:00200000:1.0:1787191343.272430:0:57967:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe5:0x0] updating i_size 0 i_blocks 0 00000020:00010000:1.0:1787191343.272436:0:57967:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51655280 (ffff936b465cca28/0) at cl_lock_release():245 00000020:00010000:1.0:1787191343.272439:0:57967:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51655280 (ffff936b465cca28/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.272444:0:57967:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99870 (ffff936b465ccf38/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.272448:0:57967:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f998b0 (ffff936b47a17008/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.272451:0:57967:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51655280 (ffff936b465cca28/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191343.272454:0:57967:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99870 (ffff936b465cca28/1) at cl_lock_fini():72 00000020:00010000:1.0:1787191343.272457:0:57967:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f998b0 (ffff936b465cca28/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191343.272471:0:57967:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe5:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:1.0:1787191343.272487:0:57967:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/229 (0 0) 00000080:00010000:1.0:1787191343.272498:0:57967:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xe5:0x0](ffff936b4898ba88) 00000002:00010000:1.0:1787191343.272506:0:57967:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe5:0x0]) in obj [0x200000405:0xe5:0x0], intent: layout flags 0 00010000:00010000:1.0:1787191343.272542:0:57967:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ad76 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.272550:0:57967:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ad76 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.272559:0:57967:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ad76 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.272581:0:57967:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57967:1874004626827776:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191343.272641:0:57967:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.276497:0:57967:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57967:1874004626827776:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191343.276528:0:57967:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ad76 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607532 expref: -99 pid: 57967 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.276543:0:57967:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ad76 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607532 expref: -99 pid: 57967 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191343.276559:0:57967:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b453a8a80 x1874004626827776/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191343.276571:0:57967:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ad76 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607532 expref: -99 pid: 57967 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191343.276583:0:57967:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ad76 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607532 expref: -99 pid: 57967 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.276592:0:57967:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/229 (0 0) 00000080:00200000:1.0:1787191343.276598:0:57967:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xe5:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191343.276614:0:57967:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) for lock 0xe5129dc88483ad76 00000080:00010000:1.0:1787191343.276621:0:57967:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ad76 from it ffffa3fb42303bc8 00010000:00010000:1.0:1787191343.276626:0:57967:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ad76 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607532 expref: -99 pid: 57967 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.276635:0:57967:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ad76 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607532 expref: -99 pid: 57967 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.276660:0:57967:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ad76 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607532 expref: -99 pid: 57967 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.276671:0:57967:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ad76 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607532 expref: -99 pid: 57967 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:1.0:1787191343.276678:0:57967:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xe5:0x0](000000009d25d36f) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ad76 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607532 expref: -99 pid: 57967 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191343.276720:0:57967:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe5:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:1.0:1787191343.276725:0:57967:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ad76 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607532 expref: -99 pid: 57967 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.276733:0:57967:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ad76 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607532 expref: -99 pid: 57967 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200008:1.0:1787191343.276804:0:57967:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe5:0x0](ffff936b4898ba88), flags 154000 00000100:00100000:0.0:1787191343.276988:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626827648:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191343.277003:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ad6f lrc: 4/0,1 mode: --/CW res: [0x200000405:0xe5:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607524 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.277024:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ad6f lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xe5:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607524 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.277035:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ad6f lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xe5:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607524 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.277045:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x200002b, status=0 req@ffff936b513bad80 x1874004626827648/t8589937183(8589937183) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191343.277057:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bad80 x1874004626827648/t8589937183(8589937183) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191343.277069:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ad6f lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xe5:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607524 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191343.277080:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ad6f lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xe5:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607524 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.277087:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 8 res 8589935621/229 (0 0) 00000080:00200000:0.0:1787191343.277101:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000405:0xe5:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787191343.277134:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe5:0x0]: layout version change: 3 -> 3 00000080:00010000:0.0:1787191343.277138:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) for lock 0xe5129dc88483ad6f 00000080:00010000:0.0:1787191343.277142:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ad6f from it ffffa3fb41cabbf0 00010000:00010000:0.0:1787191343.277146:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ad6f lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xe5:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607524 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.277154:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ad6f lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xe5:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607524 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000002:00100000:0.0:1787191343.277172:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bad80 x1874004626827648/t8589937183(8589937183) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191343.277225:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xe5:0x0], intent: getxattr flags 0 00010000:00010000:0.0:1787191343.277253:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483ad7d lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.277260:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483ad7d lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.277269:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483ad7d lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.277287:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626827904:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191343.277356:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000002:00100000:1.0:1787191343.278369:0:57967:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a475880 x1874004626826880/t8589937181(8589937181) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191343.278381:0:57967:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191343.278386:0:57967:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8a80 x1874004626828160/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191343.278404:0:57967:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57967:1874004626828160:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191343.278461:0:57967:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.282455:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626827904:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191343.282480:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483ad7d lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607540 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.282496:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483ad7d lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607540 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.282508:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483ad7d lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607540 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.282526:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b6a474e00 x1874004626827904/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191343.282538:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483ad7d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607540 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.282549:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/229 (0 0) 00000080:00200000:0.0:1787191343.282555:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xe5:0x0] suppgids 0 -1: rc 0 00000080:00010000:0.0:1787191343.282577:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) for lock 0xe5129dc88483ad7d 00000080:00010000:0.0:1787191343.282585:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ad7d from it ffffa3fb41caba38 00010000:00010000:0.0:1787191343.282589:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483ad7d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607540 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.282597:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483ad7d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607540 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:0.0:1787191343.282631:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xe5:0x0](ffff936b4898ba88) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191343.000000000, mtime 1787191343.000000000, ctime 1787191343.000000000 00010000:00010000:0.0:1787191343.282658:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ad6f lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xe5:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4607524 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.282678:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ad76 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607532 expref: -99 pid: 57967 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191343.282711:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ad6f lrc: 1/0,0 mode: --/CW res: [0x200000405:0xe5:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607524 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.282723:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191343.282727:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ad6f lrc: 0/0,0 mode: --/CW res: [0x200000405:0xe5:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607524 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1787191343.282743:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 36, max 7 00000100:00100000:0.0:1787191343.282749:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474e00 x1874004626828416/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787191343.282781:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626828416:192.168.202.101@tcp:36:bash.0 00000100:00100000:0.0:1787191343.283132:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.283503:0:57967:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57967:1874004626828160:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191343.283524:0:57967:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a475880 x1874004626826880/t8589937181(8589937181) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191343.283590:0:57967:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191343.283605:0:57967:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.283616:0:57967:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.283626:0:57967:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.283633:0:57967:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191343.283638:0:57967:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191343.283642:0:57967:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191343.283647:0:57967:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42303bf8 00010000:00010000:1.0:1787191343.283650:0:57967:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.283659:0:57967:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.283669:0:57967:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191343.283675:0:57967:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191343.283679:0:57967:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191343.283691:0:57967:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b5127a180, open_flags d902, mode 0 opened 0 00000080:00200000:1.0:1787191343.283697:0:57967:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:1.0:1787191343.283709:0:57967:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154403 00010000:00010000:1.0:1787191343.283742:0:57967:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ad84 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57967 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.283751:0:57967:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ad84 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57967 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191343.284076:0:57967:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191343.284083:0:57967:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8a80 x1874004626828672/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191343.284093:0:57967:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ad84 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57967 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.284107:0:57967:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57967:1874004626828672:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191343.284275:0:57967:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.287635:0:57967:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57967:1874004626828672:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191343.287661:0:57967:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ad84 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607563 expref: -99 pid: 57967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.287684:0:57967:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ad84 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607563 expref: -99 pid: 57967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.287692:0:57967:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ad84 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x19/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607563 expref: -99 pid: 57967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.287704:0:57967:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ad84 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x19/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607563 expref: -99 pid: 57967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.287713:0:57967:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ad84 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x19/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607563 expref: -99 pid: 57967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.287730:0:57967:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ad84 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x19/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607563 expref: -99 pid: 57967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.287739:0:57967:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ad84 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x19/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607563 expref: -99 pid: 57967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.287747:0:57967:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ad84 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x19/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607563 expref: -99 pid: 57967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191343.287767:0:57967:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b453a8a80 x1874004626828672/t8589937187(8589937187) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191343.287781:0:57967:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8a80 x1874004626828672/t8589937187(8589937187) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191343.287793:0:57967:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ad84 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x19/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607563 expref: -99 pid: 57967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191343.287806:0:57967:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ad84 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x19/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607563 expref: -99 pid: 57967 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.287817:0:57967:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/229 (0 0) 00000080:00200000:1.0:1787191343.287824:0:57967:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000100:00100000:0.0:1787191343.288239:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626828416:192.168.202.101@tcp:36:bash.0 00000080:00200000:0.0:1787191343.288279:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:0.0:1787191343.288286:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe5:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191343.288296:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xe5:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:0.0:1787191343.288302:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe5:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191343.288306:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xe5:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:0.0:1787191343.288315:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xe5:0x0](ffff936b4898ba88) 00000002:00010000:0.0:1787191343.288327:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe5:0x0]) in obj [0x200000405:0xe5:0x0], intent: layout flags 02 00010000:00010000:0.0:1787191343.288344:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ad76 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4607532 expref: -99 pid: 57967 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191343.288362:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ad84 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x19/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607563 expref: -99 pid: 57967 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.288399:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ad76 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607532 expref: -99 pid: 57967 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191343.288411:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191343.288415:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483ad76 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607532 expref: -99 pid: 57967 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191343.288437:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483ad8b lrc: 3/0,1 mode: --/EX res: [0x200000405:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.288445:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483ad8b lrc: 3/0,1 mode: --/EX res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191343.288456:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191343.288464:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474380 x1874004626828928/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191343.288474:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483ad8b lrc: 3/0,1 mode: --/EX res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.288495:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626828928:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191343.288618:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000080:00200000:1.0:1787191343.288702:0:57967:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xe5:0x0](ffff936b4898ba88): rc = 0 00000080:00200000:1.0:1787191343.288718:0:57967:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe5:0x0]: layout version change: 3 -> 3 00000080:00010000:1.0:1787191343.288724:0:57967:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) for lock 0xe5129dc88483ad84 00000080:00010000:1.0:1787191343.288736:0:57967:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) 00000080:00200008:1.0:1787191343.288751:0:57967:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe5:0x0](ffff936b4898ba88), flags 154402 00000002:00100000:1.0:1787191343.288772:0:57967:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8a80 x1874004626828672/t8589937187(8589937187) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191343.288821:0:57967:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a8a80 x1874004626828672/t8589937187(8589937187) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191343.288857:0:57967:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:1.0:1787191343.288863:0:57967:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9880 x1874004626829184/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191343.288886:0:57967:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57967:1874004626829184:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191343.288915:0:57967:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.291315:0:57967:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57967:1874004626829184:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191343.291348:0:57967:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a8a80 x1874004626828672/t8589937187(8589937187) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191343.291422:0:57967:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ad84 from it ffff936b5339fba0 00010000:00010000:1.0:1787191343.291431:0:57967:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ad84 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x19/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607563 expref: -99 pid: 57967 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.291442:0:57967:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ad84 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x19/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607563 expref: -99 pid: 57967 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191343.291464:0:57967:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88), inode mode 81a4 mask 46 00000080:00200080:1.0:1787191343.291547:0:57967:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88) cmd=800466af arg=7ffe6bb3927c 00000080:00200080:1.0:1787191343.291564:0:57967:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88) cmd=80086601 arg=7ffe6bb39218 00000100:00100000:1.0:1787191343.291606:0:57967:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57967:1874004626829312:192.168.202.101@tcp:33:lfs.0 00000100:00100000:1.0:1787191343.291722:0:57967:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191343.296533:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191343.296617:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634934016 00000100:00100000:3.0:1787191343.296627:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634934016 00000100:00100000:3.0:1787191343.296684:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1485 00000100:00100000:3.0:1787191343.296695:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634934016:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191343.296714:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ad84 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x19/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4607563 expref: -99 pid: 57967 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191343.296800:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191343.296807:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634934016:12345-192.168.202.101@tcp:104: Request processed in 114us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191343.296814:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1485 00010000:00010000:0.0:1787191343.297282:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191343.297290:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ad84 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x19/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4607563 expref: -99 pid: 57967 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.297300:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b413fe800 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191343.297305:0:57627:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ad84 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x19/0x19 rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4607563 expref: -99 pid: 57967 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.297314:0:57627:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ad84 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x19/0x19 rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4607563 expref: -99 pid: 57967 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.297324:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ad84 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x19/0x19 rrc: 4 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4607563 expref: -99 pid: 57967 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191343.297346:0:57627:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe5:0x0]: losing layout lock 00010000:00010000:0.0:1787191343.297390:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ad84 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x19/0x19 rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607563 expref: -99 pid: 57967 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.297398:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191343.297423:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ad84 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x19/0x19 rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607563 expref: -99 pid: 57967 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.297430:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ad84 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x19/0x19 rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607563 expref: -99 pid: 57967 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.297449:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191343.297451:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191343.297453:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191343.297470:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626829440:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191343.299228:0:57967:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57967:1874004626829312:192.168.202.101@tcp:33:lfs.0 00000080:00200080:1.0:1787191343.299268:0:57967:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88) cmd=c00c66f3 arg=7ffe6bb39204 00000080:00200008:1.0:1787191343.300420:0:57967:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe5:0x0](ffff936b4898ba88), flags 154002 00000100:00100000:0.0:1787191343.304076:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626829440:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191343.306434:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191343.306497:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634935296 00000100:00100000:3.0:1787191343.306505:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634935296 00000100:00100000:3.0:1787191343.306545:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1486 00000100:00100000:3.0:1787191343.306554:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:37089:x1874004634935296:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191343.306571:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483ad06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e46073e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191343.306648:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191343.306655:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:37089:x1874004634935296:12345-192.168.202.101@tcp:104: Request processed in 102us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191343.306662:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1486 00010000:00010000:1.0:1787191343.306715:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191343.306722:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483ad06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e46073e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.306731:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b413ff200 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191343.306737:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483ad06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e46073e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.306775:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483ad06 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e46073e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.306783:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191343.306804:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483ad06 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e46073e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.306811:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483ad06 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e46073e2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.306868:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191343.306870:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191343.306880:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191343.306888:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787191343.306903:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626829568:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191343.307194:0:57570:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589937189 gen 1 00000100:00100000:0.0:1787191343.307264:0:57570:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b513bad80 x1874004626827648/t8589937183(8589937183) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787191343.307279:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626828928:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191343.307294:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483ad8b lrc: 4/0,1 mode: --/EX res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607578 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.307310:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483ad8b lrc: 4/0,1 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607578 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.307320:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483ad8b lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607578 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.307330:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483ad8b lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607578 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.307341:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483ad8b lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607578 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.307350:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483ad8b lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607578 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.307357:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483ad8b lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607578 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.307366:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b6a474380 x1874004626828928/t8589937189(8589937189) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191343.307380:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483ad8b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607578 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191343.307390:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483ad8b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607578 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.307405:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/229 (0 0) 00000080:00200000:0.0:1787191343.307411:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xe5:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191343.307421:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) for lock 0xe5129dc88483ad8b 00000080:00010000:0.0:1787191343.307428:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ad8b from it ffffa3fb41cab930 00010000:00010000:0.0:1787191343.307432:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483ad8b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607578 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.307440:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483ad8b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607578 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191343.307454:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:0.0:1787191343.307460:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe5:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:0.0:1787191343.307474:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483ad8b lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607578 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.307483:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483ad8b lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607578 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1787191343.307491:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xe5:0x0](000000009d25d36f) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483ad8b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607578 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.307524:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483ad8b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607578 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.307533:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483ad8b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607578 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191343.307575:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191343.307585:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe5:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191343.307588:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191343.307595:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:0.0:1787191343.307648:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:0.0:1787191343.307661:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483ad8b lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607578 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.307669:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483ad8b lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607578 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:0.0:1787191343.307677:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xe5:0x0](000000009d25d36f) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483ad8b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607578 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191343.307695:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191343.307699:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe5:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191343.307701:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191343.307703:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:0.0:1787191343.307745:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:0.0:1787191343.307774:0:57570:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483ad61 lrc: 1/0,0 mode: PR/PR res: [0x280000401:0x1df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e460750f expref: -99 pid: 57967 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000008:00010000:0.0:1787191343.307791:0:57570:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000ed9a6481/0xe5129dc88483ad68 lrc: 1/0,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607516 expref: -99 pid: 57967 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191343.308075:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe5:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:0.0:1787191343.308081:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483ad8b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607578 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.308090:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483ad8b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607578 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00020000:00200000:0.0:1787191343.308159:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xe5:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:0.0:1787191343.308163:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe5:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191343.308165:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191343.308170:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191343.308179:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191343.308182:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:0.0:1787191343.308192:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:0.0:1787191343.308195:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f993f0, osc lock ffff936b50b63a20, flags 0x80000000 00000008:00010000:0.0:1787191343.308199:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:0.0:1787191343.308200:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f99430, osc lock ffff936b50b62850, flags 0x80000000 00010000:00010000:0.0:1787191343.308235:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.308245:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.308256:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.308274:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626829696:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191343.308315:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00000100:00100000:3.0:1787191343.312757:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191343.312794:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:1.0:1787191343.313181:0:40920:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787191343.313210:0:40920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634935552 00000100:00100000:1.0:1787191343.313218:0:40920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634935552 00000100:00100000:2.0:1787191343.313301:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191343.313336:0:40922:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787191343.313343:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634935424 00000100:00100000:3.0:1787191343.313346:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634935424 00000100:00100000:3.0:1787191343.313373:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1487 00000100:00100000:3.0:1787191343.313381:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b4121d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+5:29543:x1874004634935424:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191343.313398:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483acd5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4607379 expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191343.313456:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191343.313462:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b4121d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+5:29543:x1874004634935424:12345-192.168.202.101@tcp:104: Request processed in 82us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191343.313469:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1487 00000080:00200000:3.0:1787191343.315086:0:57968:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191343.315112:0:57968:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191343.315126:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191343.315142:0:57968:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191343.315156:0:57968:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191343.315163:0:57968:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191343.315166:0:57968:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191343.315173:0:57968:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4234bbf8 00010000:00010000:3.0:1787191343.315178:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191343.315186:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191343.315200:0:57968:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191343.315207:0:57968:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191343.315212:0:57968:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191343.315223:0:57968:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b46080d80, open_flags d900, mode 0 opened 0 00000080:00200000:3.0:1787191343.315229:0:57968:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:3.0:1787191343.315253:0:57968:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:3.0:1787191343.315298:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ad99 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.315306:0:57968:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ad99 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57968 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191343.315316:0:57968:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191343.315326:0:57968:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1ea00 x1874004626829952/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191343.315336:0:57968:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ad99 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191343.315355:0:57968:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626829952:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191343.315622:0:57968:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787191343.316993:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626829696:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191343.317024:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.317042:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.317054:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.317069:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191343.317082:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.317102:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.317111:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.317173:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008763ad1f/0xe5129dc88483ada0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.317182:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008763ad1f/0xe5129dc88483ada0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.317190:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008763ad1f/0xe5129dc88483ada0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191343.317206:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626830080:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191343.317343:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.317814:0:40920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634935168 00000100:00100000:1.0:1787191343.317823:0:40920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634935168 00000100:00100000:1.0:1787191343.317896:0:40920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 41 00000100:00100000:1.0:1787191343.317907:0:40920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51f66850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:30353:x1874004634935552:12345-192.168.202.101@tcp:104: 00010000:00010000:1.0:1787191343.317921:0:40920:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080030000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191343.317974:0:40920:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787191343.317980:0:40920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51f66850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:30353:x1874004634935552:12345-192.168.202.101@tcp:104: Request processed in 75us (5185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787191343.317987:0:40920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 41 00000100:00100000:1.0:1787191343.318034:0:40920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 42 00000100:00100000:1.0:1787191343.318040:0:40920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:8720:x1874004634935168:12345-192.168.202.101@tcp:104: 00010000:00010000:1.0:1787191343.318048:0:40920:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483acce lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e460736b expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.318077:0:40920:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787191343.318082:0:40920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:8720:x1874004634935168:12345-192.168.202.101@tcp:104: Request processed in 42us (4782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787191343.318087:0:40920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 42 00010000:00010000:1.0:1787191343.318115:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787191343.318122:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483acd5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4607379 expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.318130:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b4801e600 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191343.318136:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483acd5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e4607379 expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.318169:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483acd5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4607379 expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.318176:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191343.318193:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483acd5 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4607379 expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.318199:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000055983dd9/0xe5129dc88483acd5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4607379 expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.318216:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787191343.318219:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080030000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191343.318225:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b413ffc00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191343.318228:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428480030000 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191343.318245:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480030020 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191343.318252:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191343.318258:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480030020 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191343.318271:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 0000000060687669/0xe5129dc88483acf1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480030020 nid: local remote: 0x7130d520e46073bf expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191343.318284:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191343.318287:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483acce lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e460736b expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.318294:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b4801f200 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191343.318298:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483acce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e460736b expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.318316:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483acce lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e460736b expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.318324:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191343.318328:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483acce lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e460736b expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.318336:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483acce lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e460736b expref: -99 pid: 57962 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.318349:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191343.318350:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191343.318352:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191343.318997:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626830080:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191343.319024:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008763ad1f/0xe5129dc88483ada0 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46075a2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.319038:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008763ad1f/0xe5129dc88483ada0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e46075a2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.319048:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008763ad1f/0xe5129dc88483ada0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e46075a2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.319059:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008763ad1f/0xe5129dc88483ada0 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e46075a2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:3.0:1787191343.319069:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008763ad1f/0xe5129dc88483ada0 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e46075a2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.319080:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008763ad1f/0xe5129dc88483ada0 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46075a2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.319087:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008763ad1f/0xe5129dc88483ada0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46075a2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191343.319634:0:57968:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626829952:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191343.319649:0:57968:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ad99 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46075be expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.319667:0:57968:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ad99 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46075be expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.319676:0:57968:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ad99 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46075be expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.319686:0:57968:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ad99 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46075be expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.319695:0:57968:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ad99 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46075be expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.319705:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ad99 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46075be expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.319718:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ad99 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46075be expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.319725:0:57968:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ad99 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46075be expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191343.319736:0:57968:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b51d1ea00 x1874004626829952/t8589937190(8589937190) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191343.319750:0:57968:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1ea00 x1874004626829952/t8589937190(8589937190) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191343.319763:0:57968:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ad99 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46075be expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191343.319774:0:57968:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ad99 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46075be expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.319783:0:57968:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/229 (0 0) 00000080:00200000:3.0:1787191343.319789:0:57968:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191343.319861:0:57968:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xe5:0x0](ffff936b4898ba88): rc = 0 00000080:00200000:3.0:1787191343.319978:0:57968:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe5:0x0]: layout version change: 4 -> 4 00000080:00010000:3.0:1787191343.319985:0:57968:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) for lock 0xe5129dc88483ad99 00000080:00010000:3.0:1787191343.319998:0:57968:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) 00000080:00200008:3.0:1787191343.320020:0:57968:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe5:0x0](ffff936b4898ba88), flags 154400 00000002:00100000:3.0:1787191343.320042:0:57968:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1ea00 x1874004626829952/t8589937190(8589937190) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1787191343.320107:0:57968:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ad99 from it ffff936b466f4ba0 00010000:00010000:3.0:1787191343.320112:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ad99 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46075be expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.320122:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ad99 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46075be expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191343.320146:0:57968:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88), inode mode 81a4 mask 44 00000080:00200000:3.0:1787191343.320240:0:57968:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88), inode mode 81a4 mask 4 00000080:00200000:3.0:1787191343.320248:0:57968:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88), xattr lov 00000080:00200008:3.0:1787191343.320276:0:57968:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe5:0x0](ffff936b4898ba88), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191343.320281:0:57968:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88),name=f70.sanity-flr 00000002:00010000:3.0:1787191343.320300:0:57968:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191343.320309:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ad99 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46075be expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191343.320317:0:57968:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ad99 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46075be expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191343.320324:0:57968:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191343.320328:0:57968:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) 00000080:00010000:3.0:1787191343.320331:0:57968:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) for lock 0xe5129dc88483ad99 00000080:00010000:3.0:1787191343.320334:0:57968:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ad99 from it ffffa3fb4234bcd8 00010000:00010000:3.0:1787191343.320337:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ad99 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46075be expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191343.320347:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ad99 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46075be expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191343.320364:0:57968:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe5:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:3.0:1787191343.320373:0:57968:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe5:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191343.320377:0:57968:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191343.320381:0:57968:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe5:0x0] 00000008:00010000:3.0:1787191343.320397:0:57968:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191343.320399:0:57968:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667730, osc lock ffff936b44f64980, flags 0x400000400001002 00010000:00010000:3.0:1787191343.320413:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.320423:0:57968:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1787191343.320433:0:57968:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191343.320437:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 7/0,2 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.320446:0:57968:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:3.0:1787191343.320453:0:57968:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191343.320462:0:57968:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe5:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1787191343.320466:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51656bf0 (ffff936b465cccf8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191343.320469:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51656bf0 (ffff936b465cccf8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191343.320473:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667730 (ffff936b465cc5a8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191343.320477:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51656bf0 (ffff936b465cccf8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191343.320480:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667730 (ffff936b465cccf8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191343.320490:0:57968:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe5:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191343.320526:0:57968:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe5:0x0](ffff936b4898ba88), flags 154000 00000002:00100000:3.0:1787191343.320561:0:57968:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1ea00 x1874004626829952/t8589937190(8589937190) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191343.320572:0:57968:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191343.320577:0:57968:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1df80 x1874004626830976/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191343.320717:0:57968:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626830976:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191343.321230:0:57968:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c180 going to sleep for 11 seconds 00000100:00100000:2.0:1787191343.321316:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626830592:192.168.202.101@tcp:10:bash.0 00000100:00100000:2.0:1787191343.321371:0:2392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787191343.321379:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626830720:192.168.202.101@tcp:10:bash.0 00010000:00010000:2.0:1787191343.322555:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191343.322676:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191343.323028:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626830208:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191343.323117:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626830464:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191343.323165:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626829568:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191343.323185:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787191343.323190:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626830336:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191343.323698:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626830720:192.168.202.101@tcp:10:bash.0 00000100:00100000:3.0:1787191343.328969:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626830592:192.168.202.101@tcp:10:bash.0 00000080:00200000:3.0:1787191343.329046:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe5:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1787191343.329053:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b628948a8 (ffff936b47a17ea8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191343.329056:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b628948a8 (ffff936b47a17ea8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191343.329060:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f993f0 (ffff936b47a17cf8/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191343.329070:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.329084:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1787191343.329099:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99430 (ffff936b47a17ab8/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191343.329103:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008763ad1f/0xe5129dc88483ada0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e46075a2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.329112:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008763ad1f/0xe5129dc88483ada0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46075a2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1787191343.329121:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b628948a8 (ffff936b47a17ea8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191343.329124:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f993f0 (ffff936b47a17ea8/1) at cl_lock_fini():72 00000020:00010000:3.0:1787191343.329129:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99430 (ffff936b47a17ea8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191343.329170:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe5:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191343.329191:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xe5:0x0](ffff936b4898ba88) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191343.000000000, mtime 1787191343.000000000, ctime 1787191343.000000000, rc 0 00000080:00200008:3.0:1787191343.329283:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xe5:0x0], ppos: 0, count: 5 00000080:00200000:3.0:1787191343.329295:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:3.0:1787191343.329301:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:3.0:1787191343.329306:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:3.0:1787191343.329310:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:3.0:1787191343.329316:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@00000000a360ba6c[0x110, 1, [0x200000405:0xe5:0x0] hash] 00000020:00200000:3.0:1787191343.329318:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:3.0:1787191343.329322:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe5:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:3.0:1787191343.329335:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xe5:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:3.0:1787191343.329340:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe5:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191343.329343:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:3.0:1787191343.329348:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1787191343.329354:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:3.0:1787191343.329357:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1787191343.329371:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:3.0:1787191343.329381:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:3.0:1787191343.329384:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667730, osc lock ffff936b44f64980, flags 0x0 00010000:00010000:3.0:1787191343.329398:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191343.329412:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191343.329420:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191343.329426:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191343.329430:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191343.329437:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:3.0:1787191343.329442:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:3.0:1787191343.329489:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:3.0:1787191343.329494:0:57570:0:(rw26.c:927:ll_write_end()) page@0000000049cc8482[3 000000004231c313 2 1 00000000433d168f 0 0 0] 00000080:00200000:3.0:1787191343.329497:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @00000000ef259290 17ffffc0001021 2:0 ffff936b508429a0 0 lru 00000080:00200000:3.0:1787191343.329502:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@000000000d0226c3 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000ef00a996 00000000a27deffe > 3< 0 0 > 4< 0 0 8 484581376 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1787191343.329503:0:57570:0:(rw26.c:927:ll_write_end()) end page@0000000049cc8482 00000080:00200000:3.0:1787191343.329504:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1787191343.329507:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:3.0:1787191343.329521:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 00000000ed12b13a ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191343.329534:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b4898bc38, count 1, dirtied 1 00000080:00200000:3.0:1787191343.329537:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:3.0:1787191343.329539:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:3.0:1787191343.329550:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894c68 (ffff936b47a17cf8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191343.329551:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894c68 (ffff936b47a17cf8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191343.329553:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667730 (ffff936b465cccf8/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191343.329556:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191343.329561:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:3.0:1787191343.329567:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894c68 (ffff936b47a17cf8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191343.329569:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667730 (ffff936b47a17cf8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191343.329573:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:3.0:1787191343.329576:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1787191343.329579:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe5:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191343.329581:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:3.0:1787191343.329585:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe5:0x0] updating i_size 5 i_blocks 0 00000080:00200000:3.0:1787191343.329588:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:3.0:1787191343.329604:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe5:0x0](ffff936b4898ba88), flags 100001 00000002:00100000:3.0:1787191343.329658:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513bad80 x1874004626827648/t8589937183(8589937183) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191343.329668:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:3.0:1787191343.329673:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1ce00 x1874004626831232/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191343.329694:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ce00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626831232:192.168.202.101@tcp:35:bash.0 00000100:00100000:3.0:1787191343.330026:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.330114:0:57968:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1df80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626830976:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191343.330133:0:57968:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1ea00 x1874004626829952/t8589937190(8589937190) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191343.330392:0:57968:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191343.330414:0:57968:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.330425:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.330435:0:57968:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.330442:0:57968:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191343.330448:0:57968:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191343.330452:0:57968:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191343.330458:0:57968:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4234bb58 00010000:00010000:0.0:1787191343.330462:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.330469:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.330479:0:57968:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.330485:0:57968:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191343.330490:0:57968:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.330493:0:57968:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=9 00000080:00200008:0.0:1787191343.330501:0:57968:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe5:0x0](ffff936b4898ba88), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191343.330505:0:57968:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88),name=f70.sanity-flr 00000002:00010000:0.0:1787191343.330517:0:57968:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.330523:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ad99 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46075be expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.330531:0:57968:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ad99 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46075be expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191343.330536:0:57968:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191343.330539:0:57968:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) 00000080:00010000:0.0:1787191343.330541:0:57968:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) for lock 0xe5129dc88483ad99 00000080:00010000:0.0:1787191343.330544:0:57968:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ad99 from it ffffa3fb4234bcb8 00010000:00010000:0.0:1787191343.330547:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ad99 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46075be expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.330553:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ad99 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46075be expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191343.330569:0:57968:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe5:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1787191343.330577:0:57968:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe5:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191343.330579:0:57968:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191343.330582:0:57968:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe5:0x0] 00000008:00010000:0.0:1787191343.330611:0:57968:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191343.330613:0:57968:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee6830, osc lock ffff936b50b63300, flags 0x400000400001002 00010000:00010000:0.0:1787191343.330626:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.330641:0:57968:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:0.0:1787191343.330650:0:57968:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191343.330653:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.330660:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:0.0:1787191343.330670:0:57968:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191343.330676:0:57968:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe5:0x0] updating i_size 5 i_blocks 0 00000020:00010000:0.0:1787191343.330680:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509ba060 (ffff936b47a171b8/0) at cl_lock_release():245 00000020:00010000:0.0:1787191343.330683:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509ba060 (ffff936b47a171b8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191343.330686:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee6830 (ffff936b47a17f38/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191343.330689:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509ba060 (ffff936b47a171b8/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191343.330692:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee6830 (ffff936b47a171b8/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191343.330701:0:57968:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe5:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191343.330730:0:57968:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191343.330737:0:57968:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.330743:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.330751:0:57968:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.330761:0:57968:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191343.330766:0:57968:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191343.330768:0:57968:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191343.330772:0:57968:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4234bbf8 00010000:00010000:0.0:1787191343.330776:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.330783:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.330791:0:57968:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.330794:0:57968:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191343.330798:0:57968:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.330805:0:57968:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:0.0:1787191343.330808:0:57968:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88), inode mode 81a4 mask 46 00000080:00200008:0.0:1787191343.330815:0:57968:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe5:0x0](ffff936b4898ba88), flags 154402 00000002:00010000:0.0:1787191343.330828:0:57968:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe5:0x0]) in obj [0x200000405:0xe5:0x0], intent: open flags 0104240114403 00010000:00010000:0.0:1787191343.330896:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ada7 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.330905:0:57968:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ada7 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57968 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191343.330914:0:57968:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191343.330921:0:57968:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474e00 x1874004626831488/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191343.330928:0:57968:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ada7 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.330942:0:57968:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626831488:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191343.331116:0:57968:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.331500:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626830336:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191343.331508:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626830208:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191343.331974:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626830464:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191343.334137:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191343.334411:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634935680 00000100:00100000:2.0:1787191343.334421:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634935680 00000100:00100000:2.0:1787191343.334471:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1488 00000100:00100000:2.0:1787191343.334481:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634935680:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191343.334499:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ad99 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46075be expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000100:00100000:0.0:1787191343.334573:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ce00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626831232:192.168.202.101@tcp:35:bash.0 00010000:00010000:2.0:1787191343.334577:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191343.334591:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634935680:12345-192.168.202.101@tcp:104: Request processed in 112us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191343.334598:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1488 00000002:00100000:0.0:1787191343.334603:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513bad80 x1874004626827648/t8589937183(8589937183) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1787191343.334669:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191343.334677:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ad99 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46075be expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191343.334685:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9a600 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191343.334691:0:40929:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ad99 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46075be expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191343.334699:0:40929:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ad99 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46075be expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191343.334707:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ad99 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e46075be expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191343.334730:0:40929:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483ad8b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607578 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191343.334774:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ad99 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46075be expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191343.334783:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191343.334807:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ad99 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46075be expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191343.334813:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a600/0xe5129dc88483ad99 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46075be expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191343.334827:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191343.334829:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191343.334862:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191343.334877:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626831616:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191343.337813:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626831616:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00200000:3.0:1787191343.340539:0:57969:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191343.340565:0:57969:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191343.340579:0:57969:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191343.340594:0:57969:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191343.340602:0:57969:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191343.340610:0:57969:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191343.340613:0:57969:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191343.340620:0:57969:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42343b58 00010000:00010000:3.0:1787191343.340624:0:57969:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191343.340633:0:57969:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191343.340651:0:57969:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191343.340659:0:57969:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:3.0:1787191343.340665:0:57969:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191343.340677:0:57969:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:3.0:1787191343.340681:0:57969:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:3.0:1787191343.340693:0:57969:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1787191343.340741:0:57969:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483adae lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.340747:0:57969:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483adae lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57969 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.340756:0:57969:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483adae lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57969 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191343.340777:0:57969:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57969:1874004626831744:192.168.202.101@tcp:101:rm.0 00000100:00100000:3.0:1787191343.340867:0:57969:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.341423:0:57968:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626831488:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191343.341441:0:57968:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CW ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ada7 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46075d3 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.341450:0:57968:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ada7 lrc: 4/1,0 mode: --/CW res: [0x200000405:0xe5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46075d3 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.341461:0:57968:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ada7 lrc: 4/1,0 mode: CW/CW res: [0x200000405:0xe5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46075d3 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.341471:0:57968:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ada7 lrc: 4/1,0 mode: CW/CW res: [0x200000405:0xe5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46075d3 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.341481:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ada7 lrc: 5/1,1 mode: CW/CW res: [0x200000405:0xe5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46075d3 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.341489:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ada7 lrc: 5/1,1 mode: CW/CW res: [0x200000405:0xe5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46075d3 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.341496:0:57968:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ada7 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xe5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46075d3 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.341507:0:57968:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x200002b, status=0 req@ffff936b6a474e00 x1874004626831488/t8589937193(8589937193) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191343.341520:0:57968:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474e00 x1874004626831488/t8589937193(8589937193) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191343.341534:0:57968:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ada7 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xe5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46075d3 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.341543:0:57968:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 8 res 8589935621/229 (0 0) 00000080:00200000:0.0:1787191343.341548:0:57968:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xe5:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191343.341595:0:57968:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) for lock 0xe5129dc88483ada7 00000080:00010000:0.0:1787191343.341601:0:57968:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ada7 from it ffffa3fb4234bbf0 00010000:00010000:0.0:1787191343.341604:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ada7 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xe5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46075d3 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.341612:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ada7 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xe5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46075d3 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00100000:0.0:1787191343.341634:0:57968:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474e00 x1874004626831488/t8589937193(8589937193) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191343.341758:0:57968:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88), inode mode 81a4 mask 4 00000080:00200000:0.0:1787191343.341766:0:57968:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88), xattr lov 00000080:00200008:0.0:1787191343.341789:0:57968:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe5:0x0](ffff936b4898ba88), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191343.341795:0:57968:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88),name=f70.sanity-flr 00000002:00010000:0.0:1787191343.341805:0:57968:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe5:0x0]) in obj [0x200000405:0xe5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.341811:0:57968:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 30 res 8589935621/229 (0 0) 00010000:00010000:0.0:1787191343.341864:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483adb5 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.341936:0:57968:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483adb5 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.341948:0:57968:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483adb5 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.341962:0:57968:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626831872:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191343.342079:0:57968:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00000100:00100000:2.0:1787191343.343424:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191343.343463:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634935808 00000100:00100000:3.0:1787191343.343470:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634935808 00000100:00100000:3.0:1787191343.343522:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1489 00000100:00100000:3.0:1787191343.343533:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634935808:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191343.343548:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ada7 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xe5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e46075d3 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191343.343609:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191343.343616:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634935808:12345-192.168.202.101@tcp:104: Request processed in 85us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191343.343624:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1489 00010000:00010000:1.0:1787191343.343675:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191343.343683:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ada7 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xe5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x7130d520e46075d3 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.343690:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b43adf000 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191343.343695:0:40930:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ada7 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xe5:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e46075d3 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.343704:0:40930:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ada7 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xe5:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e46075d3 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.343717:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ada7 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0xe5:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x7130d520e46075d3 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.343759:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ada7 lrc: 2/0,0 mode: --/CW res: [0x200000405:0xe5:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e46075d3 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.343766:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191343.343797:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ada7 lrc: 1/0,0 mode: --/CW res: [0x200000405:0xe5:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e46075d3 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.343804:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483ada7 lrc: 0/0,0 mode: --/CW res: [0x200000405:0xe5:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e46075d3 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.343817:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191343.343819:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191343.343821:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191343.343828:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787191343.344154:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626832000:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191343.346525:0:57969:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57969:1874004626831744:192.168.202.101@tcp:101:rm.0 00010000:00010000:3.0:1787191343.346547:0:57969:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483adae lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46075f6 expref: -99 pid: 57969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.346569:0:57969:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483adae lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46075f6 expref: -99 pid: 57969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.346577:0:57969:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483adae lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46075f6 expref: -99 pid: 57969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.346593:0:57969:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483adae lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46075f6 expref: -99 pid: 57969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.346604:0:57969:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483adae lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46075f6 expref: -99 pid: 57969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.346617:0:57969:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483adae lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46075f6 expref: -99 pid: 57969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.346626:0:57969:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483adae lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46075f6 expref: -99 pid: 57969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.346634:0:57969:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483adae lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46075f6 expref: -99 pid: 57969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191343.346646:0:57969:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b51d1ea00 x1874004626831744/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/976 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191343.346657:0:57969:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483adae lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46075f6 expref: -99 pid: 57969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191343.346669:0:57969:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483adae lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46075f6 expref: -99 pid: 57969 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.346679:0:57969:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/229 (0 0) 00000080:00200000:3.0:1787191343.346685:0:57969:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191343.346736:0:57969:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xe5:0x0](ffff936b4898ba88): rc = 0 00000080:00200000:3.0:1787191343.346752:0:57969:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe5:0x0]: layout version change: 4 -> 4 00000080:00010000:3.0:1787191343.346758:0:57969:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) for lock 0xe5129dc88483adae 00000080:00010000:3.0:1787191343.346771:0:57969:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) 00000080:00010000:3.0:1787191343.346774:0:57969:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483adae from it ffffa3fb42343b20 00010000:00010000:3.0:1787191343.346778:0:57969:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483adae lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46075f6 expref: -99 pid: 57969 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.346786:0:57969:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483adae lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46075f6 expref: -99 pid: 57969 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200008:3.0:1787191343.346827:0:57969:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe5:0x0](ffff936b4898ba88), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191343.346860:0:57969:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88),name=f70.sanity-flr 00000100:00100000:0.0:1787191343.346861:0:57968:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626831872:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191343.346872:0:57968:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483adb5 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607604 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.346880:0:57968:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483adb5 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607604 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.346887:0:57968:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483adb5 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607604 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191343.346892:0:57969:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.346895:0:57968:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483adb5 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607604 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.346899:0:57969:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483adae lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46075f6 expref: -99 pid: 57969 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191343.346909:0:57969:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483adae lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46075f6 expref: -99 pid: 57969 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191343.346915:0:57969:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191343.346920:0:57969:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) 00000080:00010000:3.0:1787191343.346924:0:57969:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) for lock 0xe5129dc88483adae 00010000:00010000:0.0:1787191343.346966:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483adb5 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607604 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.346976:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483adb5 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607604 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.346983:0:57968:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483adb5 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607604 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.346993:0:57968:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b6a474a80 x1874004626831872/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/976 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1787191343.346994:0:57969:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483adae from it ffffa3fb42343cb8 00000002:00010000:0.0:1787191343.347002:0:57968:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483adb5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607604 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191343.347024:0:57968:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483adb5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607604 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.347033:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483adae lrc: 3/2,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46075f6 expref: -99 pid: 57969 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.347041:0:57968:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483adae lrc: 3/2,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46075f6 expref: -99 pid: 57969 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.347049:0:57968:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483adb5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607604 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.347056:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483adb5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x7130d520e4607604 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.347063:0:57968:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483adb5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000400000000 nid: local remote: 0x7130d520e4607604 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.347076:0:57969:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483adae lrc: 4/2,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46075f6 expref: -99 pid: 57969 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191343.347083:0:57969:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483adae lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46075f6 expref: -99 pid: 57969 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191343.347113:0:57969:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe5:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00010000:00010000:0.0:1787191343.347123:0:57968:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000080:00200000:0.0:1787191343.347128:0:57968:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xe5:0x0] suppgids 0 0: rc 0 00020000:00200000:3.0:1787191343.347128:0:57969:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe5:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191343.347132:0:57969:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191343.347135:0:57969:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe5:0x0] 00000008:00010000:3.0:1787191343.347152:0:57969:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000080:00200000:0.0:1787191343.347154:0:57968:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe5:0x0]: layout version change: 4 -> 4 00000008:00010000:3.0:1787191343.347155:0:57969:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667730, osc lock ffff936b44f64980, flags 0x400000400001002 00000080:00010000:0.0:1787191343.347157:0:57968:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) for lock 0xe5129dc88483adae 00000080:00010000:0.0:1787191343.347161:0:57968:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) 00000080:00010000:0.0:1787191343.347163:0:57968:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483adae from it ffffa3fb4234bcd8 00010000:00010000:0.0:1787191343.347166:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483adae lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46075f6 expref: -99 pid: 57969 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191343.347172:0:57969:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191343.347173:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483adae lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46075f6 expref: -99 pid: 57969 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191343.347183:0:57969:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191343.347190:0:57968:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe5:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:0.0:1787191343.347195:0:57968:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe5:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00000020:00200000:3.0:1787191343.347195:0:57969:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00020000:00200000:0.0:1787191343.347197:0:57968:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191343.347199:0:57968:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe5:0x0] 00010000:00010000:3.0:1787191343.347199:0:57969:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1787191343.347206:0:57968:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00010000:00010000:3.0:1787191343.347207:0:57969:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000008:00010000:0.0:1787191343.347208:0:57968:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee6830, osc lock ffff936b50b63300, flags 0x400000400001002 00010000:00010000:0.0:1787191343.347215:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:3.0:1787191343.347217:0:57969:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1787191343.347223:0:57968:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000080:00200000:3.0:1787191343.347224:0:57969:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe5:0x0] updating i_size 5 i_blocks 0 00000020:00200000:0.0:1787191343.347230:0:57968:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000020:00010000:3.0:1787191343.347230:0:57969:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509bae40 (ffff936b47a17cf8/0) at cl_lock_release():245 00010000:00010000:0.0:1787191343.347233:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 7/0,1 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00010000:3.0:1787191343.347233:0:57969:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509bae40 (ffff936b47a17cf8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191343.347236:0:57969:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667730 (ffff936b465cccf8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191343.347240:0:57969:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509bae40 (ffff936b47a17cf8/0) at cl_lock_fini():72 00010000:00010000:0.0:1787191343.347241:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000020:00010000:3.0:1787191343.347243:0:57969:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667730 (ffff936b47a17cf8/1) at cl_lock_fini():72 00000020:00200000:0.0:1787191343.347249:0:57968:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191343.347252:0:57968:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe5:0x0] updating i_size 5 i_blocks 0 00000080:00200000:3.0:1787191343.347253:0:57969:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe5:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000020:00010000:0.0:1787191343.347255:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509ba060 (ffff936b47a171b8/0) at cl_lock_release():245 00000020:00010000:0.0:1787191343.347257:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509ba060 (ffff936b47a171b8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191343.347259:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee6830 (ffff936b47a17f38/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191343.347262:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509ba060 (ffff936b47a171b8/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191343.347264:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee6830 (ffff936b47a171b8/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191343.347269:0:57968:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe5:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191343.347294:0:57969:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191343.347303:0:57969:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191343.347310:0:57969:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191343.347318:0:57969:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191343.347323:0:57969:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191343.347327:0:57969:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191343.347329:0:57969:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191343.347333:0:57969:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42343c10 00010000:00010000:3.0:1787191343.347335:0:57969:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191343.347341:0:57969:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200080:0.0:1787191343.347347:0:57968:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88) cmd=c00c66f3 arg=24982e0 00000080:00200000:3.0:1787191343.347349:0:57969:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191343.347354:0:57969:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:3.0:1787191343.347358:0:57969:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000002:00010000:0.0:1787191343.347360:0:57968:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe5:0x0]) in obj [0x200000405:0xe5:0x0], intent: open flags 05004040000002 00000080:00200000:3.0:1787191343.347364:0:57969:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:3.0:1787191343.347367:0:57969:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:3.0:1787191343.347371:0:57969:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:3.0:1787191343.347388:0:57969:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483ad8b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4607578 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:3.0:1787191343.347405:0:57969:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe5:0x0]: losing layout lock 00010000:00010000:3.0:1787191343.347416:0:57969:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483adb5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4607604 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1787191343.347423:0:57969:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe5:0x0]: losing layout lock 00010000:00010000:3.0:1787191343.347429:0:57969:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483adae lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46075f6 expref: -99 pid: 57969 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191343.347437:0:57969:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe5:0x0]: losing layout lock 00010000:00010000:3.0:1787191343.347441:0:57969:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483ad7d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4607540 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191343.347472:0:57969:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483ad8b lrc: 1/0,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607578 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191343.347480:0:57969:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483adb5 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4607604 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.347487:0:57969:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483adae lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46075f6 expref: -99 pid: 57969 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191343.347494:0:57969:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483ad7d lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4607540 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191343.347499:0:57969:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 4 locks packed 00010000:00010000:3.0:1787191343.347503:0:57969:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483ad8b lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607578 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191343.347520:0:57969:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483adae lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46075f6 expref: -99 pid: 57969 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.347528:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483adbc lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.347529:0:57969:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483ad7d lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4607540 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.347536:0:57968:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483adbc lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57968 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191343.347542:0:57969:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000020:00100000:0.0:1787191343.347545:0:57968:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:0.0:1787191343.347549:0:57968:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474a80 x1874004626832512/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191343.347549:0:57969:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1ea00 x1874004626832384/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 512/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:0.0:1787191343.347559:0:57968:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483adbc lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x81000000000000 pid: 57968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.347570:0:57968:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626832512:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191343.347570:0:57969:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57969:1874004626832384:192.168.202.101@tcp:36:rm.0 00000100:00100000:3.0:1787191343.347644:0:57969:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.347724:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626832000:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191343.347823:0:57968:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00010000:00010000:2.0:1787191343.347892:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787191343.347900:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483adb5 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4607604 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.347908:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b43adea00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191343.347912:0:43384:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483adb5 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4607604 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.347919:0:43384:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483adb5 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4607604 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.347926:0:43384:0:(ldlm_request.c:1774:ldlm_cli_cancel()) ### lock is already being destroyed 00010000:00010000:2.0:1787191343.347928:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483adb5 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4607604 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.347934:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483adb5 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4607604 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.347946:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191343.347948:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191343.347950:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191343.350986:0:57968:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626832512:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191343.351025:0:57968:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483adbc lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4607620 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.351040:0:57968:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483adbc lrc: 4/1,0 mode: --/PW res: [0x200000405:0xe5:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4607620 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.351051:0:57968:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483adbc lrc: 4/1,0 mode: PW/PW res: [0x200000405:0xe5:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4607620 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.351061:0:57969:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57969:1874004626832384:192.168.202.101@tcp:36:rm.0 00010000:00010000:3.0:1787191343.351063:0:57968:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483adbc lrc: 4/1,0 mode: PW/PW res: [0x200000405:0xe5:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4607620 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.351075:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483adbc lrc: 5/1,1 mode: PW/PW res: [0x200000405:0xe5:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4607620 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.351082:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483adbc lrc: 5/1,1 mode: PW/PW res: [0x200000405:0xe5:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4607620 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.351089:0:57968:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483adbc lrc: 4/0,1 mode: PW/PW res: [0x200000405:0xe5:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4607620 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191343.351112:0:57968:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x600002b, status=0 req@ffff936b6a474a80 x1874004626832512/t8589937194(8589937194) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191343.351125:0:57968:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474a80 x1874004626832512/t8589937194(8589937194) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191343.351138:0:57968:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483adbc lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xe5:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4607620 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.351148:0:57968:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 2 res 8589935621/229 (0 0) 00000080:00200000:3.0:1787191343.351153:0:57968:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xe5:0x0] suppgids 0 0: rc 0 00000002:00100000:3.0:1787191343.351170:0:57968:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474a80 x1874004626832512/t8589937194(8589937194) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1787191343.351177:0:57968:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) for lock 0xe5129dc88483adbc 00000080:00010000:3.0:1787191343.351183:0:57968:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483adbc from it ffffa3fb4234bcc0 00010000:00010000:3.0:1787191343.351186:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483adbc lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xe5:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4607620 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.351192:0:57968:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483adbc lrc: 2/0,0 mode: PW/PW res: [0x200000405:0xe5:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4607620 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1787191343.351246:0:57968:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe5:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00010000:00010000:3.0:1787191343.351257:0:57968:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/229 (0 0) 00000080:00010000:3.0:1787191343.351264:0:57968:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xe5:0x0](ffff936b4898ba88) 00000002:00010000:3.0:1787191343.351272:0:57968:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe5:0x0]) in obj [0x200000405:0xe5:0x0], intent: layout flags 0 00010000:00010000:3.0:1787191343.351309:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483adc3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.351316:0:57968:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483adc3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.351325:0:57968:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483adc3 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191343.351605:0:57968:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626832640:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191343.351721:0:57968:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.354324:0:57968:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626832640:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191343.354352:0:57968:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483adc3 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607635 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.354367:0:57968:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483adc3 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607635 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.354380:0:57968:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b51d1f100 x1874004626832640/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191343.354390:0:57968:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483adc3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607635 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191343.354492:0:57968:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483adc3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607635 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.354502:0:57968:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/229 (0 0) 00000080:00200000:0.0:1787191343.354508:0:57968:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xe5:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191343.354523:0:57968:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) for lock 0xe5129dc88483adc3 00000080:00010000:0.0:1787191343.354531:0:57968:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483adc3 from it ffffa3fb4234bb70 00010000:00010000:0.0:1787191343.354535:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483adc3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607635 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.354544:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483adc3 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607635 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.354573:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483adc3 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607635 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.354593:0:57968:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483adc3 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607635 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1787191343.354602:0:57968:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xe5:0x0](000000009d25d36f) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483adc3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607635 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191343.354741:0:57968:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe5:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:0.0:1787191343.354748:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483adc3 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607635 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.354756:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483adc3 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607635 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:0.0:1787191343.354771:0:57968:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe5:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191343.354775:0:57968:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191343.354782:0:57968:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191343.354793:0:57968:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000100:00100000:0.0:1787191343.354874:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787191343.354892:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626832768:192.168.202.101@tcp:1:lfs.0 00000100:00100000:3.0:1787191343.357248:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191343.357280:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634935936 00000100:00100000:3.0:1787191343.357286:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634935936 00000100:00100000:3.0:1787191343.357320:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1490 00000100:00100000:3.0:1787191343.357327:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8422:x1874004634935936:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191343.357341:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420080000000 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1787191343.357399:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191343.357405:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8422:x1874004634935936:12345-192.168.202.101@tcp:104: Request processed in 79us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191343.357412:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1490 00010000:00010000:0.0:1787191343.357428:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191343.357435:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420080000000 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1787191343.357444:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b43ade200 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191343.357449:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800428480000000 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000008:00010000:0.0:1787191343.357472:0:57627:0:(osc_cache.c:2029:try_to_add_extent_for_io()) ### extent: 00000000ed12b13a ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800429480000000 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000008:00010000:0.0:1787191343.357485:0:57627:0:(osc_cache.c:1183:osc_extent_make_ready()) ### extent: 00000000ed12b13a ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800429480000000 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1787191343.357533:0:57627:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800429480000000 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000008:00100000:0.0:1787191343.357610:0:57627:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff936b6a476680 - object 0x2c0000401:481 offset 0<>5 00000100:00100000:1.0:1787191343.357994:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626832896:192.168.202.101@tcp:4:bash.0 00000080:00200000:2.0:1787191343.361563:0:57970:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191343.361597:0:57970:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191343.361615:0:57970:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.361632:0:57970:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.361640:0:57970:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191343.361648:0:57970:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191343.361651:0:57970:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191343.361658:0:57970:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4233bb58 00010000:00010000:2.0:1787191343.361662:0:57970:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.361672:0:57970:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.361688:0:57970:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191343.361695:0:57970:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:2.0:1787191343.361701:0:57970:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191343.361711:0:57970:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:2.0:1787191343.361715:0:57970:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191343.361727:0:57970:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191343.361774:0:57970:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483adca lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.361786:0:57970:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483adca lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.361795:0:57970:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483adca lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191343.361819:0:57970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57970:1874004626833024:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191343.362290:0:57970:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f600 going to sleep for 11 seconds 00000008:00010000:1.0:1787191343.364169:0:2390:0:(osc_cache.c:917:osc_extent_finish()) ### extent: 00000000ed12b13a ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800429480000000 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000100:00100000:2.0:1787191343.364432:0:57970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57970:1874004626833024:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191343.364451:0:57970:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483adca lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.364462:0:57970:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483adca lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.364469:0:57970:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483adca lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.364476:0:57970:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483adca lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.364483:0:57970:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483adca lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.364490:0:57970:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51184800 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191343.364495:0:57970:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483adca lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.364502:0:57970:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483adca lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.364509:0:57970:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483adca lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.364516:0:57970:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191343.364522:0:57970:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483adca lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.364529:0:57970:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483adca lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191343.364553:0:57970:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513b9500 x1874004626833024/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191343.364567:0:57970:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191343.364655:0:57970:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191343.364671:0:57970:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191343.364682:0:57970:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.364692:0:57970:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.364699:0:57970:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191343.364704:0:57970:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191343.364707:0:57970:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191343.364712:0:57970:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4233bbe8 00010000:00010000:2.0:1787191343.364716:0:57970:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.364729:0:57970:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.364743:0:57970:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191343.364750:0:57970:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000080:00200000:2.0:1787191343.364756:0:57970:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191343.364768:0:57970:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:2.0:1787191343.364787:0:57970:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191343.364801:0:57970:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191343.364861:0:57970:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483add1 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.364869:0:57970:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483add1 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.364892:0:57970:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483add1 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191343.364916:0:57970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57970:1874004626833152:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191343.364983:0:57970:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f600 going to sleep for 11 seconds 00000008:00010000:1.0:1787191343.365445:0:2390:0:(osc_cache.c:497:__osc_extent_remove()) ### extent: 00000000ed12b13a ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800429480000000 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000100:00100000:1.0:1787191343.365483:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626832896:192.168.202.101@tcp:4:bash.0 00000080:00200000:0.0:1787191343.366933:0:57627:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1787191343.366994:0:57627:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:0.0:1787191343.367055:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69480000020 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1787191343.367067:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191343.367090:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69480000020 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1787191343.367099:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ad92 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69480000020 nid: local remote: 0x7130d520e460759b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1787191343.367119:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191343.367121:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191343.367124:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191343.367140:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626833280:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191343.367234:0:57970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57970:1874004626833152:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191343.367249:0:57970:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483add1 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.367256:0:57970:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483add1 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.367260:0:57970:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483add1 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.367264:0:57970:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483add1 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.367269:0:57970:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483add1 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.367272:0:57970:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51185400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191343.367275:0:57970:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483add1 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.367279:0:57970:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483add1 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.367284:0:57970:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483add1 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.367287:0:57970:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191343.367290:0:57970:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483add1 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.367294:0:57970:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185400/0xe5129dc88483add1 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191343.367307:0:57970:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513b9500 x1874004626833152/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191343.367318:0:57970:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191343.367394:0:57970:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191343.367407:0:57970:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.367417:0:57970:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.367427:0:57970:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.367434:0:57970:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191343.367439:0:57970:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191343.367443:0:57970:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191343.367449:0:57970:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4233bb58 00010000:00010000:1.0:1787191343.367452:0:57970:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.367459:0:57970:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.367468:0:57970:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191343.367474:0:57970:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:1.0:1787191343.367481:0:57970:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:1.0:1787191343.367484:0:57970:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:1.0:1787191343.367492:0:57970:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.367498:0:57970:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 102 lru_type: 1 00010000:00010000:1.0:1787191343.367503:0:57970:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 102 lru_type: 1 00000002:00010000:1.0:1787191343.367509:0:57970:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.367531:0:57970:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483add8 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.367535:0:57970:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483add8 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.367540:0:57970:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483add8 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.367550:0:57970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57970:1874004626833408:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191343.367572:0:57970:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893480 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.369461:0:57970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57970:1874004626833408:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191343.369482:0:57970:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483add8 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607674 expref: -99 pid: 57970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.369493:0:57970:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483add8 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607674 expref: -99 pid: 57970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.369503:0:57970:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483add8 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607674 expref: -99 pid: 57970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.369514:0:57970:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483add8 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607674 expref: -99 pid: 57970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.369526:0:57970:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483add8 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607674 expref: -99 pid: 57970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.369535:0:57970:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483add8 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607674 expref: -99 pid: 57970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.369542:0:57970:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483add8 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607674 expref: -99 pid: 57970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191343.369554:0:57970:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b453aad80 x1874004626833408/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191343.369568:0:57970:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483add8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607674 expref: -99 pid: 57970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.369577:0:57970:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:1.0:1787191343.369585:0:57970:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483add8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607674 expref: -99 pid: 57970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.369594:0:57970:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483add8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607674 expref: -99 pid: 57970 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:1.0:1787191343.369617:0:57970:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.369628:0:57970:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 204 lru_type: 1 00010000:00010000:1.0:1787191343.369639:0:57970:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 204 lru_type: 1 00010000:00010000:1.0:1787191343.369648:0:57970:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 204 lru_type: 1 00010000:00010000:1.0:1787191343.369657:0:57970:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 205 lru_type: 1 00000080:00200000:1.0:1787191343.369669:0:57970:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191343.369677:0:57970:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:1.0:1787191343.369681:0:57970:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:1.0:1787191343.369687:0:57970:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb4233bcb8 00010000:00010000:1.0:1787191343.369691:0:57970:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 102 lru_type: 1 00010000:00010000:1.0:1787191343.369699:0:57970:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 103 lru_type: 1 00000002:00010000:1.0:1787191343.369713:0:57970:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.369719:0:57970:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483add8 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607674 expref: -99 pid: 57970 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.369727:0:57970:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483add8 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607674 expref: -99 pid: 57970 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.369734:0:57970:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483add8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607674 expref: -99 pid: 57970 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.369743:0:57970:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483add8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607674 expref: -99 pid: 57970 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:1.0:1787191343.369751:0:57970:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.369756:0:57970:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 205 lru_type: 1 00010000:00010000:1.0:1787191343.369762:0:57970:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 205 lru_type: 1 00010000:00010000:1.0:1787191343.369770:0:57970:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 205 lru_type: 1 00010000:00010000:1.0:1787191343.369775:0:57970:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 206 lru_type: 1 00000100:00100000:0.0:1787191343.371170:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626833280:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191343.371591:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626832768:192.168.202.101@tcp:1:lfs.0 00010000:00010000:3.0:1787191343.371702:0:57968:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483adc3 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4607635 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191343.371724:0:57968:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe5:0x0]: losing layout lock 00010000:00010000:3.0:1787191343.371766:0:57968:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483adc3 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607635 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191343.371773:0:57968:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191343.371776:0:57968:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483adc3 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607635 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000020:00100000:3.0:1787191343.371795:0:57968:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1787191343.371806:0:57968:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1f800 x1874004626833664/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 472/440 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191343.371829:0:57968:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626833664:192.168.202.101@tcp:36:lfs.0 00000100:00100000:3.0:1787191343.372049:0:57968:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cd80 going to sleep for 11 seconds 00000080:00200008:0.0:1787191343.373176:0:57970:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1787191343.373186:0:57970:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191343.373210:0:57970:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.373223:0:57970:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.373235:0:57970:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.373242:0:57970:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191343.373249:0:57970:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191343.373252:0:57970:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191343.373257:0:57970:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4233bcb8 00010000:00010000:0.0:1787191343.373261:0:57970:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.373268:0:57970:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.373421:0:57970:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191343.373429:0:57970:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.373436:0:57970:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.373449:0:57970:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.373455:0:57970:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191343.373459:0:57970:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191343.373461:0:57970:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191343.373465:0:57970:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4233bb58 00010000:00010000:0.0:1787191343.373468:0:57970:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.373475:0:57970:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.373483:0:57970:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.373489:0:57970:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:0.0:1787191343.373495:0:57970:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.373506:0:57970:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:0.0:1787191343.373510:0:57970:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:0.0:1787191343.373522:0:57970:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:0.0:1787191343.373564:0:57970:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483addf lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.373572:0:57970:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483addf lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.373581:0:57970:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483addf lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.373608:0:57970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57970:1874004626833792:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191343.373691:0:57970:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.378096:0:57970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57970:1874004626833792:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191343.378118:0:57970:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483addf lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.378131:0:57970:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483addf lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.378138:0:57970:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483addf lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.378145:0:57970:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483addf lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.378154:0:57970:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483addf lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.378160:0:57970:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b43ade800 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191343.378164:0:57970:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483addf lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.378171:0:57970:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483addf lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.378178:0:57970:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483addf lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.378185:0:57970:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191343.378192:0:57970:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483addf lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.378199:0:57970:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483addf lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.378217:0:57970:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b6a475f80 x1874004626833792/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191343.378233:0:57970:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1787191343.378259:0:57970:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483add8 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607674 expref: -99 pid: 57970 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.378272:0:57970:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483add8 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607674 expref: -99 pid: 57970 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:0.0:1787191343.378280:0:57970:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483add8 from it ffffa3fb4233b930 00010000:00010000:0.0:1787191343.378284:0:57970:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483add8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607674 expref: -99 pid: 57970 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.378291:0:57970:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483add8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607674 expref: -99 pid: 57970 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191343.378368:0:57970:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191343.378382:0:57970:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.378390:0:57970:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.378398:0:57970:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.378409:0:57970:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191343.378414:0:57970:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191343.378418:0:57970:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191343.378422:0:57970:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4233bbf8 00010000:00010000:0.0:1787191343.378424:0:57970:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.378432:0:57970:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.378440:0:57970:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.378448:0:57970:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191343.378454:0:57970:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.378461:0:57970:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:0.0:1787191343.378465:0:57970:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:0.0:1787191343.378470:0:57970:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b6282ed80, open_flags a141, mode 81b6 opened 0 00000080:00200000:0.0:1787191343.378479:0:57970:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:0.0:1787191343.378498:0:57970:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xe6:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:0.0:1787191343.378508:0:57970:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483add8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4607674 expref: -99 pid: 57970 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191343.378554:0:57970:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483add8 lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4607674 expref: -99 pid: 57970 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191343.378560:0:57970:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191343.378563:0:57970:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483add8 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4607674 expref: -99 pid: 57970 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191343.378595:0:57970:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483ade6 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.378602:0:57970:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483ade6 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191343.378612:0:57970:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:0.0:1787191343.378619:0:57970:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475f80 x1874004626834048/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191343.378628:0:57970:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483ade6 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.378789:0:57970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57970:1874004626834048:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191343.379335:0:57970:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191343.390274:0:57968:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589937196 gen 1 00000100:00100000:3.0:1787191343.390294:0:57968:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b6a474e00 x1874004626831488/t8589937193(8589937193) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787191343.390307:0:57968:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b6a474a80 x1874004626832512/t8589937194(8589937194) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787191343.390328:0:57968:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626833664:192.168.202.101@tcp:36:lfs.0 00010000:00010000:3.0:1787191343.390366:0:57968:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/229 (0 0) 00000080:00010000:3.0:1787191343.390377:0:57968:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xe5:0x0](ffff936b4898ba88) 00000002:00010000:3.0:1787191343.390388:0:57968:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe5:0x0]) in obj [0x200000405:0xe5:0x0], intent: layout flags 0 00010000:00010000:3.0:1787191343.390434:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483aded lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.390444:0:57968:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483aded lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.390453:0:57968:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483aded lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191343.390477:0:57968:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626834176:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191343.390551:0:57968:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.391105:0:57970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57970:1874004626834048:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191343.391119:0:57970:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483ade6 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46076ac expref: -99 pid: 57970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.391144:0:57970:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483ade6 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46076ac expref: -99 pid: 57970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.391152:0:57970:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483ade6 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46076ac expref: -99 pid: 57970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.391163:0:57970:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483ade6 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46076ac expref: -99 pid: 57970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.391179:0:57970:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483ade6 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46076ac expref: -99 pid: 57970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.391189:0:57970:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483ade6 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46076ac expref: -99 pid: 57970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.391198:0:57970:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483ade6 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46076ac expref: -99 pid: 57970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.391204:0:57970:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483ade6 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46076ac expref: -99 pid: 57970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.391215:0:57970:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b6a475f80 x1874004626834048/t8589937197(8589937197) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191343.391228:0:57970:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475f80 x1874004626834048/t8589937197(8589937197) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191343.391238:0:57970:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483ade6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46076ac expref: -99 pid: 57970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.391247:0:57970:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/230 (0 0) 00000080:00200000:0.0:1787191343.391252:0:57970:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191343.391262:0:57970:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:0.0:1787191343.391290:0:57970:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xe6:0x0](ffff936b5396c2c8) 00000080:00200000:0.0:1787191343.391297:0:57970:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xe6:0x0], updating i_size 0 00000080:00200000:0.0:1787191343.391330:0:57970:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe6:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1787191343.391347:0:57970:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xe6:0x0](ffff936b5396c2c8) 00000080:00010000:0.0:1787191343.391352:0:57970:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe6:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483ade6 00000080:00010000:0.0:1787191343.391362:0:57970:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe6:0x0](ffff936b5396c2c8) 00000080:00200008:0.0:1787191343.391378:0:57970:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe6:0x0](ffff936b5396c2c8), flags 120501 00000002:00100000:0.0:1787191343.391396:0:57970:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475f80 x1874004626834048/t8589937197(8589937197) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191343.391430:0:57970:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ade6 from it ffff936b530f5420 00010000:00010000:0.0:1787191343.391435:0:57970:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483ade6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46076ac expref: -99 pid: 57970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.391444:0:57970:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483ade6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46076ac expref: -99 pid: 57970 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191343.391463:0:57970:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe6:0x0](ffff936b5396c2c8), inode mode 81a4 mask 40 00000080:00200000:0.0:1787191343.391517:0:57970:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe6:0x0](ffff936b5396c2c8), inode mode 81a4 mask 2 00000080:00200000:0.0:1787191343.391527:0:57970:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xe6:0x0](ffff936b5396c2c8), xattr lov 00000002:00010000:0.0:1787191343.391541:0:57970:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe6:0x0]) in obj [0x200000405:0xe6:0x0], intent: open flags 040000002 00010000:00010000:0.0:1787191343.391573:0:57970:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483adf4 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.391580:0:57970:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483adf4 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191343.391589:0:57970:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191343.391595:0:57970:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475500 x1874004626834432/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191343.391602:0:57970:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483adf4 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.391615:0:57970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57970:1874004626834432:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191343.392159:0:57970:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191343.394757:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:0.0:1787191343.394798:0:57968:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626834176:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191343.394858:0:57968:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483aded lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46076ba expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.394882:0:57968:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483aded lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46076ba expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.394897:0:57968:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b51d1f800 x1874004626834176/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191343.394907:0:57968:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483aded lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46076ba expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191343.394918:0:57968:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483aded lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46076ba expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.394928:0:57968:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/229 (0 0) 00000080:00200000:0.0:1787191343.394934:0:57968:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xe5:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191343.394949:0:57968:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) for lock 0xe5129dc88483aded 00000080:00010000:0.0:1787191343.394956:0:57968:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483aded from it ffffa3fb4234bc70 00010000:00010000:0.0:1787191343.394960:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483aded lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46076ba expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.394969:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483aded lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46076ba expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.394991:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483aded lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46076ba expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.395002:0:57968:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483aded lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46076ba expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1787191343.395022:0:57968:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xe5:0x0](000000009d25d36f) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483aded lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46076ba expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.395060:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483aded lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46076ba expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.395067:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483aded lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46076ba expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191343.395084:0:57968:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191343.395094:0:57968:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe5:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191343.395097:0:57968:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191343.395103:0:57968:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191343.395138:0:57968:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191343.395158:0:57968:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:0.0:1787191343.395171:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483aded lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46076ba expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.395179:0:57968:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483aded lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46076ba expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:0.0:1787191343.395186:0:57968:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xe5:0x0](000000009d25d36f) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483aded lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46076ba expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191343.395209:0:57968:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191343.395213:0:57968:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe5:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191343.395215:0:57968:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191343.395218:0:57968:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191343.395234:0:57968:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191343.395242:0:57968:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:0.0:1787191343.395266:0:57968:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191343 1787191343 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008763ad1f/0xe5129dc88483ada0 lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e46075a2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191343.395322:0:57968:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe5:0x0]: layout version change: 4294967294 -> 5 00010000:00010000:0.0:1787191343.395327:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483aded lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46076ba expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.395334:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483aded lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46076ba expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200080:0.0:1787191343.395355:0:57968:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88) cmd=66f4 arg=24982e0 00000080:00200008:0.0:1787191343.395367:0:57968:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe5:0x0](ffff936b4898ba88), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191343.395374:0:57968:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88),name=f70.sanity-flr 00000002:00010000:0.0:1787191343.395387:0:57968:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe5:0x0]) in obj [0x200000405:0xe5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.395392:0:57968:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 30 res 8589935621/229 (0 0) 00010000:00010000:0.0:1787191343.395438:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483adfb lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.395446:0:57968:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483adfb lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.395460:0:57968:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483adfb lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.395480:0:57968:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626834560:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191343.395561:0:57968:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99000 going to sleep for 11 seconds 00000100:00100000:2.0:1787191343.395808:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634936576 00000100:00100000:2.0:1787191343.395816:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634936576 00000100:00100000:2.0:1787191343.395903:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1491 00000100:00100000:2.0:1787191343.395914:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634936576:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191343.395925:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483ade6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46076ac expref: -99 pid: 57970 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.395983:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191343.395990:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634936576:12345-192.168.202.101@tcp:104: Request processed in 79us (1243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191343.395997:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1491 00010000:00010000:0.0:1787191343.396168:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191343.396174:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483ade6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46076ac expref: -99 pid: 57970 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.396183:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b43ade200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191343.396187:0:40929:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483ade6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46076ac expref: -99 pid: 57970 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.396196:0:40929:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483ade6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46076ac expref: -99 pid: 57970 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.396204:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483ade6 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e46076ac expref: -99 pid: 57970 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191343.396219:0:40929:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe6:0x0]: losing layout lock 00010000:00010000:0.0:1787191343.396250:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483ade6 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46076ac expref: -99 pid: 57970 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.396257:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191343.396276:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483ade6 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46076ac expref: -99 pid: 57970 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.396283:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483ade6 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46076ac expref: -99 pid: 57970 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.396295:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191343.396297:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191343.396298:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191343.396305:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787191343.396316:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626834688:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191343.405296:0:57968:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626834560:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191343.405323:0:57968:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483adfb lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46076d6 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.405336:0:57968:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483adfb lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46076d6 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.405348:0:57968:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483adfb lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46076d6 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.405359:0:57968:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483adfb lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46076d6 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.405369:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483adfb lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46076d6 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.405375:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483adfb lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46076d6 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.405379:0:57968:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483adfb lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46076d6 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.405391:0:57968:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b6a476d80 x1874004626834560/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/976 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191343.405403:0:57968:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483adfb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46076d6 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191343.405416:0:57968:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483adfb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46076d6 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.405426:0:57968:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/229 (0 0) 00000080:00200000:0.0:1787191343.405432:0:57968:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xe5:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787191343.405487:0:57968:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe5:0x0]: layout version change: 5 -> 5 00000080:00010000:0.0:1787191343.405491:0:57968:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) for lock 0xe5129dc88483adfb 00000080:00010000:0.0:1787191343.405496:0:57968:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) 00000080:00010000:0.0:1787191343.405498:0:57968:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483adfb from it ffffa3fb4234bcd8 00010000:00010000:0.0:1787191343.405500:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483adfb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46076d6 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.405506:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483adfb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46076d6 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191343.405533:0:57968:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe5:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1787191343.405541:0:57968:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe5:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191343.405543:0:57968:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191343.405545:0:57968:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe5:0x0] 00000008:00010000:0.0:1787191343.405560:0:57968:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191343.405562:0:57968:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee65b0, osc lock ffff936b50b63300, flags 0x400000400001002 00010000:00010000:0.0:1787191343.405608:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.405619:0:57968:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.405630:0:57968:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b6a476d80 x1874004626834816/t0(0) o101->lustre-OST0001-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:0.0:1787191343.405672:0:57968:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:0.0:1787191343.405683:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787191343.405699:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626834816:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191343.408678:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626834688:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191343.409088:0:57970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57970:1874004626834432:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191343.409115:0:57970:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483adf4 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.409127:0:57970:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483adf4 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.409133:0:57970:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483adf4 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.409140:0:57970:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483adf4 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xe6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.409148:0:57970:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483adf4 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xe6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.409153:0:57970:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b43ade800 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191343.409157:0:57970:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483adf4 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xe6:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.409164:0:57970:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483adf4 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xe6:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.409169:0:57970:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483adf4 lrc: 5/0,0 mode: --/CR res: [0x200000405:0xe6:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.409176:0:57970:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191343.409181:0:57970:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483adf4 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xe6:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.409186:0:57970:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483adf4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe6:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57970 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.409209:0:57970:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b6a475500 x1874004626834432/t8589937198(8589937198) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191343.409222:0:57970:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475500 x1874004626834432/t8589937198(8589937198) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191343.409236:0:57970:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xe6:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787191343.409311:0:57970:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1787191343.409319:0:57970:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191343.409367:0:57970:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xe6:0x0], updating i_size 0 00000002:00100000:0.0:1787191343.409386:0:57970:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475500 x1874004626834432/t8589937198(8589937198) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191343.409424:0:57970:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a475500 x1874004626834432/t8589937198(8589937198) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191343.409434:0:57970:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191343.409439:0:57970:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474380 x1874004626835072/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191343.409460:0:57970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57970:1874004626835072:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191343.409537:0:57970:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99b40 going to sleep for 11 seconds 00010000:00010000:1.0:1787191343.413925:0:2390:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.413951:0:2390:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.413964:0:2390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.413976:0:2390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191343.413989:0:2390:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 5, setting rss=5; kms=5, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 5/2,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1787191343.414000:0:2390:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1787191343.414030:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.414039:0:2390:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.414045:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.414053:0:2390:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1787191343.414073:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626834816:192.168.202.101@tcp:101:lfs.0 00000080:00200000:3.0:1787191343.414215:0:57968:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe5:0x0] updating i_size 5 i_blocks 8 00000020:00010000:3.0:1787191343.414221:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509b86f0 (ffff936b47a17f38/0) at cl_lock_release():245 00000020:00010000:3.0:1787191343.414225:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509b86f0 (ffff936b47a17f38/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191343.414229:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee65b0 (ffff936b47a17e18/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191343.414233:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509b86f0 (ffff936b47a17f38/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191343.414235:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee65b0 (ffff936b47a17f38/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191343.414268:0:57968:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe5:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:0.0:1787191343.415167:0:57970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57970:1874004626835072:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191343.415197:0:57970:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a475500 x1874004626834432/t8589937198(8589937198) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1787191343.415244:0:57970:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe6:0x0](ffff936b5396c2c8), flags 100001 00000002:00100000:0.0:1787191343.415293:0:57970:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a475f80 x1874004626834048/t8589937197(8589937197) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191359 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191343.415303:0:57970:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191343.415308:0:57970:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475880 x1874004626835328/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191343.415327:0:57970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57970:1874004626835328:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191343.415419:0:57970:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.420034:0:57970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57970:1874004626835328:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191343.420078:0:57970:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a475f80 x1874004626834048/t8589937197(8589937197) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191343.421462:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191343.421492:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191343.421512:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191343.421529:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191343.421537:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191343.421545:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191343.421549:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191343.421557:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:3.0:1787191343.421562:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191343.421571:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191343.421603:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191343.421612:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191343.421618:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191343.421772:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:3.0:1787191343.421778:0:57570:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b62915c80, open_flags 8241, mode 81b6 opened 0 00000080:00200000:3.0:1787191343.421786:0:57570:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:3.0:1787191343.421806:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xe7:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0101102 00010000:00010000:3.0:1787191343.421891:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483ae09 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.421898:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483ae09 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191343.421910:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191343.421921:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1c000 x1874004626835584/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191343.421931:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483ae09 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191343.421956:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626835584:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191343.422239:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.427032:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c000 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626835584:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191343.427062:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483ae09 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607700 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.427096:0:57570:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483ae09 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607700 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.427105:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483ae09 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607700 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.427116:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483ae09 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607700 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.427127:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483ae09 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607700 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.427139:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483ae09 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607700 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.427146:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483ae09 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607700 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.427152:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483ae09 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607700 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191343.427163:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x2b, status=0 req@ffff936b51d1c000 x1874004626835584/t8589937201(8589937201) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191343.427175:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1c000 x1874004626835584/t8589937201(8589937201) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191343.427188:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483ae09 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607700 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191343.427202:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483ae09 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607700 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.427210:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/230 (0 0) 00000080:00200000:1.0:1787191343.427216:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191343.427266:0:57570:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xe6:0x0](ffff936b5396c2c8): rc = 0 00000080:00200000:1.0:1787191343.427282:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe6:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:1.0:1787191343.427287:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe6:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483ae09 00000080:00010000:1.0:1787191343.427298:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe6:0x0](ffff936b5396c2c8) 00000080:00200008:1.0:1787191343.427311:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe6:0x0](ffff936b5396c2c8), flags 101101 00000002:00100000:1.0:1787191343.427333:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1c000 x1874004626835584/t8589937201(8589937201) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191343.427367:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ae09 from it ffff936b466f4ba0 00010000:00010000:1.0:1787191343.427371:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483ae09 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607700 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.427381:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483ae09 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607700 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191343.427404:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe6:0x0](ffff936b5396c2c8), inode mode 81a4 mask 42 00000002:00010000:1.0:1787191343.427430:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xe6:0x0], intent: getxattr flags 0 00010000:00010000:1.0:1787191343.427469:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483ae10 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.427477:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483ae10 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.427491:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483ae10 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.427510:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626835712:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191343.427640:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893480 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.431072:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626835712:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191343.431099:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483ae10 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607715 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.431115:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483ae10 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607715 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.431128:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483ae10 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607715 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191343.431143:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b453aad80 x1874004626835712/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191343.431155:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483ae10 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607715 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.431166:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/230 (0 0) 00000080:00200000:1.0:1787191343.431172:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xe6:0x0] suppgids 0 -1: rc 0 00000080:00010000:1.0:1787191343.431197:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe6:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483ae10 00000080:00010000:1.0:1787191343.431206:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ae10 from it ffffa3fb41caba38 00010000:00010000:1.0:1787191343.431210:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483ae10 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607715 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.431226:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483ae10 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607715 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:1.0:1787191343.431260:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xe6:0x0](ffff936b5396c2c8) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191343.000000000, mtime 1787191343.000000000, ctime 1787191343.000000000 00010000:00010000:1.0:1787191343.431287:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483ae09 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4607700 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191343.431301:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe6:0x0]: losing layout lock 00010000:00010000:1.0:1787191343.431333:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483ae09 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607700 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.431337:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191343.431340:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b600/0xe5129dc88483ae09 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607700 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:1.0:1787191343.431353:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1787191343.431357:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453aad80 x1874004626835968/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787191343.431373:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626835968:192.168.202.101@tcp:36:bash.0 00000100:00100000:1.0:1787191343.431487:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893480 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.433450:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626835968:192.168.202.101@tcp:36:bash.0 00000080:00200000:1.0:1787191343.433492:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:1.0:1787191343.433499:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe6:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:1.0:1787191343.433515:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/230 (0 0) 00000080:00010000:1.0:1787191343.433526:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xe6:0x0](ffff936b5396c2c8) 00000002:00010000:1.0:1787191343.433535:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe6:0x0]) in obj [0x200000405:0xe6:0x0], intent: layout flags 0 00010000:00010000:1.0:1787191343.433579:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ae17 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.433589:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ae17 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.433600:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ae17 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.433619:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626836096:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191343.433719:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893480 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.435439:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626836096:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191343.435466:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ae17 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607723 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.435482:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ae17 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607723 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191343.435494:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b453a9880 x1874004626836096/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191343.435502:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ae17 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607723 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191343.435510:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ae17 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607723 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.435520:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/230 (0 0) 00000080:00200000:1.0:1787191343.435524:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xe6:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191343.435537:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe6:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483ae17 00000080:00010000:1.0:1787191343.435543:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ae17 from it ffffa3fb41cab8c8 00010000:00010000:1.0:1787191343.435545:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ae17 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607723 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.435551:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ae17 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607723 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.435567:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ae17 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607723 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.435574:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ae17 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607723 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:1.0:1787191343.435580:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xe6:0x0](0000000089668027) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ae17 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607723 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191343.435621:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe6:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:1.0:1787191343.435627:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ae17 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607723 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.435635:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ae17 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607723 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:1.0:1787191343.435651:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xe6:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:1.0:1787191343.435659:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe6:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191343.435664:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xe6:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:1.0:1787191343.435673:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xe6:0x0](ffff936b5396c2c8) 00000002:00010000:1.0:1787191343.435683:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe6:0x0]) in obj [0x200000405:0xe6:0x0], intent: layout flags 02 00010000:00010000:1.0:1787191343.435696:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ae17 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4607723 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191343.435708:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe6:0x0]: losing layout lock 00010000:00010000:1.0:1787191343.435734:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ae17 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xe6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607723 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191343.435739:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191343.435741:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483ae17 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607723 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191343.435937:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ae1e lrc: 3/0,1 mode: --/EX res: [0x200000405:0xe6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.435942:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ae1e lrc: 3/0,1 mode: --/EX res: [0x200000405:0xe6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191343.435951:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191343.435957:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9880 x1874004626836352/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191343.435965:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ae1e lrc: 3/0,1 mode: --/EX res: [0x200000405:0xe6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.435982:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626836352:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191343.436101:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893480 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.448299:0:57570:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589937204 gen 1 00000100:00100000:1.0:1787191343.448382:0:57570:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b51d1c000 x1874004626835584/t8589937201(8589937201) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787191343.448413:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626836352:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191343.448438:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ae1e lrc: 4/0,1 mode: --/EX res: [0x200000405:0xe6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607731 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.448451:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ae1e lrc: 4/0,1 mode: --/CR res: [0x200000405:0xe6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607731 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.448465:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ae1e lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xe6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607731 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.448477:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ae1e lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xe6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607731 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.448502:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ae1e lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xe6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607731 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.448511:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ae1e lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xe6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607731 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.448518:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ae1e lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607731 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191343.448529:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b453a9880 x1874004626836352/t8589937204(8589937204) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191343.448555:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ae1e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607731 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191343.448566:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ae1e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607731 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.448577:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/230 (0 0) 00000080:00200000:1.0:1787191343.448593:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xe6:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191343.448607:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe6:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483ae1e 00000080:00010000:1.0:1787191343.448616:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ae1e from it ffffa3fb41cab930 00010000:00010000:1.0:1787191343.448619:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ae1e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607731 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.448628:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ae1e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607731 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191343.448660:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:1.0:1787191343.448667:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe6:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:1.0:1787191343.448682:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ae1e lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607731 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.448693:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ae1e lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607731 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:1.0:1787191343.448701:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xe6:0x0](0000000089668027) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ae1e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607731 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.448751:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ae1e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607731 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.448759:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ae1e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607731 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191343.448772:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1787191343.448782:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe6:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191343.448784:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191343.448790:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:1.0:1787191343.448825:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:1.0:1787191343.448857:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ae1e lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607731 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191343.448865:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ae1e lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607731 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:1.0:1787191343.448872:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xe6:0x0](0000000089668027) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ae1e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607731 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191343.448891:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1787191343.448896:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe6:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191343.448898:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191343.448900:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:1.0:1787191343.448911:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191343.449000:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe6:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:1.0:1787191343.449017:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ae1e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607731 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191343.449025:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ae1e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607731 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00020000:00200000:1.0:1787191343.449038:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xe6:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:1.0:1787191343.449041:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe6:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191343.449044:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191343.449051:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191343.449060:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191343.449064:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:1.0:1787191343.449078:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:1.0:1787191343.449082:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b628934b0, osc lock ffff936b46837a20, flags 0x80000000 00000008:00010000:1.0:1787191343.449087:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:1.0:1787191343.449088:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b628934f0, osc lock ffff936b46836720, flags 0x80000000 00010000:00010000:1.0:1787191343.449145:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae25 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.449155:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae25 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.449164:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae25 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.449185:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626836480:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191343.449302:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893780 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.457549:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626836480:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191343.457575:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae25 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607738 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.457671:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae25 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4607738 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.457685:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae25 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4607738 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.457702:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae25 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4607738 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191343.457714:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae25 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4607738 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.457727:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae25 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607738 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.457735:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae25 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607738 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.458682:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483ae2c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.458697:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483ae2c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.458709:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483ae2c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.458734:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626836608:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191343.462422:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893780 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.469090:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626836608:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191343.469115:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483ae2c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e460773f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.469131:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483ae2c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e460773f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.469141:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483ae2c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e460773f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.469153:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483ae2c lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e460773f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191343.469162:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483ae2c lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e460773f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.469170:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483ae2c lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460773f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.469176:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483ae2c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460773f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.469256:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626836736:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191343.469385:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626836864:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191343.475338:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626836736:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191343.475377:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626836864:192.168.202.101@tcp:10:bash.0 00000080:00200080:0.0:1787191343.477415:0:57968:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88) cmd=400866b1 arg=1 00000080:00200008:0.0:1787191343.477430:0:57968:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe5:0x0](ffff936b4898ba88), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191343.477437:0:57968:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88),name=f70.sanity-flr 00000002:00010000:0.0:1787191343.477458:0:57968:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe5:0x0]) in obj [0x200000405:0xe5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.477473:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483adfb lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46076d6 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.477492:0:57968:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483adfb lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46076d6 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191343.477499:0:57968:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191343.477508:0:57968:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) 00000080:00010000:0.0:1787191343.477511:0:57968:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) for lock 0xe5129dc88483adfb 00000080:00010000:0.0:1787191343.477518:0:57968:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483adfb from it ffffa3fb4234bcd8 00010000:00010000:0.0:1787191343.477522:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483adfb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46076d6 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.477531:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483adfb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46076d6 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191343.477554:0:57968:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe5:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1787191343.477563:0:57968:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe5:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191343.477565:0:57968:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191343.477568:0:57968:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe5:0x0] 00000008:00010000:0.0:1787191343.477585:0:57968:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191343.477589:0:57968:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee6430, osc lock ffff936b50b62000, flags 0x400000400001002 00010000:00010000:0.0:1787191343.477604:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.477615:0:57968:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:0.0:1787191343.477628:0:57968:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191343.477632:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.477641:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:0.0:1787191343.477651:0:57968:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191343.477659:0:57968:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe5:0x0] updating i_size 5 i_blocks 8 00000020:00010000:0.0:1787191343.477663:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509b8b90 (ffff936b47a17488/0) at cl_lock_release():245 00000020:00010000:0.0:1787191343.477666:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509b8b90 (ffff936b47a17488/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191343.477669:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee6430 (ffff936b47a17cf8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191343.477673:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509b8b90 (ffff936b47a17488/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191343.477675:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee6430 (ffff936b47a17488/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191343.477685:0:57968:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe5:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1787191343.477697:0:57968:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xe5:0x0], offset: 0, type: SEEK_DATA 00000080:00200000:0.0:1787191343.477701:0:57968:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe5:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:0.0:1787191343.477705:0:57968:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe5:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191343.477706:0:57968:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191343.477710:0:57968:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191343.477713:0:57968:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191343.477725:0:57968:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe5:0x0] updating i_size 5 i_blocks 8 00000080:00200000:0.0:1787191343.477731:0:57968:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe5:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191343.477734:0:57968:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000080:00200000:0.0:1787191343.477735:0:57968:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe5:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191343.477738:0:57968:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191343.477740:0:57968:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191343.477742:0:57968:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:0.0:1787191343.477746:0:57968:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:0.0:1787191343.477748:0:57968:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee6430, osc lock ffff936b50b62000, flags 0x0 00010000:00010000:0.0:1787191343.477754:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.477760:0:57968:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.477766:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.477770:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.477774:0:57968:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191343.477780:0:57968:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe5:0x0] updating i_size 5 i_blocks 8 00000100:00100000:1.0:1787191343.477995:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626836992:192.168.202.101@tcp:23:lfs.0 00000080:00200000:3.0:1787191343.478887:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe6:0x0] updating i_size 0 i_blocks 0 00000020:00010000:3.0:1787191343.478892:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b497c9308 (ffff936b465cca28/0) at cl_lock_release():245 00000020:00010000:3.0:1787191343.478894:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b497c9308 (ffff936b465cca28/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191343.478897:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b628934b0 (ffff936b47a17008/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191343.478903:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae25 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607738 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.478911:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607738 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1787191343.478922:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b628934f0 (ffff936b465ccf38/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191343.478925:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483ae2c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460773f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.478929:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483ae2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460773f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1787191343.478935:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b497c9308 (ffff936b465cca28/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191343.478936:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b628934b0 (ffff936b465cca28/1) at cl_lock_fini():72 00000020:00010000:3.0:1787191343.478939:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b628934f0 (ffff936b465cca28/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191343.478978:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe6:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191343.478991:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xe6:0x0](ffff936b5396c2c8) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191343.000000000, mtime 1787191343.000000000, ctime 1787191343.000000000, rc 0 00000080:00200008:3.0:1787191343.479078:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xe6:0x0], ppos: 0, count: 5 00000080:00200000:3.0:1787191343.479102:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:3.0:1787191343.479212:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:3.0:1787191343.479218:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:3.0:1787191343.479223:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:3.0:1787191343.479229:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@00000000bf2f0372[0x110, 1, [0x200000405:0xe6:0x0] hash] 00000020:00200000:3.0:1787191343.479231:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:3.0:1787191343.479235:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe6:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:3.0:1787191343.479246:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xe6:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:3.0:1787191343.479251:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe6:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191343.479254:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:3.0:1787191343.479257:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:3.0:1787191343.479264:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:3.0:1787191343.479266:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:3.0:1787191343.479279:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:3.0:1787191343.479290:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:3.0:1787191343.479294:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667b30, osc lock ffff936b44f64980, flags 0x0 00010000:00010000:3.0:1787191343.479306:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae25 lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607738 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191343.479322:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae25 lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607738 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191343.479332:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae25 lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607738 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191343.479341:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae25 lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607738 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191343.479348:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae25 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607738 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191343.479359:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:3.0:1787191343.479368:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:3.0:1787191343.479409:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:3.0:1787191343.479418:0:57570:0:(rw26.c:927:ll_write_end()) page@00000000cb5c1b70[3 00000000e7069d3c 2 1 0000000026fcf9d3 0 0 0] 00000080:00200000:3.0:1787191343.479422:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @000000009a98e211 17ffffc0001001 3:0 ffff936b508422a0 0 lru 00000080:00200000:3.0:1787191343.479429:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@00000000a3439d3f 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000a2a44f55 00000000a8ad9859 > 3< 0 0 > 4< 0 0 8 420335616 - | - - - - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:3.0:1787191343.479431:0:57570:0:(rw26.c:927:ll_write_end()) end page@00000000cb5c1b70 00000080:00200000:3.0:1787191343.479432:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:3.0:1787191343.480327:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:3.0:1787191343.480348:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 0000000080a32fd9 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae25 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607738 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191343.480368:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b5396c478, count 1, dirtied 1 00000080:00200000:3.0:1787191343.480373:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:3.0:1787191343.480376:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:3.0:1787191343.480391:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894e48 (ffff936b47a171b8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191343.480394:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894e48 (ffff936b47a171b8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191343.480396:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667b30 (ffff936b465cccf8/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191343.480401:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae25 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607738 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191343.480409:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae25 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607738 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:3.0:1787191343.480422:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894e48 (ffff936b47a171b8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191343.480425:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667b30 (ffff936b47a171b8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191343.480431:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:3.0:1787191343.480436:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:3.0:1787191343.480442:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe6:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191343.480445:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:3.0:1787191343.480452:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe6:0x0] updating i_size 5 i_blocks 0 00000080:00200000:3.0:1787191343.480456:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:3.0:1787191343.480491:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe6:0x0](ffff936b5396c2c8), flags 100001 00000002:00100000:3.0:1787191343.480546:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1c000 x1874004626835584/t8589937201(8589937201) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191343.480556:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191343.480561:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1fb80 x1874004626837248/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191343.480578:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626837248:192.168.202.101@tcp:35:bash.0 00000100:00100000:3.0:1787191343.481028:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.481387:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626836992:192.168.202.101@tcp:23:lfs.0 00000020:00010000:0.0:1787191343.481445:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894308 (ffff936b47a17488/0) at cl_lock_release():245 00000020:00010000:0.0:1787191343.481449:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894308 (ffff936b47a17488/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191343.481453:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee6430 (ffff936b47a17cf8/1) at cl_lock_cancel():142 00010000:00010000:0.0:1787191343.481460:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.481470:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00010000:0.0:1787191343.481483:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894308 (ffff936b47a17488/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191343.481485:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee6430 (ffff936b47a17488/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191343.481496:0:57968:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe5:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1787191343.481503:0:57968:0:(file.c:5244:ll_file_seek()) COMPLETED file f70.sanity-flr:[0x200000405:0xe5:0x0], offset: 0, type: SEEK_DATA, rc = 0 00000080:00200008:0.0:1787191343.481513:0:57968:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xe5:0x0], offset: 0, type: SEEK_HOLE 00000080:00200000:0.0:1787191343.481520:0:57968:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe5:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:0.0:1787191343.481529:0:57968:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe5:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191343.481532:0:57968:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191343.481536:0:57968:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191343.481543:0:57968:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191343.481555:0:57968:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe5:0x0] updating i_size 5 i_blocks 8 00000080:00200000:0.0:1787191343.481560:0:57968:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe5:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191343.481566:0:57968:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000080:00200000:0.0:1787191343.481568:0:57968:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe5:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191343.481573:0:57968:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191343.481576:0:57968:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191343.481579:0:57968:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:0.0:1787191343.481588:0:57968:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:0.0:1787191343.481591:0:57968:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee6430, osc lock ffff936b50b62000, flags 0x0 00010000:00010000:0.0:1787191343.481606:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191343.481618:0:57968:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191343.481628:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191343.481636:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191343.481653:0:57968:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191343.481663:0:57968:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe5:0x0] updating i_size 5 i_blocks 8 00000100:00100000:1.0:1787191343.481722:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626837376:192.168.202.101@tcp:23:lfs.0 00000100:00100000:1.0:1787191343.483880:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626837248:192.168.202.101@tcp:35:bash.0 00000002:00100000:1.0:1787191343.483915:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1c000 x1874004626835584/t8589937201(8589937201) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787191343.486533:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626837376:192.168.202.101@tcp:23:lfs.0 00000020:00010000:2.0:1787191343.486586:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894308 (ffff936b47a17488/0) at cl_lock_release():245 00000020:00010000:2.0:1787191343.486591:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894308 (ffff936b47a17488/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191343.486596:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee6430 (ffff936b47a17cf8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191343.486607:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191343.486623:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00010000:2.0:1787191343.486640:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894308 (ffff936b47a17488/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191343.486644:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee6430 (ffff936b47a17488/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191343.486679:0:57968:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe5:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191343.486695:0:57968:0:(file.c:5244:ll_file_seek()) COMPLETED file f70.sanity-flr:[0x200000405:0xe5:0x0], offset: 0, type: SEEK_HOLE, rc = 5 00000080:00200080:2.0:1787191343.486708:0:57968:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88) cmd=400866b1 arg=0 00000080:00200080:2.0:1787191343.486716:0:57968:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88) cmd=400866b1 arg=1 00000080:00200008:2.0:1787191343.486722:0:57968:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe5:0x0](ffff936b4898ba88), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191343.486728:0:57968:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88),name=f70.sanity-flr 00000002:00010000:2.0:1787191343.486745:0:57968:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe5:0x0]) in obj [0x200000405:0xe5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191343.486759:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483adfb lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46076d6 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191343.486776:0:57968:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483adfb lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46076d6 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191343.486784:0:57968:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191343.486791:0:57968:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) 00000080:00010000:2.0:1787191343.486794:0:57968:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) for lock 0xe5129dc88483adfb 00000080:00010000:2.0:1787191343.486799:0:57968:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483adfb from it ffffa3fb4234bcd8 00010000:00010000:2.0:1787191343.486802:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483adfb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46076d6 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191343.486809:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483adfb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46076d6 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191343.486827:0:57968:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe5:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:2.0:1787191343.486981:0:57968:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe5:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191343.486985:0:57968:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191343.486989:0:57968:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe5:0x0] 00000008:00010000:2.0:1787191343.487014:0:57968:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191343.487017:0:57968:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d10b0, osc lock ffff936b44e631d0, flags 0x400000400001002 00010000:00010000:2.0:1787191343.487031:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191343.487041:0:57968:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:2.0:1787191343.487053:0:57968:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191343.487057:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191343.487065:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000020:00200000:2.0:1787191343.487074:0:57968:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191343.487084:0:57968:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe5:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191343.487087:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509ba2b0 (ffff936b47a172d8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191343.487197:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509ba2b0 (ffff936b47a172d8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191343.487202:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d10b0 (ffff936b47a17c68/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191343.487206:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509ba2b0 (ffff936b47a172d8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191343.487208:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d10b0 (ffff936b47a172d8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191343.487216:0:57968:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe5:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191343.487235:0:57968:0:(file.c:2483:do_file_read_iter()) START file f70.sanity-flr:[0x200000405:0xe5:0x0], ppos: 0, count: 4096 00000080:00200000:2.0:1787191343.487245:0:57968:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: read ppos: 0, bytes: 4096 00000080:00200000:2.0:1787191343.487253:0:57968:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000020:00200000:2.0:1787191343.487258:0:57968:0:(cl_io.c:214:cl_io_rw_init()) header@00000000a360ba6c[0x110, 2, [0x200000405:0xe5:0x0] hash] 00000020:00200000:2.0:1787191343.487260:0:57968:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 4096) 2048 0 00000080:00200000:2.0:1787191343.487262:0:57968:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe5:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00000080:00200000:2.0:1787191343.487270:0:57968:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1787191343.487277:0:57968:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:2.0:1787191343.487281:0:57968:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1787191343.487292:0:57968:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:2.0:1787191343.487298:0:57968:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:2.0:1787191343.487301:0:57968:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d10b0, osc lock ffff936b44e631d0, flags 0x40000 00000080:00200000:2.0:1787191343.487306:0:57968:0:(vvp_io.c:835:vvp_io_read_start()) f70.sanity-flr: read [0, 4096) 00000001:00010000:2.0:1787191343.487312:0:57968:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe5:0x0] 00000008:00010000:2.0:1787191343.487316:0:57968:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191343.487318:0:57968:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1bb0, osc lock ffff936b44e637c0, flags 0x400001002 00010000:00010000:2.0:1787191343.487326:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1787191343.487336:0:57968:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000020:00200000:2.0:1787191343.487343:0:57968:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191343.487346:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:2.0:1787191343.487354:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 1 00000020:00200000:2.0:1787191343.487363:0:57968:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191343.487368:0:57968:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe5:0x0] updating i_size 5 i_blocks 8 00000020:00010000:2.0:1787191343.487370:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509ba2b0 (ffff936b47a172d8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191343.487373:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509ba2b0 (ffff936b47a172d8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191343.487376:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1bb0 (ffff936b47a17c68/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191343.487379:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509ba2b0 (ffff936b47a172d8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191343.487381:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1bb0 (ffff936b47a172d8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191343.487387:0:57968:0:(vvp_io.c:893:vvp_io_read_start()) count:4096 iocb pos:0 00000080:00200000:2.0:1787191343.487392:0:57968:0:(rw26.c:362:ll_direct_IO()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88), size=4096 (max 536870912), offset=0=0x0, pages 1 (max 131072), lockless, parallel 00000020:00200000:2.0:1787191343.487439:0:57968:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:2.0:1787191343.487442:0:57968:0:(rw26.c:544:ll_direct_IO()) result 0 tot_bytes 5 count 5 file_offset 5 00000020:00010000:2.0:1787191343.487446:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894f38 (ffff936b47a172d8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191343.487449:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894f38 (ffff936b47a172d8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191343.487451:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d10b0 (ffff936b47a17c68/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191343.487454:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894f38 (ffff936b47a172d8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191343.487456:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d10b0 (ffff936b47a172d8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191343.487461:0:57968:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000020:00200000:2.0:1787191343.487465:0:57968:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:2.0:1787191343.487554:0:25580:0:(osc_cache.c:2029:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff936b46699900 00000008:00100000:2.0:1787191343.487595:0:25580:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff936b513b9c00 - object 0x2c0000401:481 offset 0<>5 00000100:00100000:3.0:1787191343.487660:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626837504:192.168.202.101@tcp:3:lfs.0 00000008:00010000:3.0:1787191343.490350:0:2392:0:(osc_cache.c:917:osc_extent_finish()) ### no dlm lock: extent: ffff936b46699900 00000020:00200000:3.0:1787191343.490362:0:2392:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:3.0:1787191343.490370:0:2392:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:3.0:1787191343.490387:0:2392:0:(osc_cache.c:497:__osc_extent_remove()) ### no dlm lock: extent: ffff936b46699900 00000100:00100000:3.0:1787191343.490479:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626837504:192.168.202.101@tcp:3:lfs.0 00000080:00200000:0.0:1787191343.490758:0:57971:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191343.490782:0:57971:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.490798:0:57971:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.490810:0:57971:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.490816:0:57971:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191343.490823:0:57971:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191343.490825:0:57971:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00200000:1.0:1787191343.490911:0:57968:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:1.0:1787191343.490925:0:57968:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe5:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191343.490929:0:57968:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 1 io complete with rc: 0, result: 5, restart: 0 00000020:00200000:1.0:1787191343.490931:0:57968:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191343.490938:0:57968:0:(file.c:2324:ll_file_io_generic()) iot: 1, result: 5 00000080:00200080:1.0:1787191343.490950:0:57968:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88) cmd=400866b1 arg=0 00000080:00200080:1.0:1787191343.490956:0:57968:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88) cmd=400866b1 arg=2 00000080:00200008:1.0:1787191343.490960:0:57968:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe5:0x0](ffff936b4898ba88), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191343.490966:0:57968:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88),name=f70.sanity-flr 00000002:00010000:1.0:1787191343.490973:0:57968:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe5:0x0]) in obj [0x200000405:0xe5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.490980:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483adfb lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46076d6 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191343.490987:0:57968:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483adfb lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46076d6 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191343.490991:0:57968:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191343.490994:0:57968:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) 00000080:00010000:1.0:1787191343.490997:0:57968:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) for lock 0xe5129dc88483adfb 00000080:00010000:1.0:1787191343.491002:0:57968:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483adfb from it ffffa3fb4234bcd8 00010000:00010000:1.0:1787191343.491016:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483adfb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46076d6 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191343.491025:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483adfb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46076d6 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1787191343.491048:0:57968:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe5:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:1.0:1787191343.491058:0:57968:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe5:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191343.491062:0:57968:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191343.491065:0:57968:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe5:0x0] 00000008:00010000:1.0:1787191343.491081:0:57968:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191343.491084:0:57968:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b44ca84b0, osc lock ffff936b46836d10, flags 0x400000400001002 00010000:00010000:1.0:1787191343.491099:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 1 00010000:00010000:1.0:1787191343.491219:0:57968:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 1 00000020:00200000:1.0:1787191343.491230:0:57968:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191343.491232:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 1 00010000:00010000:1.0:1787191343.491238:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 1 00000020:00200000:1.0:1787191343.491245:0:57968:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191343.491252:0:57968:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe5:0x0] updating i_size 5 i_blocks 8 00000020:00010000:1.0:1787191343.491254:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509ba2b0 (ffff936b47a172d8/0) at cl_lock_release():245 00000020:00010000:1.0:1787191343.491256:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509ba2b0 (ffff936b47a172d8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.491259:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b44ca84b0 (ffff936b47a17c68/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.491262:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509ba2b0 (ffff936b47a172d8/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191343.491265:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b44ca84b0 (ffff936b47a172d8/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191343.491272:0:57968:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe5:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1787191343.491291:0:57968:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xe5:0x0], ppos: 0, count: 4096 00000080:00200000:1.0:1787191343.491298:0:57968:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 4096 00000080:00200000:1.0:1787191343.491305:0:57968:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 2 00000020:00200000:1.0:1787191343.491311:0:57968:0:(cl_io.c:214:cl_io_rw_init()) header@00000000a360ba6c[0x110, 2, [0x200000405:0xe5:0x0] hash] 00000020:00200000:1.0:1787191343.491314:0:57968:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 4096) 2048 0 00000080:00200000:1.0:1787191343.491316:0:57968:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe5:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00000080:00200000:1.0:1787191343.491326:0:57968:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:1.0:1787191343.491332:0:57968:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:1.0:1787191343.491335:0:57968:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x11 00000080:00200000:1.0:1787191343.491347:0:57968:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:1.0:1787191343.491353:0:57968:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:1.0:1787191343.491355:0:57968:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b44ca84b0, osc lock ffff936b46836d10, flags 0x40000 00000080:00200000:1.0:1787191343.491362:0:57968:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 4096) append 0 append lockpos 0 00000002:00010000:1.0:1787191343.491380:0:57968:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xe5:0x0], intent: getxattr flags 0 00010000:00010000:1.0:1787191343.491426:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483ae33 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.491434:0:57968:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483ae33 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.491443:0:57968:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483ae33 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.491464:0:57968:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626837632:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191343.491589:0:57968:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893780 going to sleep for 11 seconds 00000080:00010000:0.0:1787191343.491744:0:57971:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42223b58 00010000:00010000:0.0:1787191343.491750:0:57971:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.491758:0:57971:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.491768:0:57971:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.491775:0:57971:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:0.0:1787191343.491780:0:57971:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.491793:0:57971:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:0.0:1787191343.491797:0:57971:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:0.0:1787191343.491811:0:57971:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:0.0:1787191343.491863:0:57971:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae3a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.491880:0:57971:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae3a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.491888:0:57971:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae3a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57971 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.491901:0:57971:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57971:1874004626837760:192.168.202.101@tcp:101:rm.0 00000100:00100000:0.0:1787191343.491927:0:57971:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.494528:0:57968:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626837632:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191343.494554:0:57968:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483ae33 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607754 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.494569:0:57968:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483ae33 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607754 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.494581:0:57968:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483ae33 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607754 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191343.494596:0:57968:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b453aa300 x1874004626837632/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1408 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191343.494606:0:57968:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483ae33 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607754 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.494617:0:57968:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/229 (0 0) 00000080:00200000:1.0:1787191343.494624:0:57968:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xe5:0x0] suppgids 0 -1: rc 0 00000080:00010000:1.0:1787191343.494645:0:57968:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) for lock 0xe5129dc88483ae33 00000080:00010000:1.0:1787191343.494652:0:57968:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ae33 from it ffffa3fb4234b8e8 00010000:00010000:1.0:1787191343.494657:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483ae33 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607754 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.494666:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40031a00/0xe5129dc88483ae33 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607754 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191343.494702:0:57968:0:(rw26.c:362:ll_direct_IO()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88), size=4096 (max 536870912), offset=0=0x0, pages 1 (max 131072), lockless, parallel 00000020:00200000:1.0:1787191343.494765:0:57968:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:1.0:1787191343.494769:0:57968:0:(rw26.c:544:ll_direct_IO()) result 0 tot_bytes 4096 count 4096 file_offset 4096 00000080:00200000:1.0:1787191343.494783:0:57968:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe5:0x0] updating i_size 5 i_blocks 8 00000020:00010000:1.0:1787191343.494789:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894f38 (ffff936b47a172d8/0) at cl_lock_release():245 00000020:00010000:1.0:1787191343.494792:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894f38 (ffff936b47a172d8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.494796:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b44ca84b0 (ffff936b47a17c68/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.494799:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894f38 (ffff936b47a172d8/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191343.494801:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b44ca84b0 (ffff936b47a172d8/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191343.494808:0:57968:0:(vvp_io.c:533:vvp_io_advance()) advancing 4096 bytes 00000020:00200000:1.0:1787191343.494815:0:57968:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:1.0:1787191343.495227:0:40871:0:(osc_cache.c:2029:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff936b486903c0 00000008:00100000:1.0:1787191343.495309:0:40871:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff936b453aa300 - object 0x280000401:479 offset 0<>4096 00000100:00100000:0.0:1787191343.495364:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787191343.495441:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626837888:192.168.202.101@tcp:4:lfs.0 00000100:00100000:0.0:1787191343.496042:0:57971:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57971:1874004626837760:192.168.202.101@tcp:101:rm.0 00010000:00010000:0.0:1787191343.496056:0:57971:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae3a lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607770 expref: -99 pid: 57971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.496074:0:57971:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae3a lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607770 expref: -99 pid: 57971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.496083:0:57971:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae3a lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607770 expref: -99 pid: 57971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.496097:0:57971:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae3a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607770 expref: -99 pid: 57971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.496171:0:57971:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae3a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607770 expref: -99 pid: 57971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.496185:0:57971:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae3a lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607770 expref: -99 pid: 57971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.496192:0:57971:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae3a lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607770 expref: -99 pid: 57971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.496200:0:57971:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae3a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607770 expref: -99 pid: 57971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.496211:0:57971:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b6a477480 x1874004626837760/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/976 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191343.496221:0:57971:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae3a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607770 expref: -99 pid: 57971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191343.496233:0:57971:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae3a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607770 expref: -99 pid: 57971 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.496240:0:57971:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/230 (0 0) 00000080:00200000:0.0:1787191343.496246:0:57971:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191343.496290:0:57971:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xe6:0x0](ffff936b5396c2c8): rc = 0 00000080:00200000:0.0:1787191343.496306:0:57971:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe6:0x0]: layout version change: 4 -> 4 00000080:00010000:0.0:1787191343.496312:0:57971:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe6:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483ae3a 00000080:00010000:0.0:1787191343.496322:0:57971:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe6:0x0](ffff936b5396c2c8) 00000080:00010000:0.0:1787191343.496326:0:57971:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ae3a from it ffffa3fb42223b20 00010000:00010000:0.0:1787191343.496329:0:57971:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae3a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607770 expref: -99 pid: 57971 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.496338:0:57971:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae3a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607770 expref: -99 pid: 57971 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200008:0.0:1787191343.496372:0:57971:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe6:0x0](ffff936b5396c2c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191343.496378:0:57971:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe6:0x0](ffff936b5396c2c8),name=f70.sanity-flr 00000002:00010000:0.0:1787191343.496397:0:57971:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe6:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.496406:0:57971:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae3a lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607770 expref: -99 pid: 57971 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.496416:0:57971:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae3a lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607770 expref: -99 pid: 57971 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191343.496421:0:57971:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191343.496426:0:57971:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe6:0x0](ffff936b5396c2c8) 00000080:00010000:0.0:1787191343.496430:0:57971:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe6:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483ae3a 00000080:00010000:0.0:1787191343.496433:0:57971:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ae3a from it ffffa3fb42223cb8 00010000:00010000:0.0:1787191343.496436:0:57971:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae3a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607770 expref: -99 pid: 57971 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.496443:0:57971:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae3a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607770 expref: -99 pid: 57971 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191343.496460:0:57971:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe6:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1787191343.496470:0:57971:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe6:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191343.496475:0:57971:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191343.496478:0:57971:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe6:0x0] 00000008:00010000:0.0:1787191343.496520:0:57971:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191343.496525:0:57971:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee65b0, osc lock ffff936b50b625f0, flags 0x400000400001002 00010000:00010000:0.0:1787191343.496541:0:57971:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607738 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.496552:0:57971:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607738 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:0.0:1787191343.496563:0:57971:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191343.496566:0:57971:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae25 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607738 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.496573:0:57971:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae25 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607738 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:0.0:1787191343.496582:0:57971:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191343.496591:0:57971:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe6:0x0] updating i_size 5 i_blocks 0 00000020:00010000:0.0:1787191343.496596:0:57971:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509b94d0 (ffff936b47a17ea8/0) at cl_lock_release():245 00000020:00010000:0.0:1787191343.496599:0:57971:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509b94d0 (ffff936b47a17ea8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191343.496602:0:57971:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee65b0 (ffff936b47a17ab8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191343.496605:0:57971:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509b94d0 (ffff936b47a17ea8/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191343.496608:0:57971:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee65b0 (ffff936b47a17ea8/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191343.496617:0:57971:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe6:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191343.496664:0:57971:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191343.496674:0:57971:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.496683:0:57971:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.496692:0:57971:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.496699:0:57971:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191343.496703:0:57971:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191343.496705:0:57971:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191343.496709:0:57971:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42223c10 00010000:00010000:0.0:1787191343.496712:0:57971:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.496720:0:57971:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.496729:0:57971:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.496735:0:57971:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:0.0:1787191343.496740:0:57971:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.496746:0:57971:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:0.0:1787191343.496749:0:57971:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:0.0:1787191343.496754:0:57971:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:0.0:1787191343.496776:0:57971:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ae1e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe6:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4607731 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191343.496789:0:57971:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe6:0x0]: losing layout lock 00010000:00010000:0.0:1787191343.496800:0:57971:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae3a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4607770 expref: -99 pid: 57971 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191343.496808:0:57971:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe6:0x0]: losing layout lock 00010000:00010000:0.0:1787191343.496815:0:57971:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483ae10 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4607715 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.497538:0:57971:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ae1e lrc: 1/0,0 mode: --/CR res: [0x200000405:0xe6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607731 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191343.497549:0:57971:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae3a lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607770 expref: -99 pid: 57971 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.497556:0:57971:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483ae10 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4607715 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.497562:0:57971:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:0.0:1787191343.497565:0:57971:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483ae1e lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe6:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607731 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191343.497577:0:57971:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae3a lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607770 expref: -99 pid: 57971 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.497585:0:57971:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483ae10 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4607715 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1787191343.497603:0:57971:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1787191343.497613:0:57971:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477480 x1874004626838144/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787191343.497634:0:57971:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57971:1874004626838144:192.168.202.101@tcp:36:rm.0 00000100:00100000:0.0:1787191343.497721:0:57971:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787191343.498430:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191343.498521:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634937216 00000100:00100000:3.0:1787191343.498528:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634937216 00000100:00100000:3.0:1787191343.498611:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1492 00000100:00100000:3.0:1787191343.498621:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:25390:x1874004634937216:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191343.498636:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483ad61 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e460750f expref: -99 pid: 57967 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191343.498697:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191343.498704:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:25390:x1874004634937216:12345-192.168.202.101@tcp:104: Request processed in 85us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191343.498711:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1492 00010000:00010000:1.0:1787191343.498764:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191343.498771:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483ad61 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e460750f expref: -99 pid: 57967 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.498778:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b43adec00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191343.498784:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483ad61 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e460750f expref: -99 pid: 57967 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.498824:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483ad61 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e460750f expref: -99 pid: 57967 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.498862:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191343.498893:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483ad61 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e460750f expref: -99 pid: 57967 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.498900:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483ad61 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e460750f expref: -99 pid: 57967 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.498918:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191343.498920:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191343.498922:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191343.498929:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787191343.498940:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626838272:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191343.502049:0:57971:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57971:1874004626838144:192.168.202.101@tcp:36:rm.0 00000080:00200000:0.0:1787191343.502117:0:57971:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe6:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00020000:00200000:0.0:1787191343.502129:0:57971:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe6:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191343.502131:0:57971:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191343.502137:0:57971:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191343.502147:0:57971:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000008:00010000:0.0:1787191343.502165:0:57971:0:(osc_cache.c:1183:osc_extent_make_ready()) ### extent: 0000000080a32fd9 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607738 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1787191343.502203:0:57971:0:(osc_cache.c:917:osc_extent_finish()) ### extent: 0000000080a32fd9 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607738 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1787191343.502226:0:57971:0:(osc_cache.c:497:__osc_extent_remove()) ### extent: 0000000080a32fd9 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607738 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191343.502249:0:57971:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191343.502282:0:57971:0:(llite_lib.c:2066:ll_clear_inode()) VFS Op:inode=[0x200000405:0xe6:0x0](ffff936b5396c2c8) 00000008:00010000:0.0:1787191343.502308:0:57971:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 5 blocks 0 [cma]time 1787191343 1787191343 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae25 lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607738 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1787191343.502327:0:57971:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191343 1787191343 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483ae2c lrc: 1/0,0 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460773f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1787191343.508022:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626838272:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191343.510179:0:2389:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-ffff936b581fb000: committing for last_committed 21474837698 gen 2 00000008:00010000:0.0:1787191343.510270:0:2389:0:(osc_cache.c:917:osc_extent_finish()) ### no dlm lock: extent: ffff936b486903c0 00000020:00200000:0.0:1787191343.510277:0:2389:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:0.0:1787191343.510285:0:2389:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:0.0:1787191343.511143:0:2389:0:(osc_cache.c:497:__osc_extent_remove()) ### no dlm lock: extent: ffff936b486903c0 00000100:00100000:0.0:1787191343.511175:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626837888:192.168.202.101@tcp:4:lfs.0 00000080:00200000:2.0:1787191343.513287:0:57972:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191343.513317:0:57972:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191343.513333:0:57972:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.513348:0:57972:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.513355:0:57972:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191343.513363:0:57972:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191343.513367:0:57972:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191343.513374:0:57972:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b53b58 00010000:00010000:2.0:1787191343.513377:0:57972:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.513386:0:57972:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.513410:0:57972:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191343.513419:0:57972:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:2.0:1787191343.513424:0:57972:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191343.513435:0:57972:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:2.0:1787191343.513439:0:57972:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191343.513451:0:57972:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191343.513500:0:57972:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ae41 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.513507:0:57972:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ae41 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.513514:0:57972:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ae41 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191343.513533:0:57972:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57972:1874004626838400:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191343.513664:0:57972:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f3c0 going to sleep for 11 seconds 00000080:00200000:1.0:1787191343.513856:0:57968:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:1.0:1787191343.513997:0:57968:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe5:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191343.514002:0:57968:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:1.0:1787191343.514022:0:57968:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe5:0x0] updating i_size 5 i_blocks 8 00000020:00200000:1.0:1787191343.514027:0:57968:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191343.514038:0:57968:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200080:1.0:1787191343.514054:0:57968:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88) cmd=400866b1 arg=0 00000080:00200080:1.0:1787191343.514062:0:57968:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88) cmd=400866b1 arg=1 00000080:00200008:1.0:1787191343.514069:0:57968:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe5:0x0](ffff936b4898ba88), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191343.514074:0:57968:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88),name=f70.sanity-flr 00000002:00010000:1.0:1787191343.514083:0:57968:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe5:0x0]) in obj [0x200000405:0xe5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.514094:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483adfb lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46076d6 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191343.514104:0:57968:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483adfb lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46076d6 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1787191343.514120:0:57968:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191343.514125:0:57968:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) 00000080:00010000:1.0:1787191343.514128:0:57968:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) for lock 0xe5129dc88483adfb 00000080:00010000:1.0:1787191343.514133:0:57968:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483adfb from it ffffa3fb4234bcd8 00010000:00010000:1.0:1787191343.514136:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483adfb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46076d6 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191343.514145:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483adfb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46076d6 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00000080:00200000:1.0:1787191343.514164:0:57968:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe5:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:1.0:1787191343.514174:0:57968:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe5:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191343.514178:0:57968:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191343.514181:0:57968:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe5:0x0] 00000008:00010000:1.0:1787191343.514200:0:57968:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191343.514203:0:57968:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b44ca84b0, osc lock ffff936b46836d10, flags 0x400000400001002 00010000:00010000:1.0:1787191343.514220:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 1 00010000:00010000:1.0:1787191343.514231:0:57968:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 1 00000020:00200000:1.0:1787191343.514241:0:57968:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191343.514243:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 1 00010000:00010000:1.0:1787191343.514251:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00000020:00200000:1.0:1787191343.514260:0:57968:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191343.514264:0:57968:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe5:0x0] updating i_size 5 i_blocks 8 00000020:00010000:1.0:1787191343.514267:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509ba2b0 (ffff936b47a172d8/0) at cl_lock_release():245 00000020:00010000:1.0:1787191343.514270:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509ba2b0 (ffff936b47a172d8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.514273:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b44ca84b0 (ffff936b47a17c68/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.514276:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509ba2b0 (ffff936b47a172d8/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191343.514279:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b44ca84b0 (ffff936b47a172d8/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191343.514286:0:57968:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe5:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1787191343.514296:0:57968:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xe5:0x0], offset: 5, type: SEEK_DATA 00000080:00200000:1.0:1787191343.514301:0:57968:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe5:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:1.0:1787191343.514304:0:57968:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe5:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191343.514306:0:57968:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191343.514310:0:57968:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191343.514315:0:57968:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191343.514329:0:57968:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe5:0x0] updating i_size 5 i_blocks 8 00000080:00200000:1.0:1787191343.514336:0:57968:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe5:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191343.514341:0:57968:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000080:00200000:1.0:1787191343.514343:0:57968:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe5:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:1.0:1787191343.514348:0:57968:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191343.514351:0:57968:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191343.514353:0:57968:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:1.0:1787191343.514359:0:57968:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:1.0:1787191343.514361:0:57968:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b44ca84b0, osc lock ffff936b46836d10, flags 0x0 00010000:00010000:1.0:1787191343.514369:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:1.0:1787191343.514377:0:57968:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:1.0:1787191343.514385:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:1.0:1787191343.514393:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:1.0:1787191343.514400:0:57968:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00000080:00200000:1.0:1787191343.514410:0:57968:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe5:0x0] updating i_size 5 i_blocks 8 00000020:00010000:1.0:1787191343.514414:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894f38 (ffff936b47a172d8/0) at cl_lock_release():245 00000020:00010000:1.0:1787191343.514416:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894f38 (ffff936b47a172d8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.514418:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b44ca84b0 (ffff936b47a17c68/1) at cl_lock_cancel():142 00010000:00010000:1.0:1787191343.514422:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:1.0:1787191343.514429:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00000020:00010000:1.0:1787191343.514444:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894f38 (ffff936b47a172d8/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191343.514446:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b44ca84b0 (ffff936b47a172d8/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191343.514453:0:57968:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe5:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1787191343.514459:0:57968:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xe5:0x0], offset: 0, type: (null) 00000080:00200000:1.0:1787191343.514463:0:57968:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe5:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:1.0:1787191343.514468:0:57968:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe5:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191343.514470:0:57968:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191343.514472:0:57968:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe5:0x0] 00000008:00010000:1.0:1787191343.514479:0:57968:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191343.514481:0:57968:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b44ca84b0, osc lock ffff936b46836d10, flags 0x400000400001002 00010000:00010000:1.0:1787191343.514488:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1787191343.514498:0:57968:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00000020:00200000:1.0:1787191343.514505:0:57968:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191343.514508:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1787191343.514516:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00000020:00200000:1.0:1787191343.514524:0:57968:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191343.514528:0:57968:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe5:0x0] updating i_size 5 i_blocks 8 00000020:00010000:1.0:1787191343.514531:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509ba2b0 (ffff936b47a172d8/0) at cl_lock_release():245 00000020:00010000:1.0:1787191343.514534:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509ba2b0 (ffff936b47a172d8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.514536:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b44ca84b0 (ffff936b47a17c68/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.514539:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509ba2b0 (ffff936b47a172d8/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191343.514541:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b44ca84b0 (ffff936b47a172d8/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191343.514546:0:57968:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe5:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1787191343.514552:0:57968:0:(file.c:5244:ll_file_seek()) COMPLETED file f70.sanity-flr:[0x200000405:0xe5:0x0], offset: 0, type: (null), rc = 5 00000080:00200080:1.0:1787191343.514557:0:57968:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88) cmd=400866b1 arg=0 00000100:00100000:3.0:1787191343.523322:0:57972:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57972:1874004626838400:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191343.523343:0:57972:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ae41 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.523356:0:57972:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ae41 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.523361:0:57972:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ae41 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.523368:0:57972:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ae41 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.523375:0:57972:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ae41 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.523380:0:57972:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51184400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191343.523385:0:57972:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ae41 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.523390:0:57972:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ae41 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.523397:0:57972:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ae41 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.523404:0:57972:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191343.523410:0:57972:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ae41 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.523416:0:57972:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483ae41 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191343.523442:0:57972:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513bb800 x1874004626838400/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191343.523456:0:57972:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191343.523541:0:57972:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191343.523555:0:57972:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191343.523565:0:57972:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191343.523576:0:57972:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191343.523583:0:57972:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191343.523587:0:57972:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191343.523590:0:57972:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191343.523595:0:57972:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b53be8 00010000:00010000:3.0:1787191343.523598:0:57972:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191343.523606:0:57972:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191343.523622:0:57972:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191343.523629:0:57972:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000080:00200000:3.0:1787191343.523635:0:57972:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191343.523648:0:57972:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:3.0:1787191343.523652:0:57972:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:3.0:1787191343.523664:0:57972:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1787191343.523704:0:57972:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483ae48 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.523711:0:57972:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483ae48 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.523719:0:57972:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483ae48 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191343.523737:0:57972:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57972:1874004626838528:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191343.523812:0:57972:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c9c0 going to sleep for 11 seconds 00000080:00200080:1.0:1787191343.525289:0:57968:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88) cmd=400866b1 arg=2 00000080:00200008:1.0:1787191343.525306:0:57968:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe5:0x0](ffff936b4898ba88), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191343.525314:0:57968:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88),name=f70.sanity-flr 00000002:00010000:1.0:1787191343.525331:0:57968:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe5:0x0]) in obj [0x200000405:0xe5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.525344:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483adfb lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46076d6 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00010000:00010000:1.0:1787191343.525355:0:57968:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483adfb lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46076d6 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00000080:00200000:1.0:1787191343.525362:0:57968:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xe5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191343.525369:0:57968:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) 00000080:00010000:1.0:1787191343.525373:0:57968:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) for lock 0xe5129dc88483adfb 00000080:00010000:1.0:1787191343.525378:0:57968:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483adfb from it ffffa3fb4234bcd8 00010000:00010000:1.0:1787191343.525382:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483adfb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46076d6 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00010000:00010000:1.0:1787191343.525390:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483adfb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46076d6 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00000080:00200000:1.0:1787191343.525422:0:57968:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe5:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:1.0:1787191343.525434:0:57968:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe5:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191343.525437:0:57968:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191343.525440:0:57968:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe5:0x0] 00000008:00010000:1.0:1787191343.525461:0:57968:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191343.525464:0:57968:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b44ca84b0, osc lock ffff936b46836d10, flags 0x400000400001002 00010000:00010000:1.0:1787191343.525481:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00010000:00010000:1.0:1787191343.525493:0:57968:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00000020:00200000:1.0:1787191343.525505:0:57968:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191343.525508:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00010000:00010000:1.0:1787191343.525515:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00000020:00200000:1.0:1787191343.525524:0:57968:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191343.525534:0:57968:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe5:0x0] updating i_size 5 i_blocks 8 00000020:00010000:1.0:1787191343.525537:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509ba2b0 (ffff936b47a172d8/0) at cl_lock_release():245 00000020:00010000:1.0:1787191343.525540:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509ba2b0 (ffff936b47a172d8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.525543:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b44ca84b0 (ffff936b47a17c68/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.525547:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509ba2b0 (ffff936b47a172d8/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191343.525550:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b44ca84b0 (ffff936b47a172d8/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191343.525560:0:57968:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe5:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1787191343.525590:0:57968:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xe5:0x0](ffff936b4898ba88) current size 5, valid attrs 2068, mode 0, uid -1322410190, gid -1, new size 5, atime 1787191343.000000000, mtime 1787191343.000000000, ctime 1787191343.000000000 00010000:00010000:1.0:1787191343.525611:0:57968:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483adfb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46076d6 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00010000:00010000:1.0:1787191343.525625:0:57968:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483aded lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46076ba expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191343.525662:0:57968:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483adfb lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46076d6 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00010000:00010000:1.0:1787191343.525669:0:57968:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191343.525672:0:57968:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483adfb lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46076d6 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00000020:00100000:1.0:1787191343.525689:0:57968:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1787191343.525699:0:57968:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8a80 x1874004626838784/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787191343.525717:0:57968:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626838784:192.168.202.101@tcp:36:lfs.0 00000100:00100000:1.0:1787191343.525861:0:57968:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893780 going to sleep for 11 seconds 00000100:00100000:3.0:1787191343.532284:0:57972:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57972:1874004626838528:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191343.532306:0:57972:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483ae48 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.532320:0:57972:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483ae48 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.532326:0:57972:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483ae48 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.532333:0:57972:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483ae48 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.532341:0:57972:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483ae48 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.532347:0:57972:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9ba00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191343.532352:0:57972:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483ae48 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.532359:0:57972:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483ae48 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.532367:0:57972:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483ae48 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.532373:0:57972:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191343.532379:0:57972:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483ae48 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.532386:0:57972:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ba00/0xe5129dc88483ae48 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191343.532407:0:57972:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b51d1e300 x1874004626838528/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191343.532422:0:57972:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191343.532513:0:57972:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191343.532527:0:57972:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191343.532536:0:57972:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191343.532548:0:57972:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191343.532555:0:57972:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191343.532560:0:57972:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191343.532563:0:57972:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191343.532568:0:57972:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b53b58 00010000:00010000:3.0:1787191343.532573:0:57972:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000100:00100000:1.0:1787191343.532704:0:57968:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626838784:192.168.202.101@tcp:36:lfs.0 00000080:00200000:1.0:1787191343.532734:0:57968:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 2 00000080:00200000:1.0:1787191343.532741:0:57968:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe5:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:1.0:1787191343.532769:0:57968:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x11 00000080:00200000:1.0:1787191343.532788:0:57968:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:1.0:1787191343.532802:0:57968:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1787191343.532807:0:57968:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b628937b0, osc lock ffff936b46836d10, flags 0x0 00000008:00010000:1.0:1787191343.532811:0:57968:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1787191343.532812:0:57968:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b628937f0, osc lock ffff936b46836850, flags 0x0 00010000:00010000:3.0:1787191343.533169:0:57972:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191343.533184:0:57972:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191343.533191:0:57972:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:3.0:1787191343.533201:0:57972:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:3.0:1787191343.533206:0:57972:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00010000:00010000:1.0:1787191343.533217:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483ae4f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191343.533219:0:57972:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191343.533226:0:57972:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 103 lru_type: 1 00010000:00010000:1.0:1787191343.533228:0:57968:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483ae4f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.533235:0:57972:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 103 lru_type: 1 00010000:00010000:1.0:1787191343.533240:0:57968:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483ae4f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191343.533243:0:57972:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00000100:00100000:1.0:1787191343.533260:0:57968:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626838912:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191343.533265:0:57972:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483ae56 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.533270:0:57972:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483ae56 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.533277:0:57972:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483ae56 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191343.533286:0:57972:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57972:1874004626839040:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191343.533334:0:57968:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893000 going to sleep for 11 seconds 00000100:00100000:3.0:1787191343.535304:0:57972:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191343.539602:0:57972:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57972:1874004626839040:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191343.539629:0:57972:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483ae56 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46077d9 expref: -99 pid: 57972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.539642:0:57972:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483ae56 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46077d9 expref: -99 pid: 57972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.539658:0:57972:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483ae56 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46077d9 expref: -99 pid: 57972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.539668:0:57972:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483ae56 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46077d9 expref: -99 pid: 57972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.539680:0:57972:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483ae56 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46077d9 expref: -99 pid: 57972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.539690:0:57972:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483ae56 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46077d9 expref: -99 pid: 57972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.539697:0:57972:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483ae56 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46077d9 expref: -99 pid: 57972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191343.539708:0:57972:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b51d1e300 x1874004626839040/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191343.539722:0:57972:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483ae56 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46077d9 expref: -99 pid: 57972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.539732:0:57972:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:3.0:1787191343.539739:0:57972:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483ae56 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46077d9 expref: -99 pid: 57972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.539747:0:57972:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483ae56 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46077d9 expref: -99 pid: 57972 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:3.0:1787191343.539775:0:57972:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191343.539786:0:57972:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 206 lru_type: 1 00010000:00010000:3.0:1787191343.539798:0:57972:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 206 lru_type: 1 00010000:00010000:3.0:1787191343.539806:0:57972:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 206 lru_type: 1 00010000:00010000:3.0:1787191343.539813:0:57972:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 207 lru_type: 1 00000080:00200000:3.0:1787191343.540204:0:57972:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:3.0:1787191343.540212:0:57972:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:3.0:1787191343.540215:0:57972:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:3.0:1787191343.540220:0:57972:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb42b53cb8 00010000:00010000:3.0:1787191343.540223:0:57972:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 103 lru_type: 1 00010000:00010000:3.0:1787191343.540229:0:57972:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 104 lru_type: 1 00000002:00010000:0.0:1787191343.540636:0:57972:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.540645:0:57972:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483ae56 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46077d9 expref: -99 pid: 57972 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.540651:0:57972:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483ae56 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46077d9 expref: -99 pid: 57972 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.540657:0:57972:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483ae56 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46077d9 expref: -99 pid: 57972 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.540661:0:57972:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483ae56 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46077d9 expref: -99 pid: 57972 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:0.0:1787191343.540667:0:57972:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.540671:0:57972:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 207 lru_type: 1 00010000:00010000:0.0:1787191343.540675:0:57972:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 207 lru_type: 1 00010000:00010000:0.0:1787191343.540679:0:57972:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 207 lru_type: 1 00010000:00010000:0.0:1787191343.540683:0:57972:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 208 lru_type: 1 00000080:00200008:0.0:1787191343.541409:0:57972:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1787191343.541417:0:57972:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191343.541496:0:57972:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.541506:0:57972:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.541516:0:57972:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.541523:0:57972:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191343.541528:0:57972:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191343.541532:0:57972:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191343.541536:0:57972:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b53cb8 00010000:00010000:0.0:1787191343.541541:0:57972:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.541548:0:57972:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.541666:0:57972:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191343.541674:0:57972:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.541681:0:57972:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.541690:0:57972:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.541696:0:57972:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191343.541700:0:57972:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191343.541703:0:57972:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191343.541706:0:57972:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b53b58 00010000:00010000:0.0:1787191343.541709:0:57972:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.541716:0:57972:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.541725:0:57972:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.541731:0:57972:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:0.0:1787191343.541736:0:57972:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.541745:0:57972:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:0.0:1787191343.541749:0:57972:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:0.0:1787191343.541761:0:57972:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:0.0:1787191343.541806:0:57972:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae5d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.541814:0:57972:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae5d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.541825:0:57972:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae5d lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.541914:0:57968:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626838912:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191343.541933:0:57968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483ae4f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46077cb expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.541944:0:57968:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483ae4f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46077cb expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.541953:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483ae4f lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46077cb expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191343.541961:0:57968:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 4096, setting rss=4096; kms=4096, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483ae4f lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46077cb expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.541974:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483ae4f lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46077cb expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.541979:0:57968:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483ae4f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46077cb expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.541999:0:57968:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b52373000 type 11 mode 2 res 11811161089/482 (0 18446744073709551615) 00010000:00010000:1.0:1787191343.542025:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483ae64 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.542030:0:57968:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483ae64 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.542035:0:57968:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483ae64 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.542049:0:57968:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626839296:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191343.542127:0:57968:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893000 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.543002:0:57972:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57972:1874004626839168:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191343.543068:0:57972:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.547571:0:57972:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57972:1874004626839168:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191343.547594:0:57972:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae5d lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.547611:0:57972:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae5d lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.547618:0:57972:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae5d lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.547625:0:57972:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae5d lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.547634:0:57972:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae5d lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.547640:0:57972:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b43ade800 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191343.547645:0:57972:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae5d lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.547652:0:57972:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae5d lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.547660:0:57972:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae5d lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.547667:0:57972:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191343.547674:0:57972:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae5d lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.547681:0:57972:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae5d lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.547698:0:57972:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b6a477800 x1874004626839168/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191343.547719:0:57972:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1787191343.547747:0:57972:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483ae56 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46077d9 expref: -99 pid: 57972 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.547760:0:57972:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483ae56 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46077d9 expref: -99 pid: 57972 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:0.0:1787191343.547769:0:57972:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ae56 from it ffffa3fb42b53930 00010000:00010000:0.0:1787191343.547772:0:57972:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483ae56 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46077d9 expref: -99 pid: 57972 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.547780:0:57972:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483ae56 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46077d9 expref: -99 pid: 57972 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191343.547969:0:57972:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191343.547986:0:57972:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.547995:0:57972:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.548014:0:57972:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.548021:0:57972:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191343.548027:0:57972:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191343.548029:0:57972:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191343.548035:0:57972:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b53bf8 00010000:00010000:0.0:1787191343.548038:0:57972:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.548045:0:57972:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.548054:0:57972:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.548061:0:57972:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191343.548066:0:57972:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.548072:0:57972:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:0.0:1787191343.548076:0:57972:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:0.0:1787191343.548081:0:57972:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b5307d800, open_flags a141, mode 81b6 opened 0 00000100:00100000:2.0:1787191343.548619:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000080:00200000:0.0:1787191343.548694:0:57972:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:0.0:1787191343.548719:0:57972:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xe8:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:0.0:1787191343.548732:0:57972:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483ae56 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e46077d9 expref: -99 pid: 57972 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191343.548781:0:57972:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483ae56 lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46077d9 expref: -99 pid: 57972 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191343.548787:0:57972:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191343.548790:0:57972:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ae00/0xe5129dc88483ae56 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e46077d9 expref: -99 pid: 57972 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191343.548826:0:57972:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ae6b lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191343.548925:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634937344 00000100:00100000:3.0:1787191343.548934:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634937344 00010000:00010000:0.0:1787191343.548975:0:57972:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ae6b lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191343.548992:0:57972:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191343.549000:0:57972:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477800 x1874004626839552/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191343.549019:0:57972:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ae6b lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191343.549033:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1493 00000100:00100000:0.0:1787191343.549039:0:57972:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57972:1874004626839552:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191343.549043:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8422:x1874004634937344:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191343.549054:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000ed9a6481/0xe5129dc88483ad68 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4607516 expref: -99 pid: 57967 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191343.549132:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191343.549138:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:8422:x1874004634937344:12345-192.168.202.101@tcp:104: Request processed in 97us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191343.549145:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1493 00010000:00010000:1.0:1787191343.549195:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191343.549201:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000ed9a6481/0xe5129dc88483ad68 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4607516 expref: -99 pid: 57967 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.549209:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b43adfa00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191343.549214:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000ed9a6481/0xe5129dc88483ad68 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4607516 expref: -99 pid: 57967 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.549245:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000ed9a6481/0xe5129dc88483ad68 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607516 expref: -99 pid: 57967 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.549252:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191343.549270:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000ed9a6481/0xe5129dc88483ad68 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607516 expref: -99 pid: 57967 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.549278:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000ed9a6481/0xe5129dc88483ad68 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607516 expref: -99 pid: 57967 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.549292:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191343.549294:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191343.549295:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191343.549301:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787191343.549312:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626839680:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191343.549751:0:57972:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.552642:0:57968:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626839296:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191343.552676:0:57968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483ae64 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000020000 nid: local remote: 0x7130d520e46077f5 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.552692:0:57968:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483ae64 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e46077f5 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.552701:0:57968:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483ae64 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e46077f5 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191343.554278:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191343.555169:0:51131:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787191343.555190:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634937472 00000100:00100000:3.0:1787191343.555199:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634937472 00000100:00100000:3.0:1787191343.555261:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1494 00000100:00100000:3.0:1787191343.555273:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b4121f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:6489:x1874004634937472:12345-192.168.202.101@tcp:105: 00010000:00010000:3.0:1787191343.555288:0:51131:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483ae64 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e46077f5 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.555301:0:51131:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483ae64 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e46077f5 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.555310:0:51131:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483ae64 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000020000 nid: local remote: 0x7130d520e46077f5 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.555326:0:51131:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483ae64 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10080000020000 nid: local remote: 0x7130d520e46077f5 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.555337:0:51131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483ae64 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10080000020000 nid: local remote: 0x7130d520e46077f5 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.555348:0:51131:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483ae64 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x80000020000 nid: local remote: 0x7130d520e46077f5 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.555468:0:51131:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b40030600) 00000100:00100000:3.0:1787191343.555542:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b4121f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:6489:x1874004634937472:12345-192.168.202.101@tcp:105: Request processed in 271us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191343.555551:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1494 00000100:00100000:0.0:1787191343.557309:0:57972:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57972:1874004626839552:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191343.557329:0:57972:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ae6b lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607811 expref: -99 pid: 57972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.557355:0:57972:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ae6b lrc: 4/0,1 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607811 expref: -99 pid: 57972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.557364:0:57972:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ae6b lrc: 4/0,1 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607811 expref: -99 pid: 57972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.557375:0:57972:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ae6b lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607811 expref: -99 pid: 57972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.557386:0:57972:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ae6b lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607811 expref: -99 pid: 57972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.557400:0:57972:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ae6b lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607811 expref: -99 pid: 57972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.557413:0:57972:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ae6b lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607811 expref: -99 pid: 57972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.557420:0:57972:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ae6b lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607811 expref: -99 pid: 57972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.557440:0:57972:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b6a477800 x1874004626839552/t8589937208(8589937208) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191343.557454:0:57972:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477800 x1874004626839552/t8589937208(8589937208) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191343.557466:0:57972:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ae6b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607811 expref: -99 pid: 57972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.557475:0:57972:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/232 (0 0) 00000080:00200000:0.0:1787191343.557480:0:57972:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191343.557493:0:57972:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:0.0:1787191343.557525:0:57972:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8) 00000080:00200000:0.0:1787191343.557532:0:57972:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xe8:0x0], updating i_size 0 00000080:00200000:0.0:1787191343.557565:0:57972:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe8:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1787191343.557569:0:57972:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) 00000080:00010000:0.0:1787191343.557573:0:57972:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483ae6b 00000080:00010000:0.0:1787191343.557593:0:57972:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) 00000080:00200008:0.0:1787191343.557608:0:57972:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe8:0x0](ffff936b5396c2c8), flags 120501 00000002:00100000:0.0:1787191343.557629:0:57972:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477800 x1874004626839552/t8589937208(8589937208) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191343.557672:0:57972:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ae6b from it ffff936b530f52a0 00010000:00010000:0.0:1787191343.557676:0:57972:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ae6b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607811 expref: -99 pid: 57972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.557685:0:57972:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ae6b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607811 expref: -99 pid: 57972 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191343.557707:0:57972:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8), inode mode 81a4 mask 40 00000080:00200000:0.0:1787191343.557761:0:57972:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8), inode mode 81a4 mask 2 00000080:00200000:0.0:1787191343.557770:0:57972:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8), xattr lov 00000002:00010000:0.0:1787191343.557785:0:57972:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe8:0x0]) in obj [0x200000405:0xe8:0x0], intent: open flags 040000002 00010000:00010000:0.0:1787191343.557826:0:57972:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adee00/0xe5129dc88483ae72 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.558017:0:57972:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adee00/0xe5129dc88483ae72 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191343.558031:0:57972:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191343.558038:0:57972:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475180 x1874004626839936/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191343.558048:0:57972:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adee00/0xe5129dc88483ae72 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.558066:0:57972:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57972:1874004626839936:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191343.558325:0:57972:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99b40 going to sleep for 11 seconds 00010000:00010000:1.0:1787191343.558796:0:57968:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483ae64 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e46077f5 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.558810:0:57968:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483ae64 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e46077f5 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.558824:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483ae64 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000020000 nid: local remote: 0x7130d520e46077f5 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191343.558854:0:57968:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483ae64 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000020000 nid: local remote: 0x7130d520e46077f5 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.558867:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483ae64 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e46077f5 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.558993:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626839680:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787191343.559050:0:57968:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483ae64 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e46077f5 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.559132:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787191343.559142:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626840064:192.168.202.101@tcp:10:lfs.0 00000100:00100000:1.0:1787191343.559355:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787191343.559362:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626840192:192.168.202.101@tcp:10:lfs.0 00000100:00100000:2.0:1787191343.563321:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191343.563444:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634937600 00000100:00100000:3.0:1787191343.563455:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634937600 00000100:00100000:3.0:1787191343.563513:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1495 00000100:00100000:3.0:1787191343.563524:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634937600:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191343.563544:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ae6b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4607811 expref: -99 pid: 57972 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191343.563686:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191343.564184:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634937600:12345-192.168.202.101@tcp:104: Request processed in 172us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191343.564195:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1495 00010000:00010000:0.0:1787191343.564711:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191343.564722:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ae6b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4607811 expref: -99 pid: 57972 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.564732:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b43adf800 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191343.564737:0:57627:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ae6b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4607811 expref: -99 pid: 57972 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.564746:0:57627:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ae6b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4607811 expref: -99 pid: 57972 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.564754:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ae6b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4607811 expref: -99 pid: 57972 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191343.564789:0:57627:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe8:0x0]: losing layout lock 00010000:00010000:0.0:1787191343.564850:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ae6b lrc: 2/0,0 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607811 expref: -99 pid: 57972 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.564857:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191343.564882:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ae6b lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607811 expref: -99 pid: 57972 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.564890:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf800/0xe5129dc88483ae6b lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607811 expref: -99 pid: 57972 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.564904:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191343.564905:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191343.564907:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191343.564918:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787191343.564930:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626840320:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191343.566826:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626840064:192.168.202.101@tcp:10:lfs.0 00000100:00100000:1.0:1787191343.567261:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626840192:192.168.202.101@tcp:10:lfs.0 00000080:00200000:3.0:1787191343.567320:0:57968:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe5:0x0] updating i_size 5 i_blocks 8 00000020:00010000:3.0:1787191343.567327:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894f38 (ffff936b47a172d8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191343.567330:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894f38 (ffff936b47a172d8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191343.567335:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b628937b0 (ffff936b47a17c68/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191343.567345:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483ae4f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46077cb expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.567360:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483ae4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46077cb expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1787191343.567377:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b628937f0 (ffff936b465cc758/1) at cl_lock_cancel():142 00010000:00010000:3.0:1787191343.567383:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483ae64 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e46077f5 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.568757:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483ae64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e46077f5 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:3.0:1787191343.568785:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894f38 (ffff936b47a172d8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191343.568790:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b628937b0 (ffff936b47a172d8/1) at cl_lock_fini():72 00000020:00010000:3.0:1787191343.568794:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b628937f0 (ffff936b47a172d8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191343.568866:0:57968:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe5:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191343.568890:0:57968:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xe5:0x0](ffff936b4898ba88) current size 5, valid attrs 10002168, mode 0, uid -1322410190, gid -1, new size 5, atime 1787191343.000000000, mtime 1787191343.000000000, ctime 1787191343.000000000, rc 0 00000080:00200080:3.0:1787191343.568910:0:57968:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88) cmd=400866b1 arg=0 00000080:00200008:3.0:1787191343.568937:0:57968:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xe5:0x0](ffff936b4898ba88) current size 5, valid attrs 101f0, mode a3fb, uid 1401184688, gid -27797, new size 18446624687721593480, atime 1787191343.000000000, mtime 1787191343.000000000, ctime 1787191343.000000000 00000020:00100000:0.0:1787191343.569062:0:57968:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 36, max 7 00000100:00100000:0.0:1787191343.569076:0:57968:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474000 x1874004626840576/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787191343.569102:0:57968:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626840576:192.168.202.101@tcp:36:lfs.0 00000100:00100000:0.0:1787191343.569195:0:57968:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99000 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.569475:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626840320:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191343.572893:0:57968:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626840576:192.168.202.101@tcp:36:lfs.0 00000080:00200000:0.0:1787191343.572939:0:57968:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe5:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191343.572952:0:57968:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe5:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191343.572955:0:57968:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191343.572963:0:57968:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191343.572975:0:57968:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000100:00100000:0.0:1787191343.573053:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626840704:192.168.202.101@tcp:2:lfs.0 00000100:00100000:1.0:1787191343.573074:0:57972:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57972:1874004626839936:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191343.573087:0:57972:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adee00/0xe5129dc88483ae72 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.573261:0:57972:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adee00/0xe5129dc88483ae72 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.573269:0:57972:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adee00/0xe5129dc88483ae72 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.573276:0:57972:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adee00/0xe5129dc88483ae72 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.573283:0:57972:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adee00/0xe5129dc88483ae72 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.573289:0:57972:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b43adee00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191343.573294:0:57972:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adee00/0xe5129dc88483ae72 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.573301:0:57972:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adee00/0xe5129dc88483ae72 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.573307:0:57972:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adee00/0xe5129dc88483ae72 lrc: 5/0,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.573315:0:57972:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191343.573321:0:57972:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adee00/0xe5129dc88483ae72 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.573327:0:57972:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adee00/0xe5129dc88483ae72 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57972 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191343.573350:0:57972:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b6a475180 x1874004626839936/t8589937210(8589937210) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191343.573364:0:57972:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475180 x1874004626839936/t8589937210(8589937210) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191343.573764:0:57972:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xe8:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787191343.573824:0:57972:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe8:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1787191343.574089:0:57972:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe8:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191343.574140:0:57972:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xe8:0x0], updating i_size 0 00000002:00100000:1.0:1787191343.574159:0:57972:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475180 x1874004626839936/t8589937210(8589937210) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191343.574191:0:57972:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a475180 x1874004626839936/t8589937210(8589937210) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191343.574201:0:57972:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191343.574206:0:57972:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9f80 x1874004626840960/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191343.574223:0:57972:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57972:1874004626840960:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191343.574316:0:57972:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893000 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.575190:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626840704:192.168.202.101@tcp:2:lfs.0 00000080:00200000:1.0:1787191343.575239:0:57968:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe5:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1787191343.575253:0:57968:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xe5:0x0](ffff936b4898ba88) current size 5, valid attrs 100101f0, mode a3fb, uid 1401184688, gid -27797, new size 18446624687721593480, atime 1787191343.000000000, mtime 1787191343.000000000, ctime 1787191343.000000000, rc 0 00000080:00200080:1.0:1787191343.575274:0:57968:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88) cmd=c00c66f3 arg=24982e0 00010000:00010000:1.0:1787191343.575311:0:57968:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483adbc lrc: 2/0,0 mode: PW/PW res: [0x200000405:0xe5:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81008000000000 nid: local remote: 0x7130d520e4607620 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.575333:0:57968:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483adbc lrc: 0/0,0 mode: --/PW res: [0x200000405:0xe5:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x85809400000000 nid: local remote: 0x7130d520e4607620 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191343.575349:0:57968:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a474a80 x1874004626832512/t8589937194(8589937194) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191343.575360:0:57968:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:1.0:1787191343.575364:0:57968:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9c00 x1874004626841216/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191343.575381:0:57968:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626841216:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191343.575551:0:57968:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893180 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.576693:0:57972:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57972:1874004626840960:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191343.576718:0:57972:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a475180 x1874004626839936/t8589937210(8589937210) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1787191343.576769:0:57972:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe8:0x0](ffff936b5396c2c8), flags 100001 00000002:00100000:1.0:1787191343.576803:0:57972:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a477800 x1874004626839552/t8589937208(8589937208) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191359 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191343.576811:0:57972:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191343.576815:0:57972:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453ab480 x1874004626841472/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191343.576962:0:57972:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57972:1874004626841472:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191343.577030:0:57972:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893000 going to sleep for 11 seconds 00000100:00100000:3.0:1787191343.579361:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:1.0:1787191343.579385:0:57972:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57972:1874004626841472:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191343.579418:0:57972:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a477800 x1874004626839552/t8589937208(8589937208) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787191343.579516:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634937728 00000100:00100000:2.0:1787191343.579524:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634937728 00000100:00100000:2.0:1787191343.579574:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1496 00000100:00100000:2.0:1787191343.579584:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35858:x1874004634937728:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191343.579602:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483aded lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46076ba expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191343.579674:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191343.579681:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35858:x1874004634937728:12345-192.168.202.101@tcp:104: Request processed in 100us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191343.579688:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1496 00010000:00010000:0.0:1787191343.579756:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191343.579763:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483aded lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46076ba expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191343.579772:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9bc00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191343.579778:0:40929:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483aded lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46076ba expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191343.579787:0:40929:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483aded lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46076ba expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191343.579797:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483aded lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e46076ba expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1787191343.579865:0:40929:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe5:0x0]: losing layout lock 00010000:00010000:0.0:1787191343.579901:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483aded lrc: 2/0,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46076ba expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191343.579908:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191343.579931:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483aded lrc: 1/0,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46076ba expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191343.579939:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9bc00/0xe5129dc88483aded lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46076ba expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191343.579953:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191343.579955:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191343.579957:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191343.579964:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787191343.579977:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626841600:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191343.584929:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626841600:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00200000:0.0:1787191343.586359:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191343.586390:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.586531:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.586547:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.586556:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191343.586667:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191343.586672:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191343.586680:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:0.0:1787191343.586687:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.586697:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.586716:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.586726:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191343.586732:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.586748:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:0.0:1787191343.586753:0:57570:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b5307d500, open_flags 8241, mode 81b6 opened 0 00000080:00200000:0.0:1787191343.586763:0:57570:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:0.0:1787191343.586787:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xe9:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0101102 00010000:00010000:0.0:1787191343.588689:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae79 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.588706:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae79 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191343.588721:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191343.588916:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474700 x1874004626841856/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191343.588932:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae79 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.588956:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626841856:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191343.589205:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99000 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.589901:0:57968:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589937213 gen 1 00000100:00100000:1.0:1787191343.589970:0:57968:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626841216:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191343.589997:0:57968:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a474a80 x1874004626832512/t8589937194(8589937194) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1787191343.590034:0:57968:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/229 (0 0) 00000080:00010000:1.0:1787191343.590045:0:57968:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xe5:0x0](ffff936b4898ba88) 00000002:00010000:1.0:1787191343.590056:0:57968:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe5:0x0]) in obj [0x200000405:0xe5:0x0], intent: layout flags 0 00010000:00010000:1.0:1787191343.590102:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483ae80 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.590111:0:57968:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483ae80 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.590120:0:57968:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483ae80 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.590135:0:57968:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626841984:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191343.590178:0:57968:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893180 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.596128:0:57968:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626841984:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191343.596159:0:57968:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483ae80 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607850 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.596175:0:57968:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483ae80 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607850 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191343.596196:0:57968:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b453a9c00 x1874004626841984/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191343.596207:0:57968:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483ae80 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607850 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191343.596220:0:57968:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483ae80 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607850 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.596230:0:57968:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/229 (0 0) 00000080:00200000:1.0:1787191343.596236:0:57968:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xe5:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191343.596252:0:57968:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe5:0x0](ffff936b4898ba88) for lock 0xe5129dc88483ae80 00000080:00010000:1.0:1787191343.596259:0:57968:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ae80 from it ffffa3fb4234bbc8 00010000:00010000:1.0:1787191343.596264:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483ae80 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607850 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.596273:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483ae80 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607850 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.596296:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483ae80 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607850 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.596307:0:57968:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483ae80 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607850 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:1.0:1787191343.596315:0:57968:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xe5:0x0](000000009d25d36f) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483ae80 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607850 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.596362:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483ae80 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607850 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.596371:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483ae80 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607850 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191343.596386:0:57968:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1787191343.596396:0:57968:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe5:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191343.596399:0:57968:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191343.596405:0:57968:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191343.596415:0:57968:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191343.596545:0:57968:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:1.0:1787191343.596559:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483ae80 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607850 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191343.596568:0:57968:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483ae80 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607850 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:1.0:1787191343.596586:0:57968:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xe5:0x0](000000009d25d36f) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483ae80 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607850 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191343.596606:0:57968:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1787191343.596611:0:57968:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe5:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191343.596613:0:57968:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191343.596615:0:57968:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191343.596620:0:57968:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191343.596626:0:57968:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:1.0:1787191343.596638:0:57968:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 5 blocks 8 [cma]time: 1787191343 1787191343 0 by oinfo size 5 blocks 8 [cma]time 1787191343 1787191343 1787191343 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 1/0,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00000008:00010000:1.0:1787191343.596670:0:57968:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 4096 blocks 8 [cma]time: 1787191343 1787191343 0 by oinfo size 5 blocks 8 [cma]time 1787191343 1787191343 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483ae4f lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46077cb expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000008:00010000:1.0:1787191343.596685:0:57968:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191343 1787191343 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483ae64 lrc: 1/0,0 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e46077f5 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191343.596747:0:57968:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe5:0x0]: layout version change: 4294967294 -> 6 00010000:00010000:1.0:1787191343.596753:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483ae80 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607850 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191343.596761:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030000/0xe5129dc88483ae80 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607850 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200008:1.0:1787191343.596956:0:57968:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe5:0x0](ffff936b4898ba88), flags 154002 00000002:00100000:1.0:1787191343.597409:0:57968:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a474e00 x1874004626831488/t8589937193(8589937193) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191343.597977:0:57968:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:1.0:1787191343.597988:0:57968:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9c00 x1874004626842240/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191343.598024:0:57968:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626842240:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191343.598226:0:57968:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893180 going to sleep for 11 seconds 00000100:00100000:2.0:1787191343.600658:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191343.600787:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191343.601158:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634938880 00000100:00100000:3.0:1787191343.601170:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634938880 00000100:00100000:3.0:1787191343.601216:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634939008 00000100:00100000:3.0:1787191343.601219:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634939008 00000100:00100000:3.0:1787191343.601236:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1497 00000100:00100000:3.0:1787191343.601245:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:37089:x1874004634938880:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191343.601264:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483ae2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e460773f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191343.601339:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191343.601345:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:37089:x1874004634938880:12345-192.168.202.101@tcp:104: Request processed in 102us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191343.601352:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1497 00000100:00100000:3.0:1787191343.601369:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1498 00000100:00100000:3.0:1787191343.601375:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30511:x1874004634939008:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191343.601384:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4607738 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191343.601413:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787191343.601419:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30511:x1874004634939008:12345-192.168.202.101@tcp:104: Request processed in 45us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191343.601425:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1498 00010000:00010000:1.0:1787191343.601482:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787191343.601490:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483ae2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e460773f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.601500:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030800 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191343.601505:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483ae2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e460773f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.601550:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483ae2c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e460773f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.601558:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191343.601576:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483ae2c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e460773f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.601591:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009f0d2bb4/0xe5129dc88483ae2c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e460773f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.601611:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191343.601615:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4607738 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191343.601621:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b413ffa00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191343.601625:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4607738 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191343.601646:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae25 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4607738 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191343.601652:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191343.601658:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae25 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4607738 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191343.601665:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae25 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4607738 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191343.601677:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191343.601679:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191343.601680:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191343.602320:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191343.602341:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626842496:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191343.602419:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787191343.602426:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626842368:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191343.604440:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626841856:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191343.604473:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae79 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460787a expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.604763:0:57570:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae79 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460787a expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.604774:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae79 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460787a expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.604785:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae79 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460787a expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.604797:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae79 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460787a expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.604811:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae79 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460787a expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.604821:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae79 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460787a expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.604829:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae79 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460787a expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.604864:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x2b, status=0 req@ffff936b6a474700 x1874004626841856/t8589937214(8589937214) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191343.605054:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474700 x1874004626841856/t8589937214(8589937214) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191343.605068:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae79 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460787a expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191343.605084:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae79 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460787a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.605093:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/232 (0 0) 00000080:00200000:0.0:1787191343.605100:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191343.605158:0:57570:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xe8:0x0](ffff936b5396c2c8): rc = 0 00000080:00200000:0.0:1787191343.605174:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe8:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:0.0:1787191343.605179:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483ae79 00000080:00010000:0.0:1787191343.605190:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) 00000080:00200008:0.0:1787191343.605204:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe8:0x0](ffff936b5396c2c8), flags 101101 00000002:00100000:0.0:1787191343.605225:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474700 x1874004626841856/t8589937214(8589937214) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191343.605265:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ae79 from it ffff936b530f5960 00010000:00010000:0.0:1787191343.605269:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae79 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460787a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.605279:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae79 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460787a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191343.605302:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8), inode mode 81a4 mask 42 00000002:00010000:0.0:1787191343.605330:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xe8:0x0], intent: getxattr flags 0 00010000:00010000:0.0:1787191343.605785:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483ae87 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.605794:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483ae87 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.605805:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483ae87 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.605826:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626842624:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191343.606079:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99000 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.606282:0:57968:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626842240:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191343.606301:0:57968:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a474e00 x1874004626831488/t8589937193(8589937193) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191343.606342:0:57968:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe5:0x0] ignore/verify layout 1/0, layout version 5 restore needed 0 00000100:00100000:0.0:1787191343.606352:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626842368:192.168.202.101@tcp:103:ldlm_bl.0 00020000:00200000:1.0:1787191343.606353:0:57968:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe5:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191343.606359:0:57968:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191343.606365:0:57968:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000100:00100000:0.0:1787191343.606380:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626842496:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00200000:1.0:1787191343.606396:0:57968:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191343.606403:0:57968:0:(llite_lib.c:2066:ll_clear_inode()) VFS Op:inode=[0x200000405:0xe5:0x0](ffff936b4898ba88) 00000080:00200000:1.0:1787191343.606496:0:57968:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191343.606506:0:57968:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.606515:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.606524:0:57968:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.606529:0:57968:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191343.606533:0:57968:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191343.606535:0:57968:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191343.606539:0:57968:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4234bbf8 00010000:00010000:1.0:1787191343.606541:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.606547:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.606555:0:57968:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191343.606559:0:57968:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191343.606563:0:57968:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191343.606565:0:57968:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:1.0:1787191343.606568:0:57968:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8), inode mode 81a4 mask 44 00000080:00200008:1.0:1787191343.606572:0:57968:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe8:0x0](ffff936b5396c2c8), flags 154400 00000002:00010000:1.0:1787191343.606590:0:57968:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe8:0x0]) in obj [0x200000405:0xe8:0x0], intent: open flags 0104240114401 00010000:00010000:1.0:1787191343.606614:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ae8e lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.606619:0:57968:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ae8e lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57968 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191343.606625:0:57968:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191343.606630:0:57968:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9c00 x1874004626842880/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191343.606635:0:57968:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ae8e lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.606645:0:57968:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626842880:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191343.606754:0:57968:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893180 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.611232:0:57968:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626842880:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191343.611266:0:57968:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ae8e lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46078a4 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.611286:0:57968:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ae8e lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46078a4 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.611298:0:57968:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ae8e lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46078a4 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191343.611314:0:57968:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x200002b, status=0 req@ffff936b453a9c00 x1874004626842880/t8589937216(8589937216) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191343.611328:0:57968:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9c00 x1874004626842880/t8589937216(8589937216) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191343.611343:0:57968:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ae8e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46078a4 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191343.611357:0:57968:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ae8e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46078a4 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.611369:0:57968:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/232 (0 0) 00000080:00200000:1.0:1787191343.611377:0:57968:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xe8:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787191343.611450:0:57968:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe8:0x0]: layout version change: 3 -> 3 00000080:00010000:1.0:1787191343.611458:0:57968:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483ae8e 00000080:00010000:1.0:1787191343.611466:0:57968:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ae8e from it ffffa3fb4234bbf0 00010000:00010000:1.0:1787191343.611471:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ae8e lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46078a4 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.611478:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626842624:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191343.611485:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ae8e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46078a4 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000002:00100000:1.0:1787191343.611524:0:57968:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9c00 x1874004626842880/t8589937216(8589937216) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1787191343.611558:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483ae87 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607896 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.611576:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483ae87 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607896 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.611584:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483ae87 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607896 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.611596:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b6a475c00 x1874004626842624/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191343.611606:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483ae87 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607896 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.611613:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/232 (0 0) 00000080:00200000:0.0:1787191343.611618:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xe8:0x0] suppgids 0 -1: rc 0 00000080:00010000:0.0:1787191343.611639:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483ae87 00000080:00010000:0.0:1787191343.611645:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ae87 from it ffffa3fb41caba38 00010000:00010000:0.0:1787191343.611648:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483ae87 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607896 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.611657:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483ae87 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607896 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191343.611657:0:57968:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8), inode mode 81a4 mask 4 00000080:00200000:1.0:1787191343.611670:0:57968:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8), xattr lov 00000080:00200008:0.0:1787191343.611692:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xe8:0x0](ffff936b5396c2c8) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191343.000000000, mtime 1787191343.000000000, ctime 1787191343.000000000 00000080:00200008:1.0:1787191343.611697:0:57968:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe8:0x0](ffff936b5396c2c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191343.611706:0:57968:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8),name=f70.sanity-flr 00010000:00010000:0.0:1787191343.611718:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae79 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e460787a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000002:00010000:1.0:1787191343.611726:0:57968:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe8:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.611739:0:57968:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 30 res 8589935621/232 (0 0) 00010000:00010000:0.0:1787191343.611745:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ae8e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46078a4 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.611789:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae79 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460787a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.611790:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483ae95 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.611808:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191343.611810:0:57968:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483ae95 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.611813:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483ae79 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460787a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.611827:0:57968:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483ae95 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.611890:0:57968:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626843008:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191343.611970:0:57968:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893180 going to sleep for 11 seconds 00000020:00100000:0.0:1787191343.612079:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1787191343.612087:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475c00 x1874004626843264/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787191343.612101:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626843264:192.168.202.101@tcp:36:bash.0 00000100:00100000:0.0:1787191343.612127:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99000 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.616706:0:57968:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626843008:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191343.616736:0:57968:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483ae95 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46078b9 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.616759:0:57968:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483ae95 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46078b9 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.616767:0:57968:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483ae95 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46078b9 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.616778:0:57968:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483ae95 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46078b9 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.616789:0:57968:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483ae95 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46078b9 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.616802:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483ae95 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46078b9 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.616810:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483ae95 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46078b9 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.616817:0:57968:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483ae95 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46078b9 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191343.616827:0:57968:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b453a8a80 x1874004626843008/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/976 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191343.616868:0:57968:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483ae95 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46078b9 expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191343.616887:0:57968:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483ae95 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46078b9 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.616896:0:57968:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/232 (0 0) 00000080:00200000:1.0:1787191343.616903:0:57968:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787191343.616972:0:57968:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe8:0x0]: layout version change: 3 -> 3 00000080:00010000:1.0:1787191343.616978:0:57968:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483ae95 00000080:00010000:1.0:1787191343.616983:0:57968:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) 00000080:00010000:1.0:1787191343.616987:0:57968:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483ae95 from it ffffa3fb4234bcd8 00010000:00010000:1.0:1787191343.616990:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483ae95 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46078b9 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.616999:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483ae95 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46078b9 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191343.617042:0:57968:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe8:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:1.0:1787191343.617053:0:57968:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe8:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191343.617056:0:57968:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191343.617059:0:57968:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe8:0x0] 00000008:00010000:1.0:1787191343.617149:0:57968:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191343.617153:0:57968:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b628931b0, osc lock ffff936b46836e40, flags 0x400000400001002 00000008:00010000:1.0:1787191343.617161:0:57968:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191343.617163:0:57968:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b628931f0, osc lock ffff936b46836000, flags 0x400000400001002 00010000:00010000:1.0:1787191343.617208:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae9c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.617219:0:57968:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae9c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.617230:0:57968:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b453a8a80 x1874004626843392/t0(0) o101->lustre-OST0000-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191343.617285:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000572ee9c6/0xe5129dc88483aea3 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.617294:0:57968:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000572ee9c6/0xe5129dc88483aea3 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.617305:0:57968:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b453ab800 x1874004626843520/t0(0) o101->lustre-OST0001-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:1.0:1787191343.617318:0:57968:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 2 items remaining. 00000100:00100000:3.0:1787191343.617373:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:0.0:1787191343.617414:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626843392:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191343.617610:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787191343.617618:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626843520:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191343.619532:0:2390:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae9c lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.619558:0:2390:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae9c lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46078c7 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.619578:0:2390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae9c lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46078c7 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.619600:0:2390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae9c lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46078c7 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191343.619614:0:2390:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae9c lrc: 5/2,0 mode: PR/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46078c7 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1787191343.619624:0:2390:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191343.619628:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae9c lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46078c7 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.619635:0:2390:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae9c lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46078c7 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.619642:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae9c lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46078c7 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.619651:0:2390:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae9c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46078c7 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1787191343.619670:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626843392:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191343.620275:0:2390:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000572ee9c6/0xe5129dc88483aea3 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.620290:0:2390:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000572ee9c6/0xe5129dc88483aea3 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46078ce expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.620299:0:2390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000572ee9c6/0xe5129dc88483aea3 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46078ce expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.620308:0:2390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000572ee9c6/0xe5129dc88483aea3 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e46078ce expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191343.620318:0:2390:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000572ee9c6/0xe5129dc88483aea3 lrc: 5/2,0 mode: PR/PR res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46078ce expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1787191343.620327:0:2390:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1787191343.620345:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000572ee9c6/0xe5129dc88483aea3 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46078ce expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.620353:0:2390:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000572ee9c6/0xe5129dc88483aea3 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46078ce expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.620358:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000572ee9c6/0xe5129dc88483aea3 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e46078ce expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.620371:0:2390:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000572ee9c6/0xe5129dc88483aea3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46078ce expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1787191343.620385:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626843520:192.168.202.101@tcp:101:lfs.0 00000080:00200000:1.0:1787191343.620477:0:57968:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe8:0x0] updating i_size 0 i_blocks 0 00000020:00010000:1.0:1787191343.620488:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509b94d0 (ffff936b47a17ea8/0) at cl_lock_release():245 00000020:00010000:1.0:1787191343.620492:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509b94d0 (ffff936b47a17ea8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.620499:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b628931b0 (ffff936b465cc248/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.620503:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b628931f0 (ffff936b47a17ab8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.620506:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509b94d0 (ffff936b47a17ea8/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191343.620508:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b628931b0 (ffff936b47a17ea8/1) at cl_lock_fini():72 00000020:00010000:1.0:1787191343.620512:0:57968:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b628931f0 (ffff936b47a17ea8/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191343.620526:0:57968:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe8:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1787191343.620575:0:57968:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe8:0x0](ffff936b5396c2c8), flags 154000 00010000:00010000:1.0:1787191343.620607:0:57968:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ae8e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46078a4 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191343.620674:0:57968:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191343.620690:0:57968:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.620698:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.620707:0:57968:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.620713:0:57968:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191343.620719:0:57968:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191343.620723:0:57968:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191343.620728:0:57968:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb4234bbf8 00010000:00010000:1.0:1787191343.620731:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.620751:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.620761:0:57968:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191343.620767:0:57968:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191343.620772:0:57968:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191343.620786:0:57968:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b5127a000, open_flags d902, mode 0 opened 0 00000080:00200000:1.0:1787191343.620791:0:57968:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:1.0:1787191343.620805:0:57968:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154403 00010000:00010000:1.0:1787191343.620879:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aeaa lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.620896:0:57968:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aeaa lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57968 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191343.620911:0:57968:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:1.0:1787191343.620919:0:57968:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8380 x1874004626843776/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191343.620929:0:57968:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aeaa lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.620950:0:57968:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626843776:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191343.621152:0:57968:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893180 going to sleep for 11 seconds 00000100:00100000:2.0:1787191343.622726:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634939136 00000100:00100000:2.0:1787191343.622749:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634939136 00000100:00100000:2.0:1787191343.622828:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1499 00000100:00100000:2.0:1787191343.623564:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634939136:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191343.623587:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483ae95 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46078b9 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.623798:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191343.623805:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:35075:x1874004634939136:12345-192.168.202.101@tcp:104: Request processed in 247us (6433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191343.623812:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1499 00010000:00010000:0.0:1787191343.623929:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191343.623937:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483ae95 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46078b9 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.623945:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b413ff200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191343.623950:0:57627:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483ae95 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46078b9 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.623959:0:57627:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483ae95 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46078b9 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.623968:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483ae95 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e46078b9 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.623993:0:57627:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ae8e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46078a4 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191343.624046:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483ae95 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46078b9 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.624054:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191343.624086:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483ae95 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46078b9 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.624100:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ff200/0xe5129dc88483ae95 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46078b9 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.624120:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191343.624122:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191343.624124:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191343.624131:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626843904:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191343.625531:0:57968:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626843776:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191343.625551:0:57968:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aeaa lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46078ea expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.625570:0:57968:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aeaa lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46078ea expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.625577:0:57968:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aeaa lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x19/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46078ea expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.625587:0:57968:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aeaa lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x19/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46078ea expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.625597:0:57968:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aeaa lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x19/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46078ea expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.625608:0:57968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aeaa lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x19/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46078ea expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.625616:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aeaa lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x19/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46078ea expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.625623:0:57968:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aeaa lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x19/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46078ea expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191343.625649:0:57968:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b453a8380 x1874004626843776/t8589937218(8589937218) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191343.625669:0:57968:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8380 x1874004626843776/t8589937218(8589937218) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191343.625681:0:57968:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aeaa lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x19/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46078ea expref: -99 pid: 57968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191343.625704:0:57968:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aeaa lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x19/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46078ea expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.625713:0:57968:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/232 (0 0) 00000080:00200000:1.0:1787191343.625719:0:57968:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191343.625811:0:57968:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xe8:0x0](ffff936b5396c2c8): rc = 0 00000080:00200000:1.0:1787191343.625947:0:57968:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe8:0x0]: layout version change: 3 -> 3 00000080:00010000:1.0:1787191343.625969:0:57968:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483aeaa 00000080:00010000:1.0:1787191343.625994:0:57968:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) 00000080:00200008:1.0:1787191343.626030:0:57968:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe8:0x0](ffff936b5396c2c8), flags 154402 00000002:00100000:1.0:1787191343.626753:0:57968:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8380 x1874004626843776/t8589937218(8589937218) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191343.626802:0:57968:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a8380 x1874004626843776/t8589937218(8589937218) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191343.626813:0:57968:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:1.0:1787191343.626819:0:57968:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8700 x1874004626844160/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191343.628169:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626843264:192.168.202.101@tcp:36:bash.0 00000080:00200000:3.0:1787191343.628214:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:3.0:1787191343.628220:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe8:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:3.0:1787191343.628232:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xe8:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:3.0:1787191343.628237:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe8:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191343.628240:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xe8:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:3.0:1787191343.628248:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xe8:0x0](ffff936b5396c2c8) 00000002:00010000:3.0:1787191343.628260:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe8:0x0]) in obj [0x200000405:0xe8:0x0], intent: layout flags 02 00010000:00010000:3.0:1787191343.628278:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ae8e lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46078a4 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000100:00100000:0.0:1787191343.628635:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626843904:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191343.632312:0:57968:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626844160:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191343.632689:0:57968:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893180 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.635610:0:57968:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626844160:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191343.635711:0:57968:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a8380 x1874004626843776/t8589937218(8589937218) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191343.635915:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a9c00 x1874004626842880/t8589937216(8589937216) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191343.635927:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1787191343.635932:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1e300 x1874004626844416/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191343.635957:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626844416:192.168.202.101@tcp:35:bash.0 00000100:00100000:3.0:1787191343.636047:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c240 going to sleep for 11 seconds 00000080:00010000:0.0:1787191343.637728:0:57968:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483aeaa from it ffff936b5339f3c0 00010000:00010000:0.0:1787191343.637742:0:57968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aeaa lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x19/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46078ea expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.637757:0:57968:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aeaa lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x19/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46078ea expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191343.637781:0:57968:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8), inode mode 81a4 mask 46 00000080:00200080:0.0:1787191343.637852:0:57968:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8) cmd=800466af arg=7fff6e42e9fc 00000080:00200080:0.0:1787191343.637872:0:57968:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8) cmd=80086601 arg=7fff6e42e998 00000100:00100000:0.0:1787191343.637922:0:57968:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626844544:192.168.202.101@tcp:33:lfs.0 00000100:00100000:0.0:1787191343.638068:0:57968:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787191343.641744:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1e300 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626844416:192.168.202.101@tcp:35:bash.0 00000002:00100000:3.0:1787191343.641785:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a9c00 x1874004626842880/t8589937216(8589937216) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1787191343.641826:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aeaa lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x19/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46078ea expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191343.641913:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ae8e lrc: 1/0,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46078a4 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191343.641921:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191343.641925:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483ae8e lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46078a4 expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1787191343.641947:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483aeb1 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xe8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.641954:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483aeb1 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191343.641964:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191343.641971:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1ea00 x1874004626844800/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191343.641979:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483aeb1 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191343.641998:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626844800:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191343.642566:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c240 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.648490:0:57968:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57968:1874004626844544:192.168.202.101@tcp:33:lfs.0 00000080:00200080:0.0:1787191343.648550:0:57968:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8) cmd=c00c66f3 arg=7fff6e42e984 00000100:00100000:2.0:1787191343.648782:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191343.648869:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634939264 00000100:00100000:3.0:1787191343.648878:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634939264 00000100:00100000:3.0:1787191343.648935:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1500 00000100:00100000:3.0:1787191343.648945:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634939264:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191343.648972:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aeaa lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x19/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46078ea expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191343.649056:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191343.649063:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634939264:12345-192.168.202.101@tcp:104: Request processed in 120us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191343.649069:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1500 00000080:00200008:0.0:1787191343.649568:0:57968:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe8:0x0](ffff936b5396c2c8), flags 154002 00010000:00010000:1.0:1787191343.651774:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191343.651786:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aeaa lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x19/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46078ea expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191343.651800:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b413ffc00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191343.651805:0:40929:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aeaa lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x19/0x19 rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46078ea expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191343.651815:0:40929:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aeaa lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x19/0x19 rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e46078ea expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191343.651825:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aeaa lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x19/0x19 rrc: 4 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e46078ea expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191343.651862:0:40929:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe8:0x0]: losing layout lock 00010000:00010000:1.0:1787191343.651916:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aeaa lrc: 2/0,0 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x19/0x19 rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46078ea expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191343.651930:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191343.651959:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aeaa lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x19/0x19 rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46078ea expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191343.651968:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aeaa lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x19/0x19 rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46078ea expref: -99 pid: 57968 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191343.651984:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191343.651987:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191343.651988:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191343.652047:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626844928:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191343.656241:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626844928:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191343.666814:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191343.666888:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191343.666916:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191343.666931:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191343.667248:0:40922:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787191343.667267:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634939904 00000100:00100000:2.0:1787191343.667275:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634939904 00000100:00100000:2.0:1787191343.667324:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1501 00000100:00100000:2.0:1787191343.667334:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b4121c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30510:x1874004634939904:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191343.667352:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483ae4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e46077cb expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.667437:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191343.667445:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b4121c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:30510:x1874004634939904:12345-192.168.202.101@tcp:104: Request processed in 112us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191343.667452:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1501 00010000:00010000:2.0:1787191343.667485:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787191343.667491:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483ae4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e46077cb expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.667505:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030200 already unused, calling callback (ffffffffc1208790) 00010000:00010000:2.0:1787191343.667512:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483ae4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e46077cb expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.667554:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483ae4f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e46077cb expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.667561:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191343.667582:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483ae4f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e46077cb expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.667591:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000515bd461/0xe5129dc88483ae4f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e46077cb expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.667607:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191343.667609:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191343.667611:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191343.667624:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626845056:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191343.667723:0:57570:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589937222 gen 1 00000100:00100000:2.0:1787191343.667733:0:57570:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b6a474700 x1874004626841856/t8589937214(8589937214) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787191343.667754:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626844800:192.168.202.101@tcp:101:bash.0 00010000:00010000:2.0:1787191343.667769:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483aeb1 lrc: 4/0,1 mode: --/EX res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46078ff expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.667780:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483aeb1 lrc: 4/0,1 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46078ff expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.667792:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483aeb1 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46078ff expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.667802:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483aeb1 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46078ff expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.667813:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483aeb1 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46078ff expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.667822:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483aeb1 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46078ff expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.667829:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483aeb1 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46078ff expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191343.667858:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b51d1ea00 x1874004626844800/t8589937222(8589937222) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191343.667875:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483aeb1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46078ff expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191343.667886:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483aeb1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46078ff expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.667901:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/232 (0 0) 00000080:00200000:2.0:1787191343.667907:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xe8:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1787191343.667918:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483aeb1 00000080:00010000:2.0:1787191343.667925:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483aeb1 from it ffffa3fb41cab930 00010000:00010000:2.0:1787191343.667929:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483aeb1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46078ff expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.667937:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483aeb1 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46078ff expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191343.667952:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:2.0:1787191343.667958:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe8:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:2.0:1787191343.667972:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483aeb1 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46078ff expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.667981:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483aeb1 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46078ff expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:2.0:1787191343.667988:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xe8:0x0](0000000089668027) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483aeb1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46078ff expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.668034:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483aeb1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46078ff expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.668042:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483aeb1 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46078ff expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191343.668060:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe8:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191343.668070:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe8:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191343.668073:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191343.668079:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:2.0:1787191343.668121:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe8:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:2.0:1787191343.668134:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483aeb1 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46078ff expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191343.668143:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483aeb1 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46078ff expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:2.0:1787191343.668151:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xe8:0x0](0000000089668027) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483aeb1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46078ff expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191343.668168:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe8:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191343.668173:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe8:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191343.668175:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191343.668178:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:2.0:1787191343.668190:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe8:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:2.0:1787191343.668221:0:57570:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae9c lrc: 1/0,0 mode: PR/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46078c7 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000008:00010000:2.0:1787191343.668236:0:57570:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000572ee9c6/0xe5129dc88483aea3 lrc: 1/0,0 mode: PR/PR res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e46078ce expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191343.668297:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe8:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:2.0:1787191343.668303:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483aeb1 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46078ff expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191343.668311:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483aeb1 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46078ff expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00020000:00200000:2.0:1787191343.668324:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xe8:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:2.0:1787191343.668328:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe8:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191343.668330:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191343.668336:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191343.668346:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191343.668349:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:2.0:1787191343.668360:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:2.0:1787191343.668364:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b5338f330, osc lock ffff936b44e631d0, flags 0x80000000 00000008:00010000:2.0:1787191343.668368:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:2.0:1787191343.668369:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b5338f370, osc lock ffff936b44e637c0, flags 0x80000000 00010000:00010000:2.0:1787191343.668408:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.668416:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.668426:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191343.668442:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626845184:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191343.668487:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.669392:0:40920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634940032 00000100:00100000:0.0:1787191343.669401:0:40920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634940032 00000100:00100000:0.0:1787191343.669457:0:40920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634940672 00000100:00100000:0.0:1787191343.669460:0:40920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634940672 00000100:00100000:0.0:1787191343.669472:0:40920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634940800 00000100:00100000:0.0:1787191343.669475:0:40920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634940800 00000100:00100000:0.0:1787191343.669489:0:40920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 43 00000100:00100000:0.0:1787191343.669498:0:40920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:29543:x1874004634940032:12345-192.168.202.101@tcp:104: 00010000:00010000:0.0:1787191343.669510:0:40920:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008763ad1f/0xe5129dc88483ada0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e46075a2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.669574:0:40920:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787191343.669581:0:40920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:29543:x1874004634940032:12345-192.168.202.101@tcp:104: Request processed in 84us (2693us total) trans 0 rc 0/0 00000100:00100000:0.0:1787191343.669588:0:40920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 43 00000100:00100000:0.0:1787191343.669606:0:40920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 44 00000100:00100000:0.0:1787191343.669612:0:40920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+5:30511:x1874004634940672:12345-192.168.202.101@tcp:104: 00010000:00010000:0.0:1787191343.669620:0:40920:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:0.0:1787191343.669650:0:40920:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787191343.669655:0:40920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+5:30511:x1874004634940672:12345-192.168.202.101@tcp:104: Request processed in 44us (2739us total) trans 0 rc 0/0 00000100:00100000:0.0:1787191343.669665:0:40920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 44 00000100:00100000:0.0:1787191343.669676:0:40920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 45 00000100:00100000:0.0:1787191343.669683:0:40920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:8419:x1874004634940800:12345-192.168.202.101@tcp:104: 00010000:00010000:0.0:1787191343.669691:0:40920:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483ae64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000030000 nid: local remote: 0x7130d520e46077f5 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.669732:0:40920:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787191343.669738:0:40920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:LOV_OSC_UUID+4:8419:x1874004634940800:12345-192.168.202.101@tcp:104: Request processed in 56us (2806us total) trans 0 rc 0/0 00000100:00100000:0.0:1787191343.669744:0:40920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 45 00000080:00200000:1.0:1787191343.670946:0:57974:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191343.670969:0:57974:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.670981:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.670994:0:57974:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.671001:0:57974:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191343.671018:0:57974:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191343.671021:0:57974:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191343.671026:0:57974:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b5bbf8 00010000:00010000:1.0:1787191343.671030:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.671038:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.671056:0:57974:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191343.671066:0:57974:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191343.671071:0:57974:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191343.671082:0:57974:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b464a8900, open_flags d900, mode 0 opened 0 00000080:00200000:1.0:1787191343.671087:0:57974:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:1.0:1787191343.671102:0:57974:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:2.0:1787191343.671390:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787191343.671399:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008763ad1f/0xe5129dc88483ada0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e46075a2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.671407:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9a000 already unused, calling callback (ffffffffc1208790) 00010000:00010000:2.0:1787191343.671413:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008763ad1f/0xe5129dc88483ada0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e46075a2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.671456:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008763ad1f/0xe5129dc88483ada0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e46075a2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.671463:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191343.671497:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008763ad1f/0xe5129dc88483ada0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e46075a2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.671506:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000008763ad1f/0xe5129dc88483ada0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e46075a2 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.671524:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787191343.671527:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:2.0:1787191343.671534:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b43ade200 already unused, calling callback (ffffffffc1208790) 00010000:00010000:2.0:1787191343.671537:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00000100:00100000:3.0:1787191343.671539:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626845312:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787191343.671561:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:2.0:1787191343.671567:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191343.671573:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:2.0:1787191343.671579:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000fe4dd5be/0xe5129dc88483ae02 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e46076e4 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:2.0:1787191343.671592:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787191343.671595:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483ae64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000030000 nid: local remote: 0x7130d520e46077f5 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.671602:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030600 already unused, calling callback (ffffffffc1208790) 00010000:00010000:2.0:1787191343.671606:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483ae64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400030000 nid: local remote: 0x7130d520e46077f5 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.671622:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483ae64 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e46077f5 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1787191343.671622:0:2392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1787191343.671628:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787191343.671629:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626845440:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787191343.671633:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483ae64 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e46077f5 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.671646:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483ae64 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e46077f5 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1787191343.671654:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626845568:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787191343.671658:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191343.671660:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191343.671662:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191343.678163:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aebf lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.678183:0:57974:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aebf lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57974 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191343.678197:0:57974:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191343.678210:0:57974:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9500 x1874004626845824/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191343.678221:0:57974:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aebf lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57974 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.678244:0:57974:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626845824:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191343.678438:0:57974:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893180 going to sleep for 11 seconds 00010000:00010000:0.0:1787191343.679289:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191343.679297:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191343.682175:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626845056:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191343.685916:0:57974:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626845824:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191343.685944:0:57974:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aebf lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460793e expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.685967:0:57974:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aebf lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460793e expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.685982:0:57974:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aebf lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460793e expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.685993:0:57974:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aebf lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460793e expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.686014:0:57974:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aebf lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460793e expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.686028:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aebf lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460793e expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.686037:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aebf lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460793e expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.686044:0:57974:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aebf lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460793e expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191343.686056:0:57974:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b453a9500 x1874004626845824/t8589937223(8589937223) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191343.686069:0:57974:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9500 x1874004626845824/t8589937223(8589937223) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191343.686087:0:57974:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aebf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460793e expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191343.686102:0:57974:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aebf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460793e expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.686222:0:57974:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/232 (0 0) 00000080:00200000:1.0:1787191343.686229:0:57974:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191343.686279:0:57974:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xe8:0x0](ffff936b5396c2c8): rc = 0 00000080:00200000:1.0:1787191343.686295:0:57974:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe8:0x0]: layout version change: 4 -> 4 00000080:00010000:1.0:1787191343.686299:0:57974:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483aebf 00000080:00010000:1.0:1787191343.686313:0:57974:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) 00000080:00200008:1.0:1787191343.686326:0:57974:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe8:0x0](ffff936b5396c2c8), flags 154400 00000002:00100000:1.0:1787191343.686351:0:57974:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9500 x1874004626845824/t8589937223(8589937223) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191343.686412:0:57974:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483aebf from it ffff936b5339f7e0 00010000:00010000:1.0:1787191343.686417:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aebf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460793e expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.686426:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aebf lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460793e expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191343.686449:0:57974:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8), inode mode 81a4 mask 44 00000080:00200000:1.0:1787191343.686545:0:57974:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8), inode mode 81a4 mask 4 00000080:00200000:1.0:1787191343.686554:0:57974:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8), xattr lov 00000080:00200008:1.0:1787191343.686580:0:57974:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe8:0x0](ffff936b5396c2c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191343.686586:0:57974:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8),name=f70.sanity-flr 00000002:00010000:1.0:1787191343.686607:0:57974:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe8:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.686616:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aebf lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460793e expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.686631:0:57974:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aebf lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460793e expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191343.686638:0:57974:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191343.686644:0:57974:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) 00000080:00010000:1.0:1787191343.686647:0:57974:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483aebf 00000080:00010000:1.0:1787191343.686651:0:57974:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483aebf from it ffffa3fb42b5bcd8 00010000:00010000:1.0:1787191343.686655:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aebf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460793e expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.686662:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aebf lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460793e expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191343.686681:0:57974:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe8:0x0] ignore/verify layout 0/1, layout version 3 restore needed 0 00020000:00200000:1.0:1787191343.686691:0:57974:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe8:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191343.686695:0:57974:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191343.686699:0:57974:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe8:0x0] 00000008:00010000:1.0:1787191343.686717:0:57974:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191343.686720:0:57974:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b44ca8cb0, osc lock ffff936b46836000, flags 0x400000400001002 00010000:00010000:1.0:1787191343.686732:0:57974:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b52373000 type 11 mode 6 res 11811161089/485 (0 1048575) 00010000:00010000:1.0:1787191343.686782:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483aec6 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.686792:0:57974:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483aec6 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.686801:0:57974:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b453aa680 x1874004626845952/t0(0) o101->lustre-OST0001-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:1.0:1787191343.686869:0:57974:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:3.0:1787191343.687029:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626845568:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191343.687041:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626845440:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191343.687044:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626845952:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191343.687050:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626845312:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191343.687516:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9880 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626845184:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191343.687530:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.687545:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.687556:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.687568:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191343.687580:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.687591:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.687599:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.687642:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aecd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.687654:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aecd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.687663:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aecd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.687678:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8e00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626846080:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191343.687724:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893180 going to sleep for 11 seconds 00000100:00100000:3.0:1787191343.689236:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191343.689347:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634940928 00000100:00100000:2.0:1787191343.689355:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634940928 00000100:00100000:2.0:1787191343.689418:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1502 00000100:00100000:2.0:1787191343.689429:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8422:x1874004634940928:12345-192.168.202.101@tcp:106: 00010000:00010000:2.0:1787191343.689444:0:40921:0:(ldlm_lockd.c:2541:ldlm_callback_handler()) ### glimpse ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.689456:0:40921:0:(ldlm_lockd.c:2123:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00010000:2.0:1787191343.689481:0:40921:0:(cl_object.c:322:cl_object_glimpse()) header@00000000bf2f0372[0x110, 1, [0x200000405:0xe8:0x0] hash] 00000020:00010000:2.0:1787191343.689483:0:40921:0:(cl_object.c:322:cl_object_glimpse()) size: 0 mtime: 1787191343 atime: 1787191343 ctime: 1787191343 blocks: 0 00000020:00010000:2.0:1787191343.689487:0:40921:0:(cl_object.c:322:cl_object_glimpse()) header@000000006fc3d017[0x110, 2, [0x2c0000401:0x1e5:0x0] hash] 00000020:00010000:2.0:1787191343.689498:0:40921:0:(cl_object.c:322:cl_object_glimpse()) size: 0 mtime: 1787191343 atime: 1787191343 ctime: 1787191343 blocks: 0 00000100:00100000:2.0:1787191343.689543:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8422:x1874004634940928:12345-192.168.202.101@tcp:106: Request processed in 116us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191343.689550:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1502 00000100:00100000:1.0:1787191343.691221:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8e00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626846080:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191343.691244:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aecd lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607953 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.691262:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aecd lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4607953 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.691275:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aecd lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4607953 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.691289:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aecd lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4607953 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191343.691302:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aecd lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4607953 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.691314:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aecd lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607953 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.691322:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aecd lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607953 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.691562:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626846208:192.168.202.101@tcp:10:bash.0 00000100:00100000:0.0:1787191343.691639:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787191343.691646:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626846336:192.168.202.101@tcp:10:bash.0 00010000:00010000:0.0:1787191343.695804:0:2390:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483aec6 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.695828:0:2390:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483aec6 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.695890:0:2390:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483aec6 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.695904:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483aec6 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.695911:0:2390:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483aec6 lrc: 5/1,0 mode: --/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191343.695924:0:2390:0:(osc_lock.c:187:osc_lock_lvb_update()) ### no dlm lock: acquired size 0, setting rss=0; leaving kms=0, end=18446744073709551615 00000020:00200000:0.0:1787191343.695932:0:2390:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:0.0:1787191343.695943:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483aec6 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.695951:0:2390:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483aec6 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.695959:0:2390:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483aec6 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.695966:0:2390:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b413ff200 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191343.695971:0:2390:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483aec6 lrc: 5/0,0 mode: --/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1787191343.695973:0:57974:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe8:0x0] updating i_size 0 i_blocks 0 00000020:00010000:1.0:1787191343.695979:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509b94d0 (ffff936b47a17ea8/0) at cl_lock_release():245 00010000:00010000:0.0:1787191343.695982:0:2390:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000020:00010000:1.0:1787191343.695982:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509b94d0 (ffff936b47a17ea8/0) at cl_lock_cancel():142 00010000:00010000:0.0:1787191343.695988:0:2390:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483aec6 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00010000:1.0:1787191343.695988:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b44ca8cb0 (ffff936b47a17ab8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.695992:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509b94d0 (ffff936b47a17ea8/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191343.695995:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b44ca8cb0 (ffff936b47a17ea8/1) at cl_lock_fini():72 00010000:00010000:0.0:1787191343.695996:0:2390:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483aec6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1787191343.696020:0:57974:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe8:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:0.0:1787191343.696028:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626845952:192.168.202.101@tcp:101:lfs.0 00000080:00200008:1.0:1787191343.696080:0:57974:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe8:0x0](ffff936b5396c2c8), flags 154000 00000002:00100000:1.0:1787191343.696165:0:57974:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a9500 x1874004626845824/t8589937223(8589937223) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191343.696176:0:57974:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191343.696181:0:57974:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9c00 x1874004626846592/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191343.696203:0:57974:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626846592:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191343.696295:0:57974:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893180 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.697206:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626846336:192.168.202.101@tcp:10:bash.0 00000100:00100000:0.0:1787191343.697242:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626846208:192.168.202.101@tcp:10:bash.0 00000080:00200000:1.0:1787191343.697316:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe8:0x0] updating i_size 0 i_blocks 0 00000020:00010000:1.0:1787191343.697322:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894e48 (ffff936b47a171b8/0) at cl_lock_release():245 00000020:00010000:1.0:1787191343.697325:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894e48 (ffff936b47a171b8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.697329:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b5338f330 (ffff936b465cc368/1) at cl_lock_cancel():142 00010000:00010000:1.0:1787191343.697336:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.697355:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1787191343.697370:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b5338f370 (ffff936b47a17d88/1) at cl_lock_cancel():142 00010000:00010000:1.0:1787191343.697374:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aecd lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607953 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.697382:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aecd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607953 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1787191343.697391:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894e48 (ffff936b47a171b8/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191343.697453:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b5338f330 (ffff936b47a171b8/1) at cl_lock_fini():72 00000020:00010000:1.0:1787191343.697458:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b5338f370 (ffff936b47a171b8/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191343.697472:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe8:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1787191343.697483:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xe8:0x0](ffff936b5396c2c8) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191343.000000000, mtime 1787191343.000000000, ctime 1787191343.000000000, rc 0 00000080:00200008:1.0:1787191343.697620:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xe8:0x0], ppos: 0, count: 5 00000080:00200000:1.0:1787191343.697633:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:1.0:1787191343.697638:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:1.0:1787191343.697644:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:1.0:1787191343.697649:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:1.0:1787191343.697655:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@00000000bf2f0372[0x110, 1, [0x200000405:0xe8:0x0] hash] 00000020:00200000:1.0:1787191343.697657:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:1.0:1787191343.697661:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe8:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:1.0:1787191343.697672:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xe8:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:1.0:1787191343.697677:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe8:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191343.697680:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:1.0:1787191343.697685:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:1.0:1787191343.697691:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:1.0:1787191343.697694:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1787191343.697709:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:1.0:1787191343.697722:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1787191343.697727:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b44ca8cb0, osc lock ffff936b46836000, flags 0x0 00010000:00010000:1.0:1787191343.697742:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.697754:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.699668:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.699697:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.699704:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191343.699721:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:1.0:1787191343.699738:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:1.0:1787191343.699798:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:1.0:1787191343.699806:0:57570:0:(rw26.c:927:ll_write_end()) page@000000009c84e13e[3 00000000e7069d3c 2 1 0000000026fcf9d3 0 0 0] 00000080:00200000:1.0:1787191343.699809:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @000000006bb9ccd5 17ffffc0001001 3:0 ffff936b43259e00 0 lru 00000080:00200000:1.0:1787191343.699817:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@00000000cf21f552 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000ef00a996 0000000079fea6e5 > 3< 0 0 > 4< 0 0 8 484638720 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1787191343.699819:0:57570:0:(rw26.c:927:ll_write_end()) end page@000000009c84e13e 00000080:00200000:1.0:1787191343.699821:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:1.0:1787191343.699825:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:1.0:1787191343.699875:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 000000004b21917f ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191343.699895:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b5396c478, count 1, dirtied 1 00000080:00200000:1.0:1787191343.699900:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:1.0:1787191343.699902:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:1.0:1787191343.699917:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894e48 (ffff936b47a171b8/0) at cl_lock_release():245 00000020:00010000:1.0:1787191343.699920:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894e48 (ffff936b47a171b8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.699922:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b44ca8cb0 (ffff936b47a17d88/1) at cl_lock_cancel():142 00010000:00010000:1.0:1787191343.699927:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.699937:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:1.0:1787191343.699952:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894e48 (ffff936b47a171b8/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191343.699955:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b44ca8cb0 (ffff936b47a171b8/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191343.699962:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:1.0:1787191343.699969:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:1.0:1787191343.699977:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe8:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191343.699980:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:1.0:1787191343.699988:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe8:0x0] updating i_size 5 i_blocks 0 00000080:00200000:1.0:1787191343.699993:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:1.0:1787191343.700034:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe8:0x0](ffff936b5396c2c8), flags 100001 00000002:00100000:1.0:1787191343.700096:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a474700 x1874004626841856/t8589937214(8589937214) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191343.700108:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:1.0:1787191343.700115:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8380 x1874004626846848/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191343.700136:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626846848:192.168.202.101@tcp:35:bash.0 00000100:00100000:1.0:1787191343.700219:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893000 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.700891:0:57974:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626846592:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191343.700911:0:57974:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a9500 x1874004626845824/t8589937223(8589937223) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191343.701141:0:57974:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191343.701156:0:57974:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.701169:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.701182:0:57974:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.701189:0:57974:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191343.701195:0:57974:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191343.701198:0:57974:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191343.701204:0:57974:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b5bb58 00010000:00010000:1.0:1787191343.701207:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.701215:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.701227:0:57974:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191343.701234:0:57974:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191343.701240:0:57974:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191343.701243:0:57974:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=9 00000080:00200008:1.0:1787191343.701250:0:57974:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe8:0x0](ffff936b5396c2c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191343.701254:0:57974:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8),name=f70.sanity-flr 00000002:00010000:1.0:1787191343.701265:0:57974:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe8:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.701271:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aebf lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460793e expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191343.701278:0:57974:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aebf lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460793e expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191343.701284:0:57974:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191343.701287:0:57974:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) 00000080:00010000:1.0:1787191343.701290:0:57974:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483aebf 00000080:00010000:1.0:1787191343.701293:0:57974:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483aebf from it ffffa3fb42b5bcb8 00010000:00010000:1.0:1787191343.701296:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aebf lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460793e expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191343.701302:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aebf lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460793e expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191343.701321:0:57974:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe8:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:1.0:1787191343.701330:0:57974:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe8:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191343.701334:0:57974:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191343.701337:0:57974:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe8:0x0] 00000008:00010000:1.0:1787191343.701351:0:57974:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191343.701354:0:57974:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b44ca8cb0, osc lock ffff936b46836000, flags 0x400000400001002 00010000:00010000:1.0:1787191343.701370:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191343.701380:0:57974:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:1.0:1787191343.701390:0:57974:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191343.701394:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191343.701402:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:1.0:1787191343.701410:0:57974:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191343.701417:0:57974:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe8:0x0] updating i_size 5 i_blocks 0 00000020:00010000:1.0:1787191343.701422:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509ba060 (ffff936b47a171b8/0) at cl_lock_release():245 00000020:00010000:1.0:1787191343.701424:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509ba060 (ffff936b47a171b8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.701427:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b44ca8cb0 (ffff936b47a17d88/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.701431:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509ba060 (ffff936b47a171b8/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191343.701433:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b44ca8cb0 (ffff936b47a171b8/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191343.701442:0:57974:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe8:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191343.701465:0:57974:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191343.701472:0:57974:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.701478:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.701487:0:57974:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.702020:0:57974:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191343.702025:0:57974:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191343.702027:0:57974:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191343.702033:0:57974:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b5bbf8 00010000:00010000:1.0:1787191343.702036:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.702043:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.702053:0:57974:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191343.702058:0:57974:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191343.702062:0:57974:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191343.702065:0:57974:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:1.0:1787191343.702069:0:57974:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8), inode mode 81a4 mask 46 00000080:00200008:1.0:1787191343.702077:0:57974:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xe8:0x0](ffff936b5396c2c8), flags 154402 00000002:00010000:1.0:1787191343.702092:0:57974:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe8:0x0]) in obj [0x200000405:0xe8:0x0], intent: open flags 0104240114403 00010000:00010000:1.0:1787191343.702134:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483aed4 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.702141:0:57974:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483aed4 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57974 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191343.702152:0:57974:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191343.702161:0:57974:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9c00 x1874004626847104/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191343.702171:0:57974:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483aed4 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57974 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.702188:0:57974:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626847104:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191343.702399:0:57974:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893180 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.703428:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626846848:192.168.202.101@tcp:35:bash.0 00000002:00100000:1.0:1787191343.703450:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a474700 x1874004626841856/t8589937214(8589937214) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787191343.707585:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191343.707627:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634941056 00000100:00100000:3.0:1787191343.707636:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634941056 00000100:00100000:3.0:1787191343.707687:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1503 00000100:00100000:3.0:1787191343.707697:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634941056:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191343.707716:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aebf lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e460793e expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191343.707802:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191343.707809:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634941056:12345-192.168.202.101@tcp:104: Request processed in 114us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191343.707816:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1503 00010000:00010000:1.0:1787191343.707867:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191343.707874:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aebf lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e460793e expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191343.707884:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b413ffc00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191343.707889:0:40930:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aebf lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e460793e expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191343.707898:0:40930:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aebf lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e460793e expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191343.707907:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aebf lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e460793e expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191343.707932:0:40930:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483aeb1 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46078ff expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191343.707973:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aebf lrc: 2/0,0 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e460793e expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191343.707980:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191343.708016:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aebf lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e460793e expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191343.708025:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483aebf lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e460793e expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191343.708041:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191343.708043:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191343.708045:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191343.708653:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626847232:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00200000:2.0:1787191343.712348:0:57975:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191343.712379:0:57975:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191343.712395:0:57975:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.712411:0:57975:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.712419:0:57975:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191343.712426:0:57975:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191343.712430:0:57975:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191343.712437:0:57975:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b53b58 00010000:00010000:2.0:1787191343.712441:0:57975:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.712450:0:57975:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.712466:0:57975:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191343.712474:0:57975:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191343.712480:0:57975:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191343.712559:0:57975:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:2.0:1787191343.712564:0:57975:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191343.712576:0:57975:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191343.712688:0:57975:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483aedb lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.712696:0:57975:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483aedb lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.712707:0:57975:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483aedb lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57975 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191343.712731:0:57975:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57975:1874004626847360:192.168.202.101@tcp:101:rm.0 00000100:00100000:2.0:1787191343.712973:0:57975:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.714807:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626847232:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191343.718613:0:57974:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626847104:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191343.718645:0:57974:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CW ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483aed4 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607961 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.718659:0:57974:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483aed4 lrc: 4/1,0 mode: --/CW res: [0x200000405:0xe8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607961 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.718667:0:57974:0:(ldlm_request.c:795:ldlm_cli_enqueue_fini()) ### enqueue reply includes blocking AST ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483aed4 lrc: 4/1,0 mode: --/CW res: [0x200000405:0xe8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4607961 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.718680:0:57974:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483aed4 lrc: 4/1,0 mode: CW/CW res: [0x200000405:0xe8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e4607961 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.718690:0:57974:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483aed4 lrc: 4/1,0 mode: CW/CW res: [0x200000405:0xe8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4607961 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.718702:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483aed4 lrc: 5/1,1 mode: CW/CW res: [0x200000405:0xe8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e4607961 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.718708:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483aed4 lrc: 5/1,1 mode: CW/CW res: [0x200000405:0xe8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e4607961 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.718716:0:57974:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483aed4 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xe8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e4607961 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191343.718727:0:57974:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x200002b, status=0 req@ffff936b453a9c00 x1874004626847104/t8589937226(8589937226) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191343.718741:0:57974:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9c00 x1874004626847104/t8589937226(8589937226) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191343.718755:0:57974:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483aed4 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xe8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4607961 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.719019:0:57974:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 8 res 8589935621/232 (0 0) 00000080:00200000:1.0:1787191343.719027:0:57974:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xe8:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191343.719076:0:57974:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483aed4 00000080:00010000:1.0:1787191343.719083:0:57974:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483aed4 from it ffffa3fb42b5bbf0 00010000:00010000:1.0:1787191343.719087:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483aed4 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xe8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e4607961 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.719094:0:57974:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483aed4 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xe8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e4607961 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.719144:0:57974:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000002:00100000:1.0:1787191343.719162:0:57974:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9c00 x1874004626847104/t8589937226(8589937226) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191343.719312:0:57974:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8), inode mode 81a4 mask 4 00000080:00200000:1.0:1787191343.719320:0:57974:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8), xattr lov 00000080:00200008:1.0:1787191343.719346:0:57974:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe8:0x0](ffff936b5396c2c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191343.719354:0:57974:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8),name=f70.sanity-flr 00000002:00010000:1.0:1787191343.719367:0:57974:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe8:0x0]) in obj [0x200000405:0xe8:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.719374:0:57974:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 30 res 8589935621/232 (0 0) 00010000:00010000:1.0:1787191343.719427:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483aee2 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.719434:0:57974:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483aee2 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.719444:0:57974:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483aee2 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57974 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.719461:0:57974:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626847488:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191343.719545:0:57974:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893000 going to sleep for 11 seconds 00010000:00010000:2.0:1787191343.719708:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787191343.719717:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483aed4 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xe8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4607961 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.719725:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191343.719730:0:43384:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483aed4 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xe8:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4607961 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.719737:0:43384:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483aed4 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xe8:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4607961 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.719745:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483aed4 lrc: 3/0,0 mode: CW/CW res: [0x200000405:0xe8:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x7130d520e4607961 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.719912:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483aed4 lrc: 2/0,0 mode: --/CW res: [0x200000405:0xe8:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e4607961 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.719920:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191343.719939:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483aed4 lrc: 1/0,0 mode: --/CW res: [0x200000405:0xe8:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e4607961 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.719946:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483aed4 lrc: 0/0,0 mode: --/CW res: [0x200000405:0xe8:0x0].0x0 bits 0x5/0x5 rrc: 5 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e4607961 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.719965:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191343.719967:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191343.719969:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191343.719980:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626847616:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191343.724995:0:57975:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513ba680 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57975:1874004626847360:192.168.202.101@tcp:101:rm.0 00010000:00010000:0.0:1787191343.725034:0:57975:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483aedb lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460797d expref: -99 pid: 57975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.725056:0:57975:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483aedb lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460797d expref: -99 pid: 57975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.725065:0:57975:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483aedb lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460797d expref: -99 pid: 57975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.725076:0:57975:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483aedb lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460797d expref: -99 pid: 57975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.725087:0:57975:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483aedb lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460797d expref: -99 pid: 57975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.725099:0:57975:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483aedb lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460797d expref: -99 pid: 57975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.725108:0:57975:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483aedb lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460797d expref: -99 pid: 57975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.725116:0:57975:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483aedb lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460797d expref: -99 pid: 57975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.725128:0:57975:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b513ba680 x1874004626847360/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/976 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191343.725140:0:57975:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483aedb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460797d expref: -99 pid: 57975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191343.725154:0:57975:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483aedb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460797d expref: -99 pid: 57975 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.725164:0:57975:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/232 (0 0) 00000080:00200000:0.0:1787191343.725170:0:57975:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191343.725220:0:57975:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xe8:0x0](ffff936b5396c2c8): rc = 0 00000080:00200000:0.0:1787191343.725235:0:57975:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe8:0x0]: layout version change: 4 -> 4 00000080:00010000:0.0:1787191343.725240:0:57975:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483aedb 00000080:00010000:0.0:1787191343.725254:0:57975:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) 00000080:00010000:0.0:1787191343.725258:0:57975:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483aedb from it ffffa3fb42b53b20 00010000:00010000:0.0:1787191343.725262:0:57975:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483aedb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460797d expref: -99 pid: 57975 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.725272:0:57975:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483aedb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460797d expref: -99 pid: 57975 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200008:0.0:1787191343.725320:0:57975:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe8:0x0](ffff936b5396c2c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191343.725327:0:57975:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8),name=f70.sanity-flr 00000002:00010000:0.0:1787191343.725348:0:57975:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe8:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.725357:0:57975:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483aedb lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460797d expref: -99 pid: 57975 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.725368:0:57975:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483aedb lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460797d expref: -99 pid: 57975 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191343.725374:0:57975:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191343.725380:0:57975:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) 00000080:00010000:0.0:1787191343.725383:0:57975:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483aedb 00000080:00010000:0.0:1787191343.725387:0:57975:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483aedb from it ffffa3fb42b53cb8 00010000:00010000:0.0:1787191343.725389:0:57975:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483aedb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460797d expref: -99 pid: 57975 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.725412:0:57975:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483aedb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460797d expref: -99 pid: 57975 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191343.725431:0:57975:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe8:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1787191343.725441:0:57975:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe8:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191343.725444:0:57975:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191343.725447:0:57975:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe8:0x0] 00000008:00010000:0.0:1787191343.725501:0:57975:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191343.725504:0:57975:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee6430, osc lock ffff936b50b625f0, flags 0x400000400001002 00010000:00010000:0.0:1787191343.725522:0:57975:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191343.725537:0:57975:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:0.0:1787191343.725549:0:57975:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191343.725553:0:57975:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191343.725561:0:57975:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:0.0:1787191343.725572:0:57975:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191343.725583:0:57975:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe8:0x0] updating i_size 5 i_blocks 0 00000020:00010000:0.0:1787191343.725589:0:57975:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509b8000 (ffff936b47a17128/0) at cl_lock_release():245 00000020:00010000:0.0:1787191343.725592:0:57975:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509b8000 (ffff936b47a17128/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191343.725595:0:57975:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee6430 (ffff936b47a17908/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191343.725599:0:57975:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509b8000 (ffff936b47a17128/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191343.725601:0:57975:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee6430 (ffff936b47a17128/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191343.725611:0:57975:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe8:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191343.725658:0:57975:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191343.725670:0:57975:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.725678:0:57975:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.725686:0:57975:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.725697:0:57975:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191343.725701:0:57975:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191343.725704:0:57975:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191343.725708:0:57975:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b53c10 00010000:00010000:0.0:1787191343.725710:0:57975:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.725717:0:57975:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.725724:0:57975:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.725730:0:57975:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:0.0:1787191343.725734:0:57975:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.725740:0:57975:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:0.0:1787191343.725743:0:57975:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:0.0:1787191343.725748:0:57975:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:0.0:1787191343.725770:0:57975:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483aeb1 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46078ff expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1787191343.725783:0:57975:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe8:0x0]: losing layout lock 00010000:00010000:0.0:1787191343.725793:0:57975:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483aedb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e460797d expref: -99 pid: 57975 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191343.725801:0:57975:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe8:0x0]: losing layout lock 00010000:00010000:0.0:1787191343.725808:0:57975:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483ae87 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4607896 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.725875:0:57975:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483aeb1 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46078ff expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191343.725883:0:57975:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483aedb lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460797d expref: -99 pid: 57975 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.725889:0:57975:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483ae87 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4607896 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.725895:0:57975:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:0.0:1787191343.725898:0:57975:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483aeb1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46078ff expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191343.725909:0:57975:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483aedb lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460797d expref: -99 pid: 57975 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.725918:0:57975:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483ae87 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4607896 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1787191343.725934:0:57975:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1787191343.725941:0:57975:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475880 x1874004626847872/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787191343.725963:0:57975:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57975:1874004626847872:192.168.202.101@tcp:36:rm.0 00000100:00100000:1.0:1787191343.726269:0:57974:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626847488:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191343.726282:0:57974:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483aee2 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607992 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.726291:0:57974:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483aee2 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607992 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.726298:0:57974:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483aee2 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607992 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.726307:0:57974:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483aee2 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607992 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.726322:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483aee2 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607992 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.726329:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483aee2 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607992 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.726335:0:57974:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483aee2 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607992 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191343.726344:0:57974:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b453a9500 x1874004626847488/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/976 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191343.726353:0:57974:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483aee2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607992 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191343.726363:0:57974:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483aee2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607992 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.726370:0:57974:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/232 (0 0) 00000080:00200000:1.0:1787191343.726375:0:57974:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xe8:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787191343.726409:0:57974:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe8:0x0]: layout version change: 4294967294 -> 4 00000080:00010000:1.0:1787191343.726413:0:57974:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483aee2 00000080:00010000:1.0:1787191343.726418:0:57974:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) 00000080:00010000:1.0:1787191343.726420:0:57974:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483aee2 from it ffffa3fb42b5bcd8 00010000:00010000:1.0:1787191343.726424:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483aee2 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607992 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.726435:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483aee2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607992 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191343.726471:0:57974:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe8:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:1.0:1787191343.726478:0:57974:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe8:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191343.726481:0:57974:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191343.726484:0:57974:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe8:0x0] 00000008:00010000:1.0:1787191343.726495:0:57974:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191343.726498:0:57974:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b44ca8cb0, osc lock ffff936b46836000, flags 0x400000400001002 00010000:00010000:1.0:1787191343.726508:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191343.726518:0:57974:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:1.0:1787191343.726526:0:57974:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191343.726529:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191343.726536:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000020:00200000:1.0:1787191343.726545:0:57974:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191343.726550:0:57974:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe8:0x0] updating i_size 5 i_blocks 0 00000020:00010000:1.0:1787191343.726554:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509ba060 (ffff936b47a171b8/0) at cl_lock_release():245 00000020:00010000:1.0:1787191343.726556:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509ba060 (ffff936b47a171b8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.726559:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b44ca8cb0 (ffff936b47a17d88/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.726562:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509ba060 (ffff936b47a171b8/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191343.726565:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b44ca8cb0 (ffff936b47a171b8/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191343.726571:0:57974:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe8:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200080:1.0:1787191343.726679:0:57974:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8) cmd=c00c66f3 arg=23972e0 00000002:00010000:1.0:1787191343.726696:0:57974:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe8:0x0]) in obj [0x200000405:0xe8:0x0], intent: open flags 05004040000002 00010000:00010000:1.0:1787191343.726727:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483aee9 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.726734:0:57974:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483aee9 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57974 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191343.726744:0:57974:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:1.0:1787191343.726750:0:57974:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9500 x1874004626848128/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191343.726758:0:57974:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483aee9 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x81000000000000 pid: 57974 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.726771:0:57974:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626848128:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191343.727672:0:57975:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.727738:0:57974:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893000 going to sleep for 11 seconds 00000100:00100000:2.0:1787191343.728043:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626847616:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191343.730286:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191343.730386:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634941184 00000100:00100000:3.0:1787191343.730401:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634941184 00000100:00100000:3.0:1787191343.730483:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1504 00000100:00100000:3.0:1787191343.730504:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634941184:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191343.730521:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483aee2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4607992 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191343.730629:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191343.730637:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634941184:12345-192.168.202.101@tcp:104: Request processed in 145us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191343.730644:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1504 00010000:00010000:0.0:1787191343.730748:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191343.730756:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483aee2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4607992 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.730766:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191343.730771:0:57627:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483aee2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4607992 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.730780:0:57627:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483aee2 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4607992 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.730787:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483aee2 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4607992 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191343.730809:0:57627:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe8:0x0]: losing layout lock 00010000:00010000:0.0:1787191343.730881:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483aee2 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607992 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.730888:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191343.730919:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483aee2 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607992 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.730927:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483aee2 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607992 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.730942:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191343.730943:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191343.730945:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191343.730952:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787191343.730966:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626848256:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191343.731468:0:57974:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626848128:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191343.731483:0:57974:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483aee9 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e46079b5 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.731554:0:57974:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483aee9 lrc: 4/1,0 mode: --/PW res: [0x200000405:0xe8:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e46079b5 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.731570:0:57974:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483aee9 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0xe8:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e46079b5 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.731581:0:57974:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483aee9 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0xe8:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e46079b5 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.731594:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483aee9 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0xe8:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e46079b5 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.731601:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483aee9 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0xe8:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e46079b5 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.731609:0:57974:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483aee9 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0xe8:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e46079b5 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191343.731620:0:57974:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x600002b, status=0 req@ffff936b453a9500 x1874004626848128/t8589937227(8589937227) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191343.731633:0:57974:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9500 x1874004626848128/t8589937227(8589937227) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191343.731648:0:57974:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483aee9 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xe8:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e46079b5 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.731656:0:57974:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 2 res 8589935621/232 (0 0) 00000080:00200000:1.0:1787191343.731661:0:57974:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xe8:0x0] suppgids 0 0: rc 0 00000002:00100000:1.0:1787191343.731678:0:57974:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a9500 x1874004626848128/t8589937227(8589937227) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191343.731687:0:57974:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483aee9 00000080:00010000:1.0:1787191343.731693:0:57974:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483aee9 from it ffffa3fb42b5bcc0 00010000:00010000:1.0:1787191343.731696:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483aee9 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xe8:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e46079b5 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.731704:0:57974:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483aee9 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0xe8:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e46079b5 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00200000:1.0:1787191343.731757:0:57974:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe8:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00010000:00010000:1.0:1787191343.731767:0:57974:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/232 (0 0) 00000080:00010000:1.0:1787191343.731773:0:57974:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xe8:0x0](ffff936b5396c2c8) 00000002:00010000:1.0:1787191343.731782:0:57974:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe8:0x0]) in obj [0x200000405:0xe8:0x0], intent: layout flags 0 00010000:00010000:1.0:1787191343.731810:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aef0 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.731818:0:57974:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aef0 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.731827:0:57974:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aef0 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57974 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.731875:0:57974:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626848384:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191343.731918:0:57974:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893000 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.734899:0:57975:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57975:1874004626847872:192.168.202.101@tcp:36:rm.0 00000100:00100000:0.0:1787191343.735067:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626848256:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191343.736198:0:57974:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626848384:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191343.736220:0:57974:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aef0 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46079c3 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.736234:0:57974:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aef0 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46079c3 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191343.736248:0:57974:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b453a8700 x1874004626848384/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191343.736259:0:57974:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aef0 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46079c3 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191343.736270:0:57974:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aef0 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46079c3 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.736281:0:57974:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/232 (0 0) 00000080:00200000:1.0:1787191343.736287:0:57974:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xe8:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191343.736299:0:57974:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483aef0 00000080:00010000:1.0:1787191343.736307:0:57974:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483aef0 from it ffffa3fb42b5bb70 00010000:00010000:1.0:1787191343.736311:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aef0 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e46079c3 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.736321:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aef0 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46079c3 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.736346:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aef0 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46079c3 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.736357:0:57974:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aef0 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46079c3 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:1.0:1787191343.736369:0:57974:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xe8:0x0](0000000089668027) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aef0 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e46079c3 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191343.737169:0:57974:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe8:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:1.0:1787191343.737180:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aef0 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e46079c3 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.737191:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aef0 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e46079c3 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:1.0:1787191343.737211:0:57974:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe8:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191343.737214:0:57974:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191343.737221:0:57974:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191343.737234:0:57974:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000100:00100000:1.0:1787191343.737297:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787191343.737316:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626848512:192.168.202.101@tcp:1:lfs.0 00000100:00100000:2.0:1787191343.741969:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191343.742025:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634941312 00000100:00100000:3.0:1787191343.742034:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634941312 00000100:00100000:3.0:1787191343.742079:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1505 00000100:00100000:3.0:1787191343.742090:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8420:x1874004634941312:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191343.742108:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420080000000 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:3.0:1787191343.742187:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191343.742193:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8420:x1874004634941312:12345-192.168.202.101@tcp:104: Request processed in 107us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191343.742200:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1505 00010000:00010000:1.0:1787191343.742496:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191343.742504:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420080000000 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1787191343.742512:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51184400 already unused, calling callback (ffffffffc1208790) 00010000:00010000:1.0:1787191343.742518:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800428480000000 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000008:00010000:1.0:1787191343.742545:0:40929:0:(osc_cache.c:2029:try_to_add_extent_for_io()) ### extent: 000000004b21917f ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800429480000000 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000008:00010000:1.0:1787191343.742565:0:40929:0:(osc_cache.c:1183:osc_extent_make_ready()) ### extent: 000000004b21917f ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800429480000000 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:1.0:1787191343.742617:0:40929:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800429480000000 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000008:00100000:1.0:1787191343.742690:0:40929:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff936b453ab800 - object 0x2c0000401:485 offset 0<>5 00000100:00100000:1.0:1787191343.742810:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626848640:192.168.202.101@tcp:4:bash.0 00000080:00200000:3.0:1787191343.746744:0:57976:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191343.746776:0:57976:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191343.746789:0:57976:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191343.746801:0:57976:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191343.746807:0:57976:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191343.746813:0:57976:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191343.746816:0:57976:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191343.746822:0:57976:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b63b58 00010000:00010000:3.0:1787191343.746824:0:57976:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191343.747355:0:57976:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191343.747860:0:57976:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191343.747871:0:57976:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000008:00010000:1.0:1787191343.747904:0:2390:0:(osc_cache.c:917:osc_extent_finish()) ### extent: 000000004b21917f ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800429480000000 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000008:00010000:1.0:1787191343.747951:0:2390:0:(osc_cache.c:497:__osc_extent_remove()) ### extent: 000000004b21917f ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800429480000000 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000100:00100000:1.0:1787191343.747979:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626848640:192.168.202.101@tcp:4:bash.0 00000080:00200000:0.0:1787191343.748203:0:40929:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe8:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00000080:00200000:0.0:1787191343.748263:0:40929:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe8:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:0.0:1787191343.748308:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69480000020 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1787191343.748314:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191343.748343:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69480000020 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1787191343.748351:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000d7b4bdc7/0xe5129dc88483aeb8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69480000020 nid: local remote: 0x7130d520e4607922 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000100:00100000:1.0:1787191343.748359:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626848768:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787191343.748376:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191343.748377:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191343.748380:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:3.0:1787191343.748899:0:57976:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191343.748918:0:57976:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:3.0:1787191343.748923:0:57976:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:3.0:1787191343.748943:0:57976:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1787191343.748983:0:57976:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483aef7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.748992:0:57976:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483aef7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.749014:0:57976:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483aef7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191343.749030:0:57976:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ca80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57976:1874004626848896:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191343.749063:0:57976:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c840 going to sleep for 11 seconds 00000100:00100000:3.0:1787191343.751254:0:57976:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ca80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57976:1874004626848896:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191343.751276:0:57976:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483aef7 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.751288:0:57976:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483aef7 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.751294:0:57976:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483aef7 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.751301:0:57976:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483aef7 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.751309:0:57976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483aef7 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.751315:0:57976:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9a800 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:3.0:1787191343.751320:0:57976:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483aef7 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.751327:0:57976:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483aef7 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.751334:0:57976:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483aef7 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.751340:0:57976:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1787191343.751346:0:57976:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483aef7 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.751352:0:57976:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483aef7 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191343.751381:0:57976:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b51d1ca80 x1874004626848896/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191343.751405:0:57976:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191343.751501:0:57976:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191343.751515:0:57976:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191343.751525:0:57976:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191343.751536:0:57976:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191343.751543:0:57976:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191343.751549:0:57976:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191343.751552:0:57976:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191343.751557:0:57976:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b63be8 00010000:00010000:3.0:1787191343.751560:0:57976:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191343.751568:0:57976:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191343.751579:0:57976:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191343.751586:0:57976:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000080:00200000:3.0:1787191343.751591:0:57976:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191343.751605:0:57976:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:3.0:1787191343.751609:0:57976:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:3.0:1787191343.751621:0:57976:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1787191343.751659:0:57976:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483aefe lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.751666:0:57976:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483aefe lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.751675:0:57976:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483aefe lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191343.751694:0:57976:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ca80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57976:1874004626849024:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191343.751767:0:57976:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c840 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.752430:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626848512:192.168.202.101@tcp:1:lfs.0 00000100:00100000:1.0:1787191343.752567:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626848768:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787191343.753259:0:57974:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aef0 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e46079c3 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191343.753280:0:57974:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe8:0x0]: losing layout lock 00010000:00010000:3.0:1787191343.753314:0:57974:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aef0 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46079c3 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191343.753321:0:57974:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191343.753324:0:57974:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483aef0 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e46079c3 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000020:00100000:3.0:1787191343.753339:0:57974:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1787191343.753348:0:57974:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1f480 x1874004626849280/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 472/440 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191343.753366:0:57974:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626849280:192.168.202.101@tcp:36:lfs.0 00000100:00100000:3.0:1787191343.753572:0:57974:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c240 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.755449:0:57976:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ca80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57976:1874004626849024:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191343.755466:0:57976:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483aefe lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.755478:0:57976:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483aefe lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.755497:0:57976:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483aefe lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.755504:0:57976:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483aefe lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.755513:0:57976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483aefe lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.755519:0:57976:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9ac00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191343.755523:0:57976:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483aefe lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.755531:0:57976:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483aefe lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.755537:0:57976:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483aefe lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.755548:0:57976:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191343.755554:0:57976:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483aefe lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.755564:0:57976:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483aefe lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.755586:0:57976:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b51d1ca80 x1874004626849024/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191343.755600:0:57976:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191343.755701:0:57976:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191343.755724:0:57976:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.755737:0:57976:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.755749:0:57976:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.755760:0:57976:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191343.755764:0:57976:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191343.755771:0:57976:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191343.755776:0:57976:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b63b58 00010000:00010000:0.0:1787191343.755780:0:57976:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.755792:0:57976:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.755809:0:57976:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.755816:0:57976:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:0.0:1787191343.755829:0:57976:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1787191343.755876:0:57976:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:0.0:1787191343.755891:0:57976:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.755899:0:57976:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 104 lru_type: 1 00010000:00010000:0.0:1787191343.755907:0:57976:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 104 lru_type: 1 00000002:00010000:0.0:1787191343.755918:0:57976:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.756612:0:57976:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483af05 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.756622:0:57976:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483af05 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.756637:0:57976:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483af05 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.756663:0:57976:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57976:1874004626849408:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191343.756754:0:57976:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99840 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.758943:0:57976:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57976:1874004626849408:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191343.758966:0:57976:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483af05 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607a09 expref: -99 pid: 57976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.758978:0:57976:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483af05 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607a09 expref: -99 pid: 57976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.758989:0:57976:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483af05 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607a09 expref: -99 pid: 57976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.758999:0:57976:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483af05 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607a09 expref: -99 pid: 57976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.759025:0:57976:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483af05 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607a09 expref: -99 pid: 57976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.759033:0:57976:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483af05 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607a09 expref: -99 pid: 57976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.759041:0:57976:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483af05 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607a09 expref: -99 pid: 57976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.759061:0:57976:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b6a475500 x1874004626849408/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191343.759075:0:57976:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483af05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607a09 expref: -99 pid: 57976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.759085:0:57976:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:0.0:1787191343.759093:0:57976:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483af05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607a09 expref: -99 pid: 57976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.759102:0:57976:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483af05 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607a09 expref: -99 pid: 57976 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:1.0:1787191343.759182:0:57976:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.759197:0:57976:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 208 lru_type: 1 00010000:00010000:1.0:1787191343.759211:0:57976:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 208 lru_type: 1 00010000:00010000:1.0:1787191343.759221:0:57976:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 208 lru_type: 1 00010000:00010000:1.0:1787191343.759229:0:57976:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 209 lru_type: 1 00000080:00200000:1.0:1787191343.759244:0:57976:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191343.759254:0:57976:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:1.0:1787191343.759258:0:57976:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:1.0:1787191343.759264:0:57976:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb42b63cb8 00010000:00010000:1.0:1787191343.759268:0:57976:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 104 lru_type: 1 00010000:00010000:1.0:1787191343.759276:0:57976:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 105 lru_type: 1 00000002:00010000:1.0:1787191343.759292:0:57976:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.759299:0:57976:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483af05 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607a09 expref: -99 pid: 57976 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.759307:0:57976:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483af05 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607a09 expref: -99 pid: 57976 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.759315:0:57976:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483af05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607a09 expref: -99 pid: 57976 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.759322:0:57976:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483af05 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607a09 expref: -99 pid: 57976 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:1.0:1787191343.759330:0:57976:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.759335:0:57976:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 209 lru_type: 1 00010000:00010000:1.0:1787191343.759342:0:57976:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 209 lru_type: 1 00010000:00010000:1.0:1787191343.759350:0:57976:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 209 lru_type: 1 00010000:00010000:1.0:1787191343.759357:0:57976:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 210 lru_type: 1 00000080:00200008:1.0:1787191343.760223:0:57976:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:1.0:1787191343.760232:0:57976:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191343.760250:0:57976:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.760261:0:57976:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.760272:0:57976:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.760279:0:57976:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191343.760284:0:57976:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191343.760287:0:57976:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191343.760293:0:57976:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b63cb8 00010000:00010000:1.0:1787191343.760296:0:57976:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.760305:0:57976:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.760413:0:57976:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191343.760423:0:57976:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.760430:0:57976:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.760439:0:57976:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.760445:0:57976:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191343.760449:0:57976:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191343.760453:0:57976:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191343.760457:0:57976:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b63b58 00010000:00010000:1.0:1787191343.760460:0:57976:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.760468:0:57976:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.760619:0:57976:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191343.760625:0:57976:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:1.0:1787191343.760630:0:57976:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191343.760639:0:57976:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:1.0:1787191343.760644:0:57976:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191343.760656:0:57976:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191343.760696:0:57976:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483af0c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.760703:0:57976:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483af0c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.760713:0:57976:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483af0c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.760862:0:57976:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57976:1874004626849536:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191343.761016:0:57976:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893000 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.762512:0:57974:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589937229 gen 1 00000100:00100000:1.0:1787191343.762529:0:57974:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b453a9c00 x1874004626847104/t8589937226(8589937226) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787191343.763113:0:57974:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b453a9500 x1874004626848128/t8589937227(8589937227) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787191343.763140:0:57974:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626849280:192.168.202.101@tcp:36:lfs.0 00010000:00010000:1.0:1787191343.763179:0:57974:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/232 (0 0) 00000080:00010000:1.0:1787191343.763190:0:57974:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xe8:0x0](ffff936b5396c2c8) 00000002:00010000:1.0:1787191343.763201:0:57974:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe8:0x0]) in obj [0x200000405:0xe8:0x0], intent: layout flags 0 00010000:00010000:1.0:1787191343.763245:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483af13 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.763254:0:57974:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483af13 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.763262:0:57974:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483af13 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57974 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.763281:0:57974:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626849664:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191343.763353:0:57974:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628939c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.763986:0:57976:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57976:1874004626849536:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191343.764000:0:57976:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483af0c lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.764021:0:57976:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483af0c lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.764029:0:57976:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483af0c lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.764035:0:57976:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483af0c lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.764043:0:57976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483af0c lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.764049:0:57976:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b47a7f200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191343.764053:0:57976:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483af0c lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.764060:0:57976:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483af0c lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.764066:0:57976:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483af0c lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.764072:0:57976:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191343.764078:0:57976:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483af0c lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.764085:0:57976:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483af0c lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191343.764161:0:57976:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b453a8a80 x1874004626849536/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191343.764174:0:57976:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:1.0:1787191343.764195:0:57976:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483af05 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607a09 expref: -99 pid: 57976 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191343.764205:0:57976:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483af05 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607a09 expref: -99 pid: 57976 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:1.0:1787191343.764213:0:57976:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483af05 from it ffffa3fb42b63930 00010000:00010000:1.0:1787191343.764216:0:57976:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483af05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607a09 expref: -99 pid: 57976 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191343.764225:0:57976:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483af05 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607a09 expref: -99 pid: 57976 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:1.0:1787191343.764392:0:57976:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191343.764404:0:57976:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.764412:0:57976:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.764420:0:57976:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.764431:0:57976:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191343.764436:0:57976:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191343.764439:0:57976:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191343.764443:0:57976:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b63bf8 00010000:00010000:1.0:1787191343.764447:0:57976:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.764454:0:57976:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.764463:0:57976:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191343.764470:0:57976:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191343.764535:0:57976:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191343.764594:0:57976:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:1.0:1787191343.764598:0:57976:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:1.0:1787191343.764602:0:57976:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b464a9980, open_flags a141, mode 81b6 opened 0 00000080:00200000:1.0:1787191343.764612:0:57976:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:1.0:1787191343.764630:0:57976:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xea:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:1.0:1787191343.764639:0:57976:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483af05 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4607a09 expref: -99 pid: 57976 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191343.764675:0:57976:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483af05 lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4607a09 expref: -99 pid: 57976 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191343.764682:0:57976:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191343.764685:0:57976:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483af05 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4607a09 expref: -99 pid: 57976 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1787191343.764716:0:57976:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af1a lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.764723:0:57976:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af1a lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191343.764732:0:57976:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191343.764739:0:57976:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8a80 x1874004626849920/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191343.765020:0:57976:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af1a lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.765039:0:57976:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57976:1874004626849920:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191343.766420:0:57976:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893000 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.773071:0:57974:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626849664:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191343.773106:0:57974:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483af13 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607a25 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.773122:0:57974:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483af13 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607a25 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191343.773137:0:57974:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b453a9f80 x1874004626849664/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191343.773149:0:57974:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483af13 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607a25 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191343.773171:0:57974:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483af13 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607a25 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.773183:0:57974:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/232 (0 0) 00000080:00200000:1.0:1787191343.773189:0:57974:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xe8:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191343.773206:0:57974:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483af13 00000080:00010000:1.0:1787191343.773213:0:57974:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483af13 from it ffffa3fb42b5bc70 00010000:00010000:1.0:1787191343.773217:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483af13 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607a25 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.773227:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483af13 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607a25 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.773253:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483af13 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607a25 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.773264:0:57974:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483af13 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607a25 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:1.0:1787191343.773273:0:57974:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xe8:0x0](0000000089668027) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483af13 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607a25 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.773465:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483af13 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607a25 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.773654:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483af13 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607a25 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191343.773675:0:57974:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe8:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:1.0:1787191343.773685:0:57974:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe8:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191343.773689:0:57974:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191343.773696:0:57974:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191343.773708:0:57974:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191343.773729:0:57974:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe8:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:1.0:1787191343.773758:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483af13 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607a25 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191343.773768:0:57974:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483af13 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607a25 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:1.0:1787191343.773776:0:57974:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xe8:0x0](0000000089668027) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483af13 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607a25 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191343.773796:0:57974:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe8:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00020000:00200000:1.0:1787191343.773801:0:57974:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe8:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191343.773803:0:57974:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191343.773805:0:57974:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191343.773810:0:57974:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191343.773816:0:57974:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe8:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:1.0:1787191343.773880:0:57974:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191343 1787191343 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aecd lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607953 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191343.773947:0:57974:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe8:0x0]: layout version change: 4294967294 -> 5 00010000:00010000:1.0:1787191343.773952:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483af13 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607a25 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1787191343.773960:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483af13 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607a25 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200080:1.0:1787191343.773981:0:57974:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8) cmd=66f4 arg=23972e0 00000080:00200008:1.0:1787191343.773992:0:57974:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe8:0x0](ffff936b5396c2c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191343.773999:0:57974:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8),name=f70.sanity-flr 00000002:00010000:1.0:1787191343.774027:0:57974:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe8:0x0]) in obj [0x200000405:0xe8:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.774033:0:57974:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 30 res 8589935621/232 (0 0) 00010000:00010000:1.0:1787191343.774072:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483af21 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 57974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.774080:0:57974:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483af21 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.774090:0:57974:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483af21 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 57974 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.774109:0:57974:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626850048:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191343.774198:0:57974:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628939c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.777301:0:57974:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626850048:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191343.777323:0:57974:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483af21 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607a56 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.777336:0:57974:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483af21 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607a56 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.777352:0:57974:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483af21 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607a56 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.777364:0:57974:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483af21 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607a56 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.777375:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483af21 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607a56 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.777384:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483af21 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607a56 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.777392:0:57974:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483af21 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607a56 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191343.777403:0:57974:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b453a9f80 x1874004626850048/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/976 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191343.777416:0:57974:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483af21 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607a56 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:1.0:1787191343.777429:0:57974:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483af21 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607a56 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.777440:0:57974:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/232 (0 0) 00000080:00200000:1.0:1787191343.777446:0:57974:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xe8:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787191343.777520:0:57974:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe8:0x0]: layout version change: 5 -> 5 00000080:00010000:1.0:1787191343.777526:0:57974:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483af21 00000080:00010000:1.0:1787191343.777531:0:57974:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) 00000080:00010000:1.0:1787191343.777534:0:57974:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483af21 from it ffffa3fb42b5bcd8 00010000:00010000:1.0:1787191343.777538:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483af21 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607a56 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.777546:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483af21 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607a56 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191343.777577:0:57974:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe8:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:1.0:1787191343.777587:0:57974:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe8:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191343.777590:0:57974:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191343.777594:0:57974:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe8:0x0] 00000008:00010000:1.0:1787191343.777611:0:57974:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191343.777614:0:57974:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b44ca87b0, osc lock ffff936b46836000, flags 0x400000400001002 00010000:00010000:1.0:1787191343.777661:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.777672:0:57974:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.777682:0:57974:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b453a9f80 x1874004626850176/t0(0) o101->lustre-OST0001-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:1.0:1787191343.777721:0:57974:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:1.0:1787191343.777733:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787191343.777748:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626850176:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191343.779120:0:57976:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57976:1874004626849920:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191343.779143:0:57976:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af1a lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607a41 expref: -99 pid: 57976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.779169:0:57976:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af1a lrc: 4/0,1 mode: --/PR res: [0x200000405:0xea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607a41 expref: -99 pid: 57976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.779177:0:57976:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af1a lrc: 4/0,1 mode: --/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607a41 expref: -99 pid: 57976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.779187:0:57976:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af1a lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607a41 expref: -99 pid: 57976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.779197:0:57976:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af1a lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607a41 expref: -99 pid: 57976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.779209:0:57976:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af1a lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607a41 expref: -99 pid: 57976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.779216:0:57976:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af1a lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607a41 expref: -99 pid: 57976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.779224:0:57976:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af1a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607a41 expref: -99 pid: 57976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191343.779235:0:57976:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b453a8a80 x1874004626849920/t8589937230(8589937230) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191343.779247:0:57976:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8a80 x1874004626849920/t8589937230(8589937230) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191343.779258:0:57976:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af1a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607a41 expref: -99 pid: 57976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.779267:0:57976:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/234 (0 0) 00000080:00200000:1.0:1787191343.779273:0:57976:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191343.779283:0:57976:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:1.0:1787191343.779317:0:57976:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xea:0x0](ffff936b5395d348) 00000080:00200000:1.0:1787191343.779323:0:57976:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xea:0x0], updating i_size 0 00000080:00200000:1.0:1787191343.779354:0:57976:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xea:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:1.0:1787191343.779358:0:57976:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xea:0x0](ffff936b5395d348) 00000080:00010000:1.0:1787191343.779362:0:57976:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xea:0x0](ffff936b5395d348) for lock 0xe5129dc88483af1a 00000080:00010000:1.0:1787191343.779372:0:57976:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xea:0x0](ffff936b5395d348) 00000080:00200008:1.0:1787191343.779387:0:57976:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xea:0x0](ffff936b5395d348), flags 120501 00000002:00100000:1.0:1787191343.779415:0:57976:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453a8a80 x1874004626849920/t8589937230(8589937230) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191343.779451:0:57976:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483af1a from it ffff936b5339f7e0 00010000:00010000:1.0:1787191343.779456:0:57976:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af1a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607a41 expref: -99 pid: 57976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.779465:0:57976:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af1a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607a41 expref: -99 pid: 57976 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191343.779485:0:57976:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xea:0x0](ffff936b5395d348), inode mode 81a4 mask 40 00000080:00200000:1.0:1787191343.780915:0:57976:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xea:0x0](ffff936b5395d348), inode mode 81a4 mask 2 00000080:00200000:1.0:1787191343.780932:0:57976:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xea:0x0](ffff936b5395d348), xattr lov 00000002:00010000:1.0:1787191343.780954:0:57976:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xea:0x0]) in obj [0x200000405:0xea:0x0], intent: open flags 040000002 00010000:00010000:1.0:1787191343.781015:0:57976:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483af2f lrc: 3/1,0 mode: --/CR res: [0x200000405:0xea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.781025:0:57976:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483af2f lrc: 3/1,0 mode: --/CR res: [0x200000405:0xea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1787191343.781036:0:57976:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1787191343.781045:0:57976:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453ab480 x1874004626850432/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191343.781054:0:57976:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483af2f lrc: 3/1,0 mode: --/CR res: [0x200000405:0xea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.781074:0:57976:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57976:1874004626850432:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191343.781250:0:57976:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893000 going to sleep for 11 seconds 00000100:00100000:3.0:1787191343.784795:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191343.784925:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634941952 00000100:00100000:2.0:1787191343.784935:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634941952 00000100:00100000:2.0:1787191343.785001:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1506 00000100:00100000:2.0:1787191343.785022:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634941952:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191343.785042:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af1a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4607a41 expref: -99 pid: 57976 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.785119:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191343.785126:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6505:x1874004634941952:12345-192.168.202.101@tcp:104: Request processed in 107us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191343.785134:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1506 00010000:00010000:0.0:1787191343.785365:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191343.785373:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af1a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4607a41 expref: -99 pid: 57976 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.785383:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b47a7ee00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191343.785388:0:40930:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af1a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4607a41 expref: -99 pid: 57976 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.785397:0:40930:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af1a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4607a41 expref: -99 pid: 57976 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.785405:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af1a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4607a41 expref: -99 pid: 57976 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191343.785429:0:40930:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xea:0x0]: losing layout lock 00010000:00010000:0.0:1787191343.785469:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af1a lrc: 2/0,0 mode: --/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607a41 expref: -99 pid: 57976 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.785545:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191343.785564:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af1a lrc: 1/0,0 mode: --/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607a41 expref: -99 pid: 57976 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.785572:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af1a lrc: 0/0,0 mode: --/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607a41 expref: -99 pid: 57976 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.785586:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191343.785588:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191343.785589:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191343.785596:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787191343.785610:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626850560:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191343.788178:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626850560:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787191343.788542:0:2389:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.788563:0:2389:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 6/2,0 mode: --/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.788578:0:2389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.788590:0:2389:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191343.788605:0:2389:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 5, setting rss=5; kms=5, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 5/2,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1787191343.788622:0:2389:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00010000:00010000:1.0:1787191343.788642:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.788651:0:2389:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.788658:0:2389:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.788665:0:2389:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1787191343.788681:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626850176:192.168.202.101@tcp:101:lfs.0 00000080:00200000:3.0:1787191343.788888:0:57974:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe8:0x0] updating i_size 5 i_blocks 8 00000020:00010000:3.0:1787191343.788896:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509b9280 (ffff936b47a17ab8/0) at cl_lock_release():245 00000020:00010000:3.0:1787191343.788899:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509b9280 (ffff936b47a17ab8/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191343.788904:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b44ca87b0 (ffff936b465cc248/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191343.788909:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509b9280 (ffff936b47a17ab8/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191343.788912:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b44ca87b0 (ffff936b47a17ab8/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191343.788948:0:57974:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe8:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000100:00100000:1.0:1787191343.792643:0:57976:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57976:1874004626850432:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191343.792666:0:57976:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483af2f lrc: 4/1,0 mode: --/CR res: [0x200000405:0xea:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.792681:0:57976:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483af2f lrc: 4/1,0 mode: --/CR res: [0x200000405:0xea:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.792688:0:57976:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483af2f lrc: 4/1,0 mode: --/CR res: [0x200000405:0xea:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.792695:0:57976:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483af2f lrc: 3/0,0 mode: --/CR res: [0x200000405:0xea:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.792705:0:57976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483af2f lrc: 4/0,0 mode: --/CR res: [0x200000405:0xea:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.792711:0:57976:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b47a7f800 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191343.792715:0:57976:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483af2f lrc: 4/0,0 mode: --/CR res: [0x200000405:0xea:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.792723:0:57976:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483af2f lrc: 4/0,0 mode: --/CR res: [0x200000405:0xea:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.792730:0:57976:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483af2f lrc: 5/0,0 mode: --/CR res: [0x200000405:0xea:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.792753:0:57976:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191343.792760:0:57976:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483af2f lrc: 3/0,0 mode: --/CR res: [0x200000405:0xea:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.792767:0:57976:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f800/0xe5129dc88483af2f lrc: 0/0,0 mode: --/CR res: [0x200000405:0xea:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57976 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191343.792793:0:57976:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b453ab480 x1874004626850432/t8589937231(8589937231) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191343.792807:0:57976:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453ab480 x1874004626850432/t8589937231(8589937231) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191343.792824:0:57976:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xea:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1787191343.792933:0:57976:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xea:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1787191343.792942:0:57976:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xea:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191343.792996:0:57976:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xea:0x0], updating i_size 0 00000002:00100000:1.0:1787191343.793032:0:57976:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b453ab480 x1874004626850432/t8589937231(8589937231) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:1.0:1787191343.793069:0:57976:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453ab480 x1874004626850432/t8589937231(8589937231) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191343.793079:0:57976:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191343.793084:0:57976:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a9f80 x1874004626850816/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191343.793113:0:57976:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57976:1874004626850816:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191343.793190:0:57976:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893000 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.796241:0:57976:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57976:1874004626850816:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191343.796276:0:57976:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453ab480 x1874004626850432/t8589937231(8589937231) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:1.0:1787191343.796348:0:57976:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xea:0x0](ffff936b5395d348), flags 100001 00000002:00100000:1.0:1787191343.796397:0:57976:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a8a80 x1874004626849920/t8589937230(8589937230) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191359 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191343.796408:0:57976:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191343.796413:0:57976:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453aa300 x1874004626851072/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191343.796434:0:57976:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57976:1874004626851072:192.168.202.101@tcp:35:lfs.0 00000100:00100000:1.0:1787191343.796513:0:57976:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893000 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.798385:0:57976:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57976:1874004626851072:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191343.798412:0:57976:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a8a80 x1874004626849920/t8589937230(8589937230) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191343.799754:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191343.799780:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.799812:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.799850:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.799859:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191343.799867:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191343.799870:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191343.799877:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:0.0:1787191343.799881:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.799891:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.799909:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.799915:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191343.799920:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.799933:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:0.0:1787191343.799937:0:57570:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b483e7080, open_flags 8241, mode 81b6 opened 0 00000080:00200000:0.0:1787191343.799945:0:57570:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:0.0:1787191343.799964:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xeb:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0101102 00010000:00010000:0.0:1787191343.800031:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483af36 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.800039:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483af36 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191343.800050:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191343.800061:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475f80 x1874004626851328/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191343.800070:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483af36 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.800090:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626851328:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191343.800235:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99840 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.803278:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626851328:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191343.803306:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483af36 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607a8e expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.803335:0:57570:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483af36 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607a8e expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.803345:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483af36 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607a8e expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.803359:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483af36 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607a8e expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.803370:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483af36 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607a8e expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.803383:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483af36 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607a8e expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.803391:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483af36 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607a8e expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.803397:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483af36 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607a8e expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.803410:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x2b, status=0 req@ffff936b6a475f80 x1874004626851328/t8589937234(8589937234) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191343.803424:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475f80 x1874004626851328/t8589937234(8589937234) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191343.803437:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483af36 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607a8e expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191343.803450:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483af36 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607a8e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.803460:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/234 (0 0) 00000080:00200000:0.0:1787191343.803465:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191343.803541:0:57570:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xea:0x0](ffff936b5395d348): rc = 0 00000080:00200000:0.0:1787191343.803560:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xea:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:0.0:1787191343.803565:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xea:0x0](ffff936b5395d348) for lock 0xe5129dc88483af36 00000080:00010000:0.0:1787191343.803575:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xea:0x0](ffff936b5395d348) 00000080:00200008:0.0:1787191343.803590:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xea:0x0](ffff936b5395d348), flags 101101 00000002:00100000:0.0:1787191343.803613:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475f80 x1874004626851328/t8589937234(8589937234) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191343.803646:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483af36 from it ffff936b530f5ea0 00010000:00010000:0.0:1787191343.803651:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483af36 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607a8e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.803661:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483af36 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607a8e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191343.803685:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xea:0x0](ffff936b5395d348), inode mode 81a4 mask 42 00000002:00010000:0.0:1787191343.803713:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xea:0x0], intent: getxattr flags 0 00010000:00010000:0.0:1787191343.803754:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483af3d lrc: 3/1,0 mode: --/PR res: [0x200000405:0xea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.803763:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483af3d lrc: 3/1,0 mode: --/PR res: [0x200000405:0xea:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.805454:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483af3d lrc: 3/1,0 mode: --/PR res: [0x200000405:0xea:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.805502:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626851456:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191343.805605:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99840 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.807927:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626851456:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191343.807954:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483af3d lrc: 4/1,0 mode: --/PR res: [0x200000405:0xea:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607aa3 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.807971:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483af3d lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607aa3 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.807982:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483af3d lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607aa3 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.807997:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b6a476d80 x1874004626851456/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191343.808023:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483af3d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607aa3 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.808035:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/234 (0 0) 00000080:00200000:0.0:1787191343.808041:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xea:0x0] suppgids 0 -1: rc 0 00000080:00010000:0.0:1787191343.808067:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xea:0x0](ffff936b5395d348) for lock 0xe5129dc88483af3d 00000080:00010000:0.0:1787191343.808075:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483af3d from it ffffa3fb41caba38 00010000:00010000:0.0:1787191343.808079:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483af3d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607aa3 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.808089:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483af3d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607aa3 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:0.0:1787191343.808125:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xea:0x0](ffff936b5395d348) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191343.000000000, mtime 1787191343.000000000, ctime 1787191343.000000000 00010000:00010000:0.0:1787191343.808153:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483af36 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4607a8e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191343.808172:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xea:0x0]: losing layout lock 00010000:00010000:0.0:1787191343.808223:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483af36 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607a8e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.808230:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191343.808233:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade800/0xe5129dc88483af36 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607a8e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1787191343.808252:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1787191343.808259:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a476d80 x1874004626851712/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787191343.808279:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626851712:192.168.202.101@tcp:36:bash.0 00000100:00100000:0.0:1787191343.808348:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99840 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.810713:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626851712:192.168.202.101@tcp:36:bash.0 00000080:00200000:0.0:1787191343.810759:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:0.0:1787191343.810767:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xea:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00010000:00010000:0.0:1787191343.810782:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/234 (0 0) 00000080:00010000:0.0:1787191343.810792:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xea:0x0](ffff936b5395d348) 00000002:00010000:0.0:1787191343.810802:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xea:0x0]) in obj [0x200000405:0xea:0x0], intent: layout flags 0 00010000:00010000:0.0:1787191343.810882:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483af44 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.810892:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483af44 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.810901:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483af44 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.810924:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626851840:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191343.810981:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99840 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.813030:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626851840:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191343.813057:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483af44 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607ab1 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.813071:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483af44 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607ab1 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.813084:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b6a477b80 x1874004626851840/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191343.813095:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483af44 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607ab1 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191343.813113:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483af44 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607ab1 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.813123:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/234 (0 0) 00000080:00200000:0.0:1787191343.813129:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xea:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191343.813145:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xea:0x0](ffff936b5395d348) for lock 0xe5129dc88483af44 00000080:00010000:0.0:1787191343.813153:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483af44 from it ffffa3fb41cab8c8 00010000:00010000:0.0:1787191343.813157:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483af44 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607ab1 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.813166:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483af44 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607ab1 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.813187:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483af44 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xea:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607ab1 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.813197:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483af44 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607ab1 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1787191343.813206:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xea:0x0](000000001d24cd79) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483af44 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607ab1 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191343.813248:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xea:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:0.0:1787191343.813252:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483af44 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607ab1 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.813260:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483af44 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607ab1 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:0.0:1787191343.813274:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xea:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:0.0:1787191343.813281:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xea:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191343.813284:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xea:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:0.0:1787191343.813291:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xea:0x0](ffff936b5395d348) 00000002:00010000:0.0:1787191343.813299:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xea:0x0]) in obj [0x200000405:0xea:0x0], intent: layout flags 02 00010000:00010000:0.0:1787191343.813310:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483af44 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xea:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4607ab1 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191343.813322:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xea:0x0]: losing layout lock 00010000:00010000:0.0:1787191343.813346:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483af44 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607ab1 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.813352:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191343.813355:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483af44 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607ab1 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.813373:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483af4b lrc: 3/0,1 mode: --/EX res: [0x200000405:0xea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.813379:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483af4b lrc: 3/0,1 mode: --/EX res: [0x200000405:0xea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191343.813388:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191343.813394:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477b80 x1874004626852096/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191343.813403:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483af4b lrc: 3/0,1 mode: --/EX res: [0x200000405:0xea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.813424:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626852096:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191343.813481:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99840 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.824169:0:57570:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589937237 gen 1 00000100:00100000:0.0:1787191343.824283:0:57570:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b6a475f80 x1874004626851328/t8589937234(8589937234) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787191343.824297:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626852096:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191343.824313:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483af4b lrc: 4/0,1 mode: --/EX res: [0x200000405:0xea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607abf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.824322:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483af4b lrc: 4/0,1 mode: --/CR res: [0x200000405:0xea:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607abf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.824331:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483af4b lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xea:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607abf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.824339:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483af4b lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xea:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607abf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.824348:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483af4b lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xea:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607abf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.824354:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483af4b lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xea:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607abf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.824358:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483af4b lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xea:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607abf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.824365:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b6a477b80 x1874004626852096/t8589937237(8589937237) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191343.824378:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483af4b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xea:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607abf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191343.824385:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483af4b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xea:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607abf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.824393:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/234 (0 0) 00000080:00200000:0.0:1787191343.824399:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xea:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191343.824409:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xea:0x0](ffff936b5395d348) for lock 0xe5129dc88483af4b 00000080:00010000:0.0:1787191343.824416:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483af4b from it ffffa3fb41cab930 00010000:00010000:0.0:1787191343.824419:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483af4b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xea:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607abf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.824428:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483af4b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xea:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607abf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191343.824446:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:0.0:1787191343.824452:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xea:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:0.0:1787191343.824465:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483af4b lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xea:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607abf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.824475:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483af4b lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xea:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607abf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1787191343.824484:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xea:0x0](000000001d24cd79) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483af4b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xea:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607abf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.824527:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483af4b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xea:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607abf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.824538:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483af4b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xea:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607abf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191343.824548:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xea:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00020000:00200000:0.0:1787191343.824555:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xea:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191343.824557:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191343.824562:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:0.0:1787191343.824614:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xea:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:0.0:1787191343.824627:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483af4b lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xea:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607abf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.824635:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483af4b lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xea:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607abf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:0.0:1787191343.824640:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xea:0x0](000000001d24cd79) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483af4b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xea:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607abf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191343.824652:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xea:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191343.824655:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xea:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191343.824657:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191343.824658:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:0.0:1787191343.824677:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xea:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191343.824729:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xea:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:0.0:1787191343.824733:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483af4b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xea:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607abf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.824738:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483af4b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xea:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607abf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00020000:00200000:0.0:1787191343.824746:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xea:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:0.0:1787191343.824748:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xea:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191343.824750:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191343.824753:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191343.824760:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191343.824762:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:0.0:1787191343.824771:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:0.0:1787191343.824774:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f99870, osc lock ffff936b50b625f0, flags 0x80000000 00000008:00010000:0.0:1787191343.824776:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:0.0:1787191343.824777:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f998b0, osc lock ffff936b50b638f0, flags 0x80000000 00010000:00010000:0.0:1787191343.824812:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483af52 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.824819:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483af52 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.824856:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483af52 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.824873:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626852224:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191343.824940:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.834172:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626852224:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191343.834207:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483af52 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607ac6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.834228:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483af52 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4607ac6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.834244:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483af52 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4607ac6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.834259:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483af52 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4607ac6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191343.834274:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483af52 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4607ac6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.834287:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483af52 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607ac6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.834296:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483af52 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607ac6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.834367:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483af59 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.834381:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483af59 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.834405:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483af59 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.834425:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626852352:192.168.202.101@tcp:101:bash.0 00000100:00100000:1.0:1787191343.834517:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893000 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.839073:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626852352:192.168.202.101@tcp:101:bash.0 00010000:00010000:1.0:1787191343.839100:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483af59 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607acd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.839119:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483af59 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4607acd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.839131:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483af59 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4607acd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.839146:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483af59 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4607acd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191343.839158:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483af59 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4607acd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.839170:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483af59 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607acd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.839179:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483af59 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607acd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.839266:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626852480:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191343.839377:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626852608:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191343.844803:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626852608:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191343.844878:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626852480:192.168.202.101@tcp:10:bash.0 00000080:00200000:2.0:1787191343.844955:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xea:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191343.844961:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b497c98a8 (ffff936b465cc368/0) at cl_lock_release():245 00000020:00010000:2.0:1787191343.844965:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b497c98a8 (ffff936b465cc368/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191343.844969:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99870 (ffff936b47a17ea8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191343.844980:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483af52 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607ac6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.845001:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483af52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607ac6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191343.845025:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f998b0 (ffff936b47a17128/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191343.845030:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483af59 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607acd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.845039:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483af59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607acd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191343.845047:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b497c98a8 (ffff936b465cc368/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191343.845050:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99870 (ffff936b465cc368/1) at cl_lock_fini():72 00000020:00010000:2.0:1787191343.845055:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f998b0 (ffff936b465cc368/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191343.845073:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xea:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191343.845086:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xea:0x0](ffff936b5395d348) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191343.000000000, mtime 1787191343.000000000, ctime 1787191343.000000000, rc 0 00000080:00200008:2.0:1787191343.845166:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xea:0x0], ppos: 0, count: 5 00000080:00200000:2.0:1787191343.845179:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191343.845184:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:2.0:1787191343.845190:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:2.0:1787191343.845194:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1787191343.845200:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@00000000cd1998af[0x110, 1, [0x200000405:0xea:0x0] hash] 00000020:00200000:2.0:1787191343.845203:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:2.0:1787191343.845207:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xea:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:2.0:1787191343.845220:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xea:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:2.0:1787191343.845225:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xea:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191343.845229:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1787191343.845233:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1787191343.845240:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:2.0:1787191343.845243:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1787191343.845258:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:2.0:1787191343.845273:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1787191343.845278:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1a30, osc lock ffff936b44e62f70, flags 0x0 00010000:00010000:2.0:1787191343.845295:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483af52 lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607ac6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.845308:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483af52 lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607ac6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.845319:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483af52 lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607ac6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.845327:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483af52 lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607ac6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.845335:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483af52 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607ac6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191343.845346:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:2.0:1787191343.845354:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191343.845385:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:2.0:1787191343.845391:0:57570:0:(rw26.c:927:ll_write_end()) page@00000000861c6314[3 00000000efd11dd1 2 1 00000000d4478190 0 0 0] 00000080:00200000:2.0:1787191343.845395:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @00000000d010da50 17ffffc0001001 3:0 ffff936b43a1ed20 0 lru 00000080:00200000:2.0:1787191343.845402:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@00000000643634db 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000a2a44f55 00000000cdfa062a > 3< 0 0 > 4< 0 0 8 428716032 - | - - - - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1787191343.845404:0:57570:0:(rw26.c:927:ll_write_end()) end page@00000000861c6314 00000080:00200000:2.0:1787191343.845406:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:2.0:1787191343.845411:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:2.0:1787191343.845430:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 00000000b6199c02 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483af52 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607ac6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191343.845448:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b5395d4f8, count 1, dirtied 1 00000080:00200000:2.0:1787191343.845452:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:2.0:1787191343.845455:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:2.0:1787191343.845466:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b497c98a8 (ffff936b465cc368/0) at cl_lock_release():245 00000020:00010000:2.0:1787191343.845468:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b497c98a8 (ffff936b465cc368/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191343.845470:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1a30 (ffff936b47a17128/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191343.845473:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483af52 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607ac6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.845479:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483af52 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607ac6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:2.0:1787191343.845484:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b497c98a8 (ffff936b465cc368/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191343.845486:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1a30 (ffff936b465cc368/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191343.845492:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:2.0:1787191343.845496:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1787191343.845501:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xea:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191343.845505:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:2.0:1787191343.845509:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xea:0x0] updating i_size 5 i_blocks 0 00000080:00200000:2.0:1787191343.845513:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:2.0:1787191343.846057:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xea:0x0](ffff936b5395d348), flags 100001 00000002:00100000:2.0:1787191343.846128:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a475f80 x1874004626851328/t8589937234(8589937234) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191343.846141:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191343.846146:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9500 x1874004626852864/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191343.846167:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626852864:192.168.202.101@tcp:35:bash.0 00000100:00100000:2.0:1787191343.846255:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f600 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.851738:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9500 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626852864:192.168.202.101@tcp:35:bash.0 00000002:00100000:1.0:1787191343.851783:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a475f80 x1874004626851328/t8589937234(8589937234) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000080:00200080:0.0:1787191343.854171:0:57974:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8) cmd=400866b1 arg=1 00000080:00200008:0.0:1787191343.854192:0:57974:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe8:0x0](ffff936b5396c2c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191343.854201:0:57974:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8),name=f70.sanity-flr 00000002:00010000:0.0:1787191343.854221:0:57974:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe8:0x0]) in obj [0x200000405:0xe8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.854237:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483af21 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607a56 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.854252:0:57974:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483af21 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607a56 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191343.854259:0:57974:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xe8:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191343.854267:0:57974:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) 00000080:00010000:0.0:1787191343.854270:0:57974:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483af21 00000080:00010000:0.0:1787191343.854278:0:57974:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483af21 from it ffffa3fb42b5bcd8 00010000:00010000:0.0:1787191343.854281:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483af21 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607a56 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.854291:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483af21 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607a56 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191343.854318:0:57974:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe8:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1787191343.854329:0:57974:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe8:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191343.854333:0:57974:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191343.854335:0:57974:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe8:0x0] 00000008:00010000:0.0:1787191343.854355:0:57974:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191343.854358:0:57974:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee6430, osc lock ffff936b50b62130, flags 0x400000400001002 00010000:00010000:0.0:1787191343.854375:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.854386:0:57974:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00200000:0.0:1787191343.854398:0:57974:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191343.854402:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.854410:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:0.0:1787191343.854420:0:57974:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191343.854429:0:57974:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe8:0x0] updating i_size 5 i_blocks 8 00000020:00010000:0.0:1787191343.854433:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509b9e10 (ffff936b47a17b48/0) at cl_lock_release():245 00000020:00010000:0.0:1787191343.854436:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509b9e10 (ffff936b47a17b48/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191343.854439:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee6430 (ffff936b47a175a8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191343.854443:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509b9e10 (ffff936b47a17b48/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191343.854446:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee6430 (ffff936b47a17b48/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191343.854456:0:57974:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe8:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1787191343.854472:0:57974:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xe8:0x0], offset: 0, type: SEEK_DATA 00000080:00200000:0.0:1787191343.854477:0:57974:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe8:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:0.0:1787191343.854481:0:57974:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe8:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191343.854483:0:57974:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191343.854559:0:57974:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191343.854566:0:57974:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191343.854647:0:57974:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe8:0x0] updating i_size 5 i_blocks 8 00000080:00200000:0.0:1787191343.854655:0:57974:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe8:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191343.854661:0:57974:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000080:00200000:0.0:1787191343.854663:0:57974:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe8:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191343.854668:0:57974:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191343.854671:0:57974:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191343.854674:0:57974:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:0.0:1787191343.854680:0:57974:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:0.0:1787191343.854682:0:57974:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee6430, osc lock ffff936b50b62130, flags 0x0 00010000:00010000:0.0:1787191343.854691:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.854701:0:57974:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.854710:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.854718:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.854725:0:57974:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191343.854735:0:57974:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe8:0x0] updating i_size 5 i_blocks 8 00000100:00100000:1.0:1787191343.855687:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626852992:192.168.202.101@tcp:23:lfs.0 00000080:00200000:2.0:1787191343.856913:0:57977:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191343.856940:0:57977:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191343.856954:0:57977:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.856968:0:57977:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.856976:0:57977:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191343.856983:0:57977:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191343.856987:0:57977:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191343.856993:0:57977:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b53b58 00010000:00010000:2.0:1787191343.856997:0:57977:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.857016:0:57977:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.857032:0:57977:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191343.857041:0:57977:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191343.857046:0:57977:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191343.857055:0:57977:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:2.0:1787191343.857059:0:57977:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191343.857074:0:57977:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191343.857118:0:57977:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483af60 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57977 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.857125:0:57977:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483af60 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57977 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.857135:0:57977:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483af60 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57977 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191343.857156:0:57977:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57977:1874004626853120:192.168.202.101@tcp:101:rm.0 00000100:00100000:2.0:1787191343.857224:0:57977:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f600 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.858995:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626852992:192.168.202.101@tcp:23:lfs.0 00000020:00010000:0.0:1787191343.859048:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894308 (ffff936b47a17b48/0) at cl_lock_release():245 00000020:00010000:0.0:1787191343.859053:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894308 (ffff936b47a17b48/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191343.859059:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee6430 (ffff936b47a175a8/1) at cl_lock_cancel():142 00010000:00010000:0.0:1787191343.859068:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.859088:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00010000:0.0:1787191343.859101:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894308 (ffff936b47a17b48/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191343.859104:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee6430 (ffff936b47a17b48/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191343.859119:0:57974:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe8:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1787191343.859130:0:57974:0:(file.c:5244:ll_file_seek()) COMPLETED file f70.sanity-flr:[0x200000405:0xe8:0x0], offset: 0, type: SEEK_DATA, rc = 0 00000080:00200008:0.0:1787191343.859141:0:57974:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xe8:0x0], offset: 0, type: SEEK_HOLE 00000080:00200000:0.0:1787191343.859149:0:57974:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe8:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:0.0:1787191343.859156:0:57974:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe8:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191343.859158:0:57974:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191343.859163:0:57974:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191343.859169:0:57974:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191343.859183:0:57974:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe8:0x0] updating i_size 5 i_blocks 8 00000080:00200000:0.0:1787191343.859187:0:57974:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe8:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191343.859191:0:57974:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000080:00200000:0.0:1787191343.859193:0:57974:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe8:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191343.859196:0:57974:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191343.859198:0:57974:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191343.859199:0:57974:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:0.0:1787191343.859208:0:57974:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:0.0:1787191343.859210:0:57974:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee6430, osc lock ffff936b50b62130, flags 0x0 00010000:00010000:0.0:1787191343.859222:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191343.859231:0:57974:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191343.859243:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191343.859248:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191343.859252:0:57974:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191343.859259:0:57974:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe8:0x0] updating i_size 5 i_blocks 8 00000100:00100000:1.0:1787191343.859329:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626853248:192.168.202.101@tcp:23:lfs.0 00000100:00100000:2.0:1787191343.860819:0:57977:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57977:1874004626853120:192.168.202.101@tcp:101:rm.0 00010000:00010000:2.0:1787191343.861012:0:57977:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483af60 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607ae9 expref: -99 pid: 57977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.861039:0:57977:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483af60 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607ae9 expref: -99 pid: 57977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.861048:0:57977:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483af60 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607ae9 expref: -99 pid: 57977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.861059:0:57977:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483af60 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607ae9 expref: -99 pid: 57977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.861069:0:57977:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483af60 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607ae9 expref: -99 pid: 57977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.861081:0:57977:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483af60 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607ae9 expref: -99 pid: 57977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.861100:0:57977:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483af60 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607ae9 expref: -99 pid: 57977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.861107:0:57977:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483af60 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607ae9 expref: -99 pid: 57977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191343.861120:0:57977:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b513bad80 x1874004626853120/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/976 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191343.861132:0:57977:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483af60 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607ae9 expref: -99 pid: 57977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191343.861145:0:57977:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483af60 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607ae9 expref: -99 pid: 57977 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.861154:0:57977:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/234 (0 0) 00000080:00200000:2.0:1787191343.861160:0:57977:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191343.861205:0:57977:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xea:0x0](ffff936b5395d348): rc = 0 00000080:00200000:2.0:1787191343.861220:0:57977:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xea:0x0]: layout version change: 4 -> 4 00000080:00010000:2.0:1787191343.861226:0:57977:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xea:0x0](ffff936b5395d348) for lock 0xe5129dc88483af60 00000080:00010000:2.0:1787191343.861236:0:57977:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xea:0x0](ffff936b5395d348) 00000080:00010000:2.0:1787191343.861240:0:57977:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483af60 from it ffffa3fb42b53b20 00010000:00010000:2.0:1787191343.861243:0:57977:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483af60 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607ae9 expref: -99 pid: 57977 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.861252:0:57977:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483af60 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607ae9 expref: -99 pid: 57977 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200008:2.0:1787191343.861889:0:57977:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xea:0x0](ffff936b5395d348), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191343.861897:0:57977:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xea:0x0](ffff936b5395d348),name=f70.sanity-flr 00000002:00010000:2.0:1787191343.861915:0:57977:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xea:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191343.861923:0:57977:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483af60 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607ae9 expref: -99 pid: 57977 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.861931:0:57977:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483af60 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607ae9 expref: -99 pid: 57977 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191343.861935:0:57977:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191343.861939:0:57977:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xea:0x0](ffff936b5395d348) 00000080:00010000:2.0:1787191343.861941:0:57977:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xea:0x0](ffff936b5395d348) for lock 0xe5129dc88483af60 00000080:00010000:2.0:1787191343.861944:0:57977:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483af60 from it ffffa3fb42b53cb8 00010000:00010000:2.0:1787191343.861947:0:57977:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483af60 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607ae9 expref: -99 pid: 57977 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.861951:0:57977:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483af60 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607ae9 expref: -99 pid: 57977 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191343.861967:0:57977:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xea:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:2.0:1787191343.861978:0:57977:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xea:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191343.861980:0:57977:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191343.861984:0:57977:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xea:0x0] 00000008:00010000:2.0:1787191343.862000:0:57977:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191343.862016:0:57977:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1a30, osc lock ffff936b44e62f70, flags 0x400000400001002 00010000:00010000:2.0:1787191343.862038:0:57977:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483af52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607ac6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191343.862051:0:57977:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483af52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607ac6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:2.0:1787191343.862064:0:57977:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191343.862068:0:57977:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483af52 lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607ac6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191343.862076:0:57977:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483af52 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607ac6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:2.0:1787191343.862142:0:57977:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191343.862155:0:57977:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xea:0x0] updating i_size 5 i_blocks 0 00000020:00010000:2.0:1787191343.862161:0:57977:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b51654940 (ffff936b465cc368/0) at cl_lock_release():245 00000020:00010000:2.0:1787191343.862164:0:57977:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b51654940 (ffff936b465cc368/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191343.862168:0:57977:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1a30 (ffff936b47a17128/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191343.862172:0:57977:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b51654940 (ffff936b465cc368/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191343.862174:0:57977:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1a30 (ffff936b465cc368/1) at cl_lock_fini():72 00000100:00100000:1.0:1787191343.862177:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626853248:192.168.202.101@tcp:23:lfs.0 00000080:00200000:2.0:1787191343.862185:0:57977:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xea:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000020:00010000:0.0:1787191343.862221:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894308 (ffff936b47a17b48/0) at cl_lock_release():245 00000020:00010000:0.0:1787191343.862225:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894308 (ffff936b47a17b48/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191343.862229:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee6430 (ffff936b47a175a8/1) at cl_lock_cancel():142 00000080:00200000:2.0:1787191343.862232:0:57977:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00010000:00010000:0.0:1787191343.862235:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000002:00010000:2.0:1787191343.862240:0:57977:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.862245:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191343.862248:0:57977:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000020:00010000:0.0:1787191343.862255:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894308 (ffff936b47a17b48/0) at cl_lock_fini():72 00010000:00010000:2.0:1787191343.862256:0:57977:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000020:00010000:0.0:1787191343.862257:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee6430 (ffff936b47a17b48/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191343.862267:0:57977:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00200000:0.0:1787191343.862269:0:57974:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe8:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1787191343.862276:0:57974:0:(file.c:5244:ll_file_seek()) COMPLETED file f70.sanity-flr:[0x200000405:0xe8:0x0], offset: 0, type: SEEK_HOLE, rc = 5 00000080:00200080:0.0:1787191343.862288:0:57974:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8) cmd=400866b1 arg=0 00000080:00200080:0.0:1787191343.862298:0:57974:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8) cmd=400866b1 arg=1 00000080:00200008:0.0:1787191343.862302:0:57974:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe8:0x0](ffff936b5396c2c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191343.862306:0:57974:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8),name=f70.sanity-flr 00000002:00010000:0.0:1787191343.862314:0:57974:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe8:0x0]) in obj [0x200000405:0xe8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.862322:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483af21 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607a56 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.862331:0:57974:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483af21 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607a56 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191343.862337:0:57974:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xe8:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191343.862340:0:57977:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191343.862341:0:57974:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) 00000080:00010000:2.0:1787191343.862343:0:57977:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191343.862344:0:57974:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483af21 00000080:00010000:0.0:1787191343.862348:0:57974:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483af21 from it ffffa3fb42b5bcd8 00000080:00010000:2.0:1787191343.862348:0:57977:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b53c10 00010000:00010000:0.0:1787191343.862352:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483af21 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607a56 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191343.862352:0:57977:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.862361:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483af21 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607a56 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191343.862361:0:57977:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.862370:0:57977:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.862373:0:57974:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe8:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00000080:00200000:2.0:1787191343.862376:0:57977:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00020000:00200000:0.0:1787191343.862378:0:57974:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe8:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00000080:00200000:2.0:1787191343.862380:0:57977:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00020000:00200000:0.0:1787191343.862381:0:57974:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191343.862383:0:57974:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe8:0x0] 00000080:00200000:2.0:1787191343.862385:0:57977:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:2.0:1787191343.862389:0:57977:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000008:00010000:0.0:1787191343.862391:0:57974:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000080:00200000:2.0:1787191343.862394:0:57977:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00000008:00010000:0.0:1787191343.862404:0:57974:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee6430, osc lock ffff936b50b62130, flags 0x400000400001002 00010000:00010000:0.0:1787191343.862414:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191343.862415:0:57977:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483af4b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xea:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4607abf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191343.862428:0:57977:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xea:0x0]: losing layout lock 00010000:00010000:0.0:1787191343.862429:0:57974:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:0.0:1787191343.862436:0:57974:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191343.862439:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191343.862440:0:57977:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483af60 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4607ae9 expref: -99 pid: 57977 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.862448:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000080:00200000:2.0:1787191343.862448:0:57977:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xea:0x0]: losing layout lock 00010000:00010000:2.0:1787191343.862454:0:57977:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483af3d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xea:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4607aa3 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00200000:0.0:1787191343.862456:0:57974:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191343.862461:0:57974:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe8:0x0] updating i_size 5 i_blocks 8 00000020:00010000:0.0:1787191343.862464:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509b9e10 (ffff936b47a17b48/0) at cl_lock_release():245 00000020:00010000:0.0:1787191343.862466:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509b9e10 (ffff936b47a17b48/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191343.862468:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee6430 (ffff936b47a175a8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191343.862471:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509b9e10 (ffff936b47a17b48/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191343.862473:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee6430 (ffff936b47a17b48/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191343.862478:0:57974:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe8:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1787191343.862498:0:57974:0:(file.c:2483:do_file_read_iter()) START file f70.sanity-flr:[0x200000405:0xe8:0x0], ppos: 0, count: 4096 00010000:00010000:2.0:1787191343.862498:0:57977:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483af4b lrc: 1/0,0 mode: --/CR res: [0x200000405:0xea:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607abf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191343.862505:0:57974:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: read ppos: 0, bytes: 4096 00010000:00010000:2.0:1787191343.862505:0:57977:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483af60 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607ae9 expref: -99 pid: 57977 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191343.862511:0:57977:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483af3d lrc: 1/0,0 mode: --/PR res: [0x200000405:0xea:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4607aa3 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191343.862513:0:57974:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00010000:00010000:2.0:1787191343.862516:0:57977:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 3 locks packed 00000020:00200000:0.0:1787191343.862518:0:57974:0:(cl_io.c:214:cl_io_rw_init()) header@00000000bf2f0372[0x110, 2, [0x200000405:0xe8:0x0] hash] 00010000:00010000:2.0:1787191343.862519:0:57977:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483af4b lrc: 0/0,0 mode: --/CR res: [0x200000405:0xea:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607abf expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000020:00200000:0.0:1787191343.862520:0:57974:0:(cl_io.c:214:cl_io_rw_init()) io range: 1 [0, 4096) 2048 0 00000080:00200000:0.0:1787191343.862523:0:57974:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe8:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00000080:00200000:0.0:1787191343.862531:0:57974:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:0.0:1787191343.862537:0:57974:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:0.0:1787191343.862541:0:57974:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1787191343.862553:0:57974:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 0] 00000008:00010000:0.0:1787191343.862560:0:57974:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:0.0:1787191343.862563:0:57974:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b61ee6430, osc lock ffff936b50b62130, flags 0x40000 00000080:00200000:0.0:1787191343.862569:0:57974:0:(vvp_io.c:835:vvp_io_read_start()) f70.sanity-flr: read [0, 4096) 00000001:00010000:0.0:1787191343.862574:0:57974:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe8:0x0] 00000008:00010000:0.0:1787191343.862591:0:57974:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191343.862593:0:57974:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f3e030, osc lock ffff936b50b62260, flags 0x400001002 00010000:00010000:0.0:1787191343.862601:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1787191343.862610:0:57974:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00000020:00200000:0.0:1787191343.862619:0:57974:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191343.862622:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1787191343.862629:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00000020:00200000:0.0:1787191343.862638:0:57974:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191343.862642:0:57974:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe8:0x0] updating i_size 5 i_blocks 8 00000020:00010000:0.0:1787191343.862645:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509b9e10 (ffff936b47a17b48/0) at cl_lock_release():245 00000020:00010000:0.0:1787191343.862647:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509b9e10 (ffff936b47a17b48/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191343.862650:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f3e030 (ffff936b47a175a8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191343.862652:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509b9e10 (ffff936b47a17b48/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191343.862654:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f3e030 (ffff936b47a17b48/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191343.862661:0:57974:0:(vvp_io.c:893:vvp_io_read_start()) count:4096 iocb pos:0 00000080:00200000:0.0:1787191343.862666:0:57974:0:(rw26.c:362:ll_direct_IO()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8), size=4096 (max 536870912), offset=0=0x0, pages 1 (max 131072), lockless, parallel 00010000:00010000:2.0:1787191343.862701:0:57977:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483af60 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607ae9 expref: -99 pid: 57977 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191343.862712:0:57977:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483af3d lrc: 0/0,0 mode: --/PR res: [0x200000405:0xea:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4607aa3 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00200000:0.0:1787191343.862714:0:57974:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:0.0:1787191343.862716:0:57974:0:(rw26.c:544:ll_direct_IO()) result 0 tot_bytes 5 count 5 file_offset 5 00000020:00010000:0.0:1787191343.862721:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894308 (ffff936b47a17b48/0) at cl_lock_release():245 00000020:00010000:0.0:1787191343.862724:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894308 (ffff936b47a17b48/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191343.862726:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b61ee6430 (ffff936b47a175a8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191343.862728:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894308 (ffff936b47a17b48/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191343.862730:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b61ee6430 (ffff936b47a17b48/1) at cl_lock_fini():72 00000020:00100000:2.0:1787191343.862733:0:57977:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000080:00200000:0.0:1787191343.862735:0:57974:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000020:00200000:0.0:1787191343.862739:0:57974:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:2.0:1787191343.862741:0:57977:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bad80 x1874004626853504/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000008:00010000:0.0:1787191343.862755:0:31426:0:(osc_cache.c:2029:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff936b532d5a80 00000100:00100000:2.0:1787191343.862761:0:57977:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57977:1874004626853504:192.168.202.101@tcp:36:rm.0 00000008:00100000:0.0:1787191343.862784:0:31426:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff936b6a475f80 - object 0x2c0000401:485 offset 0<>5 00000100:00100000:1.0:1787191343.862849:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626853632:192.168.202.101@tcp:3:lfs.0 00000100:00100000:2.0:1787191343.862903:0:57977:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f600 going to sleep for 11 seconds 00000100:00100000:2.0:1787191343.865747:0:57977:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57977:1874004626853504:192.168.202.101@tcp:36:rm.0 00000080:00200000:2.0:1787191343.865802:0:57977:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xea:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00020000:00200000:2.0:1787191343.865813:0:57977:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xea:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191343.865817:0:57977:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191343.865822:0:57977:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191343.865861:0:57977:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000008:00010000:2.0:1787191343.865879:0:57977:0:(osc_cache.c:1183:osc_extent_make_ready()) ### extent: 00000000b6199c02 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483af52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607ac6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:2.0:1787191343.865906:0:57977:0:(osc_cache.c:917:osc_extent_finish()) ### extent: 00000000b6199c02 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483af52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607ac6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:2.0:1787191343.865927:0:57977:0:(osc_cache.c:497:__osc_extent_remove()) ### extent: 00000000b6199c02 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483af52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607ac6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191343.865947:0:57977:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xea:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191343.865989:0:57977:0:(llite_lib.c:2066:ll_clear_inode()) VFS Op:inode=[0x200000405:0xea:0x0](ffff936b5395d348) 00000008:00010000:2.0:1787191343.866030:0:57977:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 5 blocks 0 [cma]time 1787191343 1787191343 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483af52 lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607ac6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:2.0:1787191343.866050:0:57977:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191343 1787191343 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483af59 lrc: 1/0,0 mode: PW/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607acd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000008:00010000:1.0:1787191343.872581:0:2390:0:(osc_cache.c:917:osc_extent_finish()) ### no dlm lock: extent: ffff936b532d5a80 00000020:00200000:1.0:1787191343.872593:0:2390:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:1.0:1787191343.872602:0:2390:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:1.0:1787191343.872621:0:2390:0:(osc_cache.c:497:__osc_extent_remove()) ### no dlm lock: extent: ffff936b532d5a80 00000100:00100000:1.0:1787191343.872646:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626853632:192.168.202.101@tcp:3:lfs.0 00000080:00200000:0.0:1787191343.872727:0:57974:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:0.0:1787191343.872739:0:57974:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe8:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191343.872743:0:57974:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 1 io complete with rc: 0, result: 5, restart: 0 00000020:00200000:0.0:1787191343.872746:0:57974:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191343.872754:0:57974:0:(file.c:2324:ll_file_io_generic()) iot: 1, result: 5 00000080:00200080:0.0:1787191343.872768:0:57974:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8) cmd=400866b1 arg=0 00000080:00200080:0.0:1787191343.872778:0:57974:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8) cmd=400866b1 arg=2 00000080:00200008:0.0:1787191343.872784:0:57974:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe8:0x0](ffff936b5396c2c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191343.872791:0:57974:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8),name=f70.sanity-flr 00000002:00010000:0.0:1787191343.872811:0:57974:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe8:0x0]) in obj [0x200000405:0xe8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.872828:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483af21 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607a56 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191343.872875:0:57974:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483af21 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607a56 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191343.872883:0:57974:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xe8:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191343.872892:0:57974:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) 00000080:00010000:0.0:1787191343.872896:0:57974:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483af21 00000080:00010000:0.0:1787191343.872904:0:57974:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483af21 from it ffffa3fb42b5bcd8 00010000:00010000:0.0:1787191343.872908:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483af21 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607a56 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191343.872917:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483af21 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607a56 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1787191343.872942:0:57974:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe8:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:0.0:1787191343.872952:0:57974:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe8:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191343.872955:0:57974:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191343.872958:0:57974:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe8:0x0] 00000008:00010000:0.0:1787191343.872977:0:57974:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191343.872981:0:57974:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f3e030, osc lock ffff936b50b62130, flags 0x400000400001002 00010000:00010000:0.0:1787191343.872998:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00010000:00010000:0.0:1787191343.873021:0:57974:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00000020:00200000:0.0:1787191343.873032:0:57974:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191343.873036:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 6 lru_type: 0 00010000:00010000:0.0:1787191343.873044:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 1 00000020:00200000:0.0:1787191343.873054:0:57974:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191343.873062:0:57974:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe8:0x0] updating i_size 5 i_blocks 8 00000020:00010000:0.0:1787191343.873066:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509b9e10 (ffff936b47a17b48/0) at cl_lock_release():245 00000020:00010000:0.0:1787191343.873069:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509b9e10 (ffff936b47a17b48/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191343.873072:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f3e030 (ffff936b47a175a8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191343.873076:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509b9e10 (ffff936b47a17b48/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191343.873079:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f3e030 (ffff936b47a17b48/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191343.873086:0:57974:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe8:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1787191343.873104:0:57974:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xe8:0x0], ppos: 0, count: 4096 00000080:00200000:0.0:1787191343.873110:0:57974:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 4096 00000080:00200000:0.0:1787191343.873117:0:57974:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 2 00000020:00200000:0.0:1787191343.873122:0:57974:0:(cl_io.c:214:cl_io_rw_init()) header@00000000bf2f0372[0x110, 2, [0x200000405:0xe8:0x0] hash] 00000020:00200000:0.0:1787191343.873125:0:57974:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 4096) 2048 0 00000080:00200000:0.0:1787191343.873127:0:57974:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe8:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00000080:00200000:0.0:1787191343.873136:0:57974:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:0.0:1787191343.873142:0:57974:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 4096) 4096, 4096 00020000:00200000:0.0:1787191343.873145:0:57974:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x11 00000080:00200000:0.0:1787191343.873157:0:57974:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:0.0:1787191343.873164:0:57974:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 11 00000008:00010000:0.0:1787191343.873166:0:57974:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f3e030, osc lock ffff936b50b62130, flags 0x40000 00000080:00200000:0.0:1787191343.873173:0:57974:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 4096) append 0 append lockpos 0 00000002:00010000:0.0:1787191343.873189:0:57974:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xe8:0x0], intent: getxattr flags 0 00010000:00010000:0.0:1787191343.873226:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483af67 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.873234:0:57974:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483af67 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.873243:0:57974:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483af67 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57974 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.873260:0:57974:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626853760:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191343.873341:0:57974:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99840 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.876092:0:57974:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626853760:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191343.876119:0:57974:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483af67 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607b1a expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.876134:0:57974:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483af67 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607b1a expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.876146:0:57974:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483af67 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607b1a expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.876161:0:57974:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b6a477b80 x1874004626853760/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1408 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191343.876174:0:57974:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483af67 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607b1a expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.876185:0:57974:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/232 (0 0) 00000080:00200000:0.0:1787191343.876191:0:57974:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xe8:0x0] suppgids 0 -1: rc 0 00000080:00010000:0.0:1787191343.876213:0:57974:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483af67 00000080:00010000:0.0:1787191343.876222:0:57974:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483af67 from it ffffa3fb42b5b8e8 00010000:00010000:0.0:1787191343.876227:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483af67 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607b1a expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.876236:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade200/0xe5129dc88483af67 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607b1a expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191343.876275:0:57974:0:(rw26.c:362:ll_direct_IO()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8), size=4096 (max 536870912), offset=0=0x0, pages 1 (max 131072), lockless, parallel 00000020:00200000:0.0:1787191343.876339:0:57974:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000080:00200000:0.0:1787191343.876342:0:57974:0:(rw26.c:544:ll_direct_IO()) result 0 tot_bytes 4096 count 4096 file_offset 4096 00000080:00200000:0.0:1787191343.876362:0:57974:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe8:0x0] updating i_size 5 i_blocks 8 00000020:00010000:0.0:1787191343.876367:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894308 (ffff936b47a17b48/0) at cl_lock_release():245 00000020:00010000:0.0:1787191343.876370:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894308 (ffff936b47a17b48/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191343.876374:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f3e030 (ffff936b47a175a8/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191343.876377:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894308 (ffff936b47a17b48/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191343.876380:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f3e030 (ffff936b47a17b48/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191343.876386:0:57974:0:(vvp_io.c:533:vvp_io_advance()) advancing 4096 bytes 00000080:00200000:2.0:1787191343.876588:0:57978:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191343.876608:0:57978:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191343.876619:0:57978:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.876632:0:57978:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.876639:0:57978:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191343.876645:0:57978:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191343.876648:0:57978:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191343.876652:0:57978:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b63b58 00010000:00010000:2.0:1787191343.876655:0:57978:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.876661:0:57978:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.876670:0:57978:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191343.876677:0:57978:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:2.0:1787191343.876683:0:57978:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191343.876693:0:57978:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:2.0:1787191343.876698:0:57978:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191343.876709:0:57978:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191343.876748:0:57978:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483af6e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.876756:0:57978:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483af6e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.876765:0:57978:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483af6e lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191343.876784:0:57978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57978:1874004626853888:192.168.202.101@tcp:101:lfs.0 00000020:00200000:0.0:1787191343.876964:0:57974:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000008:00010000:0.0:1787191343.876984:0:31426:0:(osc_cache.c:2029:try_to_add_extent_for_io()) ### no dlm lock: extent: ffff936b532d5900 00000008:00100000:0.0:1787191343.877068:0:31426:0:(osc_request.c:2000:osc_brw_prep_request()) brw rpc ffff936b6a477b80 - object 0x280000401:483 offset 0<>4096 00000100:00100000:1.0:1787191343.877115:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626854016:192.168.202.101@tcp:4:lfs.0 00000100:00100000:2.0:1787191343.877222:0:57978:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f600 going to sleep for 11 seconds 00000100:00100000:3.0:1787191343.878916:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191343.878958:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634942592 00000100:00100000:2.0:1787191343.878966:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634942592 00000100:00100000:1.0:1787191343.879089:0:57978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57978:1874004626853888:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191343.879106:0:57978:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483af6e lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.879117:0:57978:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483af6e lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.879123:0:57978:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483af6e lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.879130:0:57978:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483af6e lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.879137:0:57978:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483af6e lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.879142:0:57978:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51185200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191343.879146:0:57978:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483af6e lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.879153:0:57978:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483af6e lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.879159:0:57978:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483af6e lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.879166:0:57978:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191343.879172:0:57978:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483af6e lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.879177:0:57978:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483af6e lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191343.879199:0:57978:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513b8a80 x1874004626853888/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191343.879212:0:57978:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191343.879292:0:57978:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191343.879305:0:57978:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.879316:0:57978:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.879327:0:57978:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.879333:0:57978:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191343.879338:0:57978:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191343.879342:0:57978:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191343.879346:0:57978:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b63be8 00010000:00010000:1.0:1787191343.879349:0:57978:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.879356:0:57978:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.879369:0:57978:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191343.879376:0:57978:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000080:00200000:1.0:1787191343.879381:0:57978:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191343.879409:0:57978:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:1.0:1787191343.879413:0:57978:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191343.879424:0:57978:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191343.879465:0:57978:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483af75 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.879473:0:57978:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483af75 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.879481:0:57978:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483af75 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.879500:0:57978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57978:1874004626854144:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191343.879563:0:57978:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628939c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191343.879802:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1507 00000100:00100000:2.0:1787191343.879814:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8427:x1874004634942592:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191343.879825:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae9c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46078c7 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.879910:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191343.879915:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8427:x1874004634942592:12345-192.168.202.101@tcp:104: Request processed in 105us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191343.879922:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1507 00010000:00010000:0.0:1787191343.879985:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191343.879992:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae9c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46078c7 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.880000:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b413ffa00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191343.880015:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae9c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e46078c7 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.880047:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae9c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46078c7 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.880053:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191343.880074:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae9c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46078c7 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.880082:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000f6037b48/0xe5129dc88483ae9c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46078c7 expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.880098:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191343.880100:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191343.880102:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191343.880111:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787191343.880120:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626854272:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191343.887900:0:57978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57978:1874004626854144:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191343.887924:0:57978:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483af75 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.887939:0:57978:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483af75 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.887945:0:57978:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483af75 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.887952:0:57978:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483af75 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.887962:0:57978:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483af75 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.887972:0:57978:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b47a7f200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191343.887977:0:57978:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483af75 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.887985:0:57978:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483af75 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.887992:0:57978:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483af75 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.888000:0:57978:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191343.888018:0:57978:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483af75 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.888025:0:57978:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f200/0xe5129dc88483af75 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191343.888049:0:57978:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b453ab480 x1874004626854144/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191343.888064:0:57978:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191343.888158:0:57978:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191343.888174:0:57978:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.888185:0:57978:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.888196:0:57978:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.888201:0:57978:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191343.888207:0:57978:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191343.888210:0:57978:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191343.888215:0:57978:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b63b58 00010000:00010000:1.0:1787191343.888217:0:57978:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.888224:0:57978:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.888238:0:57978:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191343.888245:0:57978:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:1.0:1787191343.888253:0:57978:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:1.0:1787191343.888257:0:57978:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:1.0:1787191343.888268:0:57978:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.888275:0:57978:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 105 lru_type: 1 00010000:00010000:1.0:1787191343.888283:0:57978:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 105 lru_type: 1 00000002:00010000:1.0:1787191343.888293:0:57978:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.888335:0:57978:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af7c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.888342:0:57978:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af7c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.888351:0:57978:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af7c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.888374:0:57978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57978:1874004626854400:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191343.888488:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626854272:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191343.888546:0:57978:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628939c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.892127:0:57978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57978:1874004626854400:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191343.892151:0:57978:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af7c lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607b59 expref: -99 pid: 57978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.892164:0:57978:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af7c lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607b59 expref: -99 pid: 57978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.892176:0:57978:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af7c lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607b59 expref: -99 pid: 57978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.892187:0:57978:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af7c lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607b59 expref: -99 pid: 57978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.892199:0:57978:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af7c lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607b59 expref: -99 pid: 57978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.892207:0:57978:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af7c lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607b59 expref: -99 pid: 57978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.892215:0:57978:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af7c lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607b59 expref: -99 pid: 57978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191343.892225:0:57978:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b453ab480 x1874004626854400/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191343.892246:0:57978:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607b59 expref: -99 pid: 57978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.892255:0:57978:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:1.0:1787191343.892262:0:57978:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607b59 expref: -99 pid: 57978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.892270:0:57978:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af7c lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607b59 expref: -99 pid: 57978 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:1.0:1787191343.892295:0:57978:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.892316:0:57978:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 210 lru_type: 1 00010000:00010000:1.0:1787191343.892329:0:57978:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 210 lru_type: 1 00010000:00010000:1.0:1787191343.892338:0:57978:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 210 lru_type: 1 00010000:00010000:1.0:1787191343.892345:0:57978:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 211 lru_type: 1 00000080:00200000:1.0:1787191343.892356:0:57978:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:1.0:1787191343.892364:0:57978:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:1.0:1787191343.892369:0:57978:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:1.0:1787191343.892374:0:57978:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb42b63cb8 00010000:00010000:1.0:1787191343.892378:0:57978:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 105 lru_type: 1 00010000:00010000:1.0:1787191343.892386:0:57978:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 106 lru_type: 1 00000002:00010000:1.0:1787191343.892400:0:57978:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.892406:0:57978:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af7c lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607b59 expref: -99 pid: 57978 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.892413:0:57978:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af7c lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607b59 expref: -99 pid: 57978 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.892421:0:57978:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607b59 expref: -99 pid: 57978 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.892428:0:57978:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af7c lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607b59 expref: -99 pid: 57978 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:1.0:1787191343.892435:0:57978:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.892439:0:57978:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 211 lru_type: 1 00010000:00010000:1.0:1787191343.892446:0:57978:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 211 lru_type: 1 00010000:00010000:1.0:1787191343.892454:0:57978:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 211 lru_type: 1 00010000:00010000:1.0:1787191343.892467:0:57978:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 212 lru_type: 1 00000080:00200008:1.0:1787191343.892986:0:57978:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:1.0:1787191343.892992:0:57978:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191343.893015:0:57978:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.893024:0:57978:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.893033:0:57978:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.893039:0:57978:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191343.893048:0:57978:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191343.893051:0:57978:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191343.893056:0:57978:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b63cb8 00010000:00010000:1.0:1787191343.893060:0:57978:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.893067:0:57978:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.893175:0:57978:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191343.893184:0:57978:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.893190:0:57978:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.893204:0:57978:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.893210:0:57978:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191343.893215:0:57978:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191343.893217:0:57978:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191343.893221:0:57978:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b63b58 00010000:00010000:1.0:1787191343.893224:0:57978:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.893231:0:57978:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.893239:0:57978:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191343.893245:0:57978:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:1.0:1787191343.893250:0:57978:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191343.893259:0:57978:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:1.0:1787191343.893263:0:57978:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191343.893275:0:57978:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:1.0:1787191343.893317:0:57978:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483af83 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.893324:0:57978:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483af83 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.893333:0:57978:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483af83 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.893358:0:57978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57978:1874004626854528:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191343.893439:0:57978:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628939c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.895575:0:2389:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-ffff936b581fb000: committing for last_committed 21474837714 gen 2 00000008:00010000:0.0:1787191343.895625:0:2389:0:(osc_cache.c:917:osc_extent_finish()) ### no dlm lock: extent: ffff936b532d5900 00000020:00200000:0.0:1787191343.895631:0:2389:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000020:00200000:0.0:1787191343.895639:0:2389:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000008:00010000:0.0:1787191343.895659:0:2389:0:(osc_cache.c:497:__osc_extent_remove()) ### no dlm lock: extent: ffff936b532d5900 00000100:00100000:0.0:1787191343.895683:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626854016:192.168.202.101@tcp:4:lfs.0 00000080:00200000:1.0:1787191343.895995:0:57974:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:1.0:1787191343.896017:0:57974:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe8:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191343.896022:0:57974:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 4096, restart: 0 00000080:00200000:1.0:1787191343.896032:0:57974:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe8:0x0] updating i_size 5 i_blocks 8 00000020:00200000:1.0:1787191343.896034:0:57974:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191343.896043:0:57974:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 4096 00000080:00200080:1.0:1787191343.896060:0:57974:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8) cmd=400866b1 arg=0 00000080:00200080:1.0:1787191343.896067:0:57974:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8) cmd=400866b1 arg=1 00000080:00200008:1.0:1787191343.896073:0:57974:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe8:0x0](ffff936b5396c2c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191343.896080:0:57974:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8),name=f70.sanity-flr 00000002:00010000:1.0:1787191343.896100:0:57974:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe8:0x0]) in obj [0x200000405:0xe8:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.896115:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483af21 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607a56 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191343.896128:0:57974:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483af21 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607a56 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1787191343.896135:0:57974:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xe8:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191343.896144:0:57974:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) 00000080:00010000:1.0:1787191343.896147:0:57974:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483af21 00000080:00010000:1.0:1787191343.896155:0:57974:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483af21 from it ffffa3fb42b5bcd8 00010000:00010000:1.0:1787191343.896159:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483af21 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607a56 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191343.896167:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483af21 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607a56 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00000080:00200000:1.0:1787191343.896191:0:57974:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe8:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:1.0:1787191343.896201:0:57974:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe8:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191343.896204:0:57974:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191343.896207:0:57974:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe8:0x0] 00000008:00010000:1.0:1787191343.896230:0:57974:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191343.896234:0:57974:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b44ca88b0, osc lock ffff936b46836e40, flags 0x400000400001002 00010000:00010000:1.0:1787191343.896250:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 1 00010000:00010000:1.0:1787191343.896262:0:57974:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 1 00000020:00200000:1.0:1787191343.896273:0:57974:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191343.896276:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 7 lru_type: 1 00010000:00010000:1.0:1787191343.896283:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00000020:00200000:1.0:1787191343.896293:0:57974:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191343.896298:0:57974:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe8:0x0] updating i_size 5 i_blocks 8 00000020:00010000:1.0:1787191343.896302:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509b9e10 (ffff936b47a17b48/0) at cl_lock_release():245 00000020:00010000:1.0:1787191343.896305:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509b9e10 (ffff936b47a17b48/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.896308:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b44ca88b0 (ffff936b47a175a8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.896312:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509b9e10 (ffff936b47a17b48/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191343.896315:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b44ca88b0 (ffff936b47a17b48/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191343.896322:0:57974:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe8:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1787191343.896333:0:57974:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xe8:0x0], offset: 5, type: SEEK_DATA 00000080:00200000:1.0:1787191343.896338:0:57974:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe8:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:1.0:1787191343.896342:0:57974:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe8:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191343.896345:0:57974:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191343.896349:0:57974:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191343.896354:0:57974:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191343.896367:0:57974:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe8:0x0] updating i_size 5 i_blocks 8 00000080:00200000:1.0:1787191343.896375:0:57974:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe8:0x0] ignore/verify layout 0/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191343.896379:0:57974:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 1 00000080:00200000:1.0:1787191343.896381:0:57974:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe8:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:1.0:1787191343.896385:0:57974:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191343.896389:0:57974:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:1.0:1787191343.896391:0:57974:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 0 [0, 18446744073709551615] 00000008:00010000:1.0:1787191343.896397:0:57974:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 8 00000008:00010000:1.0:1787191343.896399:0:57974:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b44ca88b0, osc lock ffff936b46836e40, flags 0x0 00010000:00010000:1.0:1787191343.896408:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:1.0:1787191343.896417:0:57974:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:1.0:1787191343.896425:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:1.0:1787191343.896434:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 6/2,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:1.0:1787191343.896442:0:57974:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00000080:00200000:1.0:1787191343.896453:0:57974:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe8:0x0] updating i_size 5 i_blocks 8 00000020:00010000:1.0:1787191343.896457:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894308 (ffff936b47a17b48/0) at cl_lock_release():245 00000020:00010000:1.0:1787191343.896459:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894308 (ffff936b47a17b48/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.896462:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b44ca88b0 (ffff936b47a175a8/1) at cl_lock_cancel():142 00010000:00010000:1.0:1787191343.896466:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 8 lru_type: 1 00010000:00010000:1.0:1787191343.896476:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00000020:00010000:1.0:1787191343.896484:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894308 (ffff936b47a17b48/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191343.896487:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b44ca88b0 (ffff936b47a17b48/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191343.896494:0:57974:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe8:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1787191343.896500:0:57974:0:(file.c:5213:ll_file_seek()) START file f70.sanity-flr:[0x200000405:0xe8:0x0], offset: 0, type: (null) 00000080:00200000:1.0:1787191343.896504:0:57974:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe8:0x0] ignore/verify layout 0/1, layout version 5 restore needed 0 00020000:00200000:1.0:1787191343.896509:0:57974:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe8:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191343.896511:0:57974:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191343.896514:0:57974:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe8:0x0] 00000008:00010000:1.0:1787191343.896520:0:57974:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191343.896521:0:57974:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b44ca88b0, osc lock ffff936b46836e40, flags 0x400000400001002 00010000:00010000:1.0:1787191343.896529:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1787191343.896538:0:57974:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00000020:00200000:1.0:1787191343.896550:0:57974:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:1.0:1787191343.896553:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1787191343.896561:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00000020:00200000:1.0:1787191343.896569:0:57974:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:1.0:1787191343.896573:0:57974:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe8:0x0] updating i_size 5 i_blocks 8 00000020:00010000:1.0:1787191343.896576:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509b9e10 (ffff936b47a17b48/0) at cl_lock_release():245 00000020:00010000:1.0:1787191343.896578:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509b9e10 (ffff936b47a17b48/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.896581:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b44ca88b0 (ffff936b47a175a8/1) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.896583:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509b9e10 (ffff936b47a17b48/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191343.896586:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b44ca88b0 (ffff936b47a17b48/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191343.896591:0:57974:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe8:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1787191343.896598:0:57974:0:(file.c:5244:ll_file_seek()) COMPLETED file f70.sanity-flr:[0x200000405:0xe8:0x0], offset: 0, type: (null), rc = 5 00000080:00200080:1.0:1787191343.896604:0:57974:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8) cmd=400866b1 arg=0 00000100:00100000:2.0:1787191343.896880:0:57978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57978:1874004626854528:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191343.896894:0:57978:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483af83 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.896904:0:57978:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483af83 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.896910:0:57978:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483af83 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.896915:0:57978:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483af83 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.896922:0:57978:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483af83 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.896928:0:57978:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51fe1e00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191343.896933:0:57978:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483af83 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.896940:0:57978:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483af83 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.896945:0:57978:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483af83 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.896950:0:57978:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191343.896955:0:57978:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483af83 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.896959:0:57978:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1e00/0xe5129dc88483af83 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191343.896971:0:57978:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b453ab480 x1874004626854528/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191343.896980:0:57978:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1787191343.896995:0:57978:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af7c lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607b59 expref: -99 pid: 57978 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191343.897012:0:57978:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af7c lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607b59 expref: -99 pid: 57978 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:2.0:1787191343.897021:0:57978:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483af7c from it ffffa3fb42b63930 00010000:00010000:2.0:1787191343.897025:0:57978:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607b59 expref: -99 pid: 57978 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191343.897036:0:57978:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af7c lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607b59 expref: -99 pid: 57978 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191343.897107:0:57978:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191343.897118:0:57978:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191343.897125:0:57978:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.897134:0:57978:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.897140:0:57978:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191343.897145:0:57978:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191343.897148:0:57978:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191343.897153:0:57978:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b63bf8 00010000:00010000:2.0:1787191343.897156:0:57978:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.897163:0:57978:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.897172:0:57978:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191343.897178:0:57978:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191343.897183:0:57978:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191343.897189:0:57978:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:2.0:1787191343.897192:0:57978:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:2.0:1787191343.897197:0:57978:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b53067b00, open_flags a141, mode 81b6 opened 0 00000080:00200000:2.0:1787191343.897207:0:57978:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:2.0:1787191343.897224:0:57978:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xec:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:2.0:1787191343.897235:0:57978:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af7c lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4607b59 expref: -99 pid: 57978 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191343.897275:0:57978:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af7c lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4607b59 expref: -99 pid: 57978 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191343.897282:0:57978:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191343.897284:0:57978:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7ee00/0xe5129dc88483af7c lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4607b59 expref: -99 pid: 57978 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191343.897313:0:57978:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483af8a lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.897320:0:57978:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483af8a lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191343.897330:0:57978:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191343.897336:0:57978:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb100 x1874004626854784/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191343.897345:0:57978:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483af8a lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191343.897365:0:57978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57978:1874004626854784:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191343.901904:0:57978:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191343.904267:0:57978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57978:1874004626854784:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191343.904290:0:57978:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483af8a lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607b8a expref: -99 pid: 57978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.904316:0:57978:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483af8a lrc: 4/0,1 mode: --/PR res: [0x200000405:0xec:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607b8a expref: -99 pid: 57978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.904326:0:57978:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483af8a lrc: 4/0,1 mode: --/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607b8a expref: -99 pid: 57978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.904337:0:57978:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483af8a lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607b8a expref: -99 pid: 57978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.904348:0:57978:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483af8a lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607b8a expref: -99 pid: 57978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.904361:0:57978:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483af8a lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607b8a expref: -99 pid: 57978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00200080:0.0:1787191343.904365:0:57974:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8) cmd=400866b1 arg=2 00010000:00010000:2.0:1787191343.904368:0:57978:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483af8a lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607b8a expref: -99 pid: 57978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.904375:0:57978:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483af8a lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607b8a expref: -99 pid: 57978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00200008:0.0:1787191343.904378:0:57974:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xe8:0x0](ffff936b5396c2c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191343.904385:0:57974:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8),name=f70.sanity-flr 00000002:00100000:2.0:1787191343.904386:0:57978:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b513bb100 x1874004626854784/t8589937240(8589937240) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191343.904399:0:57978:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bb100 x1874004626854784/t8589937240(8589937240) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191343.904411:0:57978:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483af8a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607b8a expref: -99 pid: 57978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.904421:0:57978:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/236 (0 0) 00000080:00200000:2.0:1787191343.904427:0:57978:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191343.904437:0:57978:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:2.0:1787191343.904465:0:57978:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xec:0x0](ffff936b48989148) 00000080:00200000:2.0:1787191343.904471:0:57978:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xec:0x0], updating i_size 0 00000002:00010000:0.0:1787191343.904477:0:57974:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe8:0x0]) in obj [0x200000405:0xe8:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.904488:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483af21 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607a56 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00010000:00010000:0.0:1787191343.904499:0:57974:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483af21 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607a56 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00000080:00200000:2.0:1787191343.904501:0:57978:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xec:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00200000:0.0:1787191343.904506:0:57974:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000405:0xe8:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191343.904506:0:57978:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xec:0x0](ffff936b48989148) 00000080:00010000:2.0:1787191343.904509:0:57978:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xec:0x0](ffff936b48989148) for lock 0xe5129dc88483af8a 00000080:00010000:0.0:1787191343.904512:0:57974:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) 00000080:00010000:0.0:1787191343.904516:0:57974:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483af21 00000080:00010000:2.0:1787191343.904517:0:57978:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xec:0x0](ffff936b48989148) 00000080:00010000:0.0:1787191343.904520:0:57974:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483af21 from it ffffa3fb42b5bcd8 00010000:00010000:0.0:1787191343.904523:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483af21 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607a56 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00010000:00010000:0.0:1787191343.904530:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483af21 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607a56 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00000080:00200008:2.0:1787191343.904530:0:57978:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xec:0x0](ffff936b48989148), flags 120501 00000002:00100000:2.0:1787191343.904545:0:57978:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bb100 x1874004626854784/t8589937240(8589937240) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191343.904551:0:57974:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe8:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:0.0:1787191343.904561:0:57974:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe8:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191343.904565:0:57974:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191343.904568:0:57974:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xe8:0x0] 00000080:00010000:2.0:1787191343.904570:0:57978:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483af8a from it ffff936b60dc4900 00010000:00010000:2.0:1787191343.904573:0:57978:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483af8a lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607b8a expref: -99 pid: 57978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.904581:0:57978:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483af8a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607b8a expref: -99 pid: 57978 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191343.904596:0:57978:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xec:0x0](ffff936b48989148), inode mode 81a4 mask 40 00000080:00200000:2.0:1787191343.904645:0:57978:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xec:0x0](ffff936b48989148), inode mode 81a4 mask 2 00000080:00200000:2.0:1787191343.904655:0:57978:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xec:0x0](ffff936b48989148), xattr lov 00000002:00010000:2.0:1787191343.904668:0:57978:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xec:0x0]) in obj [0x200000405:0xec:0x0], intent: open flags 040000002 00000008:00010000:0.0:1787191343.904673:0:57974:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191343.904676:0:57974:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f3e030, osc lock ffff936b50b62130, flags 0x400000400001002 00010000:00010000:0.0:1787191343.904691:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00010000:00010000:0.0:1787191343.904703:0:57974:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00010000:00010000:2.0:1787191343.904709:0:57978:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483af91 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00200000:0.0:1787191343.904714:0:57974:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191343.904715:0:57978:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483af91 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xec:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.904717:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 5/1,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 10 lru_type: 1 00010000:00010000:0.0:1787191343.904726:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00000020:00100000:2.0:1787191343.904730:0:57978:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000020:00200000:0.0:1787191343.904735:0:57974:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000100:00100000:2.0:1787191343.904736:0:57978:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8e00 x1874004626855040/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000080:00200000:0.0:1787191343.904742:0:57974:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe8:0x0] updating i_size 5 i_blocks 8 00010000:00010000:2.0:1787191343.904744:0:57978:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483af91 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xec:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00010000:0.0:1787191343.904746:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509bb9d0 (ffff936b47a17908/0) at cl_lock_release():245 00000020:00010000:0.0:1787191343.904749:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509bb9d0 (ffff936b47a17908/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191343.904752:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f3e030 (ffff936b47a17248/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191343.904755:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509bb9d0 (ffff936b47a17908/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191343.904758:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f3e030 (ffff936b47a17908/1) at cl_lock_fini():72 00000100:00100000:2.0:1787191343.904761:0:57978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57978:1874004626855040:192.168.202.101@tcp:101:lfs.0 00000080:00200000:0.0:1787191343.904767:0:57974:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe8:0x0] ignore/verify layout 0/1, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1787191343.904790:0:57974:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xe8:0x0](ffff936b5396c2c8) current size 5, valid attrs 2068, mode 0, uid -1322410190, gid -1, new size 5, atime 1787191343.000000000, mtime 1787191343.000000000, ctime 1787191343.000000000 00010000:00010000:0.0:1787191343.904810:0:57974:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483af21 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4607a56 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00010000:00010000:0.0:1787191343.904826:0:57974:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483af13 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607a25 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000100:00100000:2.0:1787191343.904930:0:57978:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f0c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787191343.904950:0:57974:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483af21 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607a56 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00010000:00010000:0.0:1787191343.904957:0:57974:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191343.904960:0:57974:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7fe00/0xe5129dc88483af21 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xe8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607a56 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 6 lru_type: 1 00000020:00100000:0.0:1787191343.904973:0:57974:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 36, max 7 00000100:00100000:0.0:1787191343.904979:0:57974:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477b80 x1874004626855296/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787191343.904991:0:57974:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626855296:192.168.202.101@tcp:36:lfs.0 00000100:00100000:0.0:1787191343.905181:0:57974:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99840 going to sleep for 11 seconds 00000100:00100000:2.0:1787191343.907099:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191343.907178:0:40922:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787191343.907197:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634942720 00000100:00100000:3.0:1787191343.907206:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634942720 00000100:00100000:3.0:1787191343.907263:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1508 00000100:00100000:3.0:1787191343.907272:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b50880850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634942720:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191343.907289:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483af8a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4607b8a expref: -99 pid: 57978 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191343.907624:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191343.907632:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b50880850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634942720:12345-192.168.202.101@tcp:104: Request processed in 361us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191343.907639:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1508 00010000:00010000:0.0:1787191343.907972:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191343.907980:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483af8a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4607b8a expref: -99 pid: 57978 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.907989:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51184000 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191343.907993:0:57627:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483af8a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4607b8a expref: -99 pid: 57978 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.908011:0:57627:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483af8a lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4607b8a expref: -99 pid: 57978 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.908020:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483af8a lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4607b8a expref: -99 pid: 57978 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191343.908041:0:57627:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xec:0x0]: losing layout lock 00010000:00010000:0.0:1787191343.908087:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483af8a lrc: 2/0,0 mode: --/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607b8a expref: -99 pid: 57978 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.908094:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787191343.908152:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626855424:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787191343.908319:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483af8a lrc: 1/0,0 mode: --/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607b8a expref: -99 pid: 57978 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.908328:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483af8a lrc: 0/0,0 mode: --/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607b8a expref: -99 pid: 57978 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.908343:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191343.908345:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191343.908347:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191343.910497:0:57974:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626855296:192.168.202.101@tcp:36:lfs.0 00000080:00200000:0.0:1787191343.910543:0:57974:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 2 00000080:00200000:0.0:1787191343.910551:0:57974:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe8:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:0.0:1787191343.910571:0:57974:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x11 00000080:00200000:0.0:1787191343.910623:0:57974:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:0.0:1787191343.910639:0:57974:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:0.0:1787191343.910643:0:57974:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f99870, osc lock ffff936b50b62130, flags 0x0 00000008:00010000:0.0:1787191343.910647:0:57974:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:0.0:1787191343.910648:0:57974:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f998b0, osc lock ffff936b50b62260, flags 0x0 00010000:00010000:0.0:1787191343.910701:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a86cc8f2/0xe5129dc88483af98 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.910714:0:57974:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a86cc8f2/0xe5129dc88483af98 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.910724:0:57974:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a86cc8f2/0xe5129dc88483af98 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.910744:0:57974:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626855552:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191343.910818:0:57974:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.911207:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626855424:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191343.911561:0:57978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57978:1874004626855040:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191343.911573:0:57978:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483af91 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xec:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.911583:0:57978:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483af91 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xec:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.911590:0:57978:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483af91 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xec:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.911596:0:57978:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483af91 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xec:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.911603:0:57978:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483af91 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xec:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.911608:0:57978:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51185a00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191343.911611:0:57978:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483af91 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xec:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.911622:0:57978:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483af91 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xec:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.911628:0:57978:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483af91 lrc: 5/0,0 mode: --/CR res: [0x200000405:0xec:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.911635:0:57978:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191343.911641:0:57978:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483af91 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xec:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.911648:0:57978:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483af91 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xec:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57978 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191343.911671:0:57978:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b513b8e00 x1874004626855040/t8589937242(8589937242) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191343.911685:0:57978:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b8e00 x1874004626855040/t8589937242(8589937242) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191343.911699:0:57978:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xec:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1787191343.911738:0:57978:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xec:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1787191343.911746:0:57978:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xec:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191343.911793:0:57978:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xec:0x0], updating i_size 0 00000002:00100000:2.0:1787191343.911811:0:57978:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b8e00 x1874004626855040/t8589937242(8589937242) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191343.912153:0:57978:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513b8e00 x1874004626855040/t8589937242(8589937242) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191343.912164:0:57978:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191343.912169:0:57978:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bbb80 x1874004626855808/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191343.912186:0:57978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57978:1874004626855808:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191343.912287:0:57978:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.912658:0:57974:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626855552:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191343.912676:0:57974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a86cc8f2/0xe5129dc88483af98 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607bb4 expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.912691:0:57974:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a86cc8f2/0xe5129dc88483af98 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607bb4 expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.912703:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a86cc8f2/0xe5129dc88483af98 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607bb4 expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191343.912713:0:57974:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 4096, setting rss=4096; kms=4096, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a86cc8f2/0xe5129dc88483af98 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607bb4 expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.912721:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a86cc8f2/0xe5129dc88483af98 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4607bb4 expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.912726:0:57974:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a86cc8f2/0xe5129dc88483af98 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4607bb4 expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.912743:0:57974:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b52373000 type 11 mode 2 res 11811161089/486 (0 18446744073709551615) 00010000:00010000:0.0:1787191343.912761:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001f958678/0xe5129dc88483af9f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.912766:0:57974:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001f958678/0xe5129dc88483af9f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.912772:0:57974:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001f958678/0xe5129dc88483af9f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.912780:0:57974:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626855936:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191343.912978:0:57974:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f996c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191343.914571:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191343.914707:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634942848 00000100:00100000:3.0:1787191343.914715:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634942848 00000100:00100000:1.0:1787191343.914737:0:57978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57978:1874004626855808:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191343.914763:0:57978:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513b8e00 x1874004626855040/t8589937242(8589937242) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1787191343.914765:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1509 00000100:00100000:3.0:1787191343.914773:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:29543:x1874004634942848:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191343.914787:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000572ee9c6/0xe5129dc88483aea3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46078ce expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200008:1.0:1787191343.914817:0:57978:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xec:0x0](ffff936b48989148), flags 100001 00000002:00100000:1.0:1787191343.914879:0:57978:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513bb100 x1874004626854784/t8589937240(8589937240) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191359 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:1.0:1787191343.914888:0:57978:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1787191343.914893:0:57978:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453a8a80 x1874004626856192/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1787191343.914910:0:57978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57978:1874004626856192:192.168.202.101@tcp:35:lfs.0 00010000:00010000:3.0:1787191343.914942:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191343.914950:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:29543:x1874004634942848:12345-192.168.202.101@tcp:104: Request processed in 177us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191343.914957:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1509 00000100:00100000:1.0:1787191343.915010:0:57978:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b628930c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787191343.915276:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191343.915284:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000572ee9c6/0xe5129dc88483aea3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e46078ce expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.915298:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b413fe800 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191343.916731:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000572ee9c6/0xe5129dc88483aea3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e46078ce expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.916813:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000572ee9c6/0xe5129dc88483aea3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46078ce expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.916821:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787191343.916893:0:57978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8a80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57978:1874004626856192:192.168.202.101@tcp:35:lfs.0 00000002:00100000:3.0:1787191343.916920:0:57978:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513bb100 x1874004626854784/t8589937240(8589937240) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1787191343.917992:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000572ee9c6/0xe5129dc88483aea3 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46078ce expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.918015:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000572ee9c6/0xe5129dc88483aea3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e46078ce expref: -99 pid: 57968 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.918033:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191343.918035:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191343.918037:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191343.918055:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626856320:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00200000:0.0:1787191343.919174:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191343.919201:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.919215:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.919232:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.919246:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191343.919252:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191343.919255:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191343.919266:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:0.0:1787191343.919270:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.919278:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.919295:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.919302:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191343.919307:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.919320:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:0.0:1787191343.919325:0:57570:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b483e7200, open_flags 8241, mode 81b6 opened 0 00000080:00200000:0.0:1787191343.919333:0:57570:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:0.0:1787191343.919350:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xed:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0101102 00000100:00100000:1.0:1787191343.919556:0:57974:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475500 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626855936:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191343.919575:0:57974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001f958678/0xe5129dc88483af9f lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000020000 nid: local remote: 0x7130d520e4607bbb expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.919599:0:57974:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001f958678/0xe5129dc88483af9f lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e4607bbb expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.919608:0:57974:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001f958678/0xe5129dc88483af9f lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e4607bbb expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.919809:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483afa6 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.919818:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483afa6 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191343.919885:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191343.919894:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474700 x1874004626856576/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191343.919908:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483afa6 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.919926:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626856576:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191343.920064:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00000100:00100000:3.0:1787191343.921138:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191343.921224:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634942976 00000100:00100000:2.0:1787191343.921232:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634942976 00000100:00100000:2.0:1787191343.921285:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1510 00000100:00100000:2.0:1787191343.921295:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:9508:x1874004634942976:12345-192.168.202.101@tcp:105: 00010000:00010000:2.0:1787191343.921308:0:40922:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001f958678/0xe5129dc88483af9f lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e4607bbb expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.921319:0:40922:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001f958678/0xe5129dc88483af9f lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e4607bbb expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.921327:0:40922:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001f958678/0xe5129dc88483af9f lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000020000 nid: local remote: 0x7130d520e4607bbb expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.921338:0:40922:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001f958678/0xe5129dc88483af9f lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10080000020000 nid: local remote: 0x7130d520e4607bbb expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.921346:0:40922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001f958678/0xe5129dc88483af9f lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10080000020000 nid: local remote: 0x7130d520e4607bbb expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.921355:0:40922:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001f958678/0xe5129dc88483af9f lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x80000020000 nid: local remote: 0x7130d520e4607bbb expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.921378:0:40922:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b43adf800) 00000100:00100000:2.0:1787191343.921426:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:9508:x1874004634942976:12345-192.168.202.101@tcp:105: Request processed in 132us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191343.921433:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1510 00010000:00010000:1.0:1787191343.921503:0:57974:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001f958678/0xe5129dc88483af9f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e4607bbb expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.921514:0:57974:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001f958678/0xe5129dc88483af9f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x20000 nid: local remote: 0x7130d520e4607bbb expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.921528:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001f958678/0xe5129dc88483af9f lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10000000020000 nid: local remote: 0x7130d520e4607bbb expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191343.921545:0:57974:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001f958678/0xe5129dc88483af9f lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x10020000020000 nid: local remote: 0x7130d520e4607bbb expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.921556:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001f958678/0xe5129dc88483af9f lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4607bbb expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.921563:0:57974:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001f958678/0xe5129dc88483af9f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4607bbb expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.922283:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626856704:192.168.202.101@tcp:10:lfs.0 00000100:00100000:1.0:1787191343.922318:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626856832:192.168.202.101@tcp:10:lfs.0 00000100:00100000:0.0:1787191343.922764:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626856576:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191343.922783:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483afa6 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607bd7 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.922803:0:57570:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483afa6 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xec:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607bd7 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.922809:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483afa6 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607bd7 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.922816:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483afa6 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607bd7 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.922823:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483afa6 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607bd7 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.922861:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483afa6 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607bd7 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.922869:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483afa6 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607bd7 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.922877:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483afa6 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607bd7 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.922890:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x2b, status=0 req@ffff936b6a474700 x1874004626856576/t8589937245(8589937245) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191343.922901:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474700 x1874004626856576/t8589937245(8589937245) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191343.922910:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483afa6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607bd7 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191343.922920:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483afa6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607bd7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.922926:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/236 (0 0) 00000080:00200000:0.0:1787191343.922931:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191343.922973:0:57570:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xec:0x0](ffff936b48989148): rc = 0 00000080:00200000:0.0:1787191343.922983:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xec:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:0.0:1787191343.922987:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xec:0x0](ffff936b48989148) for lock 0xe5129dc88483afa6 00000080:00010000:0.0:1787191343.922996:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xec:0x0](ffff936b48989148) 00000080:00200008:0.0:1787191343.923018:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xec:0x0](ffff936b48989148), flags 101101 00000002:00100000:0.0:1787191343.923043:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474700 x1874004626856576/t8589937245(8589937245) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191343.923078:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483afa6 from it ffff936b530f5d20 00010000:00010000:0.0:1787191343.923082:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483afa6 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607bd7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.923187:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483afa6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607bd7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191343.923209:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xec:0x0](ffff936b48989148), inode mode 81a4 mask 42 00000002:00010000:0.0:1787191343.923236:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xec:0x0], intent: getxattr flags 0 00010000:00010000:0.0:1787191343.923270:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483afad lrc: 3/1,0 mode: --/PR res: [0x200000405:0xec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.923278:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483afad lrc: 3/1,0 mode: --/PR res: [0x200000405:0xec:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.923287:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483afad lrc: 3/1,0 mode: --/PR res: [0x200000405:0xec:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.923302:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626856960:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191343.923354:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.925260:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626856832:192.168.202.101@tcp:10:lfs.0 00000100:00100000:1.0:1787191343.925278:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626856320:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191343.925311:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626856704:192.168.202.101@tcp:10:lfs.0 00000080:00200000:1.0:1787191343.925348:0:57974:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xe8:0x0] updating i_size 5 i_blocks 8 00000020:00010000:1.0:1787191343.925355:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894f38 (ffff936b47a17908/0) at cl_lock_release():245 00000020:00010000:1.0:1787191343.925358:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894f38 (ffff936b47a17908/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.925363:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99870 (ffff936b47a17248/1) at cl_lock_cancel():142 00010000:00010000:1.0:1787191343.925372:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a86cc8f2/0xe5129dc88483af98 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4607bb4 expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.925386:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a86cc8f2/0xe5129dc88483af98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607bb4 expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1787191343.925418:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f998b0 (ffff936b47a17998/1) at cl_lock_cancel():142 00010000:00010000:1.0:1787191343.925423:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001f958678/0xe5129dc88483af9f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020000020000 nid: local remote: 0x7130d520e4607bbb expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.925432:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001f958678/0xe5129dc88483af9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4607bbb expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1787191343.925441:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894f38 (ffff936b47a17908/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191343.925444:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99870 (ffff936b47a17908/1) at cl_lock_fini():72 00000020:00010000:1.0:1787191343.925448:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f998b0 (ffff936b47a17908/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191343.925462:0:57974:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe8:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1787191343.925472:0:57974:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xe8:0x0](ffff936b5396c2c8) current size 5, valid attrs 10002168, mode 0, uid -1322410190, gid -1, new size 5, atime 1787191343.000000000, mtime 1787191343.000000000, ctime 1787191343.000000000, rc 0 00000080:00200080:1.0:1787191343.925489:0:57974:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8) cmd=400866b1 arg=0 00000080:00200008:1.0:1787191343.925519:0:57974:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xe8:0x0](ffff936b5396c2c8) current size 5, valid attrs 101f0, mode a3fb, uid 1628897280, gid -27797, new size 18446624687906013896, atime 1787191343.000000000, mtime 1787191343.000000000, ctime 1787191343.000000000 00000020:00100000:1.0:1787191343.925567:0:57974:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1787191343.925575:0:57974:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b453aa680 x1874004626857216/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787191343.925601:0:57974:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626857216:192.168.202.101@tcp:36:lfs.0 00000100:00100000:1.0:1787191343.925673:0:57974:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893900 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.926735:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626856960:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191343.926754:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483afad lrc: 4/1,0 mode: --/PR res: [0x200000405:0xec:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607bec expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.926768:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483afad lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607bec expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.926778:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483afad lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607bec expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.926797:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b6a475c00 x1874004626856960/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191343.926808:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483afad lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607bec expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.926817:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/236 (0 0) 00000080:00200000:0.0:1787191343.926822:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xec:0x0] suppgids 0 -1: rc 0 00000080:00010000:0.0:1787191343.926888:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xec:0x0](ffff936b48989148) for lock 0xe5129dc88483afad 00000080:00010000:0.0:1787191343.926897:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483afad from it ffffa3fb41caba38 00010000:00010000:0.0:1787191343.926901:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483afad lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607bec expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.926911:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483afad lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607bec expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:0.0:1787191343.926940:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xec:0x0](ffff936b48989148) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191343.000000000, mtime 1787191343.000000000, ctime 1787191343.000000000 00010000:00010000:0.0:1787191343.926964:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483afa6 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4607bd7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191343.926981:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xec:0x0]: losing layout lock 00010000:00010000:0.0:1787191343.927025:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483afa6 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607bd7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.927032:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191343.927035:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483afa6 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607bd7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1787191343.927069:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 36, max 7 00000100:00100000:0.0:1787191343.927079:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475c00 x1874004626857472/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787191343.927103:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626857472:192.168.202.101@tcp:36:bash.0 00000100:00100000:0.0:1787191343.927156:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.927648:0:57974:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa680 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626857216:192.168.202.101@tcp:36:lfs.0 00000080:00200000:1.0:1787191343.927677:0:57974:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe8:0x0] ignore/verify layout 0/0, layout version 5 restore needed 0 00020000:00200000:1.0:1787191343.927690:0:57974:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe8:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191343.927693:0:57974:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:1.0:1787191343.927699:0:57974:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:1.0:1787191343.927712:0:57974:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000100:00100000:1.0:1787191343.927775:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787191343.927787:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626857600:192.168.202.101@tcp:2:lfs.0 00000100:00100000:1.0:1787191343.930705:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626857600:192.168.202.101@tcp:2:lfs.0 00000080:00200000:2.0:1787191343.930734:0:57974:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe8:0x0] ignore/verify layout 0/0, layout version 5 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191343.930774:0:57974:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xe8:0x0](ffff936b5396c2c8) current size 5, valid attrs 100101f0, mode a3fb, uid 1628897280, gid -27797, new size 18446624687906013896, atime 1787191343.000000000, mtime 1787191343.000000000, ctime 1787191343.000000000, rc 0 00000080:00200080:2.0:1787191343.930796:0:57974:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8) cmd=c00c66f3 arg=23972e0 00010000:00010000:2.0:1787191343.930883:0:57974:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483aee9 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0xe8:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x81008000000000 nid: local remote: 0x7130d520e46079b5 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.930903:0:57974:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483aee9 lrc: 0/0,0 mode: --/PW res: [0x200000405:0xe8:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x85809400000000 nid: local remote: 0x7130d520e46079b5 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191343.930921:0:57974:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a9500 x1874004626848128/t8589937227(8589937227) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191343.930932:0:57974:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191343.930938:0:57974:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9180 x1874004626857856/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191343.930959:0:57974:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626857856:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191343.931378:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626857472:192.168.202.101@tcp:36:bash.0 00000080:00200000:0.0:1787191343.931405:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:0.0:1787191343.931411:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xec:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00010000:00010000:0.0:1787191343.931424:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/236 (0 0) 00000080:00010000:0.0:1787191343.931433:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xec:0x0](ffff936b48989148) 00000002:00010000:0.0:1787191343.931441:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xec:0x0]) in obj [0x200000405:0xec:0x0], intent: layout flags 0 00010000:00010000:0.0:1787191343.931471:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adec00/0xe5129dc88483afb4 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.931479:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adec00/0xe5129dc88483afb4 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.931487:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adec00/0xe5129dc88483afb4 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.931495:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626857984:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191343.931552:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00000100:00100000:2.0:1787191343.931768:0:57974:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f840 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.933405:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626857984:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191343.933431:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adec00/0xe5129dc88483afb4 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607c01 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.933449:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adec00/0xe5129dc88483afb4 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607c01 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.933462:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b6a474e00 x1874004626857984/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191343.933473:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adec00/0xe5129dc88483afb4 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607c01 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191343.933486:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adec00/0xe5129dc88483afb4 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607c01 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.933496:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/236 (0 0) 00000080:00200000:0.0:1787191343.933501:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xec:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191343.933515:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xec:0x0](ffff936b48989148) for lock 0xe5129dc88483afb4 00000080:00010000:0.0:1787191343.933521:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483afb4 from it ffffa3fb41cab8c8 00010000:00010000:0.0:1787191343.933525:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adec00/0xe5129dc88483afb4 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607c01 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.933535:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adec00/0xe5129dc88483afb4 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607c01 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.933554:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adec00/0xe5129dc88483afb4 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607c01 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.933565:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adec00/0xe5129dc88483afb4 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607c01 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1787191343.933579:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xec:0x0](000000005d342181) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adec00/0xe5129dc88483afb4 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607c01 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191343.933643:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xec:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:0.0:1787191343.933648:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adec00/0xe5129dc88483afb4 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607c01 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.933656:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adec00/0xe5129dc88483afb4 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607c01 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:0.0:1787191343.933671:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xec:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:0.0:1787191343.933676:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xec:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191343.933680:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xec:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:0.0:1787191343.933687:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xec:0x0](ffff936b48989148) 00000002:00010000:0.0:1787191343.933696:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xec:0x0]) in obj [0x200000405:0xec:0x0], intent: layout flags 02 00010000:00010000:0.0:1787191343.933709:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adec00/0xe5129dc88483afb4 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4607c01 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191343.933722:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xec:0x0]: losing layout lock 00010000:00010000:0.0:1787191343.933747:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adec00/0xe5129dc88483afb4 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607c01 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.933753:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191343.933757:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adec00/0xe5129dc88483afb4 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607c01 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.933777:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483afbb lrc: 3/0,1 mode: --/EX res: [0x200000405:0xec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.933785:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483afbb lrc: 3/0,1 mode: --/EX res: [0x200000405:0xec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191343.933795:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:0.0:1787191343.933801:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474e00 x1874004626858240/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191343.933810:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483afbb lrc: 3/0,1 mode: --/EX res: [0x200000405:0xec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.933825:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626858240:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191343.933980:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191343.934203:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634943104 00000100:00100000:2.0:1787191343.934209:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634943104 00000100:00100000:2.0:1787191343.934255:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1511 00000100:00100000:2.0:1787191343.934265:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6508:x1874004634943104:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191343.934277:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483af13 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4607a25 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191343.934331:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191343.934338:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6508:x1874004634943104:12345-192.168.202.101@tcp:104: Request processed in 75us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191343.934345:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1511 00010000:00010000:1.0:1787191343.934360:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191343.934368:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483af13 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4607a25 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191343.934376:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b47a7f400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191343.934381:0:40930:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483af13 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4607a25 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191343.934389:0:40930:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483af13 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4607a25 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191343.934397:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483af13 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4607a25 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000080:00200000:1.0:1787191343.934410:0:40930:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xe8:0x0]: losing layout lock 00000100:00100000:0.0:1787191343.934720:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99480 going to sleep for 11 seconds 00010000:00010000:1.0:1787191343.935194:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483af13 lrc: 2/0,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607a25 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191343.935203:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191343.935234:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483af13 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607a25 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191343.935247:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b47a7f400/0xe5129dc88483af13 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x8 rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607a25 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1787191343.935260:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191343.935262:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191343.935264:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191343.935273:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787191343.935284:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626858368:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787191343.937411:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626858368:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787191343.943173:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191343.943208:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634944000 00000100:00100000:3.0:1787191343.943216:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634944000 00000100:00100000:3.0:1787191343.943285:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1512 00000100:00100000:3.0:1787191343.943296:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:37089:x1874004634944000:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191343.943315:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483af52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4607ac6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191343.943390:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191343.943398:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:37089:x1874004634944000:12345-192.168.202.101@tcp:104: Request processed in 104us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191343.943405:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1512 00010000:00010000:0.0:1787191343.943484:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191343.943492:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483af52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4607ac6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191343.943500:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b43adee00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191343.943506:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483af52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4607ac6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191343.943548:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483af52 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4607ac6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191343.943555:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191343.943587:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483af52 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4607ac6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191343.943595:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483af52 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4607ac6 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191343.943618:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191343.943620:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191343.943622:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191343.943630:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787191343.943644:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626858496:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191343.944348:0:57974:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589937250 gen 1 00000100:00100000:2.0:1787191343.944430:0:57974:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b6a474700 x1874004626856576/t8589937245(8589937245) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787191343.944450:0:57974:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626857856:192.168.202.101@tcp:35:lfs.0 00000002:00100000:2.0:1787191343.944478:0:57974:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a9500 x1874004626848128/t8589937227(8589937227) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1787191343.944506:0:57974:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/232 (0 0) 00000080:00010000:2.0:1787191343.944520:0:57974:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xe8:0x0](ffff936b5396c2c8) 00000002:00010000:2.0:1787191343.944532:0:57974:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xe8:0x0]) in obj [0x200000405:0xe8:0x0], intent: layout flags 0 00010000:00010000:2.0:1787191343.944566:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483afc2 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.944587:0:57974:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483afc2 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.944599:0:57974:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483afc2 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57974 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191343.944614:0:57974:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626858624:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191343.944667:0:57974:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f840 going to sleep for 11 seconds 00000100:00100000:2.0:1787191343.946768:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:0.0:1787191343.947385:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626858240:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191343.947414:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483afbb lrc: 4/0,1 mode: --/EX res: [0x200000405:0xec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607c16 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.947426:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483afbb lrc: 4/0,1 mode: --/CR res: [0x200000405:0xec:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607c16 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.947439:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483afbb lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607c16 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.947451:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483afbb lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607c16 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.947470:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483afbb lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607c16 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.947478:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483afbb lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607c16 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.947486:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483afbb lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607c16 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.947500:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b6a474e00 x1874004626858240/t8589937250(8589937250) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191343.947519:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483afbb lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607c16 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191343.947530:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483afbb lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607c16 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.947540:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/236 (0 0) 00000080:00200000:0.0:1787191343.947547:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xec:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191343.947561:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xec:0x0](ffff936b48989148) for lock 0xe5129dc88483afbb 00000080:00010000:0.0:1787191343.947569:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483afbb from it ffffa3fb41cab930 00010000:00010000:0.0:1787191343.947573:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483afbb lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607c16 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.947581:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483afbb lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607c16 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191343.947598:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:0.0:1787191343.947605:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xec:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:0.0:1787191343.947619:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483afbb lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607c16 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.947630:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483afbb lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607c16 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1787191343.947643:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xec:0x0](000000005d342181) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483afbb lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607c16 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.947682:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483afbb lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607c16 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.947690:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483afbb lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607c16 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191343.947731:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xec:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191343.947740:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xec:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191343.947743:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191343.947749:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:0.0:1787191343.947829:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xec:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:0.0:1787191343.947868:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483afbb lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607c16 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.947877:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483afbb lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607c16 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:0.0:1787191343.947883:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xec:0x0](000000005d342181) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483afbb lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607c16 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191343.947899:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xec:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191343.947903:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xec:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191343.947906:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191343.947908:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:0.0:1787191343.947931:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xec:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191343.948011:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xec:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:0.0:1787191343.948016:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483afbb lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607c16 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191343.948024:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483afbb lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607c16 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00020000:00200000:0.0:1787191343.948036:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xec:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00000100:00100000:3.0:1787191343.948105:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634944256 00000100:00100000:3.0:1787191343.948112:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634944256 00000100:00100000:3.0:1787191343.948153:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1513 00000100:00100000:3.0:1787191343.948163:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:29543:x1874004634944256:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191343.948175:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483af59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4607acd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00020000:00200000:0.0:1787191343.948246:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xec:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191343.948248:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191343.948254:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191343.948265:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191343.948268:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:0.0:1787191343.948279:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:0.0:1787191343.948283:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f994b0, osc lock ffff936b50b62e40, flags 0x80000000 00000008:00010000:0.0:1787191343.948289:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:0.0:1787191343.948291:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f994f0, osc lock ffff936b50b62260, flags 0x80000000 00010000:00010000:0.0:1787191343.948328:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483afc9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.948338:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483afc9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.948348:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483afc9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.948367:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626858752:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191343.949471:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00010000:00010000:3.0:1787191343.949605:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191343.949615:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:29543:x1874004634944256:12345-192.168.202.101@tcp:104: Request processed in 1451us (2852us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191343.949623:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1513 00010000:00010000:0.0:1787191343.949684:0:57627:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191343.949691:0:57627:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483af59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4607acd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.949703:0:57627:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b47a7f800 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191343.949709:0:57627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483af59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4607acd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.949746:0:57627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483af59 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4607acd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.949753:0:57627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191343.949766:0:57627:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483af59 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4607acd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.949773:0:57627:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009aaff363/0xe5129dc88483af59 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4607acd expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191343.949790:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191343.949793:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191343.949794:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191343.949814:0:57974:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626858624:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191343.949843:0:57974:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483afc2 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607c39 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.949854:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626858880:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787191343.949855:0:57974:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483afc2 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607c39 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191343.949867:0:57974:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b513b9180 x1874004626858624/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191343.949876:0:57974:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483afc2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607c39 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191343.949886:0:57974:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483afc2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607c39 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.949895:0:57974:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/232 (0 0) 00000100:00100000:1.0:1787191343.949901:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626858496:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00200000:2.0:1787191343.949901:0:57974:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xe8:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1787191343.949913:0:57974:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xe8:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483afc2 00000080:00010000:2.0:1787191343.949919:0:57974:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483afc2 from it ffffa3fb42b5bbc8 00010000:00010000:2.0:1787191343.949923:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483afc2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607c39 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.949931:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483afc2 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607c39 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.949955:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483afc2 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607c39 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.949963:0:57974:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483afc2 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607c39 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:2.0:1787191343.949971:0:57974:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xe8:0x0](0000000089668027) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483afc2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607c39 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.950010:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483afc2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607c39 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.950019:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483afc2 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607c39 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191343.950033:0:57974:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe8:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191343.950042:0:57974:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe8:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191343.950045:0:57974:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191343.950049:0:57974:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191343.950056:0:57974:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191343.950069:0:57974:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe8:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:2.0:1787191343.950080:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483afc2 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607c39 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191343.950098:0:57974:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483afc2 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607c39 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:2.0:1787191343.950111:0:57974:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xe8:0x0](0000000089668027) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483afc2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607c39 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191343.950128:0:57974:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe8:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191343.950133:0:57974:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe8:0x0]: flr state: 3, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191343.950135:0:57974:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191343.950138:0:57974:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191343.950142:0:57974:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191343.950148:0:57974:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe8:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:2.0:1787191343.950159:0:57974:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 5 blocks 8 [cma]time: 1787191343 1787191343 1787191343 by oinfo size 5 blocks 8 [cma]time 1787191343 1787191343 1787191343 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 1/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00000008:00010000:2.0:1787191343.950185:0:57974:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 4096 blocks 8 [cma]time: 1787191343 1787191343 0 by oinfo size 5 blocks 8 [cma]time 1787191343 1787191343 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a86cc8f2/0xe5129dc88483af98 lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607bb4 expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000008:00010000:2.0:1787191343.950198:0:57974:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191343 1787191343 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001f958678/0xe5129dc88483af9f lrc: 1/0,0 mode: PW/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000020000 nid: local remote: 0x7130d520e4607bbb expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191343.950242:0:57974:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xe8:0x0]: layout version change: 4294967294 -> 6 00010000:00010000:2.0:1787191343.950247:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483afc2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607c39 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191343.950255:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185a00/0xe5129dc88483afc2 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607c39 expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200008:2.0:1787191343.950474:0:57974:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xe8:0x0](ffff936b5396c2c8), flags 154002 00000002:00100000:2.0:1787191343.950510:0:57974:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b453a9c00 x1874004626847104/t8589937226(8589937226) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191343.950521:0:57974:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191343.950526:0:57974:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9180 x1874004626859136/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191343.950541:0:57974:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626859136:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191343.950574:0:57974:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f840 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.953533:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626858880:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191343.955466:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626858752:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191343.955466:0:57974:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626859136:192.168.202.101@tcp:35:lfs.0 00010000:00010000:0.0:1787191343.955492:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483afc9 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607c40 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191343.955501:0:57974:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b453a9c00 x1874004626847104/t8589937226(8589937226) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1787191343.955511:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483afc9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4607c40 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.955526:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483afc9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4607c40 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.955540:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483afc9 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4607c40 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191343.955552:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483afc9 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4607c40 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1787191343.955554:0:57974:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xe8:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00010000:00010000:0.0:1787191343.955563:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483afc9 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607c40 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00020000:00200000:3.0:1787191343.955566:0:57974:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xe8:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191343.955569:0:57974:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00010000:00010000:0.0:1787191343.955571:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483afc9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607c40 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00020000:00200000:3.0:1787191343.955575:0:57974:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:3.0:1787191343.955607:0:57974:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xe8:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1787191343.955615:0:57974:0:(llite_lib.c:2066:ll_clear_inode()) VFS Op:inode=[0x200000405:0xe8:0x0](ffff936b5396c2c8) 00010000:00010000:0.0:1787191343.955642:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483afd0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.955650:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483afd0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.955659:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483afd0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.955677:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626859264:192.168.202.101@tcp:101:bash.0 00000080:00200000:3.0:1787191343.955726:0:57974:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191343.955741:0:57974:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191343.955752:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000100:00100000:0.0:1787191343.955754:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00010000:00010000:3.0:1787191343.955763:0:57974:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191343.955771:0:57974:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191343.955777:0:57974:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191343.955781:0:57974:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191343.955787:0:57974:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b5bbf8 00010000:00010000:3.0:1787191343.955790:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191343.955798:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191343.956581:0:57974:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191343.956594:0:57974:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191343.956601:0:57974:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191343.956616:0:57974:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b53354600, open_flags d900, mode 0 opened 0 00000080:00200000:3.0:1787191343.956623:0:57974:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:3.0:1787191343.956641:0:57974:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:3.0:1787191343.956681:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483afd7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.956689:0:57974:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483afd7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57974 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191343.956700:0:57974:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191343.956708:0:57974:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1f480 x1874004626859520/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191343.956718:0:57974:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483afd7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57974 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191343.956732:0:57974:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626859520:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191343.956893:0:57974:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.963049:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626859264:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191343.963079:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483afd0 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607c4e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.963111:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483afd0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4607c4e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.963125:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483afd0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4607c4e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.963142:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483afd0 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4607c4e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191343.963154:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483afd0 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4607c4e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.963165:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483afd0 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607c4e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.963172:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483afd0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607c4e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.963272:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787191343.963290:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626859648:192.168.202.101@tcp:10:bash.0 00000100:00100000:1.0:1787191343.963518:0:2389:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787191343.963530:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626859776:192.168.202.101@tcp:10:bash.0 00000100:00100000:3.0:1787191343.964594:0:57974:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1f480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626859520:192.168.202.101@tcp:101:lfs.0 00010000:00010000:3.0:1787191343.964613:0:57974:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483afd7 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607c6a expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.964633:0:57974:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483afd7 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607c6a expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.964641:0:57974:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483afd7 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607c6a expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.964651:0:57974:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483afd7 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607c6a expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.964661:0:57974:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483afd7 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607c6a expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.964673:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483afd7 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607c6a expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.964681:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483afd7 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607c6a expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.964688:0:57974:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483afd7 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607c6a expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191343.964700:0:57974:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b51d1f480 x1874004626859520/t8589937252(8589937252) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191343.964712:0:57974:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1f480 x1874004626859520/t8589937252(8589937252) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191343.964725:0:57974:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483afd7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607c6a expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191343.964737:0:57974:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483afd7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607c6a expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.964747:0:57974:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/236 (0 0) 00000080:00200000:3.0:1787191343.964753:0:57974:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1787191343.964802:0:57974:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xec:0x0](ffff936b48989148): rc = 0 00000080:00200000:3.0:1787191343.964818:0:57974:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xec:0x0]: layout version change: 4 -> 4 00000080:00010000:3.0:1787191343.964823:0:57974:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xec:0x0](ffff936b48989148) for lock 0xe5129dc88483afd7 00000080:00010000:3.0:1787191343.965531:0:57974:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xec:0x0](ffff936b48989148) 00000080:00200008:3.0:1787191343.965544:0:57974:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xec:0x0](ffff936b48989148), flags 154400 00000002:00100000:3.0:1787191343.965564:0:57974:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1f480 x1874004626859520/t8589937252(8589937252) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1787191343.965606:0:57974:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483afd7 from it ffff936b466f4960 00010000:00010000:3.0:1787191343.965612:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483afd7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607c6a expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191343.965622:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483afd7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607c6a expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191343.965643:0:57974:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xec:0x0](ffff936b48989148), inode mode 81a4 mask 44 00000080:00200000:3.0:1787191343.965698:0:57974:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xec:0x0](ffff936b48989148), inode mode 81a4 mask 4 00000080:00200000:3.0:1787191343.965703:0:57974:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xec:0x0](ffff936b48989148), xattr lov 00000080:00200008:3.0:1787191343.965722:0:57974:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xec:0x0](ffff936b48989148), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1787191343.965726:0:57974:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xec:0x0](ffff936b48989148),name=f70.sanity-flr 00000002:00010000:3.0:1787191343.965741:0:57974:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xec:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191343.965748:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483afd7 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607c6a expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191343.965755:0:57974:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483afd7 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607c6a expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191343.965760:0:57974:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191343.965763:0:57974:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xec:0x0](ffff936b48989148) 00000080:00010000:3.0:1787191343.965766:0:57974:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xec:0x0](ffff936b48989148) for lock 0xe5129dc88483afd7 00000080:00010000:3.0:1787191343.965770:0:57974:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483afd7 from it ffffa3fb42b5bcd8 00010000:00010000:3.0:1787191343.965773:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483afd7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607c6a expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191343.965780:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483afd7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607c6a expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191343.965800:0:57974:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xec:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:3.0:1787191343.965811:0:57974:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xec:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:3.0:1787191343.965814:0:57974:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:3.0:1787191343.965818:0:57974:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xec:0x0] 00000100:00100000:1.0:1787191343.966301:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626859776:192.168.202.101@tcp:10:bash.0 00000100:00100000:0.0:1787191343.966373:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626859648:192.168.202.101@tcp:10:bash.0 00000080:00200000:1.0:1787191343.966443:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xec:0x0] updating i_size 0 i_blocks 0 00000020:00010000:1.0:1787191343.966450:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894a88 (ffff936b47a17bd8/0) at cl_lock_release():245 00000020:00010000:1.0:1787191343.966453:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894a88 (ffff936b47a17bd8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.966458:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f994b0 (ffff936b47a176c8/1) at cl_lock_cancel():142 00010000:00010000:1.0:1787191343.966466:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483afc9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607c40 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.966479:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483afc9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607c40 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1787191343.966488:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f994f0 (ffff936b47a17908/1) at cl_lock_cancel():142 00010000:00010000:1.0:1787191343.966491:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483afd0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607c4e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.966496:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483afd0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607c4e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:1.0:1787191343.966501:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894a88 (ffff936b47a17bd8/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191343.966503:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f994b0 (ffff936b47a17bd8/1) at cl_lock_fini():72 00000020:00010000:1.0:1787191343.966506:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f994f0 (ffff936b47a17bd8/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191343.966518:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xec:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:1.0:1787191343.966526:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xec:0x0](ffff936b48989148) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191343.000000000, mtime 1787191343.000000000, ctime 1787191343.000000000, rc 0 00000080:00200008:1.0:1787191343.966608:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xec:0x0], ppos: 0, count: 5 00000080:00200000:1.0:1787191343.966619:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:1.0:1787191343.966625:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:1.0:1787191343.966629:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:1.0:1787191343.966633:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:1.0:1787191343.966639:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@0000000007c7e8c5[0x110, 1, [0x200000405:0xec:0x0] hash] 00000020:00200000:1.0:1787191343.966640:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:1.0:1787191343.966643:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xec:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:1.0:1787191343.966650:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xec:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:1.0:1787191343.966653:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xec:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191343.966655:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:1.0:1787191343.966658:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:1.0:1787191343.966663:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:1.0:1787191343.966665:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1787191343.966676:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:1.0:1787191343.966684:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:1.0:1787191343.966688:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b44ca88b0, osc lock ffff936b46836e40, flags 0x0 00010000:00010000:1.0:1787191343.966702:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483afc9 lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607c40 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.966710:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483afc9 lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607c40 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.966721:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483afc9 lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607c40 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.966729:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483afc9 lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607c40 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.966736:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483afc9 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607c40 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191343.966746:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:1.0:1787191343.966753:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:1.0:1787191343.966790:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:1.0:1787191343.966798:0:57570:0:(rw26.c:927:ll_write_end()) page@00000000784fe0cb[3 000000006a6cacfc 2 1 00000000dffde8bf 0 0 0] 00000080:00200000:1.0:1787191343.966801:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @000000005a2959a6 17ffffc0001001 3:0 ffff936b43259ee0 0 lru 00000080:00200000:1.0:1787191343.966808:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@0000000063fbdd99 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000ef00a996 00000000280494ef > 3< 0 0 > 4< 0 0 8 484638720 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:1.0:1787191343.966811:0:57570:0:(rw26.c:927:ll_write_end()) end page@00000000784fe0cb 00000080:00200000:1.0:1787191343.966813:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:1.0:1787191343.966817:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:1.0:1787191343.966852:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 000000006e7e8181 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483afc9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607c40 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191343.966872:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b489892f8, count 1, dirtied 1 00000080:00200000:1.0:1787191343.966876:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:1.0:1787191343.966881:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:1.0:1787191343.966893:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894a88 (ffff936b47a17bd8/0) at cl_lock_release():245 00000020:00010000:1.0:1787191343.966896:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894a88 (ffff936b47a17bd8/0) at cl_lock_cancel():142 00000020:00010000:1.0:1787191343.966899:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b44ca88b0 (ffff936b47a17908/1) at cl_lock_cancel():142 00010000:00010000:1.0:1787191343.966903:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483afc9 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607c40 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191343.966912:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483afc9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607c40 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:1.0:1787191343.966921:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894a88 (ffff936b47a17bd8/0) at cl_lock_fini():72 00000020:00010000:1.0:1787191343.966923:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b44ca88b0 (ffff936b47a17bd8/1) at cl_lock_fini():72 00000080:00200000:1.0:1787191343.966929:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:1.0:1787191343.966933:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:1.0:1787191343.966937:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xec:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:1.0:1787191343.966941:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:0.0:1787191343.967028:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xec:0x0] updating i_size 5 i_blocks 0 00000080:00200000:0.0:1787191343.967032:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:0.0:1787191343.967051:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xec:0x0](ffff936b48989148), flags 100001 00000002:00100000:0.0:1787191343.967105:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a474700 x1874004626856576/t8589937245(8589937245) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191343.967116:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191343.967122:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477800 x1874004626860032/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191343.967141:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626860032:192.168.202.101@tcp:35:bash.0 00000100:00100000:0.0:1787191343.967262:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000008:00010000:3.0:1787191343.967681:0:57974:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:3.0:1787191343.967687:0:57974:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b50667db0, osc lock ffff936b44f64980, flags 0x400000400001002 00010000:00010000:3.0:1787191343.967703:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483afc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607c40 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191343.967713:0:57974:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483afc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607c40 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:3.0:1787191343.967722:0:57974:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:3.0:1787191343.967726:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483afc9 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607c40 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191343.967733:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483afc9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607c40 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:3.0:1787191343.967743:0:57974:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:3.0:1787191343.967749:0:57974:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xec:0x0] updating i_size 5 i_blocks 0 00000020:00010000:3.0:1787191343.967753:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509babf0 (ffff936b47a17d88/0) at cl_lock_release():245 00000020:00010000:3.0:1787191343.967755:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509babf0 (ffff936b47a17d88/0) at cl_lock_cancel():142 00000020:00010000:3.0:1787191343.967758:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b50667db0 (ffff936b465cc5a8/1) at cl_lock_cancel():142 00000020:00010000:3.0:1787191343.967761:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509babf0 (ffff936b47a17d88/0) at cl_lock_fini():72 00000020:00010000:3.0:1787191343.967763:0:57974:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b50667db0 (ffff936b47a17d88/1) at cl_lock_fini():72 00000080:00200000:3.0:1787191343.967772:0:57974:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xec:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:3.0:1787191343.967800:0:57974:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xec:0x0](ffff936b48989148), flags 154000 00000002:00100000:3.0:1787191343.967823:0:57974:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1f480 x1874004626859520/t8589937252(8589937252) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1787191343.967828:0:57974:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 35, max 7 00000100:00100000:3.0:1787191343.968051:0:57974:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1ca80 x1874004626860288/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1787191343.968068:0:57974:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ca80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626860288:192.168.202.101@tcp:35:lfs.0 00000100:00100000:3.0:1787191343.968116:0:57974:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.969359:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626860032:192.168.202.101@tcp:35:bash.0 00000002:00100000:0.0:1787191343.969387:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a474700 x1874004626856576/t8589937245(8589937245) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787191343.972342:0:57974:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ca80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626860288:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191343.972378:0:57974:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1f480 x1874004626859520/t8589937252(8589937252) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191343.972444:0:57974:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191343.972461:0:57974:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191343.972476:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.972491:0:57974:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.972518:0:57974:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191343.972524:0:57974:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191343.972527:0:57974:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191343.972534:0:57974:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b5bbf8 00010000:00010000:0.0:1787191343.972538:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191343.972547:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191343.972561:0:57974:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.972567:0:57974:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191343.972573:0:57974:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191343.972587:0:57974:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:0.0:1787191343.972590:0:57974:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xec:0x0](ffff936b48989148), inode mode 81a4 mask 46 00000080:00200008:0.0:1787191343.972596:0:57974:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xec:0x0](ffff936b48989148), flags 154402 00000002:00010000:0.0:1787191343.972609:0:57974:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xec:0x0]) in obj [0x200000405:0xec:0x0], intent: open flags 0104240114403 00010000:00010000:0.0:1787191343.972649:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483afde lrc: 3/1,0 mode: --/CR res: [0x200000405:0xec:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 57974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.972657:0:57974:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483afde lrc: 3/1,0 mode: --/CR res: [0x200000405:0xec:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57974 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191343.972668:0:57974:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191343.972674:0:57974:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477800 x1874004626860544/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191343.972684:0:57974:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483afde lrc: 3/1,0 mode: --/CR res: [0x200000405:0xec:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x0 pid: 57974 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.972704:0:57974:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626860544:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191343.972898:0:57974:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f993c0 going to sleep for 11 seconds 00000080:00200000:2.0:1787191343.973096:0:57979:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191343.973106:0:57979:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191343.973114:0:57979:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.973121:0:57979:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.973126:0:57979:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191343.973129:0:57979:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191343.973131:0:57979:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191343.973134:0:57979:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42343b58 00010000:00010000:2.0:1787191343.973136:0:57979:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.973141:0:57979:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.973151:0:57979:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191343.973154:0:57979:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191343.973156:0:57979:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191343.973158:0:57979:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=8 00000080:00200008:2.0:1787191343.973162:0:57979:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xec:0x0](ffff936b48989148), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191343.973166:0:57979:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xec:0x0](ffff936b48989148),name=f70.sanity-flr 00000002:00010000:2.0:1787191343.973174:0:57979:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xec:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191343.973178:0:57979:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483afd7 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607c6a expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191343.973183:0:57979:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483afd7 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607c6a expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191343.973186:0:57979:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191343.973188:0:57979:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xec:0x0](ffff936b48989148) 00000080:00010000:2.0:1787191343.973190:0:57979:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xec:0x0](ffff936b48989148) for lock 0xe5129dc88483afd7 00000080:00010000:2.0:1787191343.973192:0:57979:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483afd7 from it ffffa3fb42343cb8 00010000:00010000:2.0:1787191343.973193:0:57979:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483afd7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607c6a expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191343.973197:0:57979:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483afd7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607c6a expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191343.973212:0:57979:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xec:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:2.0:1787191343.973221:0:57979:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xec:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191343.973223:0:57979:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191343.973226:0:57979:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xec:0x0] 00000008:00010000:2.0:1787191343.973240:0:57979:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191343.973243:0:57979:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1f30, osc lock ffff936b44e62f70, flags 0x400000400001002 00010000:00010000:2.0:1787191343.973254:0:57979:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483afc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607c40 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191343.973262:0:57979:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483afc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607c40 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:2.0:1787191343.973271:0:57979:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191343.973275:0:57979:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483afc9 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607c40 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191343.973283:0:57979:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483afc9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607c40 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000020:00200000:2.0:1787191343.973292:0:57979:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191343.973303:0:57979:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xec:0x0] updating i_size 5 i_blocks 0 00000020:00010000:2.0:1787191343.973309:0:57979:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509b84a0 (ffff936b47a17998/0) at cl_lock_release():245 00000020:00010000:2.0:1787191343.973312:0:57979:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509b84a0 (ffff936b47a17998/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191343.973315:0:57979:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1f30 (ffff936b465cc368/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191343.973319:0:57979:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509b84a0 (ffff936b47a17998/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191343.973321:0:57979:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1f30 (ffff936b47a17998/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191343.973332:0:57979:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xec:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191343.973348:0:57979:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191343.973353:0:57979:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191343.973357:0:57979:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.973366:0:57979:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.973370:0:57979:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191343.973372:0:57979:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191343.973374:0:57979:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191343.973376:0:57979:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42343c10 00010000:00010000:2.0:1787191343.973378:0:57979:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191343.973383:0:57979:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.973388:0:57979:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191343.973391:0:57979:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191343.973393:0:57979:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191343.973399:0:57979:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:2.0:1787191343.973403:0:57979:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:2.0:1787191343.973407:0:57979:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:2.0:1787191343.973427:0:57979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483afbb lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4607c16 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191343.973441:0:57979:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xec:0x0]: losing layout lock 00010000:00010000:2.0:1787191343.973453:0:57979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483afd7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4607c6a expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191343.973461:0:57979:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xec:0x0]: losing layout lock 00010000:00010000:2.0:1787191343.973469:0:57979:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483afad lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xec:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4607bec expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.973500:0:57979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483afbb lrc: 1/0,0 mode: --/CR res: [0x200000405:0xec:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607c16 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191343.973508:0:57979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483afd7 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607c6a expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191343.973513:0:57979:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483afad lrc: 1/0,0 mode: --/PR res: [0x200000405:0xec:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4607bec expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.973518:0:57979:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:2.0:1787191343.973522:0:57979:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483afbb lrc: 0/0,0 mode: --/CR res: [0x200000405:0xec:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607c16 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191343.973534:0:57979:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483afd7 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607c6a expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191343.973543:0:57979:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483afad lrc: 0/0,0 mode: --/PR res: [0x200000405:0xec:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4607bec expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:2.0:1787191343.973554:0:57979:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 36, max 7 00000100:00100000:2.0:1787191343.973559:0:57979:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8e00 x1874004626860800/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787191343.973571:0:57979:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57979:1874004626860800:192.168.202.101@tcp:36:rm.0 00000100:00100000:2.0:1787191343.973605:0:57979:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787191343.976072:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191343.976154:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634945024 00000100:00100000:3.0:1787191343.976162:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634945024 00000100:00100000:3.0:1787191343.976227:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1514 00000100:00100000:3.0:1787191343.976235:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634945024:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191343.976245:0:51131:0:(ldlm_lockd.c:2455:ldlm_callback_handler()) callback on lock 0xe5129dc88483afd7 - lock disappeared 00010000:00010000:3.0:1787191343.976302:0:51131:0:(ldlm_lockd.c:2352:ldlm_callback_errmsg()) @@@ Operate with invalid parameter, NID=12345-192.168.202.101@tcp lock=0xe5129dc88483afd7: rc = 0 req@ffff936b513bb100 x1874004634945024/t0(0) o104->f10005b0-4ec5-4888-9c81-49c0b11e82c4@192.168.202.101@tcp:654/0 lens 328/224 e 0 to 0 dl 1787191354 ref 1 fl Interpret:/0/0 rc -22/-22 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191343.976310:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:6507:x1874004634945024:12345-192.168.202.101@tcp:104: Request processed in 77us (246us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787191343.976314:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1514 00000100:00100000:0.0:1787191343.978491:0:57974:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626860544:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191343.978511:0:57974:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CW ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483afde lrc: 4/1,0 mode: --/CR res: [0x200000405:0xec:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607c7f expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.978520:0:57974:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483afde lrc: 4/1,0 mode: --/CW res: [0x200000405:0xec:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607c7f expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.978525:0:57974:0:(ldlm_request.c:795:ldlm_cli_enqueue_fini()) ### enqueue reply includes blocking AST ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483afde lrc: 4/1,0 mode: --/CW res: [0x200000405:0xec:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4607c7f expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.978533:0:57974:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483afde lrc: 4/1,0 mode: CW/CW res: [0x200000405:0xec:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e4607c7f expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.978540:0:57974:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483afde lrc: 4/1,0 mode: CW/CW res: [0x200000405:0xec:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4607c7f expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.978549:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483afde lrc: 5/1,1 mode: CW/CW res: [0x200000405:0xec:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e4607c7f expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.978554:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483afde lrc: 5/1,1 mode: CW/CW res: [0x200000405:0xec:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e4607c7f expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.978559:0:57974:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483afde lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xec:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e4607c7f expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191343.978569:0:57974:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x200002b, status=0 req@ffff936b6a477800 x1874004626860544/t8589937255(8589937255) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191343.978578:0:57974:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477800 x1874004626860544/t8589937255(8589937255) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191343.978598:0:57974:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483afde lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xec:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4607c7f expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.978606:0:57974:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 8 res 8589935621/236 (0 0) 00000080:00200000:0.0:1787191343.978610:0:57974:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xec:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191343.978651:0:57974:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xec:0x0](ffff936b48989148) for lock 0xe5129dc88483afde 00000080:00010000:0.0:1787191343.978656:0:57974:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483afde from it ffffa3fb42b5bbf0 00010000:00010000:0.0:1787191343.978658:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483afde lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xec:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e4607c7f expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.978663:0:57974:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483afde lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xec:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x10400400000000 nid: local remote: 0x7130d520e4607c7f expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.978681:0:57974:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000002:00100000:0.0:1787191343.978703:0:57974:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477800 x1874004626860544/t8589937255(8589937255) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1787191343.978725:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191343.978732:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483afde lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xec:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4607c7f expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.978739:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b43adfa00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191343.978744:0:40929:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483afde lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xec:0x0].0x0 bits 0x5/0x5 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4607c7f expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.978751:0:40929:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483afde lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xec:0x0].0x0 bits 0x5/0x5 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x7130d520e4607c7f expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.978759:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483afde lrc: 3/0,0 mode: CW/CW res: [0x200000405:0xec:0x0].0x0 bits 0x5/0x5 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x7130d520e4607c7f expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00200080:0.0:1787191343.978789:0:57974:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xec:0x0](ffff936b48989148) cmd=800466af arg=7fffa770176c 00010000:00010000:1.0:1787191343.978802:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483afde lrc: 2/0,0 mode: --/CW res: [0x200000405:0xec:0x0].0x0 bits 0x5/0x5 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e4607c7f expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00200080:0.0:1787191343.978803:0:57974:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xec:0x0](ffff936b48989148) cmd=80086601 arg=7fffa7701708 00010000:00010000:1.0:1787191343.978809:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787191343.978828:0:57974:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626861056:192.168.202.101@tcp:33:lfs.0 00000100:00100000:0.0:1787191343.978924:0:57974:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00010000:00010000:1.0:1787191343.979668:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483afde lrc: 1/0,0 mode: --/CW res: [0x200000405:0xec:0x0].0x0 bits 0x5/0x5 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e4607c7f expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.979677:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483afde lrc: 0/0,0 mode: --/CW res: [0x200000405:0xec:0x0].0x0 bits 0x5/0x5 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x7130d520e4607c7f expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.979694:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191343.979697:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191343.979698:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191343.979708:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787191343.979721:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626860928:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191343.980898:0:57974:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626861056:192.168.202.101@tcp:33:lfs.0 00000080:00200080:0.0:1787191343.980934:0:57974:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xec:0x0](ffff936b48989148) cmd=c00c66f3 arg=7fffa77016f4 00000002:00010000:0.0:1787191343.980957:0:57974:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xec:0x0]) in obj [0x200000405:0xec:0x0], intent: open flags 01004040000002 00010000:00010000:0.0:1787191343.980996:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483afe5 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xec:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191343.981015:0:57974:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x81000000001000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483afe5 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xec:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57974 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191343.981030:0:57974:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191343.981038:0:57974:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474700 x1874004626861312/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191343.981048:0:57974:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483afe5 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xec:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x81000000000000 pid: 57974 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191343.981064:0:57974:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626861312:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191343.981215:0:57974:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99600 going to sleep for 11 seconds 00000100:00100000:0.0:1787191343.983341:0:57979:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8e00 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57979:1874004626860800:192.168.202.101@tcp:36:rm.0 00000100:00100000:1.0:1787191343.984085:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626860928:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191343.985537:0:57974:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626861312:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191343.985560:0:57974:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PW ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483afe5 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xec:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4607ca9 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.985572:0:57974:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483afe5 lrc: 4/1,0 mode: --/PW res: [0x200000405:0xec:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4607ca9 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.985584:0:57974:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483afe5 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0xec:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4607ca9 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.985596:0:57974:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483afe5 lrc: 4/1,0 mode: PW/PW res: [0x200000405:0xec:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4607ca9 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.985608:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483afe5 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0xec:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4607ca9 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.985616:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483afe5 lrc: 5/1,1 mode: PW/PW res: [0x200000405:0xec:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4607ca9 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.985624:0:57974:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483afe5 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0xec:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4607ca9 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191343.985636:0:57974:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x600002b, status=0 req@ffff936b6a474700 x1874004626861312/t8589937257(8589937257) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191343.985650:0:57974:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474700 x1874004626861312/t8589937257(8589937257) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191343.985665:0:57974:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483afe5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xec:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x81000000000000 nid: local remote: 0x7130d520e4607ca9 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.985676:0:57974:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 2 res 8589935621/236 (0 0) 00000080:00200000:2.0:1787191343.985682:0:57974:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xec:0x0] suppgids 0 0: rc 0 00000002:00100000:2.0:1787191343.985701:0:57974:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a474700 x1874004626861312/t8589937257(8589937257) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1787191343.985708:0:57974:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xec:0x0](ffff936b48989148) for lock 0xe5129dc88483afe5 00000080:00010000:2.0:1787191343.985715:0:57974:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483afe5 from it ffffa3fb42b5bcc0 00010000:00010000:2.0:1787191343.985718:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483afe5 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0xec:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4607ca9 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.985726:0:57974:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483afe5 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0xec:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x91000000000000 nid: local remote: 0x7130d520e4607ca9 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00200080:2.0:1787191343.985777:0:57974:0:(file.c:4645:ll_file_ioctl()) VFS Op:inode=[0x200000405:0xec:0x0](ffff936b48989148) cmd=c00c66f3 arg=2397500 00010000:00010000:2.0:1787191343.985818:0:57974:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483afe5 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0xec:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x81008000000000 nid: local remote: 0x7130d520e4607ca9 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.985852:0:57974:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483afe5 lrc: 0/0,0 mode: --/PW res: [0x200000405:0xec:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x85809400000000 nid: local remote: 0x7130d520e4607ca9 expref: -99 pid: 57974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191343.985873:0:57974:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a474700 x1874004626861312/t8589937257(8589937257) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191343.985881:0:57974:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191343.985887:0:57974:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bad80 x1874004626861568/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191343.985905:0:57974:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626861568:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191343.985983:0:57974:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787191343.988039:0:57974:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bad80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626861568:192.168.202.101@tcp:35:lfs.0 00000080:00020000:2.0:1787191343.988056:0:57974:0:(file.c:251:ll_close_inode_openhandle()) lustre-clilmv-ffff936b581fb000: inode [0x200000405:0xec:0x0] mdc close failed: rc = -1 00000002:00100000:2.0:1787191343.988074:0:57974:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a474700 x1874004626861312/t8589937257(8589937257) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1787191343.988104:0:57974:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xec:0x0](ffff936b48989148) 00000002:00010000:2.0:1787191343.988115:0:57974:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xec:0x0]) in obj [0x200000405:0xec:0x0], intent: layout flags 0 00010000:00010000:2.0:1787191343.988165:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483afec lrc: 3/1,0 mode: --/CR res: [0x200000405:0xec:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.988174:0:57974:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483afec lrc: 3/1,0 mode: --/CR res: [0x200000405:0xec:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.988184:0:57974:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483afec lrc: 3/1,0 mode: --/CR res: [0x200000405:0xec:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57974 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191343.988201:0:57974:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626861696:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191343.988266:0:57974:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787191343.991184:0:57974:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626861696:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191343.991216:0:57974:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483afec lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607cbe expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.991232:0:57974:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483afec lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607cbe expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191343.991246:0:57974:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b513b9180 x1874004626861696/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191343.991263:0:57974:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483afec lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607cbe expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191343.991286:0:57974:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483afec lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607cbe expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.991297:0:57974:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/236 (0 0) 00000080:00200000:2.0:1787191343.991303:0:57974:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xec:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1787191343.991319:0:57974:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xec:0x0](ffff936b48989148) for lock 0xe5129dc88483afec 00000080:00010000:2.0:1787191343.991326:0:57974:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483afec from it ffffa3fb42b5bbc8 00010000:00010000:2.0:1787191343.991331:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483afec lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607cbe expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191343.991341:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483afec lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607cbe expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.991365:0:57974:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483afec lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607cbe expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.991376:0:57974:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483afec lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607cbe expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:2.0:1787191343.991384:0:57974:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xec:0x0](000000005d342181) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483afec lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607cbe expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191343.991572:0:57974:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xec:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:2.0:1787191343.991578:0:57974:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483afec lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607cbe expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191343.991586:0:57974:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184800/0xe5129dc88483afec lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xec:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607cbe expref: -99 pid: 57974 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200008:2.0:1787191343.991660:0:57974:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xec:0x0](ffff936b48989148), flags 154002 00000080:00200000:1.0:1787191343.991695:0:57980:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00100000:2.0:1787191343.991699:0:57974:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a477800 x1874004626860544/t8589937255(8589937255) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191343.991709:0:57980:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00000020:00100000:2.0:1787191343.991709:0:57974:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191343.991714:0:57974:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9180 x1874004626861952/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1787191343.991718:0:57980:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.991731:0:57980:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000100:00100000:2.0:1787191343.991734:0:57974:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626861952:192.168.202.101@tcp:35:lfs.0 00000080:00200000:1.0:1787191343.991738:0:57980:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191343.991743:0:57980:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191343.991746:0:57980:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191343.991750:0:57980:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b63b58 00010000:00010000:1.0:1787191343.991753:0:57980:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.991760:0:57980:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.991768:0:57980:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191343.991775:0:57980:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:1.0:1787191343.991780:0:57980:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191343.991791:0:57980:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:1.0:1787191343.991796:0:57980:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:1.0:1787191343.991807:0:57980:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00000100:00100000:2.0:1787191343.991810:0:57974:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338ff00 going to sleep for 11 seconds 00010000:00010000:1.0:1787191343.991861:0:57980:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483aff3 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.991869:0:57980:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483aff3 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.991879:0:57980:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483aff3 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787191343.991896:0:57980:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57980:1874004626862080:192.168.202.101@tcp:101:lfs.0 00000100:00100000:1.0:1787191343.991923:0:57980:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893900 going to sleep for 11 seconds 00000100:00100000:1.0:1787191343.994246:0:57980:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57980:1874004626862080:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191343.994246:0:57974:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57974:1874004626861952:192.168.202.101@tcp:35:lfs.0 00010000:00010000:1.0:1787191343.994264:0:57980:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483aff3 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.994277:0:57980:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483aff3 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.994284:0:57980:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483aff3 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.994290:0:57980:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483aff3 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.994299:0:57980:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483aff3 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.994305:0:57980:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51fe1200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191343.994310:0:57980:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483aff3 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.994317:0:57980:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483aff3 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.994324:0:57980:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483aff3 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.994331:0:57980:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191343.994338:0:57980:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483aff3 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191343.994338:0:57974:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a477800 x1874004626860544/t8589937255(8589937255) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1787191343.994345:0:57980:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe1200/0xe5129dc88483aff3 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191343.994361:0:57980:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b453aa300 x1874004626862080/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191343.994373:0:57980:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191343.994449:0:57980:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191343.994462:0:57980:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191343.994473:0:57980:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.994483:0:57980:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191343.994490:0:57980:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191343.994495:0:57980:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191343.994498:0:57980:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191343.994503:0:57980:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b63be8 00010000:00010000:1.0:1787191343.994507:0:57980:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191343.994515:0:57980:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191343.994526:0:57974:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xec:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00000080:00200000:1.0:1787191343.994528:0:57980:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191343.994534:0:57980:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00020000:00200000:2.0:1787191343.994537:0:57974:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xec:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00000080:00200000:1.0:1787191343.994539:0:57980:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00020000:00200000:2.0:1787191343.994541:0:57974:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191343.994546:0:57974:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:1.0:1787191343.994549:0:57980:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:1.0:1787191343.994552:0:57980:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00020000:00200000:2.0:1787191343.994556:0:57974:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000002:00010000:1.0:1787191343.994563:0:57980:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00000008:00010000:2.0:1787191343.994572:0:57974:0:(osc_cache.c:1183:osc_extent_make_ready()) ### extent: 000000006e7e8181 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483afc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607c40 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000008:00010000:2.0:1787191343.994596:0:57974:0:(osc_cache.c:917:osc_extent_finish()) ### extent: 000000006e7e8181 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483afc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607c40 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000008:00010000:2.0:1787191343.994625:0:57974:0:(osc_cache.c:497:__osc_extent_remove()) ### extent: 000000006e7e8181 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483afc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607c40 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000080:00200000:2.0:1787191343.994646:0:57974:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xec:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:1.0:1787191343.994665:0:57980:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483affa lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.994672:0:57980:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483affa lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191343.994681:0:57980:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483affa lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00000080:00200000:2.0:1787191343.994694:0:57974:0:(llite_lib.c:2066:ll_clear_inode()) VFS Op:inode=[0x200000405:0xec:0x0](ffff936b48989148) 00000100:00100000:1.0:1787191343.994698:0:57980:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57980:1874004626862208:192.168.202.101@tcp:101:lfs.0 00000008:00010000:2.0:1787191343.994718:0:57974:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 5 blocks 0 [cma]time 1787191343 1787191343 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483afc9 lrc: 1/0,0 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607c40 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00000008:00010000:2.0:1787191343.994736:0:57974:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191343 1787191343 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483afd0 lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607c4e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1787191343.994804:0:57980:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b62893900 going to sleep for 11 seconds 00000100:00100000:1.0:1787191344.000106:0:57980:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aa300 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57980:1874004626862208:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191344.000128:0:57980:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483affa lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191344.000142:0:57980:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483affa lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191344.000149:0:57980:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483affa lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191344.000156:0:57980:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483affa lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191344.000165:0:57980:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483affa lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191344.000177:0:57980:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51fe0a00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191344.000182:0:57980:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483affa lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191344.000189:0:57980:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483affa lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191344.000196:0:57980:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483affa lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191344.000203:0:57980:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191344.000209:0:57980:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483affa lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191344.000216:0:57980:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51fe0a00/0xe5129dc88483affa lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191344.000236:0:57980:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b453aa300 x1874004626862208/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191359 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191344.000252:0:57980:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191344.000928:0:57980:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191344.000941:0:57980:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191344.000951:0:57980:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191344.000960:0:57980:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191344.000965:0:57980:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191344.000969:0:57980:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191344.000972:0:57980:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191344.000976:0:57980:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b63b58 00010000:00010000:0.0:1787191344.000978:0:57980:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191344.000984:0:57980:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191344.000995:0:57980:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191344.001011:0:57980:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:0.0:1787191344.001020:0:57980:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1787191344.001029:0:57980:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:0.0:1787191344.001039:0:57980:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191344.001047:0:57980:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 106 lru_type: 1 00010000:00010000:0.0:1787191344.001056:0:57980:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 106 lru_type: 1 00000002:00010000:0.0:1787191344.001065:0:57980:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191344.001105:0:57980:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483b001 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.001112:0:57980:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483b001 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.001121:0:57980:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483b001 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191344.001147:0:57980:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57980:1874004626862336:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191344.001279:0:57980:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00000080:00200000:2.0:1787191344.003757:0:57981:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191344.003784:0:57981:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191344.003798:0:57981:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191344.003814:0:57981:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191344.003823:0:57981:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191344.004253:0:57981:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191344.004258:0:57981:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191344.004266:0:57981:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b6bbf8 00010000:00010000:2.0:1787191344.004270:0:57981:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191344.004281:0:57981:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191344.004296:0:57981:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191344.004302:0:57981:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191344.004308:0:57981:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191344.004320:0:57981:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b62866f00, open_flags d900, mode 0 opened 0 00000080:00200000:2.0:1787191344.004326:0:57981:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:2.0:1787191344.004341:0:57981:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:2.0:1787191344.004390:0:57981:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483b008 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.004399:0:57981:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483b008 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57981 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191344.004410:0:57981:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191344.004421:0:57981:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9180 x1874004626862592/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191344.004430:0:57981:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483b008 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57981 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191344.004449:0:57981:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57981:1874004626862592:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191344.004691:0:57981:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787191344.006911:0:57980:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57980:1874004626862336:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191344.006933:0:57980:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483b001 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607cfd expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.006945:0:57980:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483b001 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607cfd expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.006956:0:57980:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483b001 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607cfd expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.006968:0:57980:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483b001 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607cfd expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.006977:0:57980:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483b001 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607cfd expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.006982:0:57980:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483b001 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607cfd expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.006987:0:57980:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483b001 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607cfd expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191344.006994:0:57980:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b6a477480 x1874004626862336/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191360 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191344.007021:0:57980:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483b001 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607cfd expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.007031:0:57980:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:0.0:1787191344.007038:0:57980:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483b001 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607cfd expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.007046:0:57980:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483b001 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607cfd expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:0.0:1787191344.007073:0:57980:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191344.007083:0:57980:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 212 lru_type: 1 00010000:00010000:0.0:1787191344.007101:0:57980:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 212 lru_type: 1 00010000:00010000:0.0:1787191344.007111:0:57980:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 212 lru_type: 1 00010000:00010000:0.0:1787191344.007118:0:57980:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 213 lru_type: 1 00000080:00200000:0.0:1787191344.007130:0:57980:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191344.007138:0:57980:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:0.0:1787191344.007142:0:57980:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:0.0:1787191344.007148:0:57980:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb42b63cb8 00010000:00010000:0.0:1787191344.007152:0:57980:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 106 lru_type: 1 00010000:00010000:0.0:1787191344.007159:0:57980:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 107 lru_type: 1 00000002:00010000:0.0:1787191344.007174:0:57980:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191344.007181:0:57980:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483b001 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607cfd expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.007193:0:57980:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483b001 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607cfd expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.007202:0:57980:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483b001 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607cfd expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.007209:0:57980:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483b001 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607cfd expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:0.0:1787191344.007217:0:57980:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191344.007223:0:57980:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 213 lru_type: 1 00010000:00010000:0.0:1787191344.007230:0:57980:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 213 lru_type: 1 00010000:00010000:0.0:1787191344.007238:0:57980:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 213 lru_type: 1 00010000:00010000:0.0:1787191344.007249:0:57980:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 214 lru_type: 1 00000080:00200008:0.0:1787191344.007736:0:57980:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1787191344.007742:0:57980:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191344.007753:0:57980:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191344.007758:0:57980:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191344.007776:0:57980:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191344.007780:0:57980:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191344.007783:0:57980:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191344.007785:0:57980:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191344.007788:0:57980:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b63cb8 00010000:00010000:0.0:1787191344.007790:0:57980:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191344.007795:0:57980:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191344.007911:0:57980:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191344.007918:0:57980:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191344.007922:0:57980:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191344.007931:0:57980:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191344.007935:0:57980:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191344.007938:0:57980:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191344.007940:0:57980:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191344.007942:0:57980:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b63b58 00010000:00010000:0.0:1787191344.007944:0:57980:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191344.007948:0:57980:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191344.007954:0:57980:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191344.007958:0:57980:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:0.0:1787191344.007961:0:57980:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000100:00100000:1.0:1787191344.008804:0:57981:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57981:1874004626862592:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191344.008816:0:57981:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483b008 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191344.008823:0:57981:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483b008 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191344.008827:0:57981:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483b008 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191344.008866:0:57981:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483b008 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191344.008873:0:57981:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483b008 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191344.008879:0:57981:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51185c00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191344.008884:0:57981:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483b008 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191344.008891:0:57981:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483b008 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 57981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191344.008898:0:57981:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483b008 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191344.008906:0:57981:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1787191344.008911:0:57981:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483b008 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57981 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191344.008919:0:57981:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483b008 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57981 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191344.008935:0:57981:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x7, status=0 req@ffff936b513b9180 x1874004626862592/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/608 e 0 to 0 dl 1787191360 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191344.008943:0:57981:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191344.008974:0:57980:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:0.0:1787191344.008980:0:57980:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:0.0:1787191344.008996:0:57980:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:0.0:1787191344.009044:0:57980:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483b00f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.009050:0:57980:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483b00f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.009056:0:57980:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483b00f lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191344.009073:0:57980:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57980:1874004626862720:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191344.009208:0:57980:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00010000:00010000:0.0:1787191344.009230:0:57981:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483b001 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607cfd expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191344.009238:0:57981:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483b001 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607cfd expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:0.0:1787191344.009246:0:57981:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483b001 from it ffffa3fb42b6b9a0 00010000:00010000:0.0:1787191344.009249:0:57981:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483b001 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607cfd expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191344.009255:0:57981:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483b001 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607cfd expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191344.009452:0:57981:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191344.009463:0:57981:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191344.009470:0:57981:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191344.009478:0:57981:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191344.009483:0:57981:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191344.009487:0:57981:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191344.009489:0:57981:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191344.009493:0:57981:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b6bb58 00010000:00010000:0.0:1787191344.009495:0:57981:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191344.009500:0:57981:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191344.009505:0:57981:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191344.009508:0:57981:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191344.009512:0:57981:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191344.009513:0:57981:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=9 00000100:00100000:0.0:1787191344.013828:0:57980:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57980:1874004626862720:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191344.013875:0:57980:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483b00f lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.013890:0:57980:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483b00f lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.013897:0:57980:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483b00f lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.013904:0:57980:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483b00f lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.013914:0:57980:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483b00f lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.013920:0:57980:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b43adf000 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191344.013924:0:57980:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483b00f lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.013935:0:57980:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483b00f lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.013943:0:57980:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483b00f lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.013950:0:57980:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191344.013957:0:57980:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483b00f lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.013963:0:57980:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf000/0xe5129dc88483b00f lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191344.013979:0:57980:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b6a477480 x1874004626862720/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191360 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191344.013994:0:57980:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1787191344.014030:0:57980:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483b001 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607cfd expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191344.014043:0:57980:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483b001 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607cfd expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00010000:0.0:1787191344.014052:0:57980:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483b001 from it ffffa3fb42b63930 00010000:00010000:0.0:1787191344.014057:0:57980:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483b001 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607cfd expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191344.014064:0:57980:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483b001 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607cfd expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1787191344.014184:0:57980:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191344.014198:0:57980:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191344.014208:0:57980:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191344.014217:0:57980:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191344.014224:0:57980:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191344.014229:0:57980:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191344.014233:0:57980:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191344.014238:0:57980:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b63bf8 00010000:00010000:0.0:1787191344.014241:0:57980:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191344.014249:0:57980:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191344.014259:0:57980:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191344.014266:0:57980:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191344.014271:0:57980:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191344.014276:0:57980:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:0.0:1787191344.014279:0:57980:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:0.0:1787191344.014284:0:57980:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b483e7380, open_flags a141, mode 81b6 opened 0 00000080:00200000:0.0:1787191344.014292:0:57980:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:0.0:1787191344.014311:0:57980:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xee:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:0.0:1787191344.014321:0:57980:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483b001 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4607cfd expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191344.014369:0:57980:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483b001 lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4607cfd expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191344.014376:0:57980:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191344.014379:0:57980:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adea00/0xe5129dc88483b001 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4607cfd expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1787191344.014406:0:57980:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483b016 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.014414:0:57980:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483b016 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191344.014423:0:57980:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191344.014430:0:57980:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477480 x1874004626862976/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191344.014438:0:57980:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483b016 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191344.014458:0:57980:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57980:1874004626862976:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191344.014580:0:57980:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787191344.017713:0:57980:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57980:1874004626862976:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191344.017739:0:57980:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483b016 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607d43 expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.017765:0:57980:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483b016 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xee:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607d43 expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.017774:0:57980:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483b016 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607d43 expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.017784:0:57980:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483b016 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607d43 expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.017795:0:57980:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483b016 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607d43 expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.017807:0:57980:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483b016 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607d43 expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.017816:0:57980:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483b016 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607d43 expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.017824:0:57980:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483b016 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607d43 expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191344.017907:0:57980:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b6a477480 x1874004626862976/t8589937260(8589937260) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191360 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191344.017921:0:57980:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477480 x1874004626862976/t8589937260(8589937260) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191360 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191344.017933:0:57980:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483b016 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607d43 expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.017943:0:57980:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/238 (0 0) 00000080:00200000:0.0:1787191344.017949:0:57980:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191344.017960:0:57980:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:0.0:1787191344.017985:0:57980:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xee:0x0](ffff936b5396c2c8) 00000080:00200000:0.0:1787191344.017992:0:57980:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xee:0x0], updating i_size 0 00000080:00200000:0.0:1787191344.018037:0:57980:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xee:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1787191344.018042:0:57980:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xee:0x0](ffff936b5396c2c8) 00000080:00010000:0.0:1787191344.018045:0:57980:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xee:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483b016 00000080:00010000:0.0:1787191344.018054:0:57980:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xee:0x0](ffff936b5396c2c8) 00000080:00200008:0.0:1787191344.018065:0:57980:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xee:0x0](ffff936b5396c2c8), flags 120501 00000002:00100000:0.0:1787191344.018094:0:57980:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477480 x1874004626862976/t8589937260(8589937260) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191360 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191344.018124:0:57980:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483b016 from it ffff936b530f5840 00010000:00010000:0.0:1787191344.018129:0:57980:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483b016 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607d43 expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.018139:0:57980:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483b016 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607d43 expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191344.018161:0:57980:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xee:0x0](ffff936b5396c2c8), inode mode 81a4 mask 40 00000080:00200000:0.0:1787191344.018203:0:57980:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xee:0x0](ffff936b5396c2c8), inode mode 81a4 mask 2 00000080:00200000:0.0:1787191344.018212:0:57980:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xee:0x0](ffff936b5396c2c8), xattr lov 00000002:00010000:0.0:1787191344.018227:0:57980:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xee:0x0]) in obj [0x200000405:0xee:0x0], intent: open flags 040000002 00010000:00010000:0.0:1787191344.018278:0:57980:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483b01d lrc: 3/1,0 mode: --/CR res: [0x200000405:0xee:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.018286:0:57980:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483b01d lrc: 3/1,0 mode: --/CR res: [0x200000405:0xee:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191344.018301:0:57980:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191344.018308:0:57980:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477800 x1874004626863232/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191344.018318:0:57980:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483b01d lrc: 3/1,0 mode: --/CR res: [0x200000405:0xee:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191344.018337:0:57980:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57980:1874004626863232:192.168.202.101@tcp:101:lfs.0 00000100:00100000:0.0:1787191344.018506:0:57980:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787191344.020200:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191344.020240:0:40921:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787191344.020347:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634945152 00000100:00100000:3.0:1787191344.020355:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634945152 00000100:00100000:3.0:1787191344.020457:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1515 00000100:00100000:3.0:1787191344.020469:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b4121c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634945152:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191344.020485:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483b016 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4607d43 expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191344.020543:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191344.020548:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b4121c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634945152:12345-192.168.202.101@tcp:104: Request processed in 84us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191344.020555:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1515 00010000:00010000:1.0:1787191344.020643:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787191344.020650:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483b016 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4607d43 expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191344.020663:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b43adfe00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:1.0:1787191344.020668:0:40930:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483b016 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4607d43 expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191344.020676:0:40930:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483b016 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4607d43 expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191344.020684:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483b016 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4607d43 expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191344.020703:0:40930:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xee:0x0]: losing layout lock 00010000:00010000:1.0:1787191344.020741:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483b016 lrc: 2/0,0 mode: --/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607d43 expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191344.020748:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787191344.020767:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483b016 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607d43 expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191344.020772:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483b016 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607d43 expref: -99 pid: 57980 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191344.020781:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191344.020782:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787191344.020783:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787191344.020794:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626863360:192.168.202.101@tcp:103:ldlm_bl.0 00000080:00200000:2.0:1787191344.022798:0:57982:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191344.022824:0:57982:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191344.022867:0:57982:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191344.022883:0:57982:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191344.022891:0:57982:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191344.022899:0:57982:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191344.022903:0:57982:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191344.022909:0:57982:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b73bf8 00010000:00010000:2.0:1787191344.022913:0:57982:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191344.022922:0:57982:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191344.022936:0:57982:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191344.022942:0:57982:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191344.022948:0:57982:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191344.022960:0:57982:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b51274f00, open_flags d900, mode 0 opened 0 00000080:00200000:2.0:1787191344.022966:0:57982:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open 00000002:00010000:2.0:1787191344.022979:0:57982:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open flags 0154401 00010000:00010000:2.0:1787191344.023033:0:57982:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483b024 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.023041:0:57982:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483b024 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57982 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191344.023051:0:57982:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 2 is allocated opc 101, max 7 00000100:00100000:2.0:1787191344.023061:0:57982:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513baa00 x1874004626863616/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191344.023070:0:57982:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483b024 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57982 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191344.023096:0:57982:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57982:1874004626863616:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191344.023493:0:57982:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f840 going to sleep for 11 seconds 00000100:00100000:1.0:1787191344.025650:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626863360:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191344.025657:0:57980:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57980:1874004626863232:192.168.202.101@tcp:101:lfs.0 00010000:00010000:0.0:1787191344.025674:0:57980:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483b01d lrc: 4/1,0 mode: --/CR res: [0x200000405:0xee:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.025686:0:57980:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483b01d lrc: 4/1,0 mode: --/CR res: [0x200000405:0xee:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.025692:0:57980:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483b01d lrc: 4/1,0 mode: --/CR res: [0x200000405:0xee:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.025700:0:57980:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483b01d lrc: 3/0,0 mode: --/CR res: [0x200000405:0xee:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.025707:0:57980:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483b01d lrc: 4/0,0 mode: --/CR res: [0x200000405:0xee:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.025713:0:57980:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b43adfa00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191344.025718:0:57980:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483b01d lrc: 4/0,0 mode: --/CR res: [0x200000405:0xee:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.025729:0:57980:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483b01d lrc: 4/0,0 mode: --/CR res: [0x200000405:0xee:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.025736:0:57980:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483b01d lrc: 5/0,0 mode: --/CR res: [0x200000405:0xee:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.025743:0:57980:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1787191344.025750:0:57980:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483b01d lrc: 3/0,0 mode: --/CR res: [0x200000405:0xee:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.025757:0:57980:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483b01d lrc: 0/0,0 mode: --/CR res: [0x200000405:0xee:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57980 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191344.025781:0:57980:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b6a477800 x1874004626863232/t8589937261(8589937261) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191360 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191344.025793:0:57980:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477800 x1874004626863232/t8589937261(8589937261) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191360 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191344.025809:0:57980:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xee:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787191344.025975:0:57980:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xee:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1787191344.025984:0:57980:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xee:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191344.026048:0:57980:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xee:0x0], updating i_size 0 00000002:00100000:0.0:1787191344.026068:0:57980:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a477800 x1874004626863232/t8589937261(8589937261) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191360 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191344.026178:0:57980:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a477800 x1874004626863232/t8589937261(8589937261) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191360 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191344.026187:0:57980:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191344.026193:0:57980:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474700 x1874004626863872/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191344.026213:0:57980:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57980:1874004626863872:192.168.202.101@tcp:35:lfs.0 00000100:00100000:0.0:1787191344.026328:0:57980:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787191344.028335:0:57982:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57982:1874004626863616:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191344.028364:0:57982:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483b024 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607d7b expref: -99 pid: 57982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191344.028373:0:57980:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57980:1874004626863872:192.168.202.101@tcp:35:lfs.0 00000002:00100000:0.0:1787191344.028454:0:57980:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a477800 x1874004626863232/t8589937261(8589937261) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191360 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1787191344.028485:0:57982:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483b024 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607d7b expref: -99 pid: 57982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191344.028494:0:57982:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483b024 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607d7b expref: -99 pid: 57982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191344.028504:0:57982:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483b024 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607d7b expref: -99 pid: 57982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00200008:0.0:1787191344.028510:0:57980:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xee:0x0](ffff936b5396c2c8), flags 100001 00010000:00010000:1.0:1787191344.028514:0:57982:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483b024 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607d7b expref: -99 pid: 57982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191344.028526:0:57982:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483b024 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607d7b expref: -99 pid: 57982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191344.028534:0:57982:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483b024 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607d7b expref: -99 pid: 57982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191344.028540:0:57982:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483b024 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607d7b expref: -99 pid: 57982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1787191344.028549:0:57982:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x2b, status=0 req@ffff936b513baa00 x1874004626863616/t8589937262(8589937262) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191360 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191344.028550:0:57980:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a477480 x1874004626862976/t8589937260(8589937260) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191360 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191344.028560:0:57980:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191344.028565:0:57980:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475180 x1874004626864128/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000002:00100000:1.0:1787191344.028566:0:57982:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513baa00 x1874004626863616/t8589937262(8589937262) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191360 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1787191344.028577:0:57982:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483b024 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607d7b expref: -99 pid: 57982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191344.028583:0:57980:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57980:1874004626864128:192.168.202.101@tcp:35:lfs.0 00000002:00010000:1.0:1787191344.028599:0:57982:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483b024 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607d7b expref: -99 pid: 57982 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191344.028606:0:57982:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/238 (0 0) 00000080:00200000:1.0:1787191344.028611:0:57982:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:1.0:1787191344.028649:0:57982:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xee:0x0](ffff936b5396c2c8): rc = 0 00000100:00100000:0.0:1787191344.028653:0:57980:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00000080:00200000:1.0:1787191344.028664:0:57982:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xee:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:1.0:1787191344.028669:0:57982:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xee:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483b024 00000080:00010000:1.0:1787191344.028687:0:57982:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xee:0x0](ffff936b5396c2c8) 00000080:00200008:1.0:1787191344.028698:0:57982:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xee:0x0](ffff936b5396c2c8), flags 154400 00000002:00100000:1.0:1787191344.028714:0:57982:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513baa00 x1874004626863616/t8589937262(8589937262) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191360 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:1.0:1787191344.028765:0:57982:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483b024 from it ffff936b60dc4900 00010000:00010000:1.0:1787191344.028770:0:57982:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483b024 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607d7b expref: -99 pid: 57982 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191344.028779:0:57982:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483b024 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607d7b expref: -99 pid: 57982 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191344.028800:0:57982:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xee:0x0](ffff936b5396c2c8), inode mode 81a4 mask 44 00000080:00200000:1.0:1787191344.028920:0:57982:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xee:0x0](ffff936b5396c2c8), inode mode 81a4 mask 4 00000080:00200000:1.0:1787191344.028928:0:57982:0:(xattr.c:744:ll_xattr_get()) VFS Op:inode=[0x200000405:0xee:0x0](ffff936b5396c2c8), xattr lov 00000080:00200008:1.0:1787191344.028954:0:57982:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xee:0x0](ffff936b5396c2c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1787191344.028960:0:57982:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xee:0x0](ffff936b5396c2c8),name=f70.sanity-flr 00000002:00010000:1.0:1787191344.028977:0:57982:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xee:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191344.028985:0:57982:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483b024 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607d7b expref: -99 pid: 57982 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191344.028995:0:57982:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483b024 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607d7b expref: -99 pid: 57982 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787191344.029014:0:57982:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191344.029020:0:57982:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xee:0x0](ffff936b5396c2c8) 00000080:00010000:1.0:1787191344.029023:0:57982:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xee:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483b024 00000080:00010000:1.0:1787191344.029026:0:57982:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483b024 from it ffffa3fb42b73cd8 00010000:00010000:1.0:1787191344.029029:0:57982:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483b024 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607d7b expref: -99 pid: 57982 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787191344.029033:0:57982:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483b024 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607d7b expref: -99 pid: 57982 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:1.0:1787191344.029047:0:57982:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xee:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0 00020000:00200000:1.0:1787191344.029055:0:57982:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xee:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:1.0:1787191344.029057:0:57982:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:1.0:1787191344.029060:0:57982:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xee:0x0] 00000008:00010000:1.0:1787191344.029073:0:57982:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:1.0:1787191344.029076:0:57982:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b44ca87b0, osc lock ffff936b46836e40, flags 0x400000400001002 00010000:00010000:1.0:1787191344.029102:0:57982:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483b02b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57982 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191344.029113:0:57982:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x400000400001000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483b02b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57982 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191344.029120:0:57982:0:(ldlm_request.c:1139:ldlm_cli_enqueue()) @@@ enqueue lock with no delay req@ffff936b453aaa00 x1874004626864256/t0(0) o101->lustre-OST0000-osc-ffff936b581fb000@192.168.202.101@tcp:28/4 lens 328/400 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000020:00200000:1.0:1787191344.029149:0:57982:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00000100:00100000:1.0:1787191344.029159:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787191344.029170:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b453aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626864256:192.168.202.101@tcp:101:lfs.0 00010000:00010000:1.0:1787191344.031092:0:2390:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483b02b lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57982 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191344.031116:0:2390:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483b02b lrc: 6/2,0 mode: --/PR res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607d89 expref: -99 pid: 57982 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191344.031129:0:2390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483b02b lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607d89 expref: -99 pid: 57982 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191344.031141:0:2390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483b02b lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607d89 expref: -99 pid: 57982 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:1.0:1787191344.031156:0:2390:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483b02b lrc: 5/2,0 mode: PR/PR res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607d89 expref: -99 pid: 57982 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00200000:1.0:1787191344.031168:0:2390:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000100:00100000:0.0:1787191344.031178:0:57980:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57980:1874004626864128:192.168.202.101@tcp:35:lfs.0 00010000:00010000:1.0:1787191344.031185:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483b02b lrc: 6/2,0 mode: PR/PR res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4607d89 expref: -99 pid: 57982 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191344.031193:0:2390:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483b02b lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4607d89 expref: -99 pid: 57982 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787191344.031200:0:2390:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483b02b lrc: 5/1,0 mode: PR/PR res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020000000000 nid: local remote: 0x7130d520e4607d89 expref: -99 pid: 57982 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191344.031204:0:57980:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a477480 x1874004626862976/t8589937260(8589937260) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191360 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1787191344.031208:0:2390:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483b02b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607d89 expref: -99 pid: 57982 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1787191344.031222:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b453aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626864256:192.168.202.101@tcp:101:lfs.0 00000080:00200000:2.0:1787191344.031316:0:57982:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xee:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191344.031323:0:57982:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509bb2e0 (ffff936b47a17908/0) at cl_lock_release():245 00000020:00010000:2.0:1787191344.031326:0:57982:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509bb2e0 (ffff936b47a17908/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191344.031331:0:57982:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b44ca87b0 (ffff936b47a176c8/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191344.031335:0:57982:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509bb2e0 (ffff936b47a17908/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191344.031338:0:57982:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b44ca87b0 (ffff936b47a17908/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191344.031374:0:57982:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xee:0x0] ignore/verify layout 0/1, layout version 3 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191344.031440:0:57982:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xee:0x0](ffff936b5396c2c8), flags 154000 00000002:00100000:2.0:1787191344.031483:0:57982:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513baa00 x1874004626863616/t8589937262(8589937262) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191360 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191344.031493:0:57982:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191344.031497:0:57982:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9c00 x1874004626864512/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191344.031513:0:57982:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57982:1874004626864512:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191344.031578:0:57982:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f300 going to sleep for 11 seconds 00000100:00100000:1.0:1787191344.032947:0:57982:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57982:1874004626864512:192.168.202.101@tcp:35:lfs.0 00000002:00100000:1.0:1787191344.032969:0:57982:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513baa00 x1874004626863616/t8589937262(8589937262) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191360 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:1.0:1787191344.033121:0:57982:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:1.0:1787191344.033135:0:57982:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1787191344.033146:0:57982:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191344.033155:0:57982:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191344.033160:0:57982:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1787191344.033164:0:57982:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:1.0:1787191344.033166:0:57982:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:1.0:1787191344.033172:0:57982:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b73bf8 00010000:00010000:1.0:1787191344.033175:0:57982:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1787191344.033180:0:57982:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:1.0:1787191344.033190:0:57982:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:1.0:1787191344.033194:0:57982:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:1.0:1787191344.033198:0:57982:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:1.0:1787191344.033200:0:57982:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=265 00000080:00200000:1.0:1787191344.033203:0:57982:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xee:0x0](ffff936b5396c2c8), inode mode 81a4 mask 44 00000080:00200008:1.0:1787191344.033209:0:57982:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xee:0x0](ffff936b5396c2c8), flags 154400 00000002:00010000:1.0:1787191344.033218:0:57982:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xee:0x0]) in obj [0x200000405:0xee:0x0], intent: open flags 0104240114401 00000080:00200000:3.0:1787191344.033474:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191344.033482:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191344.033488:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191344.033499:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191344.033503:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191344.033506:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191344.033508:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191344.033510:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:3.0:1787191344.033512:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191344.033517:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191344.033524:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191344.033526:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:3.0:1787191344.033528:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191344.033531:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:3.0:1787191344.033534:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xee:0x0](ffff936b5396c2c8), inode mode 81a4 mask 42 00000080:00200008:3.0:1787191344.033536:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xee:0x0](ffff936b5396c2c8), flags 101101 00000002:00010000:3.0:1787191344.033543:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xee:0x0]) in obj [0x200000405:0xee:0x0], intent: open|creat flags 04240101102 00010000:00010000:3.0:1787191344.033550:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483b024 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4607d7b expref: -99 pid: 57982 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1787191344.033564:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xee:0x0]: losing layout lock 00010000:00010000:3.0:1787191344.033594:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483b024 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607d7b expref: -99 pid: 57982 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191344.033605:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191344.033608:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184600/0xe5129dc88483b024 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607d7b expref: -99 pid: 57982 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1787191344.033638:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483b032 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xee:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191344.033643:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483b032 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xee:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1787191344.033650:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1787191344.033654:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1dc00 x1874004626864768/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1787191344.033660:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483b032 lrc: 3/0,1 mode: --/CW res: [0x200000405:0xee:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191344.033672:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626864768:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191344.033804:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191344.037470:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1dc00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626864768:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191344.037498:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483b032 lrc: 4/0,1 mode: --/CW res: [0x200000405:0xee:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607d97 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191344.037514:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483b032 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xee:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607d97 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191344.037525:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483b032 lrc: 4/0,1 mode: CW/CW res: [0x200000405:0xee:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607d97 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191344.037546:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x200002b, status=0 req@ffff936b51d1dc00 x1874004626864768/t8589937266(8589937266) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191360 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1787191344.037561:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1dc00 x1874004626864768/t8589937266(8589937266) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191360 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191344.037575:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483b032 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xee:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607d97 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:3.0:1787191344.037600:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483b032 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xee:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607d97 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191344.037612:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 8 res 8589935621/238 (0 0) 00000080:00200000:3.0:1787191344.037618:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000405:0xee:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1787191344.037682:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xee:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:3.0:1787191344.037688:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xee:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483b032 00000080:00010000:3.0:1787191344.037694:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483b032 from it ffffa3fb41cabbf0 00010000:00010000:3.0:1787191344.037699:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483b032 lrc: 3/0,1 mode: CW/CW res: [0x200000405:0xee:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607d97 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191344.037708:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483b032 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xee:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607d97 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000002:00100000:3.0:1787191344.037736:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b51d1dc00 x1874004626864768/t8589937266(8589937266) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191360 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191344.037797:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xee:0x0], intent: getxattr flags 0 00010000:00010000:3.0:1787191344.037866:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483b039 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xee:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191344.037875:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483b039 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xee:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191344.037884:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483b039 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xee:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191344.037904:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626864896:192.168.202.101@tcp:101:bash.0 00000100:00100000:3.0:1787191344.037973:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191344.040767:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626864896:192.168.202.101@tcp:101:bash.0 00010000:00010000:3.0:1787191344.040792:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483b039 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xee:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607dac expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191344.040807:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483b039 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607dac expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191344.040819:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483b039 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607dac expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1787191344.040856:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b51d1c700 x1874004626864896/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191360 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1787191344.040868:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483b039 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607dac expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191344.040879:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/238 (0 0) 00000080:00200000:3.0:1787191344.040885:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xee:0x0] suppgids 0 -1: rc 0 00000080:00010000:3.0:1787191344.040909:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xee:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483b039 00000080:00010000:3.0:1787191344.040917:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483b039 from it ffffa3fb41caba38 00010000:00010000:3.0:1787191344.040921:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483b039 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607dac expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191344.040931:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483b039 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607dac expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:3.0:1787191344.040967:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xee:0x0](ffff936b5396c2c8) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191344.000000000, mtime 1787191344.000000000, ctime 1787191344.000000000 00010000:00010000:3.0:1787191344.040997:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483b032 lrc: 2/0,0 mode: CW/CW res: [0x200000405:0xee:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4607d97 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191344.041032:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xee:0x0]: losing layout lock 00010000:00010000:3.0:1787191344.041068:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483b032 lrc: 1/0,0 mode: --/CW res: [0x200000405:0xee:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607d97 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191344.041075:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191344.041078:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b400/0xe5129dc88483b032 lrc: 0/0,0 mode: --/CW res: [0x200000405:0xee:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607d97 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:3.0:1787191344.041096:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1787191344.041103:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b51d1c700 x1874004626865152/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787191344.041122:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626865152:192.168.202.101@tcp:36:bash.0 00000100:00100000:3.0:1787191344.041193:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191344.044182:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1c700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626865152:192.168.202.101@tcp:36:bash.0 00000080:00200000:2.0:1787191344.044269:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:2.0:1787191344.044276:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xee:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00010000:00010000:2.0:1787191344.044294:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/238 (0 0) 00000080:00010000:2.0:1787191344.044306:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xee:0x0](ffff936b5396c2c8) 00000002:00010000:2.0:1787191344.044316:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xee:0x0]) in obj [0x200000405:0xee:0x0], intent: layout flags 0 00010000:00010000:2.0:1787191344.044352:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483b040 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xee:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.044357:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483b040 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.044364:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483b040 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191344.044378:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8a80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626865280:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191344.044452:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787191344.046178:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8a80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626865280:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191344.046202:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483b040 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607dba expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.046215:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483b040 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607dba expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191344.046232:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b513b8a80 x1874004626865280/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191360 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191344.046243:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483b040 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607dba expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191344.046255:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483b040 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607dba expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.046265:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/238 (0 0) 00000080:00200000:0.0:1787191344.046270:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xee:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191344.046285:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xee:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483b040 00000080:00010000:0.0:1787191344.046292:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483b040 from it ffffa3fb41cab8c8 00010000:00010000:0.0:1787191344.046296:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483b040 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607dba expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.046305:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483b040 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607dba expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.046324:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483b040 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xee:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607dba expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.046334:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483b040 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607dba expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1787191344.046343:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xee:0x0](0000000089668027) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483b040 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607dba expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191344.046385:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xee:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:0.0:1787191344.046390:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483b040 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607dba expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.046397:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483b040 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607dba expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:0.0:1787191344.046411:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xee:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:0.0:1787191344.046418:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xee:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191344.046421:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xee:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:0.0:1787191344.046428:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xee:0x0](ffff936b5396c2c8) 00000002:00010000:0.0:1787191344.046435:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xee:0x0]) in obj [0x200000405:0xee:0x0], intent: layout flags 02 00010000:00010000:0.0:1787191344.046448:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483b040 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xee:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4607dba expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191344.046460:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xee:0x0]: losing layout lock 00010000:00010000:0.0:1787191344.046483:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483b040 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607dba expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191344.046489:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191344.046492:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185200/0xe5129dc88483b040 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607dba expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191344.046511:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483b047 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xee:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.046517:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483b047 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191344.046526:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191344.046532:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474a80 x1874004626865536/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191344.046542:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483b047 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191344.046558:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626865536:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191344.046619:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787191344.059311:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191344.059344:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191344.059369:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191344.059399:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634946048 00000100:00100000:2.0:1787191344.059408:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634946048 00000100:00100000:2.0:1787191344.059446:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634946176 00000100:00100000:2.0:1787191344.059450:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634946176 00000100:00100000:2.0:1787191344.059460:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634946304 00000100:00100000:2.0:1787191344.059462:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634946304 00000100:00100000:2.0:1787191344.059475:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1516 00000100:00100000:2.0:1787191344.059484:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+6:30511:x1874004634946048:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191344.059502:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001f958678/0xe5129dc88483af9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000030000 nid: local remote: 0x7130d520e4607bbb expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191344.059572:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191344.059578:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+6:30511:x1874004634946048:12345-192.168.202.101@tcp:104: Request processed in 95us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191344.059586:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1516 00000100:00100000:2.0:1787191344.059605:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1517 00000100:00100000:2.0:1787191344.059611:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+5:37089:x1874004634946176:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191344.059619:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:2.0:1787191344.059648:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787191344.059653:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+5:37089:x1874004634946176:12345-192.168.202.101@tcp:104: Request processed in 43us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191344.059660:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1517 00000100:00100000:2.0:1787191344.059671:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1518 00000100:00100000:2.0:1787191344.059677:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:29543:x1874004634946304:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191344.059685:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483afc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4607c40 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191344.059714:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787191344.059719:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:29543:x1874004634946304:12345-192.168.202.101@tcp:104: Request processed in 43us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191344.059726:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1518 00010000:00010000:2.0:1787191344.059740:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787191344.059746:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001f958678/0xe5129dc88483af9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000030000 nid: local remote: 0x7130d520e4607bbb expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191344.059755:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b43adf800 already unused, calling callback (ffffffffc1208790) 00010000:00010000:2.0:1787191344.059760:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001f958678/0xe5129dc88483af9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400030000 nid: local remote: 0x7130d520e4607bbb expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191344.059806:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001f958678/0xe5129dc88483af9f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e4607bbb expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191344.059815:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191344.059857:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001f958678/0xe5129dc88483af9f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e4607bbb expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191344.059867:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000001f958678/0xe5129dc88483af9f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400030020 nid: local remote: 0x7130d520e4607bbb expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191344.059886:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787191344.059890:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:2.0:1787191344.059897:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b47a7e600 already unused, calling callback (ffffffffc1208790) 00010000:00010000:2.0:1787191344.059901:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:2.0:1787191344.059920:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:2.0:1787191344.059927:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191344.059933:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:2.0:1787191344.059946:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000037497fa4/0xe5129dc88483af28 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4607a5d expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 11 lru_type: 1 00010000:00010000:2.0:1787191344.059959:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787191344.059962:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483afc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4607c40 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191344.059968:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b43adec00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:2.0:1787191344.059972:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483afc9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4607c40 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191344.059989:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483afc9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4607c40 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191344.059996:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191344.060014:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483afc9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4607c40 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191344.060022:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 00000000043645d6/0xe5129dc88483afc9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4607c40 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787191344.060035:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191344.060036:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191344.060038:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191344.060049:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191344.060055:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191344.060067:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626865664:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191344.060118:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626865920:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191344.060144:0:2392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787191344.060150:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626865792:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191344.060372:0:57570:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589937269 gen 1 00000100:00100000:0.0:1787191344.063685:0:57570:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b51d1dc00 x1874004626864768/t8589937266(8589937266) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191360 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787191344.063710:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626865536:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191344.063731:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483b047 lrc: 4/0,1 mode: --/EX res: [0x200000405:0xee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607dc8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.063742:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483b047 lrc: 4/0,1 mode: --/CR res: [0x200000405:0xee:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607dc8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.063754:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483b047 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xee:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607dc8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.063765:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483b047 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xee:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607dc8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.063778:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483b047 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xee:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607dc8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.063787:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483b047 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xee:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607dc8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.063795:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483b047 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xee:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607dc8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191344.063805:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b6a474a80 x1874004626865536/t8589937269(8589937269) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191360 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191344.063827:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483b047 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xee:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607dc8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191344.063892:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483b047 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xee:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607dc8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.063904:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/238 (0 0) 00000080:00200000:0.0:1787191344.063910:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xee:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191344.063924:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xee:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483b047 00000080:00010000:0.0:1787191344.063932:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483b047 from it ffffa3fb41cab930 00010000:00010000:0.0:1787191344.063936:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483b047 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xee:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607dc8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.063945:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483b047 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xee:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607dc8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191344.063963:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:0.0:1787191344.063970:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xee:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:0.0:1787191344.063985:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483b047 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xee:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607dc8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.063996:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483b047 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xee:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607dc8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1787191344.064015:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xee:0x0](0000000089668027) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483b047 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xee:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607dc8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.064056:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483b047 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xee:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607dc8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.064065:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483b047 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xee:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607dc8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191344.064079:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xee:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191344.064088:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xee:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191344.064092:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191344.064098:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191344.064109:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191344.064127:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xee:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:0.0:1787191344.064139:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483b047 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xee:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607dc8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191344.064148:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483b047 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xee:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607dc8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:0.0:1787191344.064156:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xee:0x0](0000000089668027) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483b047 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xee:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607dc8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191344.064173:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xee:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191344.064176:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xee:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191344.064178:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191344.064180:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191344.064182:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191344.064186:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xee:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000008:00010000:0.0:1787191344.064196:0:57570:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 0 0 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483b02b lrc: 1/0,0 mode: PR/PR res: [0x280000401:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020000000000 nid: local remote: 0x7130d520e4607d89 expref: -99 pid: 57982 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191344.064246:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xee:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:0.0:1787191344.064249:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483b047 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xee:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607dc8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191344.064254:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483b047 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xee:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607dc8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00020000:00200000:0.0:1787191344.064261:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xee:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:0.0:1787191344.064263:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xee:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191344.064265:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191344.064268:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191344.064277:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191344.064280:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:0.0:1787191344.064291:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:0.0:1787191344.064295:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f99db0, osc lock ffff936b50b62130, flags 0x80000000 00000008:00010000:0.0:1787191344.064298:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:0.0:1787191344.064300:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f99df0, osc lock ffff936b50b638f0, flags 0x80000000 00010000:00010000:0.0:1787191344.064309:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b52377800 type 11 mode 2 res 10737419265/488 (0 1048575) 00010000:00010000:0.0:1787191344.064340:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001f3cf24d/0xe5129dc88483b04e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.064346:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001f3cf24d/0xe5129dc88483b04e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.064353:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001f3cf24d/0xe5129dc88483b04e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191344.064369:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626866048:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191344.064515:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99000 going to sleep for 11 seconds 00000100:00100000:2.0:1787191344.065885:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191344.066014:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191344.066038:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191344.066106:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626865664:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191344.066137:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634947200 00000100:00100000:2.0:1787191344.066149:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634947200 00000100:00100000:2.0:1787191344.066183:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634947328 00000100:00100000:2.0:1787191344.066186:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634947328 00000100:00100000:2.0:1787191344.066196:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634947456 00000100:00100000:2.0:1787191344.066198:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634947456 00000100:00100000:2.0:1787191344.066212:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1519 00000100:00100000:2.0:1787191344.066220:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+6:8420:x1874004634947200:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191344.066234:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483afd0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4607c4e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191344.066346:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191344.066353:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+6:8420:x1874004634947200:12345-192.168.202.101@tcp:104: Request processed in 133us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191344.066360:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1519 00000100:00100000:2.0:1787191344.066384:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1520 00000100:00100000:2.0:1787191344.066390:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+5:8419:x1874004634947328:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191344.066412:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a86cc8f2/0xe5129dc88483af98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4607bb4 expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1787191344.066551:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1521 00000100:00100000:3.0:1787191344.066560:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+5:30353:x1874004634947456:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191344.066569:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aecd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4607953 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.067189:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787191344.067197:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483afd0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4607c4e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.067206:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b43adee00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191344.067211:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483afd0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4607c4e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.067251:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483afd0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4607c4e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.067259:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191344.067293:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483afd0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4607c4e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.067301:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000e9deb721/0xe5129dc88483afd0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4607c4e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.067327:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787191344.067330:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a86cc8f2/0xe5129dc88483af98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4607bb4 expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.067337:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b43ade800 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191344.067340:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a86cc8f2/0xe5129dc88483af98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e4607bb4 expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.067360:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a86cc8f2/0xe5129dc88483af98 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4607bb4 expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.067367:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191344.067373:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a86cc8f2/0xe5129dc88483af98 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4607bb4 expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.067380:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a86cc8f2/0xe5129dc88483af98 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4607bb4 expref: -99 pid: 57974 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.067535:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191344.067540:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aecd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4607953 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.067547:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030600 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191344.067550:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aecd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4607953 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.067574:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aecd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4607953 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.067581:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191344.067586:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aecd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4607953 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.067592:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001c20128a/0xe5129dc88483aecd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4607953 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.067606:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191344.067607:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191344.067609:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191344.067626:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626866176:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191344.067677:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626866432:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191344.067706:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787191344.067712:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626866304:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787191344.067842:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1787191344.067851:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+5:8419:x1874004634947328:12345-192.168.202.101@tcp:104: Request processed in 1460us (1836us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191344.067859:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1520 00000100:00100000:2.0:1787191344.068097:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626865792:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191344.068107:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626865920:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787191344.068539:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1787191344.068549:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:30353:x1874004634947456:12345-192.168.202.101@tcp:104: Request processed in 1989us (2509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191344.068556:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1521 00000100:00100000:3.0:1787191344.068610:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191344.068637:0:51131:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787191344.068648:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634947584 00000100:00100000:3.0:1787191344.068654:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634947584 00000100:00100000:3.0:1787191344.068688:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1522 00000100:00100000:3.0:1787191344.068695:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b4121c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8422:x1874004634947584:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191344.068707:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483b02b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4607d89 expref: -99 pid: 57982 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191344.068748:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191344.068753:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b4121c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:8422:x1874004634947584:12345-192.168.202.101@tcp:104: Request processed in 59us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191344.068760:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1522 00010000:00010000:2.0:1787191344.068916:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787191344.068923:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483b02b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420000010000 nid: local remote: 0x7130d520e4607d89 expref: -99 pid: 57982 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191344.068931:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51fe0a00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:2.0:1787191344.068936:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483b02b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428400010000 nid: local remote: 0x7130d520e4607d89 expref: -99 pid: 57982 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191344.068966:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483b02b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4607d89 expref: -99 pid: 57982 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191344.068974:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191344.068994:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483b02b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4607d89 expref: -99 pid: 57982 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191344.069012:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000bfd97e96/0xe5129dc88483b02b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29400010020 nid: local remote: 0x7130d520e4607d89 expref: -99 pid: 57982 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191344.069026:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191344.069027:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191344.069029:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191344.069035:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191344.069041:0:2392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787191344.069051:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626866560:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787191344.069214:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191344.073514:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:0.0:1787191344.073552:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626866304:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191344.073565:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626866176:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191344.073573:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626866432:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191344.073627:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626866048:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191344.073652:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001f3cf24d/0xe5129dc88483b04e lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e4607e07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.073668:0:57570:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001f3cf24d/0xe5129dc88483b04e lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4607e07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.073676:0:57570:0:(ldlm_request.c:327:ldlm_completion_ast()) ### waiting indefinitely because of NO_TIMEOUT ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001f3cf24d/0xe5129dc88483b04e lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4607e07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191344.073776:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634947712 00000100:00100000:3.0:1787191344.073784:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634947712 00000100:00100000:3.0:1787191344.073859:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1523 00000100:00100000:3.0:1787191344.073868:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b513bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:9508:x1874004634947712:12345-192.168.202.101@tcp:105: 00010000:00010000:3.0:1787191344.073878:0:51131:0:(ldlm_lockd.c:2534:ldlm_callback_handler()) ### completion ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001f3cf24d/0xe5129dc88483b04e lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4607e07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191344.073892:0:51131:0:(ldlm_lockd.c:1975:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001f3cf24d/0xe5129dc88483b04e lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4607e07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191344.073901:0:51131:0:(ldlm_lockd.c:2052:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001f3cf24d/0xe5129dc88483b04e lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e4607e07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191344.073911:0:51131:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001f3cf24d/0xe5129dc88483b04e lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080080020000 nid: local remote: 0x7130d520e4607e07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191344.073920:0:51131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001f3cf24d/0xe5129dc88483b04e lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10080080020000 nid: local remote: 0x7130d520e4607e07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191344.073929:0:51131:0:(ldlm_lockd.c:2080:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001f3cf24d/0xe5129dc88483b04e lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80080020000 nid: local remote: 0x7130d520e4607e07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191344.073958:0:51131:0:(ldlm_lockd.c:2091:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff936b43adea00) 00010000:00010000:0.0:1787191344.074015:0:57570:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001f3cf24d/0xe5129dc88483b04e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4607e07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191344.074022:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b513bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:9508:x1874004634947712:12345-192.168.202.101@tcp:105: Request processed in 155us (518us total) trans 0 rc 0/0 00010000:00010000:0.0:1787191344.074025:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001f3cf24d/0xe5129dc88483b04e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80020000 nid: local remote: 0x7130d520e4607e07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191344.074029:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1523 00010000:00010000:0.0:1787191344.074039:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001f3cf24d/0xe5129dc88483b04e lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080020000 nid: local remote: 0x7130d520e4607e07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191344.074051:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001f3cf24d/0xe5129dc88483b04e lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080020000 nid: local remote: 0x7130d520e4607e07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.074061:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001f3cf24d/0xe5129dc88483b04e lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4607e07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.074069:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001f3cf24d/0xe5129dc88483b04e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4607e07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.074133:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c3917ae/0xe5129dc88483b055 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.074142:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c3917ae/0xe5129dc88483b055 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.074153:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c3917ae/0xe5129dc88483b055 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191344.074171:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626866688:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191344.074214:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99000 going to sleep for 11 seconds 00000100:00100000:0.0:1787191344.076071:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626866688:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191344.076105:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c3917ae/0xe5129dc88483b055 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607e0e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.076124:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c3917ae/0xe5129dc88483b055 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4607e0e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.076136:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c3917ae/0xe5129dc88483b055 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4607e0e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.076148:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c3917ae/0xe5129dc88483b055 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4607e0e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191344.076161:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c3917ae/0xe5129dc88483b055 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4607e0e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.076174:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c3917ae/0xe5129dc88483b055 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607e0e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.076182:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c3917ae/0xe5129dc88483b055 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607e0e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191344.076274:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626866816:192.168.202.101@tcp:10:bash.0 00000100:00100000:0.0:1787191344.076375:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626866944:192.168.202.101@tcp:10:bash.0 00000100:00100000:2.0:1787191344.076733:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626866560:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191344.083130:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626866944:192.168.202.101@tcp:10:bash.0 00000100:00100000:0.0:1787191344.083229:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626866816:192.168.202.101@tcp:10:bash.0 00000080:00200000:2.0:1787191344.083331:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xee:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191344.083339:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b628947b8 (ffff936b47a17998/0) at cl_lock_release():245 00000020:00010000:2.0:1787191344.083343:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b628947b8 (ffff936b47a17998/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191344.083348:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99db0 (ffff936b47a17bd8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191344.083358:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001f3cf24d/0xe5129dc88483b04e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4607e07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.083374:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001f3cf24d/0xe5129dc88483b04e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4607e07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191344.083391:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99df0 (ffff936b47a171b8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191344.083396:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c3917ae/0xe5129dc88483b055 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607e0e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.083405:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c3917ae/0xe5129dc88483b055 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607e0e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191344.083421:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b628947b8 (ffff936b47a17998/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191344.083424:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99db0 (ffff936b47a17998/1) at cl_lock_fini():72 00000020:00010000:2.0:1787191344.083429:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99df0 (ffff936b47a17998/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191344.083469:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xee:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191344.083674:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xee:0x0](ffff936b5396c2c8) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191344.000000000, mtime 1787191344.000000000, ctime 1787191344.000000000, rc 0 00000080:00200008:2.0:1787191344.083776:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xee:0x0], ppos: 0, count: 5 00000080:00200000:2.0:1787191344.083788:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191344.083794:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:2.0:1787191344.083799:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:2.0:1787191344.083804:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1787191344.083810:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@0000000031acd956[0x110, 1, [0x200000405:0xee:0x0] hash] 00000020:00200000:2.0:1787191344.083812:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:2.0:1787191344.083816:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xee:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:2.0:1787191344.083917:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xee:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:2.0:1787191344.083923:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xee:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191344.083926:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1787191344.083931:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1787191344.083940:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:2.0:1787191344.083943:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1787191344.083959:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:2.0:1787191344.083973:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1787191344.083978:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1a30, osc lock ffff936b44e62f70, flags 0x0 00010000:00010000:2.0:1787191344.083995:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001f3cf24d/0xe5129dc88483b04e lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4607e07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191344.084019:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001f3cf24d/0xe5129dc88483b04e lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4607e07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191344.084037:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001f3cf24d/0xe5129dc88483b04e lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4607e07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191344.084046:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001f3cf24d/0xe5129dc88483b04e lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4607e07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191344.084054:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001f3cf24d/0xe5129dc88483b04e lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4607e07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191344.084066:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:2.0:1787191344.084075:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191344.084146:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:2.0:1787191344.084155:0:57570:0:(rw26.c:927:ll_write_end()) page@00000000861c6314[3 0000000007a164b0 2 1 00000000dffde8bf 0 0 0] 00000080:00200000:2.0:1787191344.084159:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @0000000008e601bd 17ffffc0001001 3:0 ffff936b43a1ed20 0 lru 00000080:00200000:2.0:1787191344.084167:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@00000000643634db 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000a2a44f55 00000000a48fd6f2 > 3< 0 0 > 4< 0 0 8 437096448 - | - - - - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1787191344.084170:0:57570:0:(rw26.c:927:ll_write_end()) end page@00000000861c6314 00000080:00200000:2.0:1787191344.084171:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:2.0:1787191344.084175:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:2.0:1787191344.084194:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 00000000b6199c02 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001f3cf24d/0xe5129dc88483b04e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4607e07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191344.084214:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b5396c478, count 1, dirtied 1 00000080:00200000:2.0:1787191344.084218:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:2.0:1787191344.084221:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:2.0:1787191344.084234:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894a88 (ffff936b47a17bd8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191344.084237:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894a88 (ffff936b47a17bd8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191344.084240:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1a30 (ffff936b465cc368/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191344.084244:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001f3cf24d/0xe5129dc88483b04e lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4607e07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191344.084253:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001f3cf24d/0xe5129dc88483b04e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4607e07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:2.0:1787191344.084264:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894a88 (ffff936b47a17bd8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191344.084267:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1a30 (ffff936b47a17bd8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191344.084274:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:2.0:1787191344.084278:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1787191344.084283:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xee:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191344.084286:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:2.0:1787191344.084292:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xee:0x0] updating i_size 5 i_blocks 0 00000080:00200000:2.0:1787191344.084296:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:2.0:1787191344.084315:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xee:0x0](ffff936b5396c2c8), flags 100001 00000002:00100000:2.0:1787191344.084373:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b51d1dc00 x1874004626864768/t8589937266(8589937266) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191360 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191344.084386:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191344.084392:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9f80 x1874004626867200/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191344.084411:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626867200:192.168.202.101@tcp:35:bash.0 00000100:00100000:2.0:1787191344.084732:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191344.092433:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626867200:192.168.202.101@tcp:35:bash.0 00000002:00100000:2.0:1787191344.092473:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b51d1dc00 x1874004626864768/t8589937266(8589937266) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191360 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191344.099698:0:57983:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191344.099729:0:57983:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191344.099746:0:57983:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191344.099762:0:57983:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191344.099771:0:57983:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191344.099778:0:57983:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191344.099782:0:57983:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191344.099790:0:57983:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b53b58 00010000:00010000:3.0:1787191344.099794:0:57983:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191344.099802:0:57983:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191344.099819:0:57983:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191344.099827:0:57983:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:3.0:1787191344.099903:0:57983:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191344.099916:0:57983:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:3.0:1787191344.099921:0:57983:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:3.0:1787191344.099933:0:57983:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1787191344.099981:0:57983:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483b05c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191344.099990:0:57983:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483b05c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57983 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191344.100227:0:57983:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483b05c lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57983 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191344.100252:0:57983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1e680 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57983:1874004626867328:192.168.202.101@tcp:101:rm.0 00000100:00100000:3.0:1787191344.100451:0:57983:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787191344.102788:0:57983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1e680 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57983:1874004626867328:192.168.202.101@tcp:101:rm.0 00010000:00010000:2.0:1787191344.102812:0:57983:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483b05c lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607e2a expref: -99 pid: 57983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.102853:0:57983:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483b05c lrc: 4/1,0 mode: --/PR res: [0x200000405:0xee:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607e2a expref: -99 pid: 57983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.102862:0:57983:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483b05c lrc: 4/1,0 mode: --/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607e2a expref: -99 pid: 57983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.102873:0:57983:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483b05c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607e2a expref: -99 pid: 57983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.102885:0:57983:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483b05c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607e2a expref: -99 pid: 57983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.102898:0:57983:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483b05c lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607e2a expref: -99 pid: 57983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.102905:0:57983:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483b05c lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607e2a expref: -99 pid: 57983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.102912:0:57983:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483b05c lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607e2a expref: -99 pid: 57983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191344.102923:0:57983:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b51d1e680 x1874004626867328/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/976 e 0 to 0 dl 1787191360 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191344.102934:0:57983:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483b05c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607e2a expref: -99 pid: 57983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191344.102950:0:57983:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483b05c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607e2a expref: -99 pid: 57983 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.102959:0:57983:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/238 (0 0) 00000080:00200000:2.0:1787191344.102966:0:57983:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191344.103030:0:57983:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xee:0x0](ffff936b5396c2c8): rc = 0 00000080:00200000:2.0:1787191344.103047:0:57983:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xee:0x0]: layout version change: 4 -> 4 00000080:00010000:2.0:1787191344.103052:0:57983:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xee:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483b05c 00000080:00010000:2.0:1787191344.103065:0:57983:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xee:0x0](ffff936b5396c2c8) 00000080:00010000:2.0:1787191344.103069:0:57983:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483b05c from it ffffa3fb42b53b20 00010000:00010000:2.0:1787191344.103072:0:57983:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483b05c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607e2a expref: -99 pid: 57983 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.103081:0:57983:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483b05c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607e2a expref: -99 pid: 57983 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200008:2.0:1787191344.103121:0:57983:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xee:0x0](ffff936b5396c2c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1787191344.103128:0:57983:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xee:0x0](ffff936b5396c2c8),name=f70.sanity-flr 00000002:00010000:2.0:1787191344.103150:0:57983:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xee:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191344.103159:0:57983:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483b05c lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607e2a expref: -99 pid: 57983 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191344.103170:0:57983:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483b05c lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607e2a expref: -99 pid: 57983 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191344.103177:0:57983:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191344.103183:0:57983:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xee:0x0](ffff936b5396c2c8) 00000080:00010000:2.0:1787191344.103186:0:57983:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xee:0x0](ffff936b5396c2c8) for lock 0xe5129dc88483b05c 00000080:00010000:2.0:1787191344.103189:0:57983:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483b05c from it ffffa3fb42b53cb8 00010000:00010000:2.0:1787191344.103193:0:57983:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483b05c lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607e2a expref: -99 pid: 57983 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191344.103199:0:57983:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483b05c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607e2a expref: -99 pid: 57983 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191344.103218:0:57983:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xee:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:2.0:1787191344.103229:0:57983:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xee:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191344.103232:0:57983:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:2.0:1787191344.103236:0:57983:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xee:0x0] 00000008:00010000:2.0:1787191344.103254:0:57983:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:2.0:1787191344.103257:0:57983:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d1a30, osc lock ffff936b44e62f70, flags 0x400000400001002 00010000:00010000:2.0:1787191344.103281:0:57983:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001f3cf24d/0xe5129dc88483b04e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4607e07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191344.103293:0:57983:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001f3cf24d/0xe5129dc88483b04e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4607e07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:2.0:1787191344.103304:0:57983:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:2.0:1787191344.103307:0:57983:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001f3cf24d/0xe5129dc88483b04e lrc: 6/0,1 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080020000 nid: local remote: 0x7130d520e4607e07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191344.103314:0:57983:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001f3cf24d/0xe5129dc88483b04e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080020000 nid: local remote: 0x7130d520e4607e07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:2.0:1787191344.103328:0:57983:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:2.0:1787191344.103336:0:57983:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xee:0x0] updating i_size 5 i_blocks 0 00000020:00010000:2.0:1787191344.103342:0:57983:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509b9030 (ffff936b47a17bd8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191344.103345:0:57983:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509b9030 (ffff936b47a17bd8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191344.103348:0:57983:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d1a30 (ffff936b465cc368/1) at cl_lock_cancel():142 00000020:00010000:2.0:1787191344.103351:0:57983:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509b9030 (ffff936b47a17bd8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191344.103354:0:57983:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d1a30 (ffff936b47a17bd8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191344.103365:0:57983:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xee:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191344.103412:0:57983:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191344.103421:0:57983:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191344.103428:0:57983:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191344.103436:0:57983:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191344.103442:0:57983:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191344.103446:0:57983:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191344.103449:0:57983:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191344.103453:0:57983:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b53c10 00010000:00010000:2.0:1787191344.103456:0:57983:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191344.103463:0:57983:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191344.103475:0:57983:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191344.103482:0:57983:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191344.103486:0:57983:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191344.103492:0:57983:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:2.0:1787191344.103496:0:57983:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:2.0:1787191344.103500:0:57983:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:2.0:1787191344.103522:0:57983:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483b047 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xee:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4607dc8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191344.103536:0:57983:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xee:0x0]: losing layout lock 00010000:00010000:2.0:1787191344.103547:0:57983:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483b05c lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4607e2a expref: -99 pid: 57983 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191344.103556:0:57983:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xee:0x0]: losing layout lock 00010000:00010000:2.0:1787191344.103563:0:57983:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483b039 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xee:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4607dac expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191344.103611:0:57983:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483b047 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xee:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607dc8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191344.103619:0:57983:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483b05c lrc: 1/0,0 mode: --/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607e2a expref: -99 pid: 57983 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191344.103626:0:57983:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483b039 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xee:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4607dac expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191344.103632:0:57983:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:2.0:1787191344.103635:0:57983:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfa00/0xe5129dc88483b047 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xee:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607dc8 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191344.103649:0:57983:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a800/0xe5129dc88483b05c lrc: 0/0,0 mode: --/PR res: [0x200000405:0xee:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607e2a expref: -99 pid: 57983 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191344.103658:0:57983:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9a400/0xe5129dc88483b039 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xee:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4607dac expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:2.0:1787191344.103677:0:57983:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:2.0:1787191344.103685:0:57983:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9f80 x1874004626867584/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787191344.103707:0:57983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57983:1874004626867584:192.168.202.101@tcp:36:rm.0 00000100:00100000:2.0:1787191344.103784:0:57983:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191344.107600:0:57983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57983:1874004626867584:192.168.202.101@tcp:36:rm.0 00000080:00200000:2.0:1787191344.115706:0:57984:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191344.115740:0:57984:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191344.115758:0:57984:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191344.115775:0:57984:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191344.115784:0:57984:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191344.115792:0:57984:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191344.115796:0:57984:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191344.115804:0:57984:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42343b58 00010000:00010000:2.0:1787191344.115809:0:57984:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191344.115819:0:57984:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191344.115987:0:57984:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191344.115996:0:57984:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:2.0:1787191344.116015:0:57984:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191344.116028:0:57984:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:2.0:1787191344.116033:0:57984:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191344.116045:0:57984:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191344.116124:0:57984:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483b063 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.116132:0:57984:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483b063 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.116143:0:57984:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483b063 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191344.116169:0:57984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57984:1874004626867712:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191344.116301:0:57984:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191344.118649:0:57984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57984:1874004626867712:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191344.118671:0:57984:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483b063 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.118685:0:57984:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483b063 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.118697:0:57984:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483b063 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.118705:0:57984:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483b063 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.118714:0:57984:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483b063 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.118721:0:57984:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51185e00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191344.118726:0:57984:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483b063 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.118734:0:57984:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483b063 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.118742:0:57984:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483b063 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.118749:0:57984:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191344.118755:0:57984:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483b063 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.118762:0:57984:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185e00/0xe5129dc88483b063 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191344.118787:0:57984:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513bb480 x1874004626867712/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191360 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191344.118802:0:57984:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191344.119058:0:57984:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191344.119074:0:57984:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191344.119095:0:57984:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191344.119108:0:57984:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191344.119116:0:57984:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191344.119121:0:57984:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191344.119125:0:57984:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191344.119131:0:57984:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42343be8 00010000:00010000:2.0:1787191344.119135:0:57984:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191344.119143:0:57984:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191344.119157:0:57984:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191344.119164:0:57984:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000080:00200000:2.0:1787191344.119170:0:57984:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191344.119182:0:57984:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:2.0:1787191344.119187:0:57984:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191344.119198:0:57984:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191344.119239:0:57984:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483b06a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.119247:0:57984:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483b06a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.119262:0:57984:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483b06a lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191344.119283:0:57984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57984:1874004626867840:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191344.119355:0:57984:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191344.121203:0:57984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57984:1874004626867840:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191344.121218:0:57984:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483b06a lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.121229:0:57984:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483b06a lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.121236:0:57984:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483b06a lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.121242:0:57984:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483b06a lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.121249:0:57984:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483b06a lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.121255:0:57984:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51184000 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191344.121259:0:57984:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483b06a lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.121266:0:57984:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483b06a lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.121273:0:57984:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483b06a lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.121281:0:57984:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191344.121286:0:57984:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483b06a lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.121293:0:57984:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184000/0xe5129dc88483b06a lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191344.121314:0:57984:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513bb480 x1874004626867840/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191360 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191344.121328:0:57984:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191344.121415:0:57984:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191344.121429:0:57984:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191344.121439:0:57984:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191344.121450:0:57984:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191344.121457:0:57984:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191344.121462:0:57984:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191344.121465:0:57984:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191344.121470:0:57984:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42343b58 00010000:00010000:2.0:1787191344.121474:0:57984:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191344.121482:0:57984:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191344.121503:0:57984:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191344.121510:0:57984:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:2.0:1787191344.121518:0:57984:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:2.0:1787191344.121523:0:57984:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:2.0:1787191344.121534:0:57984:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191344.121541:0:57984:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 107 lru_type: 1 00010000:00010000:2.0:1787191344.121550:0:57984:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 107 lru_type: 1 00000002:00010000:2.0:1787191344.121561:0:57984:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191344.121612:0:57984:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483b071 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.121620:0:57984:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483b071 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.121629:0:57984:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483b071 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191344.121647:0:57984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57984:1874004626867968:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191344.121710:0:57984:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191344.124343:0:57984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57984:1874004626867968:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191344.124366:0:57984:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483b071 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607e7e expref: -99 pid: 57984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.124384:0:57984:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483b071 lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607e7e expref: -99 pid: 57984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.124403:0:57984:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483b071 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607e7e expref: -99 pid: 57984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.124416:0:57984:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483b071 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607e7e expref: -99 pid: 57984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.124429:0:57984:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483b071 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607e7e expref: -99 pid: 57984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.124437:0:57984:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483b071 lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607e7e expref: -99 pid: 57984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.124446:0:57984:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483b071 lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607e7e expref: -99 pid: 57984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191344.124458:0:57984:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b513bb480 x1874004626867968/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191360 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191344.124471:0:57984:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483b071 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607e7e expref: -99 pid: 57984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.124482:0:57984:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:2.0:1787191344.124489:0:57984:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483b071 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607e7e expref: -99 pid: 57984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.124503:0:57984:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483b071 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607e7e expref: -99 pid: 57984 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:2.0:1787191344.124531:0:57984:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191344.124543:0:57984:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 214 lru_type: 1 00010000:00010000:2.0:1787191344.124554:0:57984:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 214 lru_type: 1 00010000:00010000:2.0:1787191344.124563:0:57984:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 214 lru_type: 1 00010000:00010000:2.0:1787191344.124570:0:57984:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 215 lru_type: 1 00000080:00200000:2.0:1787191344.124592:0:57984:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1787191344.124602:0:57984:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:2.0:1787191344.124606:0:57984:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:2.0:1787191344.124612:0:57984:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb42343cb8 00010000:00010000:2.0:1787191344.124615:0:57984:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 107 lru_type: 1 00010000:00010000:2.0:1787191344.124624:0:57984:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 108 lru_type: 1 00000002:00010000:2.0:1787191344.124638:0:57984:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191344.124644:0:57984:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483b071 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607e7e expref: -99 pid: 57984 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191344.124652:0:57984:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483b071 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607e7e expref: -99 pid: 57984 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191344.124661:0:57984:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483b071 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607e7e expref: -99 pid: 57984 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191344.124668:0:57984:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483b071 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607e7e expref: -99 pid: 57984 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:2.0:1787191344.124676:0:57984:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191344.124681:0:57984:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 215 lru_type: 1 00010000:00010000:2.0:1787191344.124689:0:57984:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 215 lru_type: 1 00010000:00010000:2.0:1787191344.124697:0:57984:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 215 lru_type: 1 00010000:00010000:2.0:1787191344.124704:0:57984:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 216 lru_type: 1 00000080:00200008:2.0:1787191344.125501:0:57984:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:2.0:1787191344.125509:0:57984:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191344.125525:0:57984:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191344.125535:0:57984:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191344.125547:0:57984:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191344.125554:0:57984:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191344.125559:0:57984:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191344.125563:0:57984:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191344.125568:0:57984:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42343cb8 00010000:00010000:2.0:1787191344.125571:0:57984:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191344.125644:0:57984:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191344.125765:0:57984:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191344.125774:0:57984:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191344.125780:0:57984:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191344.125789:0:57984:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191344.125795:0:57984:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191344.125800:0:57984:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191344.125802:0:57984:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191344.125806:0:57984:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42343b58 00010000:00010000:2.0:1787191344.125809:0:57984:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191344.125817:0:57984:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191344.125827:0:57984:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191344.125932:0:57984:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191344.125938:0:57984:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191344.125958:0:57984:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:2.0:1787191344.125963:0:57984:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191344.125975:0:57984:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191344.126226:0:57984:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483b078 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.126235:0:57984:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483b078 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.126245:0:57984:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483b078 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191344.126269:0:57984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57984:1874004626868096:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191344.126401:0:57984:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191344.128323:0:57984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57984:1874004626868096:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191344.128343:0:57984:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483b078 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.128355:0:57984:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483b078 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.128366:0:57984:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483b078 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.128373:0:57984:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483b078 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.128383:0:57984:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483b078 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.128389:0:57984:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51185c00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191344.128402:0:57984:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483b078 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.128409:0:57984:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483b078 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.128416:0:57984:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483b078 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.128423:0:57984:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191344.128429:0:57984:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483b078 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.128436:0:57984:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185c00/0xe5129dc88483b078 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191344.129353:0:57984:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513bb480 x1874004626868096/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191360 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191344.129372:0:57984:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1787191344.129452:0:57984:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483b071 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607e7e expref: -99 pid: 57984 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191344.129467:0:57984:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483b071 lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607e7e expref: -99 pid: 57984 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:2.0:1787191344.129475:0:57984:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483b071 from it ffffa3fb42343930 00010000:00010000:2.0:1787191344.129479:0:57984:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483b071 lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607e7e expref: -99 pid: 57984 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191344.129487:0:57984:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483b071 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607e7e expref: -99 pid: 57984 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191344.129640:0:57984:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191344.129655:0:57984:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191344.129663:0:57984:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191344.129671:0:57984:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191344.129678:0:57984:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191344.129683:0:57984:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191344.129686:0:57984:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191344.129690:0:57984:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42343bf8 00010000:00010000:2.0:1787191344.129693:0:57984:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191344.129700:0:57984:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191344.129714:0:57984:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191344.129722:0:57984:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191344.129727:0:57984:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191344.129733:0:57984:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:2.0:1787191344.129737:0:57984:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:2.0:1787191344.129741:0:57984:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b52230c00, open_flags a141, mode 81b6 opened 0 00000080:00200000:2.0:1787191344.129749:0:57984:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:2.0:1787191344.129768:0:57984:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xef:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:2.0:1787191344.129779:0:57984:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483b071 lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4607e7e expref: -99 pid: 57984 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191344.129829:0:57984:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483b071 lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4607e7e expref: -99 pid: 57984 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191344.129897:0:57984:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191344.129900:0:57984:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185600/0xe5129dc88483b071 lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4607e7e expref: -99 pid: 57984 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191344.129938:0:57984:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483b07f lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.129946:0:57984:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483b07f lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191344.129958:0:57984:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191344.129969:0:57984:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb480 x1874004626868352/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191344.129984:0:57984:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483b07f lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191344.130014:0:57984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57984:1874004626868352:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191344.130509:0:57984:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191344.133430:0:57984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57984:1874004626868352:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191344.133457:0:57984:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483b07f lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607eaf expref: -99 pid: 57984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.133489:0:57984:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483b07f lrc: 4/0,1 mode: --/PR res: [0x200000405:0xef:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607eaf expref: -99 pid: 57984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.133498:0:57984:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483b07f lrc: 4/0,1 mode: --/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607eaf expref: -99 pid: 57984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.133510:0:57984:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483b07f lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607eaf expref: -99 pid: 57984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.133521:0:57984:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483b07f lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607eaf expref: -99 pid: 57984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.133534:0:57984:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483b07f lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607eaf expref: -99 pid: 57984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.133542:0:57984:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483b07f lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607eaf expref: -99 pid: 57984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.133554:0:57984:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483b07f lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607eaf expref: -99 pid: 57984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191344.133567:0:57984:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b513bb480 x1874004626868352/t8589937272(8589937272) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191360 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191344.133581:0:57984:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bb480 x1874004626868352/t8589937272(8589937272) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191360 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191344.133593:0:57984:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483b07f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607eaf expref: -99 pid: 57984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.133601:0:57984:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/239 (0 0) 00000080:00200000:2.0:1787191344.133608:0:57984:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191344.133619:0:57984:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:2.0:1787191344.133645:0:57984:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xef:0x0](ffff936b48989148) 00000080:00200000:2.0:1787191344.133651:0:57984:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xef:0x0], updating i_size 0 00000080:00200000:2.0:1787191344.133684:0:57984:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xef:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:2.0:1787191344.133690:0:57984:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xef:0x0](ffff936b48989148) 00000080:00010000:2.0:1787191344.133693:0:57984:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xef:0x0](ffff936b48989148) for lock 0xe5129dc88483b07f 00000080:00010000:2.0:1787191344.133702:0:57984:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xef:0x0](ffff936b48989148) 00000080:00200008:2.0:1787191344.133716:0:57984:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xef:0x0](ffff936b48989148), flags 120501 00000002:00100000:2.0:1787191344.133735:0:57984:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bb480 x1874004626868352/t8589937272(8589937272) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191360 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1787191344.133771:0:57984:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483b07f from it ffff936b60dc4c60 00010000:00010000:2.0:1787191344.133775:0:57984:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483b07f lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607eaf expref: -99 pid: 57984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.133785:0:57984:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483b07f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607eaf expref: -99 pid: 57984 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191344.133806:0:57984:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xef:0x0](ffff936b48989148), inode mode 81a4 mask 40 00000080:00200000:2.0:1787191344.133989:0:57984:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xef:0x0](ffff936b48989148), inode mode 81a4 mask 2 00000080:00200000:2.0:1787191344.134011:0:57984:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xef:0x0](ffff936b48989148), xattr lov 00000002:00010000:2.0:1787191344.134030:0:57984:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xef:0x0]) in obj [0x200000405:0xef:0x0], intent: open flags 040000002 00010000:00010000:2.0:1787191344.134072:0:57984:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483b086 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.134080:0:57984:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483b086 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xef:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191344.134089:0:57984:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191344.134097:0:57984:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9c00 x1874004626868608/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191344.134105:0:57984:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483b086 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xef:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191344.134125:0:57984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57984:1874004626868608:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191344.134282:0:57984:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787191344.135942:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191344.135985:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634947840 00000100:00100000:2.0:1787191344.135993:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634947840 00000100:00100000:2.0:1787191344.136062:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1524 00000100:00100000:2.0:1787191344.136072:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634947840:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191344.136087:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483b07f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4607eaf expref: -99 pid: 57984 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191344.136187:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191344.136194:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:12284:x1874004634947840:12345-192.168.202.101@tcp:104: Request processed in 124us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191344.136202:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1524 00010000:00010000:0.0:1787191344.136249:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191344.136257:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483b07f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4607eaf expref: -99 pid: 57984 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.136265:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51185000 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191344.136271:0:40930:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483b07f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4607eaf expref: -99 pid: 57984 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.136280:0:40930:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483b07f lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4607eaf expref: -99 pid: 57984 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.136288:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483b07f lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4607eaf expref: -99 pid: 57984 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191344.136313:0:40930:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xef:0x0]: losing layout lock 00010000:00010000:0.0:1787191344.136354:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483b07f lrc: 2/0,0 mode: --/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607eaf expref: -99 pid: 57984 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.136362:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191344.136384:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483b07f lrc: 1/0,0 mode: --/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607eaf expref: -99 pid: 57984 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.136391:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51185000/0xe5129dc88483b07f lrc: 0/0,0 mode: --/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607eaf expref: -99 pid: 57984 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.136418:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191344.136420:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191344.136422:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191344.136430:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787191344.136443:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626868736:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191344.140677:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626868736:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191344.141492:0:57984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57984:1874004626868608:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191344.141511:0:57984:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483b086 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xef:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.141526:0:57984:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483b086 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xef:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.141533:0:57984:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483b086 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xef:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.141540:0:57984:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483b086 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xef:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.141550:0:57984:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483b086 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xef:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.141556:0:57984:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51184400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191344.141561:0:57984:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483b086 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xef:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.141568:0:57984:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483b086 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xef:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.141580:0:57984:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483b086 lrc: 5/0,0 mode: --/CR res: [0x200000405:0xef:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.141588:0:57984:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191344.141594:0:57984:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483b086 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xef:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.141600:0:57984:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184400/0xe5129dc88483b086 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xef:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57984 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191344.141627:0:57984:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b513b9c00 x1874004626868608/t8589937273(8589937273) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191360 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191344.141641:0:57984:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9c00 x1874004626868608/t8589937273(8589937273) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191360 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191344.141657:0:57984:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xef:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1787191344.141703:0:57984:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xef:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1787191344.141711:0:57984:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xef:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191344.141763:0:57984:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xef:0x0], updating i_size 0 00000002:00100000:2.0:1787191344.141782:0:57984:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9c00 x1874004626868608/t8589937273(8589937273) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191360 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191344.141821:0:57984:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513b9c00 x1874004626868608/t8589937273(8589937273) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191360 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191344.141857:0:57984:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191344.141864:0:57984:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513baa00 x1874004626868992/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191344.141884:0:57984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57984:1874004626868992:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191344.141955:0:57984:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191344.143366:0:57984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57984:1874004626868992:192.168.202.101@tcp:35:lfs.0 00000002:00100000:2.0:1787191344.143404:0:57984:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513b9c00 x1874004626868608/t8589937273(8589937273) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191360 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:2.0:1787191344.143460:0:57984:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xef:0x0](ffff936b48989148), flags 100001 00000002:00100000:2.0:1787191344.143500:0:57984:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513bb480 x1874004626868352/t8589937272(8589937272) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191360 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191344.143510:0:57984:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191344.143515:0:57984:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b8700 x1874004626869248/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191344.143533:0:57984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57984:1874004626869248:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191344.143694:0:57984:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191344.145929:0:57984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57984:1874004626869248:192.168.202.101@tcp:35:lfs.0 00000002:00100000:2.0:1787191344.145962:0:57984:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513bb480 x1874004626868352/t8589937272(8589937272) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191360 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191344.147300:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191344.147325:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191344.147344:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191344.147359:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191344.147367:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191344.147374:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191344.147377:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191344.147385:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:0.0:1787191344.147389:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191344.147473:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191344.147489:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191344.147497:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191344.147503:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191344.147516:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:0.0:1787191344.147521:0:57570:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b483e7200, open_flags 8241, mode 81b6 opened 0 00000080:00200000:0.0:1787191344.147530:0:57570:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:0.0:1787191344.147550:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xf0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0101102 00010000:00010000:0.0:1787191344.147679:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483b08d lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.147688:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483b08d lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191344.147699:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191344.147711:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475180 x1874004626869504/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191344.147720:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483b08d lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191344.147741:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626869504:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191344.148015:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99000 going to sleep for 11 seconds 00000100:00100000:0.0:1787191344.153189:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626869504:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191344.153221:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483b08d lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607ee7 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.153253:0:57570:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483b08d lrc: 4/0,1 mode: --/PR res: [0x200000405:0xef:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607ee7 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.153263:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483b08d lrc: 4/0,1 mode: --/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607ee7 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.153274:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483b08d lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607ee7 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.153285:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483b08d lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607ee7 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.153298:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483b08d lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607ee7 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.153306:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483b08d lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607ee7 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.153313:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483b08d lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607ee7 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191344.153327:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x2b, status=0 req@ffff936b6a475180 x1874004626869504/t8589937276(8589937276) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191360 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191344.153341:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475180 x1874004626869504/t8589937276(8589937276) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191360 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191344.153354:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483b08d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607ee7 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191344.153366:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483b08d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607ee7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.153376:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/239 (0 0) 00000080:00200000:0.0:1787191344.153382:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191344.153439:0:57570:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xef:0x0](ffff936b48989148): rc = 0 00000080:00200000:0.0:1787191344.153455:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xef:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:0.0:1787191344.153460:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xef:0x0](ffff936b48989148) for lock 0xe5129dc88483b08d 00000080:00010000:0.0:1787191344.153471:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xef:0x0](ffff936b48989148) 00000080:00200008:0.0:1787191344.153496:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xef:0x0](ffff936b48989148), flags 101101 00000002:00100000:0.0:1787191344.153519:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475180 x1874004626869504/t8589937276(8589937276) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191360 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191344.153554:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483b08d from it ffff936b530f5000 00010000:00010000:0.0:1787191344.153559:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483b08d lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607ee7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.153569:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483b08d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607ee7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191344.153601:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xef:0x0](ffff936b48989148), inode mode 81a4 mask 42 00000002:00010000:0.0:1787191344.153629:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xef:0x0], intent: getxattr flags 0 00010000:00010000:0.0:1787191344.153667:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483b094 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.153675:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483b094 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xef:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.153683:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483b094 lrc: 3/1,0 mode: --/PR res: [0x200000405:0xef:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191344.153703:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626869632:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191344.153781:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99000 going to sleep for 11 seconds 00000100:00100000:0.0:1787191344.158097:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626869632:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191344.158126:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483b094 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xef:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607efc expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.158144:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483b094 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607efc expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.158155:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483b094 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607efc expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191344.158170:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b6a474700 x1874004626869632/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191360 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191344.158183:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483b094 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607efc expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.158193:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/239 (0 0) 00000080:00200000:0.0:1787191344.158200:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xef:0x0] suppgids 0 -1: rc 0 00000080:00010000:0.0:1787191344.158227:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xef:0x0](ffff936b48989148) for lock 0xe5129dc88483b094 00000080:00010000:0.0:1787191344.158235:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483b094 from it ffffa3fb41caba38 00010000:00010000:0.0:1787191344.158239:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483b094 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607efc expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.158249:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483b094 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607efc expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:0.0:1787191344.158285:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xef:0x0](ffff936b48989148) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191344.000000000, mtime 1787191344.000000000, ctime 1787191344.000000000 00010000:00010000:0.0:1787191344.158314:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483b08d lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4607ee7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191344.158332:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xef:0x0]: losing layout lock 00010000:00010000:0.0:1787191344.158373:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483b08d lrc: 1/0,0 mode: --/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607ee7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.158380:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191344.158383:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf600/0xe5129dc88483b08d lrc: 0/0,0 mode: --/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607ee7 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1787191344.158464:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1787191344.158472:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474700 x1874004626869888/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787191344.158495:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626869888:192.168.202.101@tcp:36:bash.0 00000100:00100000:0.0:1787191344.158574:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99000 going to sleep for 11 seconds 00000100:00100000:0.0:1787191344.165653:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626869888:192.168.202.101@tcp:36:bash.0 00000080:00200000:0.0:1787191344.165703:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:0.0:1787191344.165711:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xef:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00010000:00010000:0.0:1787191344.165728:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/239 (0 0) 00000080:00010000:0.0:1787191344.165741:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xef:0x0](ffff936b48989148) 00000002:00010000:0.0:1787191344.165750:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xef:0x0]) in obj [0x200000405:0xef:0x0], intent: layout flags 0 00010000:00010000:0.0:1787191344.165798:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483b09b lrc: 3/1,0 mode: --/CR res: [0x200000405:0xef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.165808:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483b09b lrc: 3/1,0 mode: --/CR res: [0x200000405:0xef:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.165818:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483b09b lrc: 3/1,0 mode: --/CR res: [0x200000405:0xef:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191344.165894:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626870016:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191344.166039:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99000 going to sleep for 11 seconds 00000100:00100000:0.0:1787191344.167930:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626870016:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191344.168028:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483b09b lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xef:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607f0a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.168043:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483b09b lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xef:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607f0a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191344.168058:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b6a477480 x1874004626870016/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191360 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191344.168070:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483b09b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xef:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607f0a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191344.168087:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483b09b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xef:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607f0a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.168097:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/239 (0 0) 00000080:00200000:0.0:1787191344.168103:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xef:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191344.168120:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xef:0x0](ffff936b48989148) for lock 0xe5129dc88483b09b 00000080:00010000:0.0:1787191344.168128:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483b09b from it ffffa3fb41cab8c8 00010000:00010000:0.0:1787191344.168131:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483b09b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xef:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607f0a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.168141:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483b09b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xef:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607f0a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.168164:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483b09b lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xef:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607f0a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.168175:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483b09b lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xef:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607f0a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1787191344.168183:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xef:0x0](000000005d342181) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483b09b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xef:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607f0a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191344.168225:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xef:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:0.0:1787191344.168232:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483b09b lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xef:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607f0a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.168239:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483b09b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xef:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607f0a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:0.0:1787191344.168255:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xef:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:0.0:1787191344.168262:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xef:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191344.168266:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xef:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:0.0:1787191344.168274:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xef:0x0](ffff936b48989148) 00000002:00010000:0.0:1787191344.168282:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xef:0x0]) in obj [0x200000405:0xef:0x0], intent: layout flags 02 00010000:00010000:0.0:1787191344.168295:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483b09b lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xef:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4607f0a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191344.168307:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xef:0x0]: losing layout lock 00010000:00010000:0.0:1787191344.168333:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483b09b lrc: 1/0,0 mode: --/CR res: [0x200000405:0xef:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607f0a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191344.168340:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191344.168343:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43ade600/0xe5129dc88483b09b lrc: 0/0,0 mode: --/CR res: [0x200000405:0xef:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607f0a expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191344.168366:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483b0a2 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.168374:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483b0a2 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xef:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191344.168384:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191344.168390:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477480 x1874004626870272/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191344.168567:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483b0a2 lrc: 3/0,1 mode: --/EX res: [0x200000405:0xef:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191344.168601:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626870272:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191344.168666:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99000 going to sleep for 11 seconds 00000100:00100000:3.0:1787191344.178208:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191344.178249:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191344.178286:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634948480 00000100:00100000:3.0:1787191344.178295:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634948480 00000100:00100000:3.0:1787191344.178338:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634949120 00000100:00100000:3.0:1787191344.178342:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634949120 00000100:00100000:3.0:1787191344.178360:0:40922:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1525 00000100:00100000:3.0:1787191344.178370:0:40922:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:29543:x1874004634948480:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191344.178388:0:40922:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c3917ae/0xe5129dc88483b055 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800420080010000 nid: local remote: 0x7130d520e4607e0e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:2.0:1787191344.178532:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1526 00000100:00100000:2.0:1787191344.178543:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8422:x1874004634949120:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191344.178552:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001f3cf24d/0xe5129dc88483b04e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420080030000 nid: local remote: 0x7130d520e4607e07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1787191344.178601:0:40922:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787191344.178608:0:40922:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:29543:x1874004634948480:12345-192.168.202.101@tcp:104: Request processed in 240us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191344.178616:0:40922:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1525 00010000:00010000:0.0:1787191344.179085:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787191344.179094:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c3917ae/0xe5129dc88483b055 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800420080010000 nid: local remote: 0x7130d520e4607e0e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.179104:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b43adf000 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191344.179111:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c3917ae/0xe5129dc88483b055 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800428480010000 nid: local remote: 0x7130d520e4607e0e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191344.179161:0:40929:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xee:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1787191344.179176:0:40929:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xee:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:0.0:1787191344.179221:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c3917ae/0xe5129dc88483b055 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x804c69480010020 nid: local remote: 0x7130d520e4607e0e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.179229:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191344.179250:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c3917ae/0xe5129dc88483b055 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x804c69480010020 nid: local remote: 0x7130d520e4607e0e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.179258:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000006c3917ae/0xe5129dc88483b055 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x804c69480010020 nid: local remote: 0x7130d520e4607e0e expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.179280:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191344.179283:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001f3cf24d/0xe5129dc88483b04e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800420080030000 nid: local remote: 0x7130d520e4607e07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191344.179295:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b43adea00 already unused, calling callback (ffffffffc1208790) 00010000:00010000:0.0:1787191344.179299:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001f3cf24d/0xe5129dc88483b04e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800428480030000 nid: local remote: 0x7130d520e4607e07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1787191344.179316:0:40929:0:(osc_cache.c:1183:osc_extent_make_ready()) ### extent: 00000000b6199c02 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001f3cf24d/0xe5129dc88483b04e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800429480030000 nid: local remote: 0x7130d520e4607e07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1787191344.179342:0:40929:0:(osc_cache.c:917:osc_extent_finish()) ### extent: 00000000b6199c02 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001f3cf24d/0xe5129dc88483b04e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800429480030000 nid: local remote: 0x7130d520e4607e07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1787191344.179364:0:40929:0:(osc_cache.c:497:__osc_extent_remove()) ### extent: 00000000b6199c02 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001f3cf24d/0xe5129dc88483b04e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800429480030000 nid: local remote: 0x7130d520e4607e07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191344.179375:0:40929:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xee:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1787191344.179502:0:40929:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xee:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:0.0:1787191344.179531:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001f3cf24d/0xe5129dc88483b04e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69480030020 nid: local remote: 0x7130d520e4607e07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191344.179539:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191344.179546:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001f3cf24d/0xe5129dc88483b04e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69480030020 nid: local remote: 0x7130d520e4607e07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191344.179553:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 000000001f3cf24d/0xe5129dc88483b04e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x804c69480030020 nid: local remote: 0x7130d520e4607e07 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191344.179575:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191344.179578:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191344.179579:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191344.179598:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626870400:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191344.179668:0:2390:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787191344.179675:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626870528:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787191344.180091:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1787191344.180100:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8422:x1874004634949120:12345-192.168.202.101@tcp:104: Request processed in 1559us (1849us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191344.180107:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1526 00010000:00010000:0.0:1787191344.180171:0:57627:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191344.184326:0:57570:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589937279 gen 1 00000100:00100000:2.0:1787191344.184417:0:57570:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b6a475180 x1874004626869504/t8589937276(8589937276) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191360 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1787191344.184434:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477480 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626870272:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191344.184435:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626870400:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191344.184453:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626870528:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787191344.184453:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483b0a2 lrc: 4/0,1 mode: --/EX res: [0x200000405:0xef:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607f18 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.184464:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483b0a2 lrc: 4/0,1 mode: --/CR res: [0x200000405:0xef:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607f18 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.184476:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483b0a2 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xef:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607f18 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.184487:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483b0a2 lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xef:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607f18 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.184500:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483b0a2 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xef:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607f18 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.184509:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483b0a2 lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xef:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607f18 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.184516:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483b0a2 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xef:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607f18 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191344.184526:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b6a477480 x1874004626870272/t8589937279(8589937279) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191360 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191344.184545:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483b0a2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xef:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607f18 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:2.0:1787191344.184556:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483b0a2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xef:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607f18 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.184567:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/239 (0 0) 00000080:00200000:2.0:1787191344.184574:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xef:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1787191344.184584:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xef:0x0](ffff936b48989148) for lock 0xe5129dc88483b0a2 00000080:00010000:2.0:1787191344.184592:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483b0a2 from it ffffa3fb41cab930 00010000:00010000:2.0:1787191344.184596:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483b0a2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xef:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607f18 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.184605:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483b0a2 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xef:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607f18 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191344.184621:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:2.0:1787191344.184628:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xef:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:2.0:1787191344.184642:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483b0a2 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xef:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607f18 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191344.184653:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483b0a2 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xef:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607f18 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:2.0:1787191344.184661:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xef:0x0](000000005d342181) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483b0a2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xef:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607f18 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191344.184701:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483b0a2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xef:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607f18 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191344.184715:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483b0a2 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xef:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607f18 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191344.184729:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xef:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191344.184739:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xef:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191344.184742:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191344.184749:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:2.0:1787191344.184781:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xef:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:2.0:1787191344.184793:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483b0a2 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xef:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607f18 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191344.184802:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483b0a2 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xef:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607f18 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:2.0:1787191344.184809:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xef:0x0](000000005d342181) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483b0a2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xef:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607f18 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787191344.184825:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xef:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191344.184851:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xef:0x0]: flr state: 1, move mirror from 1 to 1, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191344.184854:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191344.184857:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[2] flags 0x10 00000080:00200000:2.0:1787191344.184870:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xef:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191344.184939:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xef:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:2.0:1787191344.184956:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483b0a2 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xef:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607f18 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191344.184965:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483b0a2 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xef:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607f18 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00020000:00200000:2.0:1787191344.184978:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xef:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:2.0:1787191344.184982:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xef:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191344.184984:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:2.0:1787191344.184990:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1787191344.185010:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1787191344.185014:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:2.0:1787191344.185026:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:2.0:1787191344.185030:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b5338f870, osc lock ffff936b44e62f70, flags 0x80000000 00000008:00010000:2.0:1787191344.185034:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:2.0:1787191344.185035:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b5338f8b0, osc lock ffff936b44e62ab0, flags 0x80000000 00010000:00010000:2.0:1787191344.185078:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000061df71ff/0xe5129dc88483b0a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.185088:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000061df71ff/0xe5129dc88483b0a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.185098:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000061df71ff/0xe5129dc88483b0a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191344.185120:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626870656:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191344.185190:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787191344.186810:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626870656:192.168.202.101@tcp:101:bash.0 00010000:00010000:2.0:1787191344.186850:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000061df71ff/0xe5129dc88483b0a9 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607f3b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.186868:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000061df71ff/0xe5129dc88483b0a9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4607f3b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.186882:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000061df71ff/0xe5129dc88483b0a9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4607f3b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.186894:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000061df71ff/0xe5129dc88483b0a9 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4607f3b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1787191344.186907:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000061df71ff/0xe5129dc88483b0a9 lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4607f3b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.186918:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000061df71ff/0xe5129dc88483b0a9 lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607f3b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.186926:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000061df71ff/0xe5129dc88483b0a9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607f3b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.187067:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a31bda98/0xe5129dc88483b0b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.187076:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a31bda98/0xe5129dc88483b0b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.187084:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a31bda98/0xe5129dc88483b0b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191344.187102:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626870784:192.168.202.101@tcp:101:bash.0 00000100:00100000:2.0:1787191344.187200:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787191344.188723:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626870784:192.168.202.101@tcp:101:bash.0 00010000:00010000:2.0:1787191344.188744:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a31bda98/0xe5129dc88483b0b0 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607f42 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.188759:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a31bda98/0xe5129dc88483b0b0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4607f42 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.188772:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a31bda98/0xe5129dc88483b0b0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4607f42 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.188784:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a31bda98/0xe5129dc88483b0b0 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4607f42 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:2.0:1787191344.188796:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a31bda98/0xe5129dc88483b0b0 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4607f42 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.188807:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a31bda98/0xe5129dc88483b0b0 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607f42 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.188815:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a31bda98/0xe5129dc88483b0b0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607f42 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191344.188936:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626870912:192.168.202.101@tcp:10:bash.0 00000100:00100000:3.0:1787191344.189131:0:2392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787191344.189139:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626871040:192.168.202.101@tcp:10:bash.0 00000100:00100000:2.0:1787191344.192191:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626870912:192.168.202.101@tcp:10:bash.0 00000100:00100000:2.0:1787191344.193262:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626871040:192.168.202.101@tcp:10:bash.0 00000080:00200000:0.0:1787191344.193378:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xef:0x0] updating i_size 0 i_blocks 0 00000020:00010000:0.0:1787191344.193385:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894d58 (ffff936b47a172d8/0) at cl_lock_release():245 00000020:00010000:0.0:1787191344.193389:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894d58 (ffff936b47a172d8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191344.193403:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b5338f870 (ffff936b47a17bd8/1) at cl_lock_cancel():142 00010000:00010000:0.0:1787191344.193415:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000061df71ff/0xe5129dc88483b0a9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607f3b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.193431:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000061df71ff/0xe5129dc88483b0a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607f3b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:0.0:1787191344.193449:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b5338f8b0 (ffff936b465cc368/1) at cl_lock_cancel():142 00010000:00010000:0.0:1787191344.193454:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a31bda98/0xe5129dc88483b0b0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607f42 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.193470:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a31bda98/0xe5129dc88483b0b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607f42 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:0.0:1787191344.193480:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894d58 (ffff936b47a172d8/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191344.193483:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b5338f870 (ffff936b47a172d8/1) at cl_lock_fini():72 00000020:00010000:0.0:1787191344.193488:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b5338f8b0 (ffff936b47a172d8/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191344.193507:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xef:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:0.0:1787191344.193521:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xef:0x0](ffff936b48989148) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191344.000000000, mtime 1787191344.000000000, ctime 1787191344.000000000, rc 0 00000080:00200008:0.0:1787191344.193953:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xef:0x0], ppos: 0, count: 5 00000080:00200000:0.0:1787191344.193967:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:0.0:1787191344.193974:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:0.0:1787191344.193979:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:0.0:1787191344.193984:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:0.0:1787191344.193990:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@00000000655f3130[0x110, 1, [0x200000405:0xef:0x0] hash] 00000020:00200000:0.0:1787191344.193993:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:0.0:1787191344.193997:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xef:0x0] ignore/verify layout 0/0, layout version 4 restore needed 0 00020000:00200000:0.0:1787191344.194020:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xef:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:0.0:1787191344.194025:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xef:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191344.194028:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:0.0:1787191344.194034:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:0.0:1787191344.194042:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:0.0:1787191344.194045:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1787191344.194062:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:0.0:1787191344.194077:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:0.0:1787191344.194082:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f3eb30, osc lock ffff936b50b625f0, flags 0x0 00010000:00010000:0.0:1787191344.194223:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000061df71ff/0xe5129dc88483b0a9 lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607f3b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.194244:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000061df71ff/0xe5129dc88483b0a9 lrc: 2/0,1 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607f3b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.194256:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000061df71ff/0xe5129dc88483b0a9 lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607f3b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.194265:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000061df71ff/0xe5129dc88483b0a9 lrc: 6/0,2 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607f3b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.194338:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000061df71ff/0xe5129dc88483b0a9 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607f3b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191344.194351:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:0.0:1787191344.194360:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:0.0:1787191344.194405:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:0.0:1787191344.194414:0:57570:0:(rw26.c:927:ll_write_end()) page@00000000f5d5107d[3 00000000d14e5e69 2 1 000000001d879872 0 0 0] 00000080:00200000:0.0:1787191344.194418:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @0000000008e601bd 17ffffc0001001 3:0 ffff936b522c4460 0 lru 00000080:00200000:0.0:1787191344.194424:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@00000000fe0bc93a 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000ef00a996 0000000089efeb9b > 3< 0 0 > 4< 0 0 8 484610048 - | - - + - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:0.0:1787191344.194426:0:57570:0:(rw26.c:927:ll_write_end()) end page@00000000f5d5107d 00000080:00200000:0.0:1787191344.194427:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:0.0:1787191344.194431:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:0.0:1787191344.194451:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 0000000081543d07 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000061df71ff/0xe5129dc88483b0a9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607f3b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191344.194469:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b489892f8, count 1, dirtied 1 00000080:00200000:0.0:1787191344.194473:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:0.0:1787191344.194477:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:0.0:1787191344.194491:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894d58 (ffff936b47a172d8/0) at cl_lock_release():245 00000020:00010000:0.0:1787191344.194494:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894d58 (ffff936b47a172d8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191344.194497:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f3eb30 (ffff936b465cc368/1) at cl_lock_cancel():142 00010000:00010000:0.0:1787191344.194502:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000061df71ff/0xe5129dc88483b0a9 lrc: 5/0,1 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607f3b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.194510:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000061df71ff/0xe5129dc88483b0a9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607f3b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:0.0:1787191344.194522:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894d58 (ffff936b47a172d8/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191344.194525:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f3eb30 (ffff936b47a172d8/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191344.194532:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:0.0:1787191344.194537:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:0.0:1787191344.194542:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xef:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191344.194545:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:0.0:1787191344.194551:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xef:0x0] updating i_size 5 i_blocks 0 00000080:00200000:0.0:1787191344.194556:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:0.0:1787191344.194645:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xef:0x0](ffff936b48989148), flags 100001 00000002:00100000:0.0:1787191344.194704:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a475180 x1874004626869504/t8589937276(8589937276) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191360 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1787191344.194717:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1787191344.194722:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477b80 x1874004626871296/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1787191344.194744:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626871296:192.168.202.101@tcp:35:bash.0 00000100:00100000:0.0:1787191344.194955:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787191344.199475:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626871296:192.168.202.101@tcp:35:bash.0 00000002:00100000:0.0:1787191344.199511:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a475180 x1874004626869504/t8589937276(8589937276) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191360 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1787191344.205048:0:57985:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191344.205079:0:57985:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191344.205095:0:57985:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191344.205111:0:57985:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191344.205125:0:57985:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191344.205133:0:57985:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191344.205137:0:57985:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191344.205145:0:57985:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42323b58 00010000:00010000:3.0:1787191344.205150:0:57985:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191344.205160:0:57985:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191344.205176:0:57985:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191344.205184:0:57985:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:3.0:1787191344.205190:0:57985:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191344.205202:0:57985:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:3.0:1787191344.205207:0:57985:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:3.0:1787191344.205219:0:57985:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1787191344.205342:0:57985:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483b0b7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191344.205351:0:57985:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483b0b7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191344.205363:0:57985:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483b0b7 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57985 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191344.205392:0:57985:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1d500 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57985:1874004626871424:192.168.202.101@tcp:101:rm.0 00000100:00100000:3.0:1787191344.205540:0:57985:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787191344.208692:0:57985:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1d500 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57985:1874004626871424:192.168.202.101@tcp:101:rm.0 00010000:00010000:0.0:1787191344.208719:0:57985:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483b0b7 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607f5e expref: -99 pid: 57985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.208744:0:57985:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483b0b7 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xef:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607f5e expref: -99 pid: 57985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.208753:0:57985:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483b0b7 lrc: 4/1,0 mode: --/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607f5e expref: -99 pid: 57985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.208766:0:57985:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483b0b7 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607f5e expref: -99 pid: 57985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.208778:0:57985:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483b0b7 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607f5e expref: -99 pid: 57985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.208791:0:57985:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483b0b7 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607f5e expref: -99 pid: 57985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.208799:0:57985:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483b0b7 lrc: 5/2,0 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607f5e expref: -99 pid: 57985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.208806:0:57985:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483b0b7 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607f5e expref: -99 pid: 57985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191344.208825:0:57985:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b51d1d500 x1874004626871424/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/976 e 0 to 0 dl 1787191360 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191344.208865:0:57985:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483b0b7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607f5e expref: -99 pid: 57985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191344.208878:0:57985:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483b0b7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607f5e expref: -99 pid: 57985 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.208888:0:57985:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/239 (0 0) 00000080:00200000:0.0:1787191344.208895:0:57985:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191344.208950:0:57985:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xef:0x0](ffff936b48989148): rc = 0 00000080:00200000:0.0:1787191344.208967:0:57985:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xef:0x0]: layout version change: 4 -> 4 00000080:00010000:0.0:1787191344.208972:0:57985:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xef:0x0](ffff936b48989148) for lock 0xe5129dc88483b0b7 00000080:00010000:0.0:1787191344.208983:0:57985:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xef:0x0](ffff936b48989148) 00000080:00010000:0.0:1787191344.208987:0:57985:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483b0b7 from it ffffa3fb42323b20 00010000:00010000:0.0:1787191344.208991:0:57985:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483b0b7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607f5e expref: -99 pid: 57985 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.209010:0:57985:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483b0b7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607f5e expref: -99 pid: 57985 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200008:0.0:1787191344.209049:0:57985:0:(file.c:6295:ll_getattr_dentry()) START file f70.sanity-flr:[0x200000405:0xef:0x0](ffff936b48989148), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787191344.209056:0:57985:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0xef:0x0](ffff936b48989148),name=f70.sanity-flr 00000002:00010000:0.0:1787191344.209079:0:57985:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xef:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191344.209088:0:57985:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483b0b7 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607f5e expref: -99 pid: 57985 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.209100:0:57985:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483b0b7 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607f5e expref: -99 pid: 57985 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191344.209107:0:57985:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191344.209112:0:57985:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xef:0x0](ffff936b48989148) 00000080:00010000:0.0:1787191344.209115:0:57985:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xef:0x0](ffff936b48989148) for lock 0xe5129dc88483b0b7 00000080:00010000:0.0:1787191344.209119:0:57985:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483b0b7 from it ffffa3fb42323cb8 00010000:00010000:0.0:1787191344.209123:0:57985:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483b0b7 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607f5e expref: -99 pid: 57985 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.209130:0:57985:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483b0b7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607f5e expref: -99 pid: 57985 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191344.209150:0:57985:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xef:0x0] ignore/verify layout 0/1, layout version 4 restore needed 0 00020000:00200000:0.0:1787191344.209161:0:57985:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xef:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191344.209165:0:57985:0:(lov_io.c:709:lov_io_mirror_init()) use non-delayed RPC state for this IO 00000001:00010000:0.0:1787191344.209169:0:57985:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000405:0xef:0x0] 00000008:00010000:0.0:1787191344.209188:0:57985:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a 00000008:00010000:0.0:1787191344.209192:0:57985:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f3eb30, osc lock ffff936b50b625f0, flags 0x400000400001002 00010000:00010000:0.0:1787191344.209208:0:57985:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000061df71ff/0xe5129dc88483b0a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607f3b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191344.209220:0:57985:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 1048575) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000061df71ff/0xe5129dc88483b0a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607f3b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00200000:0.0:1787191344.209232:0:57985:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining. 00010000:00010000:0.0:1787191344.209236:0:57985:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000061df71ff/0xe5129dc88483b0a9 lrc: 6/0,1 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4607f3b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191344.209245:0:57985:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000061df71ff/0xe5129dc88483b0a9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607f3b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000020:00200000:0.0:1787191344.209255:0:57985:0:(cl_io.c:1849:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining. 00000080:00200000:0.0:1787191344.209264:0:57985:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xef:0x0] updating i_size 5 i_blocks 0 00000020:00010000:0.0:1787191344.209378:0:57985:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b509b8940 (ffff936b47a172d8/0) at cl_lock_release():245 00000020:00010000:0.0:1787191344.209382:0:57985:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b509b8940 (ffff936b47a172d8/0) at cl_lock_cancel():142 00000020:00010000:0.0:1787191344.209386:0:57985:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f3eb30 (ffff936b465cc368/1) at cl_lock_cancel():142 00000020:00010000:0.0:1787191344.209390:0:57985:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b509b8940 (ffff936b47a172d8/0) at cl_lock_fini():72 00000020:00010000:0.0:1787191344.209393:0:57985:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f3eb30 (ffff936b47a172d8/1) at cl_lock_fini():72 00000080:00200000:0.0:1787191344.209403:0:57985:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xef:0x0] ignore/verify layout 0/1, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191344.209453:0:57985:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191344.209463:0:57985:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191344.209471:0:57985:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191344.209480:0:57985:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191344.209487:0:57985:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191344.209492:0:57985:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191344.209495:0:57985:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191344.209499:0:57985:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42323c10 00010000:00010000:0.0:1787191344.209502:0:57985:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191344.209511:0:57985:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191344.209520:0:57985:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191344.209526:0:57985:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:0.0:1787191344.209530:0:57985:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191344.209536:0:57985:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=0 00000080:00200000:0.0:1787191344.209540:0:57985:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:0.0:1787191344.209545:0:57985:0:(namei.c:2418:ll_unlink()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08) 00010000:00010000:0.0:1787191344.209565:0:57985:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483b0a2 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xef:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4607f18 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191344.209585:0:57985:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xef:0x0]: losing layout lock 00010000:00010000:0.0:1787191344.209597:0:57985:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483b0b7 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e4607f5e expref: -99 pid: 57985 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191344.209606:0:57985:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xef:0x0]: losing layout lock 00010000:00010000:0.0:1787191344.209613:0:57985:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483b094 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xef:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4607efc expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.209657:0:57985:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483b0a2 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xef:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607f18 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191344.209665:0:57985:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483b0b7 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607f5e expref: -99 pid: 57985 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191344.209672:0:57985:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483b094 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xef:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4607efc expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.209683:0:57985:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:0.0:1787191344.209687:0:57985:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adf200/0xe5129dc88483b0a2 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xef:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607f18 expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787191344.209701:0:57985:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9b000/0xe5129dc88483b0b7 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e4607f5e expref: -99 pid: 57985 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191344.209712:0:57985:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfc00/0xe5129dc88483b094 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xef:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4607efc expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1787191344.209730:0:57985:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1787191344.209739:0:57985:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a477b80 x1874004626871680/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 504/944 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787191344.209761:0:57985:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57985:1874004626871680:192.168.202.101@tcp:36:rm.0 00000100:00100000:0.0:1787191344.209903:0:57985:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787191344.213540:0:57985:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a477b80 pname:cluuid:pid:xid:nid:opc:job rm:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57985:1874004626871680:192.168.202.101@tcp:36:rm.0 00000080:00200000:0.0:1787191344.213678:0:57985:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xef:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00020000:00200000:0.0:1787191344.213692:0:57985:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xef:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191344.213696:0:57985:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191344.213702:0:57985:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191344.213713:0:57985:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000008:00010000:0.0:1787191344.213731:0:57985:0:(osc_cache.c:1183:osc_extent_make_ready()) ### extent: 0000000081543d07 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000061df71ff/0xe5129dc88483b0a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607f3b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1787191344.213762:0:57985:0:(osc_cache.c:917:osc_extent_finish()) ### extent: 0000000081543d07 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000061df71ff/0xe5129dc88483b0a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607f3b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1787191344.213786:0:57985:0:(osc_cache.c:497:__osc_extent_remove()) ### extent: 0000000081543d07 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000061df71ff/0xe5129dc88483b0a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607f3b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787191344.213809:0:57985:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xef:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191344.213892:0:57985:0:(llite_lib.c:2066:ll_clear_inode()) VFS Op:inode=[0x200000405:0xef:0x0](ffff936b48989148) 00000008:00010000:0.0:1787191344.213924:0:57985:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 5 blocks 0 [cma]time 1787191344 1787191344 0 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000061df71ff/0xe5129dc88483b0a9 lrc: 1/0,0 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607f3b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000008:00010000:0.0:1787191344.213949:0:57985:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 0 0 0 by oinfo size 0 blocks 0 [cma]time 1787191344 1787191344 0 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a31bda98/0xe5129dc88483b0b0 lrc: 1/0,0 mode: PW/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4607f42 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1787191344.221315:0:57986:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:3.0:1787191344.221345:0:57986:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787191344.221363:0:57986:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191344.221380:0:57986:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191344.221389:0:57986:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1787191344.221397:0:57986:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:3.0:1787191344.221401:0:57986:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:3.0:1787191344.221409:0:57986:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b53b58 00010000:00010000:3.0:1787191344.221413:0:57986:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:3.0:1787191344.221421:0:57986:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:3.0:1787191344.221437:0:57986:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:3.0:1787191344.221444:0:57986:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=29 00000080:00200000:3.0:1787191344.221449:0:57986:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:3.0:1787191344.221461:0:57986:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=13 00000080:00200000:3.0:1787191344.221465:0:57986:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:3.0:1787191344.221477:0:57986:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:3.0:1787191344.221529:0:57986:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483b0be lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191344.221538:0:57986:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483b0be lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787191344.221552:0:57986:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483b0be lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787191344.221578:0:57986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57986:1874004626871808:192.168.202.101@tcp:101:lfs.0 00000100:00100000:3.0:1787191344.221672:0:57986:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5235c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787191344.223781:0:57986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1fb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57986:1874004626871808:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191344.223802:0:57986:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483b0be lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.223815:0:57986:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483b0be lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.223821:0:57986:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483b0be lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.223827:0:57986:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483b0be lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.223893:0:57986:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483b0be lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.223899:0:57986:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b44e9ac00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191344.223904:0:57986:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483b0be lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.223911:0:57986:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483b0be lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.223918:0:57986:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483b0be lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.223924:0:57986:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191344.223930:0:57986:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483b0be lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.223936:0:57986:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b44e9ac00/0xe5129dc88483b0be lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191344.223962:0:57986:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b51d1fb80 x1874004626871808/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191360 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191344.223976:0:57986:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191344.224072:0:57986:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191344.224098:0:57986:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191344.224109:0:57986:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191344.224119:0:57986:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191344.224125:0:57986:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191344.224131:0:57986:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191344.224135:0:57986:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191344.224140:0:57986:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b53be8 00010000:00010000:2.0:1787191344.224144:0:57986:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191344.224152:0:57986:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191344.224166:0:57986:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191344.224174:0:57986:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=16408 00000080:00200000:2.0:1787191344.224179:0:57986:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191344.224191:0:57986:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=16392 00000080:00200000:2.0:1787191344.224195:0:57986:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191344.224207:0:57986:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191344.224254:0:57986:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483b0c5 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.224262:0:57986:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483b0c5 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.224272:0:57986:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483b0c5 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191344.224293:0:57986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57986:1874004626871936:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191344.224361:0:57986:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787191344.227596:0:57986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57986:1874004626871936:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191344.227617:0:57986:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483b0c5 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.227631:0:57986:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483b0c5 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.227638:0:57986:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483b0c5 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.227646:0:57986:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483b0c5 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.227654:0:57986:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483b0c5 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.227661:0:57986:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51184a00 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191344.227666:0:57986:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483b0c5 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.227674:0:57986:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483b0c5 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.227682:0:57986:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483b0c5 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.227689:0:57986:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191344.227695:0:57986:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483b0c5 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.227701:0:57986:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184a00/0xe5129dc88483b0c5 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191344.227727:0:57986:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513b9c00 x1874004626871936/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191360 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191344.227743:0:57986:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191344.228164:0:57986:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191344.228180:0:57986:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191344.228191:0:57986:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191344.228203:0:57986:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191344.228211:0:57986:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191344.228216:0:57986:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191344.228220:0:57986:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191344.228225:0:57986:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b53b58 00010000:00010000:2.0:1787191344.228230:0:57986:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191344.228238:0:57986:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191344.228253:0:57986:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191344.228261:0:57986:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=13 00000080:00200008:2.0:1787191344.228282:0:57986:0:(file.c:6295:ll_getattr_dentry()) START file d70.sanity-flr:[0x200000405:0x53:0x0](ffff936b48924b08), request_mask 0, flags 0, foreign 0 00000080:00200000:2.0:1787191344.228288:0:57986:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08),name=d70.sanity-flr 00000002:00010000:2.0:1787191344.228301:0:57986:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0x53:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191344.228309:0:57986:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 108 lru_type: 1 00010000:00010000:2.0:1787191344.228318:0:57986:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 108 lru_type: 1 00000002:00010000:2.0:1787191344.228330:0:57986:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191344.228375:0:57986:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483b0cc lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.228382:0:57986:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483b0cc lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.228690:0:57986:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483b0cc lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191344.228714:0:57986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57986:1874004626872064:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191344.228864:0:57986:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787191344.230858:0:57986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57986:1874004626872064:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191344.230882:0:57986:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483b0cc lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607fb2 expref: -99 pid: 57986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.230894:0:57986:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483b0cc lrc: 4/1,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607fb2 expref: -99 pid: 57986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.230906:0:57986:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483b0cc lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607fb2 expref: -99 pid: 57986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.230917:0:57986:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483b0cc lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607fb2 expref: -99 pid: 57986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.230930:0:57986:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483b0cc lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607fb2 expref: -99 pid: 57986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.230938:0:57986:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483b0cc lrc: 5/2,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607fb2 expref: -99 pid: 57986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.230946:0:57986:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483b0cc lrc: 4/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607fb2 expref: -99 pid: 57986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191344.230959:0:57986:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0 req@ffff936b513b9c00 x1874004626872064/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 576/640 e 0 to 0 dl 1787191360 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191344.230974:0:57986:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483b0cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607fb2 expref: -99 pid: 57986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.230984:0:57986:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589937616/5 (0 0) 00010000:00010000:2.0:1787191344.230992:0:57986:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483b0cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607fb2 expref: -99 pid: 57986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.231011:0:57986:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483b0cc lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607fb2 expref: -99 pid: 57986 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:2.0:1787191344.231037:0:57986:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191344.231049:0:57986:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 216 lru_type: 1 00010000:00010000:2.0:1787191344.231061:0:57986:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 216 lru_type: 1 00010000:00010000:2.0:1787191344.231070:0:57986:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 216 lru_type: 1 00010000:00010000:2.0:1787191344.231077:0:57986:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 217 lru_type: 1 00000080:00200000:2.0:1787191344.231089:0:57986:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00010000:2.0:1787191344.231099:0:57986:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) 00000080:00010000:2.0:1787191344.231103:0:57986:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0x53:0x0](ffff936b48924b08) for lock 0xe5129dc884837323 00000080:00010000:2.0:1787191344.231109:0:57986:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837323 from it ffffa3fb42b53cb8 00010000:00010000:2.0:1787191344.231113:0:57986:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 108 lru_type: 1 00010000:00010000:2.0:1787191344.231122:0:57986:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b4801ee00/0xe5129dc884837323 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x53:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fc019 expref: -99 pid: 57576 timeout: 0 lvb_type: 0 lru_score: 109 lru_type: 1 00000002:00010000:2.0:1787191344.231142:0:57986:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000bd0:0x5:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191344.231148:0:57986:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483b0cc lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607fb2 expref: -99 pid: 57986 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191344.231156:0:57986:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483b0cc lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607fb2 expref: -99 pid: 57986 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191344.231164:0:57986:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483b0cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607fb2 expref: -99 pid: 57986 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191344.231172:0:57986:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483b0cc lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607fb2 expref: -99 pid: 57986 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00010000:2.0:1787191344.231180:0:57986:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x240000406:0x5:0x0]) in obj [0x240000406:0x5:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191344.231185:0:57986:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 217 lru_type: 1 00010000:00010000:2.0:1787191344.231193:0:57986:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 217 lru_type: 1 00010000:00010000:2.0:1787191344.231201:0:57986:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 217 lru_type: 1 00010000:00010000:2.0:1787191344.231208:0:57986:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0001-mdc-ffff936b581fb000 lock: ffff936b4150aa00/0xe5129dc884837315 lrc: 2/0,0 mode: PR/PR res: [0x240000406:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbff6 expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 218 lru_type: 1 00000080:00200008:2.0:1787191344.231993:0:57986:0:(file.c:6295:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff936b489d63c8), request_mask 0, flags 0, foreign 0 00000080:00200000:2.0:1787191344.232032:0:57986:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191344.232048:0:57986:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191344.232059:0:57986:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191344.232069:0:57986:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191344.232077:0:57986:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191344.232082:0:57986:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191344.232085:0:57986:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191344.232090:0:57986:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b53cb8 00010000:00010000:2.0:1787191344.232094:0:57986:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191344.232102:0:57986:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191344.232219:0:57986:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191344.232228:0:57986:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191344.232234:0:57986:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191344.232244:0:57986:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191344.232250:0:57986:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191344.232255:0:57986:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191344.232258:0:57986:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191344.232262:0:57986:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b53b58 00010000:00010000:2.0:1787191344.232265:0:57986:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191344.232478:0:57986:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191344.232488:0:57986:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191344.232494:0:57986:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=24 00000080:00200000:2.0:1787191344.232499:0:57986:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191344.232510:0:57986:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), flags=8 00000080:00200000:2.0:1787191344.232515:0:57986:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=getattr 00000002:00010000:2.0:1787191344.232527:0:57986:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x0:0x0:0x0]) in obj [0x200000bd0:0x5:0x0], intent: getattr flags 01 00010000:00010000:2.0:1787191344.232569:0:57986:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483b0d3 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.232633:0:57986:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483b0d3 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.232646:0:57986:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483b0d3 lrc: 3/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191344.232670:0:57986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57986:1874004626872192:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191344.232752:0:57986:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787191344.236174:0:57986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57986:1874004626872192:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191344.236196:0:57986:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483b0d3 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.236214:0:57986:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483b0d3 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.236222:0:57986:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483b0d3 lrc: 4/1,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.236229:0:57986:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483b0d3 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.236239:0:57986:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483b0d3 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.236246:0:57986:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030800 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191344.236251:0:57986:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483b0d3 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.236259:0:57986:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483b0d3 lrc: 4/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.236267:0:57986:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483b0d3 lrc: 5/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.236275:0:57986:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191344.236282:0:57986:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483b0d3 lrc: 3/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.236288:0:57986:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030800/0xe5129dc88483b0d3 lrc: 0/0,0 mode: --/CR res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191344.236307:0:57986:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0x7, status=0 req@ffff936b513b9c00 x1874004626872192/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 584/584 e 0 to 0 dl 1787191360 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191344.236329:0:57986:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1787191344.236357:0:57986:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483b0cc lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607fb2 expref: -99 pid: 57986 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191344.236370:0:57986:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483b0cc lrc: 2/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607fb2 expref: -99 pid: 57986 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00010000:2.0:1787191344.236378:0:57986:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483b0cc from it ffffa3fb42b53930 00010000:00010000:2.0:1787191344.236383:0:57986:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483b0cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607fb2 expref: -99 pid: 57986 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787191344.236489:0:57986:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483b0cc lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607fb2 expref: -99 pid: 57986 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787191344.236567:0:57986:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:2.0:1787191344.236642:0:57986:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787191344.236652:0:57986:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191344.236661:0:57986:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191344.236668:0:57986:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787191344.236673:0:57986:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:2.0:1787191344.236676:0:57986:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:2.0:1787191344.236681:0:57986:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb42b53bf8 00010000:00010000:2.0:1787191344.236685:0:57986:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1787191344.236693:0:57986:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:2.0:1787191344.236702:0:57986:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:2.0:1787191344.236709:0:57986:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:2.0:1787191344.236714:0:57986:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:2.0:1787191344.236721:0:57986:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f70.sanity-flr, flags=777 00000080:00200000:2.0:1787191344.236724:0:57986:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:2.0:1787191344.236729:0:57986:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b52230d80, open_flags a141, mode 81b6 opened 0 00000080:00200000:2.0:1787191344.236739:0:57986:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:2.0:1787191344.236758:0:57986:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xf1:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0120502 00010000:00010000:2.0:1787191344.236769:0:57986:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483b0cc lrc: 2/0,0 mode: PR/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7130d520e4607fb2 expref: -99 pid: 57986 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191344.236814:0:57986:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483b0cc lrc: 1/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4607fb2 expref: -99 pid: 57986 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191344.236822:0:57986:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191344.236825:0:57986:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b51184e00/0xe5129dc88483b0cc lrc: 0/0,0 mode: --/PR res: [0x200000bd0:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7130d520e4607fb2 expref: -99 pid: 57986 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191344.236928:0:57986:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483b0da lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.236936:0:57986:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483b0da lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191344.236954:0:57986:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191344.236961:0:57986:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9c00 x1874004626872448/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191344.236971:0:57986:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483b0da lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191344.236992:0:57986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57986:1874004626872448:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191344.237197:0:57986:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787191344.241521:0:57986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9c00 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57986:1874004626872448:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191344.241547:0:57986:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483b0da lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607fe3 expref: -99 pid: 57986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.241587:0:57986:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483b0da lrc: 4/0,1 mode: --/PR res: [0x200000405:0xf1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607fe3 expref: -99 pid: 57986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.241596:0:57986:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483b0da lrc: 4/0,1 mode: --/PR res: [0x200000405:0xf1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607fe3 expref: -99 pid: 57986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.241607:0:57986:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483b0da lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xf1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607fe3 expref: -99 pid: 57986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.241619:0:57986:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483b0da lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xf1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607fe3 expref: -99 pid: 57986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.241633:0:57986:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483b0da lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xf1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607fe3 expref: -99 pid: 57986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.241648:0:57986:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483b0da lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xf1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607fe3 expref: -99 pid: 57986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.241656:0:57986:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483b0da lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xf1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4607fe3 expref: -99 pid: 57986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191344.241668:0:57986:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x8000037, status=0 req@ffff936b513b9c00 x1874004626872448/t8589937282(8589937282) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191360 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191344.241682:0:57986:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9c00 x1874004626872448/t8589937282(8589937282) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191360 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787191344.241694:0:57986:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483b0da lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4607fe3 expref: -99 pid: 57986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.241703:0:57986:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/241 (0 0) 00000080:00200000:2.0:1787191344.241709:0:57986:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787191344.241721:0:57986:0:(namei.c:1628:ll_create_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000080:00200000:2.0:1787191344.241748:0:57986:0:(llite_lib.c:3356:ll_read_inode2()) VFS Op:inode=[0x200000405:0xf1:0x0](ffff936b4898ba88) 00000080:00200000:2.0:1787191344.241755:0:57986:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xf1:0x0], updating i_size 0 00000080:00200000:2.0:1787191344.241787:0:57986:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xf1:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:2.0:1787191344.241791:0:57986:0:(namei.c:1594:ll_create_node()) setting l_ast_data to inode [0x200000405:0xf1:0x0](ffff936b4898ba88) 00000080:00010000:2.0:1787191344.241795:0:57986:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xf1:0x0](ffff936b4898ba88) for lock 0xe5129dc88483b0da 00000080:00010000:2.0:1787191344.241804:0:57986:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xf1:0x0](ffff936b4898ba88) 00000080:00200008:2.0:1787191344.241818:0:57986:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xf1:0x0](ffff936b4898ba88), flags 120501 00000002:00100000:2.0:1787191344.241866:0:57986:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513b9c00 x1874004626872448/t8589937282(8589937282) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191360 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1787191344.241908:0:57986:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483b0da from it ffff936b60dc4ba0 00010000:00010000:2.0:1787191344.241913:0:57986:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483b0da lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e4607fe3 expref: -99 pid: 57986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.241922:0:57986:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483b0da lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xf1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e4607fe3 expref: -99 pid: 57986 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191344.241944:0:57986:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xf1:0x0](ffff936b4898ba88), inode mode 81a4 mask 40 00000080:00200000:2.0:1787191344.242013:0:57986:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xf1:0x0](ffff936b4898ba88), inode mode 81a4 mask 2 00000080:00200000:2.0:1787191344.242023:0:57986:0:(xattr.c:413:ll_xattr_set()) VFS Op:inode=[0x200000405:0xf1:0x0](ffff936b4898ba88), xattr lov 00000002:00010000:2.0:1787191344.242040:0:57986:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xf1:0x0]) in obj [0x200000405:0xf1:0x0], intent: open flags 040000002 00010000:00010000:2.0:1787191344.242083:0:57986:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483b0e1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xf1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.242233:0:57986:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483b0e1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xf1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787191344.242245:0:57986:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787191344.242252:0:57986:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb480 x1874004626872704/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/132176 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787191344.242262:0:57986:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483b0e1 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xf1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787191344.242283:0:57986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57986:1874004626872704:192.168.202.101@tcp:101:lfs.0 00000100:00100000:2.0:1787191344.242504:0:57986:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787191344.244474:0:2384:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191344.244521:0:40922:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634949248 00000100:00100000:2.0:1787191344.244531:0:40922:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634949248 00000100:00100000:3.0:1787191344.244674:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1527 00000100:00100000:3.0:1787191344.244685:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634949248:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191344.244704:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483b0da lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xf1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4607fe3 expref: -99 pid: 57986 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191344.244776:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191344.244783:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:f10005b0-4ec5-4888-9c81-49c0b11e82c4+5:7719:x1874004634949248:12345-192.168.202.101@tcp:104: Request processed in 101us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191344.244790:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1527 00010000:00010000:0.0:1787191344.244794:0:43384:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787191344.244801:0:43384:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483b0da lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xf1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7130d520e4607fe3 expref: -99 pid: 57986 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.244809:0:43384:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030400 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:0.0:1787191344.244814:0:43384:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483b0da lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xf1:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4607fe3 expref: -99 pid: 57986 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.244822:0:43384:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483b0da lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xf1:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7130d520e4607fe3 expref: -99 pid: 57986 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.244848:0:43384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483b0da lrc: 3/0,0 mode: PR/PR res: [0x200000405:0xf1:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7130d520e4607fe3 expref: -99 pid: 57986 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191344.244874:0:43384:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xf1:0x0]: losing layout lock 00010000:00010000:0.0:1787191344.244916:0:43384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483b0da lrc: 2/0,0 mode: --/PR res: [0x200000405:0xf1:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607fe3 expref: -99 pid: 57986 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.244923:0:43384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191344.244944:0:43384:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483b0da lrc: 1/0,0 mode: --/PR res: [0x200000405:0xf1:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607fe3 expref: -99 pid: 57986 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.244952:0:43384:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030400/0xe5129dc88483b0da lrc: 0/0,0 mode: --/PR res: [0x200000405:0xf1:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7130d520e4607fe3 expref: -99 pid: 57986 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.244966:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191344.244967:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787191344.244969:0:43384:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787191344.244983:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626872832:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191344.246723:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626872832:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191344.247699:0:57986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb480 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57986:1874004626872704:192.168.202.101@tcp:101:lfs.0 00010000:00010000:2.0:1787191344.247717:0:57986:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483b0e1 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xf1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.247729:0:57986:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483b0e1 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xf1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.247736:0:57986:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483b0e1 lrc: 4/1,0 mode: --/CR res: [0x200000405:0xf1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.247744:0:57986:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483b0e1 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xf1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.247753:0:57986:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483b0e1 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xf1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.247759:0:57986:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b40030200 already unused, calling callback (ffffffffc1b143c0) 00010000:00010000:2.0:1787191344.247763:0:57986:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483b0e1 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xf1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.247770:0:57986:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483b0e1 lrc: 4/0,0 mode: --/CR res: [0x200000405:0xf1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.247778:0:57986:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483b0e1 lrc: 5/0,0 mode: --/CR res: [0x200000405:0xf1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.247785:0:57986:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787191344.247791:0:57986:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483b0e1 lrc: 3/0,0 mode: --/CR res: [0x200000405:0xf1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.247798:0:57986:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b40030200/0xe5129dc88483b0e1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xf1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 57986 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787191344.247827:0:57986:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x1 disposition=0x800002b, status=0 req@ffff936b513bb480 x1874004626872704/t8589937283(8589937283) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191360 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191344.247856:0:57986:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bb480 x1874004626872704/t8589937283(8589937283) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 968/1000 e 0 to 0 dl 1787191360 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787191344.247872:0:57986:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000405:0xf1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1787191344.247917:0:57986:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xf1:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:2.0:1787191344.247926:0:57986:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xf1:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191344.247975:0:57986:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000405:0xf1:0x0], updating i_size 0 00000002:00100000:2.0:1787191344.247993:0:57986:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b513bb480 x1874004626872704/t8589937283(8589937283) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191360 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787191344.248040:0:57986:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513bb480 x1874004626872704/t8589937283(8589937283) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191360 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191344.248050:0:57986:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191344.248055:0:57986:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513b9f80 x1874004626873088/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191344.248074:0:57986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57986:1874004626873088:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191344.248144:0:57986:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787191344.250038:0:57986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513b9f80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57986:1874004626873088:192.168.202.101@tcp:35:lfs.0 00000002:00100000:2.0:1787191344.250069:0:57986:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513bb480 x1874004626872704/t8589937283(8589937283) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 912/1000 e 0 to 0 dl 1787191360 ref 2 fl Complete:RQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200008:2.0:1787191344.250142:0:57986:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xf1:0x0](ffff936b4898ba88), flags 100001 00000002:00100000:2.0:1787191344.250185:0:57986:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b513b9c00 x1874004626872448/t8589937282(8589937282) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191360 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191344.250196:0:57986:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191344.250201:0:57986:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bbb80 x1874004626873344/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191344.250220:0:57986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57986:1874004626873344:192.168.202.101@tcp:35:lfs.0 00000100:00100000:2.0:1787191344.250285:0:57986:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787191344.252301:0:57986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bbb80 pname:cluuid:pid:xid:nid:opc:job lfs:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57986:1874004626873344:192.168.202.101@tcp:35:lfs.0 00000002:00100000:2.0:1787191344.252335:0:57986:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b513b9c00 x1874004626872448/t8589937282(8589937282) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 528/608 e 0 to 0 dl 1787191360 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1787191344.254012:0:57570:0:(file.c:6190:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8),name=/ 00000002:00010000:0.0:1787191344.254039:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787191344.254057:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191344.254072:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191344.254081:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787191344.254088:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) 00000080:00010000:0.0:1787191344.254092:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff936b489d63c8) for lock 0xe5129dc884837300 00000080:00010000:0.0:1787191344.254101:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc884837300 from it ffffa3fb41cabbf8 00010000:00010000:0.0:1787191344.254105:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1787191344.254113:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b587bca00/0xe5129dc884837300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e45fbfbe expref: -99 pid: 57572 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1787191344.254128:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff936b489d63c8), inode mode 41ed mask 1 00000080:00200000:0.0:1787191344.254135:0:57570:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d70.sanity-flr, flags=25 00000080:00200000:0.0:1787191344.254141:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 1 00000080:00200000:0.0:1787191344.254153:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0x53:0x0](ffff936b48924b08), inode mode 41ed mask 3 00000080:00200000:0.0:1787191344.254157:0:57570:0:(namei.c:1412:ll_atomic_open()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), file ffff936b483e6300, open_flags 8241, mode 81b6 opened 0 00000080:00200000:0.0:1787191344.254166:0:57570:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f70.sanity-flr, dir=[0x200000405:0x53:0x0](ffff936b48924b08), intent=open|creat 00000002:00010000:0.0:1787191344.254190:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: f70.sanity-flr,[0x200000405:0xf2:0x0]) in obj [0x200000bd0:0x5:0x0], intent: open|creat flags 0101102 00010000:00010000:0.0:1787191344.254244:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483b0e8 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.254253:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483b0e8 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191344.254264:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191344.254275:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475180 x1874004626873600/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/66640 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191344.254284:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483b0e8 lrc: 3/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191344.254304:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626873600:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191344.254523:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787191344.257257:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475180 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626873600:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191344.257289:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483b0e8 lrc: 4/0,1 mode: --/CW res: [0x200000bd0:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460801b expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.257317:0:57570:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483b0e8 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xf1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460801b expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.257324:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483b0e8 lrc: 4/0,1 mode: --/PR res: [0x200000405:0xf1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460801b expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.257334:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483b0e8 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xf1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460801b expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.257345:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483b0e8 lrc: 4/0,1 mode: PR/PR res: [0x200000405:0xf1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460801b expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.257357:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483b0e8 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xf1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460801b expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.257365:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483b0e8 lrc: 5/1,1 mode: PR/PR res: [0x200000405:0xf1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460801b expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.257373:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483b0e8 lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xf1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460801b expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191344.257384:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x3 disposition=0x2b, status=0 req@ffff936b6a475180 x1874004626873600/t8589937286(8589937286) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191360 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1787191344.257738:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475180 x1874004626873600/t8589937286(8589937286) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 976/1000 e 0 to 0 dl 1787191360 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191344.257755:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483b0e8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460801b expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191344.257770:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483b0e8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460801b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.257780:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/241 (0 0) 00000080:00200000:0.0:1787191344.257786:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000bd0:0x5:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787191344.257901:0:57570:0:(namei.c:147:ll_iget()) got inode: [0x200000405:0xf1:0x0](ffff936b4898ba88): rc = 0 00000080:00200000:0.0:1787191344.257921:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xf1:0x0]: layout version change: 4294967294 -> 3 00000080:00010000:0.0:1787191344.257927:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xf1:0x0](ffff936b4898ba88) for lock 0xe5129dc88483b0e8 00000080:00010000:0.0:1787191344.257939:0:57570:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000405:0xf1:0x0](ffff936b4898ba88) 00000080:00200008:0.0:1787191344.257954:0:57570:0:(file.c:1090:ll_file_open()) START file f70.sanity-flr:[0x200000405:0xf1:0x0](ffff936b4898ba88), flags 101101 00000002:00100000:0.0:1787191344.257977:0:57570:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff936b6a475180 x1874004626873600/t8589937286(8589937286) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191360 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1787191344.258025:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483b0e8 from it ffff936b530f5d80 00010000:00010000:0.0:1787191344.258030:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483b0e8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460801b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.258040:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483b0e8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xf1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460801b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191344.258063:0:57570:0:(file.c:6671:ll_inode_permission()) VFS Op:inode=[0x200000405:0xf1:0x0](ffff936b4898ba88), inode mode 81a4 mask 42 00000002:00010000:0.0:1787191344.258091:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x0:0x0:0x0]) in obj [0x200000405:0xf1:0x0], intent: getxattr flags 0 00010000:00010000:0.0:1787191344.258132:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483b0ef lrc: 3/1,0 mode: --/PR res: [0x200000405:0xf1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.258140:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483b0ef lrc: 3/1,0 mode: --/PR res: [0x200000405:0xf1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.258150:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483b0ef lrc: 3/1,0 mode: --/PR res: [0x200000405:0xf1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191344.258171:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626873728:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191344.258247:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787191344.260299:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626873728:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191344.260321:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483b0ef lrc: 4/1,0 mode: --/PR res: [0x200000405:0xf1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4608030 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.260336:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483b0ef lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xf1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4608030 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.260347:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483b0ef lrc: 4/1,0 mode: PR/PR res: [0x200000405:0xf1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4608030 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191344.260361:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x80 disposition=0x0, status=0 req@ffff936b6a475c00 x1874004626873728/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 568/1488 e 0 to 0 dl 1787191360 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191344.260372:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483b0ef lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4608030 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.260381:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 4 res 8589935621/241 (0 0) 00000080:00200000:0.0:1787191344.260387:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 128 on i1 [0x200000405:0xf1:0x0] suppgids 0 -1: rc 0 00000080:00010000:0.0:1787191344.260660:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xf1:0x0](ffff936b4898ba88) for lock 0xe5129dc88483b0ef 00000080:00010000:0.0:1787191344.260669:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483b0ef from it ffffa3fb41caba38 00010000:00010000:0.0:1787191344.260673:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483b0ef lrc: 3/1,0 mode: PR/PR res: [0x200000405:0xf1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e4608030 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.260683:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413fe800/0xe5129dc88483b0ef lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xf1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e4608030 expref: -99 pid: 57570 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:0.0:1787191344.260718:0:57570:0:(llite_lib.c:2427:ll_setattr_raw()) START file f70.sanity-flr:[0x200000405:0xf1:0x0](ffff936b4898ba88) current size 0, valid attrs a068, mode 0, uid 2, gid 0, new size 0, atime 1787191344.000000000, mtime 1787191344.000000000, ctime 1787191344.000000000 00010000:00010000:0.0:1787191344.260747:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483b0e8 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0xf1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e460801b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191344.260766:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xf1:0x0]: losing layout lock 00010000:00010000:0.0:1787191344.260802:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483b0e8 lrc: 1/0,0 mode: --/PR res: [0x200000405:0xf1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460801b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.260810:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191344.260813:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b43adfe00/0xe5129dc88483b0e8 lrc: 0/0,0 mode: --/PR res: [0x200000405:0xf1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460801b expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1787191344.260893:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1787191344.260901:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a475c00 x1874004626873984/t0(0) o36->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 488/512 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787191344.260922:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626873984:192.168.202.101@tcp:36:bash.0 00000100:00100000:0.0:1787191344.260989:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787191344.263509:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626873984:192.168.202.101@tcp:36:bash.0 00000080:00200000:0.0:1787191344.263558:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:0.0:1787191344.264069:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xf1:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00010000:00010000:0.0:1787191344.264088:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 31 res 8589935621/241 (0 0) 00000080:00010000:0.0:1787191344.264102:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xf1:0x0](ffff936b4898ba88) 00000002:00010000:0.0:1787191344.264113:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xf1:0x0]) in obj [0x200000405:0xf1:0x0], intent: layout flags 0 00010000:00010000:0.0:1787191344.264162:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483b0f6 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xf1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.264171:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483b0f6 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xf1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.264182:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483b0f6 lrc: 3/1,0 mode: --/CR res: [0x200000405:0xf1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191344.264203:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626874112:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191344.264274:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787191344.266264:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626874112:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191344.266290:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483b0f6 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xf1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460803e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.266305:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483b0f6 lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xf1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460803e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191344.266320:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b6a474380 x1874004626874112/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191360 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191344.266331:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483b0f6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xf1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460803e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191344.266350:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483b0f6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xf1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460803e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.266360:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/241 (0 0) 00000080:00200000:0.0:1787191344.266366:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xf1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191344.266382:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xf1:0x0](ffff936b4898ba88) for lock 0xe5129dc88483b0f6 00000080:00010000:0.0:1787191344.266389:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483b0f6 from it ffffa3fb41cab8c8 00010000:00010000:0.0:1787191344.266452:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483b0f6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xf1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460803e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.266463:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483b0f6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xf1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460803e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.266487:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483b0f6 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xf1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460803e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.266499:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483b0f6 lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xf1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460803e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1787191344.266508:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xf1:0x0](000000009d25d36f) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483b0f6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xf1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460803e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191344.266549:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xf1:0x0]: layout version change: 4294967294 -> 3 00010000:00010000:0.0:1787191344.266554:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483b0f6 lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xf1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460803e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.266562:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483b0f6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xf1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460803e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00020000:00200000:0.0:1787191344.266635:0:57570:0:(lov_io.c:569:lov_io_mirror_init()) [0x200000405:0xf1:0x0] need write intent for [0, 18446744073709551615) 00000080:00200000:0.0:1787191344.266643:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xf1:0x0] ignore/verify layout 0/0, layout version 3 need write layout 1, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191344.266647:0:57570:0:(vvp_io.c:371:vvp_io_fini()) [0x200000405:0xf1:0x0] write layout, type 3 [0x0, 0x1) 00000080:00010000:0.0:1787191344.266655:0:57570:0:(file.c:7058:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200000405:0xf1:0x0](ffff936b4898ba88) 00000002:00010000:0.0:1787191344.266664:0:57570:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000405:0xf1:0x0]) in obj [0x200000405:0xf1:0x0], intent: layout flags 02 00010000:00010000:0.0:1787191344.266677:0:57570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483b0f6 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xf1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7130d520e460803e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191344.266691:0:57570:0:(vvp_object.c:117:vvp_conf_set()) [0x200000405:0xf1:0x0]: losing layout lock 00010000:00010000:0.0:1787191344.266720:0:57570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483b0f6 lrc: 1/0,0 mode: --/CR res: [0x200000405:0xf1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460803e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191344.266728:0:57570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787191344.266731:0:57570:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffa00/0xe5129dc88483b0f6 lrc: 0/0,0 mode: --/CR res: [0x200000405:0xf1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7130d520e460803e expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191344.266755:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483b0fd lrc: 3/0,1 mode: --/EX res: [0x200000405:0xf1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.266762:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483b0fd lrc: 3/0,1 mode: --/EX res: [0x200000405:0xf1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787191344.266773:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1787191344.266780:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b6a474380 x1874004626874368/t0(0) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/792 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1787191344.266790:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483b0fd lrc: 3/0,1 mode: --/EX res: [0x200000405:0xf1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x0 pid: 57570 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191344.266812:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626874368:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191344.266944:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787191344.273988:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:2.0:1787191344.274169:0:40921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634950400 00000100:00100000:2.0:1787191344.274179:0:40921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634950400 00000100:00100000:2.0:1787191344.274235:0:40921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1528 00000100:00100000:2.0:1787191344.274246:0:40921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b51d1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8419:x1874004634950400:12345-192.168.202.101@tcp:104: 00010000:00010000:2.0:1787191344.274265:0:40921:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000061df71ff/0xe5129dc88483b0a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4607f3b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191344.274352:0:40921:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787191344.274360:0:40921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b51d1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:LOV_OSC_UUID+4:8419:x1874004634950400:12345-192.168.202.101@tcp:104: Request processed in 116us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787191344.274368:0:40921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1528 00010000:00010000:2.0:1787191344.274399:0:40930:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787191344.274406:0:40930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000061df71ff/0xe5129dc88483b0a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4607f3b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191344.274414:0:40930:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51185400 already unused, calling callback (ffffffffc1208790) 00010000:00010000:2.0:1787191344.274421:0:40930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000061df71ff/0xe5129dc88483b0a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4607f3b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00000100:00100000:3.0:1787191344.274554:0:2383:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.101@tcp (source: 12345-192.168.202.101@tcp) 00000100:00100000:3.0:1787191344.274585:0:51131:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787191344.274597:0:51131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004634950528 00000100:00100000:3.0:1787191344.274600:0:51131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004634950528 00000100:00100000:3.0:1787191344.274624:0:51131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.101@tcp, seq: 1529 00000100:00100000:3.0:1787191344.274631:0:51131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff936b4121cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:37089:x1874004634950528:12345-192.168.202.101@tcp:104: 00010000:00010000:3.0:1787191344.274640:0:51131:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a31bda98/0xe5129dc88483b0b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4607f42 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191344.274675:0:51131:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787191344.274681:0:51131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff936b4121cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:37089:x1874004634950528:12345-192.168.202.101@tcp:104: Request processed in 51us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1787191344.274688:0:51131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.101@tcp, seq: 1529 00010000:00010000:3.0:1787191344.274717:0:40929:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787191344.274722:0:40929:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a31bda98/0xe5129dc88483b0b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x420080010000 nid: local remote: 0x7130d520e4607f42 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191344.274730:0:40929:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff936b51185800 already unused, calling callback (ffffffffc1208790) 00010000:00010000:3.0:1787191344.274734:0:40929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a31bda98/0xe5129dc88483b0b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x428480010000 nid: local remote: 0x7130d520e4607f42 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191344.274774:0:40929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a31bda98/0xe5129dc88483b0b0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4607f42 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191344.274781:0:40929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787191344.274801:0:40929:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a31bda98/0xe5129dc88483b0b0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4607f42 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191344.274809:0:40929:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000a31bda98/0xe5129dc88483b0b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4607f42 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1787191344.274851:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191344.274854:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787191344.274856:0:40929:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787191344.274864:0:2391:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787191344.274879:0:2391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626874496:192.168.202.101@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787191344.275249:0:40930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000061df71ff/0xe5129dc88483b0a9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4607f3b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191344.275258:0:40930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787191344.275282:0:40930:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000061df71ff/0xe5129dc88483b0a9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4607f3b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191344.275292:0:40930:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff936b581fb000 lock: 0000000061df71ff/0xe5129dc88483b0a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x4c29480010020 nid: local remote: 0x7130d520e4607f3b expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787191344.275308:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191344.275309:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787191344.275311:0:40930:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787191344.275319:0:2392:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787191344.275328:0:2392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626874624:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191344.275755:0:57570:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff936b581fb000: committing for last_committed 8589937289 gen 1 00000100:00100000:0.0:1787191344.275844:0:57570:0:(client.c:3174:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff936b6a475180 x1874004626873600/t8589937286(8589937286) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191360 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787191344.275864:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626874368:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191344.275881:0:57570:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483b0fd lrc: 4/0,1 mode: --/EX res: [0x200000405:0xf1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460804c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.275891:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483b0fd lrc: 4/0,1 mode: --/CR res: [0x200000405:0xf1:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460804c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.275903:0:57570:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483b0fd lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xf1:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460804c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.275915:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483b0fd lrc: 4/0,1 mode: CR/CR res: [0x200000405:0xf1:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460804c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.275927:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483b0fd lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xf1:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460804c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.275936:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483b0fd lrc: 5/1,1 mode: CR/CR res: [0x200000405:0xf1:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460804c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.275944:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483b0fd lrc: 4/1,0 mode: CR/CR res: [0x200000405:0xf1:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460804c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787191344.275955:0:57570:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x400 disposition=0x1, status=0 req@ffff936b6a474380 x1874004626874368/t8589937289(8589937289) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 376/736 e 0 to 0 dl 1787191360 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787191344.275972:0:57570:0:(mdc_locks.c:939:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 392 ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483b0fd lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xf1:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460804c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1787191344.275984:0:57570:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483b0fd lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xf1:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460804c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.275994:0:57570:0:(ldlm_lock.c:1544:ldlm_lock_match_with_skip()) ### not matched ns ffff936b51d29000 type 13 mode 16 res 8589935621/241 (0 0) 00000080:00200000:0.0:1787191344.276010:0:57570:0:(namei.c:952:ll_intent_lock()) intent lock 1024 on i1 [0x200000405:0xf1:0x0] suppgids 0 0: rc 0 00000080:00010000:0.0:1787191344.276021:0:57570:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000405:0xf1:0x0](ffff936b4898ba88) for lock 0xe5129dc88483b0fd 00000080:00010000:0.0:1787191344.276030:0:57570:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xe5129dc88483b0fd from it ffffa3fb41cab930 00010000:00010000:0.0:1787191344.276033:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483b0fd lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xf1:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460804c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.276042:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483b0fd lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xf1:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460804c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787191344.276059:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000080:00200000:0.0:1787191344.276066:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xf1:0x0] ignore/verify layout 0/0, layout version 3 restore needed 0 00010000:00010000:0.0:1787191344.276081:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483b0fd lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xf1:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460804c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.276092:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483b0fd lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xf1:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460804c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1787191344.276105:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xf1:0x0](000000009d25d36f) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483b0fd lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xf1:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460804c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.276142:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483b0fd lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xf1:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7130d520e460804c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787191344.276150:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483b0fd lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xf1:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460804c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191344.276164:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xf1:0x0] ignore/verify layout 1/0, layout version 4 restore needed 0 00020000:00200000:0.0:1787191344.276174:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xf1:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191344.276178:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191344.276185:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191344.276196:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191344.276213:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xf1:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00010000:00010000:0.0:1787191344.276225:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483b0fd lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xf1:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460804c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191344.276234:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483b0fd lrc: 2/1,0 mode: CR/CR res: [0x200000405:0xf1:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460804c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00010000:0.0:1787191344.276242:0:57570:0:(file.c:6941:ll_layout_lock_set()) ### file [0x200000405:0xf1:0x0](000000009d25d36f) being reconfigured ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483b0fd lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xf1:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7130d520e460804c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787191344.276260:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xf1:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1787191344.276264:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xf1:0x0]: flr state: 1, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191344.276267:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191344.276269:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191344.276274:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191344.276279:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xf1:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787191344.276357:0:57570:0:(file.c:6836:ll_layout_conf()) [0x200000405:0xf1:0x0]: layout version change: 4294967294 -> 4 00010000:00010000:0.0:1787191344.276363:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483b0fd lrc: 3/1,0 mode: CR/CR res: [0x200000405:0xf1:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7130d520e460804c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787191344.276371:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff936b581fb000 lock: ffff936b413ffc00/0xe5129dc88483b0fd lrc: 2/0,0 mode: CR/CR res: [0x200000405:0xf1:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7130d520e460804c expref: -99 pid: 57570 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00020000:00200000:0.0:1787191344.276384:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xf1:0x0]there are 0 components to be staled to modify file extent [0x0, 0xffffffffffffffff), iot: 3 00020000:00200000:0.0:1787191344.276387:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xf1:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:0.0:1787191344.276390:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00020000:00200000:0.0:1787191344.276410:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:0.0:1787191344.276422:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:0.0:1787191344.276425:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 18446744073709551615] 00000008:00010000:0.0:1787191344.276436:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:0.0:1787191344.276440:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f99b70, osc lock ffff936b50b625f0, flags 0x80000000 00000008:00010000:0.0:1787191344.276444:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 4 00000008:00010000:0.0:1787191344.276446:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b42f99bb0, osc lock ffff936b50b62000, flags 0x80000000 00010000:00010000:0.0:1787191344.276485:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483b104 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.276494:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483b104 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.276505:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483b104 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191344.276522:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626874752:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191344.276587:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99000 going to sleep for 11 seconds 00000100:00100000:2.0:1787191344.278568:0:2392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2392:1874004626874624:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787191344.278608:0:2391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b51d1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2391:1874004626874496:192.168.202.101@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787191344.280630:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626874752:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191344.280656:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483b104 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x0 nid: local remote: 0x7130d520e460806f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.280676:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483b104 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e460806f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.280689:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483b104 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e460806f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.280703:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483b104 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e460806f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191344.280716:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483b104 lrc: 4/0,2 mode: PW/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e460806f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.280729:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483b104 lrc: 5/0,2 mode: PW/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460806f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.280738:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483b104 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460806f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.280805:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483b10b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.280820:0:57570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x80000000 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483b10b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.280850:0:57570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483b10b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191344.280874:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626874880:192.168.202.101@tcp:101:bash.0 00000100:00100000:0.0:1787191344.280947:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b42f99000 going to sleep for 11 seconds 00000100:00100000:0.0:1787191344.282256:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626874880:192.168.202.101@tcp:101:bash.0 00010000:00010000:0.0:1787191344.282275:0:57570:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483b10b lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x0 nid: local remote: 0x7130d520e4608076 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.282287:0:57570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483b10b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4608076 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.282298:0:57570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483b10b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x80000000 nid: local remote: 0x7130d520e4608076 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.282309:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483b10b lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10000080000000 nid: local remote: 0x7130d520e4608076 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000008:00010000:0.0:1787191344.282320:0:57570:0:(osc_lock.c:187:osc_lock_lvb_update()) ### acquired size 0, setting rss=0; kms=0, end=18446744073709551615 ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483b10b lrc: 4/0,2 mode: PW/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x10020080000000 nid: local remote: 0x7130d520e4608076 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.282331:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483b10b lrc: 5/0,2 mode: PW/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4608076 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787191344.282340:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483b10b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4608076 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787191344.282482:0:2389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626875008:192.168.202.101@tcp:10:bash.0 00000100:00100000:0.0:1787191344.282707:0:2390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626875136:192.168.202.101@tcp:10:bash.0 00000100:00100000:0.0:1787191344.285662:0:2389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2389:1874004626875008:192.168.202.101@tcp:10:bash.0 00000100:00100000:0.0:1787191344.285702:0:2390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b6a475c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f10005b0-4ec5-4888-9c81-49c0b11e82c4:2390:1874004626875136:192.168.202.101@tcp:10:bash.0 00000080:00200000:2.0:1787191344.285820:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xf1:0x0] updating i_size 0 i_blocks 0 00000020:00010000:2.0:1787191344.285828:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894d58 (ffff936b47a172d8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191344.285858:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894d58 (ffff936b47a172d8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191344.285862:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99b70 (ffff936b465cc368/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191344.285873:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483b104 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460806f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.285896:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483b104 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460806f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191344.285912:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b42f99bb0 (ffff936b47a17bd8/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191344.285918:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483b10b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e4608076 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787191344.285927:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff936b581fb000 lock: 000000009a6a0d67/0xe5129dc88483b10b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e4608076 expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000020:00010000:2.0:1787191344.285936:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894d58 (ffff936b47a172d8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191344.285939:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99b70 (ffff936b47a172d8/1) at cl_lock_fini():72 00000020:00010000:2.0:1787191344.285945:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b42f99bb0 (ffff936b47a172d8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191344.285964:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xf1:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200008:2.0:1787191344.286009:0:57570:0:(llite_lib.c:2686:ll_setattr_raw()) COMPLETED file f70.sanity-flr:[0x200000405:0xf1:0x0](ffff936b4898ba88) current size 0, valid attrs 1000a168, mode 0, uid 2, gid 0, new size 0, atime 1787191344.000000000, mtime 1787191344.000000000, ctime 1787191344.000000000, rc 0 00000080:00200008:2.0:1787191344.286105:0:57570:0:(file.c:2650:do_file_write_iter()) START file f70.sanity-flr:[0x200000405:0xf1:0x0], ppos: 0, count: 5 00000080:00200000:2.0:1787191344.286117:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191344.286124:0:57570:0:(file.c:2626:ll_do_tiny_write()) result: 0, original count 5 00000080:00200000:2.0:1787191344.286129:0:57570:0:(file.c:2090:ll_file_io_generic()) f70.sanity-flr: write ppos: 0, bytes: 5 00000080:00200000:2.0:1787191344.286134:0:57570:0:(file.c:1848:ll_io_set_mirror()) f70.sanity-flr: desiginated mirror: 0 00000020:00200000:2.0:1787191344.286140:0:57570:0:(cl_io.c:214:cl_io_rw_init()) header@000000009d300a6b[0x110, 1, [0x200000405:0xf1:0x0] hash] 00000020:00200000:2.0:1787191344.286143:0:57570:0:(cl_io.c:214:cl_io_rw_init()) io range: 2 [0, 5) 0 0 00000080:00200000:2.0:1787191344.286147:0:57570:0:(vvp_io.c:1826:vvp_io_init()) [0x200000405:0xf1:0x0] ignore/verify layout 0/0, layout version 0 restore needed 0 00020000:00200000:2.0:1787191344.286160:0:57570:0:(lov_io.c:311:lov_io_mirror_write_intent()) [0x200000405:0xf1:0x0]there are 0 components to be staled to modify file extent [0x0, 0x100000), iot: 2 00020000:00200000:2.0:1787191344.286165:0:57570:0:(lov_io.c:655:lov_io_mirror_init()) [0x200000405:0xf1:0x0]: flr state: 2, move mirror from 0 to 0, have retried: 0, mirror count: 2 00020000:00200000:2.0:1787191344.286169:0:57570:0:(lov_io.c:709:lov_io_mirror_init()) use delayed RPC state for this IO 00000080:00200000:2.0:1787191344.286174:0:57570:0:(file.c:2168:ll_file_io_generic()) Range lock [0, 0] 00020000:00200000:2.0:1787191344.286180:0:57570:0:(lov_io.c:1277:lov_io_rw_iter_init()) stripe: 0 chunk: [0, 5) 5, 5 00020000:00200000:2.0:1787191344.286184:0:57570:0:(lov_io.c:1085:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:2.0:1787191344.286199:0:57570:0:(vvp_io.c:214:vvp_io_one_lock_index()) lock: 1 [0, 0] 00000008:00010000:2.0:1787191344.286213:0:57570:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: 0 00000008:00010000:2.0:1787191344.286217:0:57570:0:(osc_lock.c:1318:osc_lock_init()) ### lock ffff936b587d10b0, osc lock ffff936b44e63db0, flags 0x0 00010000:00010000:2.0:1787191344.286235:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483b104 lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460806f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191344.286248:0:57570:0:(ldlm_lock.c:1527:ldlm_lock_match_with_skip()) ### matched (0 4095) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483b104 lrc: 2/0,1 mode: PW/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460806f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191344.286261:0:57570:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483b104 lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460806f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191344.286270:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483b104 lrc: 6/0,2 mode: PW/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460806f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191344.286277:0:57570:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483b104 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460806f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191344.286288:0:57570:0:(vvp_io.c:1292:vvp_io_write_start()) f70.sanity-flr: write [0, 5) append 0 append lockpos 0 00000080:00200000:2.0:1787191344.286296:0:57570:0:(rw26.c:675:ll_write_begin()) Writing 0 of 0 to 5 bytes 00000080:00200000:2.0:1787191344.286341:0:57570:0:(rw26.c:869:ll_write_end()) pos 0, len 5, copied 5 00000080:00200000:2.0:1787191344.286349:0:57570:0:(rw26.c:927:ll_write_end()) page@000000001afc971b[3 0000000081fd9ea7 2 1 00000000dffde8bf 0 0 0] 00000080:00200000:2.0:1787191344.286353:0:57570:0:(rw26.c:927:ll_write_end()) vmpage @00000000f3fb5935 17ffffc0001001 3:0 ffff936b43a1eb60 0 lru 00000080:00200000:2.0:1787191344.286360:0:57570:0:(rw26.c:927:ll_write_end()) osc-page@000000003eb8e0e6 0: 1< 0 - - > 2< 0 0 0 0x0 0x0 | 00000000a2a44f55 00000000a9621480 > 3< 0 0 > 4< 0 0 8 437067776 - | - - - - > 5< - - - - | 0 - | 0 - -> 00000080:00200000:2.0:1787191344.286363:0:57570:0:(rw26.c:927:ll_write_end()) end page@000000001afc971b 00000080:00200000:2.0:1787191344.286364:0:57570:0:(rw26.c:927:ll_write_end()) queued cl_page: 1. 00000080:00200000:2.0:1787191344.286369:0:57570:0:(vvp_io.c:1175:vvp_io_write_commit()) commit async pages: 1, from 0, to 5 prio 0 00000008:00010000:2.0:1787191344.286387:0:57570:0:(osc_cache.c:867:osc_extent_find()) ### extent: 000000006e99f8a6 ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483b104 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460806f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787191344.286420:0:57570:0:(vvp_io.c:1088:vvp_set_batch_dirty()) mapping ffff936b4898bc38, count 1, dirtied 1 00000080:00200000:2.0:1787191344.286424:0:57570:0:(vvp_io.c:1198:vvp_io_write_commit()) Committed 1 pages 5 bytes, tot: 5 00000080:00200000:2.0:1787191344.286427:0:57570:0:(vvp_io.c:1358:vvp_io_write_start()) f70.sanity-flr: write bytes 0, result: 5 00000020:00010000:2.0:1787191344.286440:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff936b62894a88 (ffff936b47a17bd8/0) at cl_lock_release():245 00000020:00010000:2.0:1787191344.286443:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b62894a88 (ffff936b47a17bd8/0) at cl_lock_cancel():142 00000020:00010000:2.0:1787191344.286446:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff936b587d10b0 (ffff936b465cc368/1) at cl_lock_cancel():142 00010000:00010000:2.0:1787191344.286450:0:57570:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483b104 lrc: 5/0,1 mode: PW/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x810020080000000 nid: local remote: 0x7130d520e460806f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787191344.286459:0:57570:0:(ldlm_lock.c:917:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff936b581fb000 lock: 00000000de9070b3/0xe5129dc88483b104 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x800020080000000 nid: local remote: 0x7130d520e460806f expref: -99 pid: 57570 timeout: 0 lvb_type: 1 lru_score: 2 lru_type: 0 00000020:00010000:2.0:1787191344.286470:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b62894a88 (ffff936b47a17bd8/0) at cl_lock_fini():72 00000020:00010000:2.0:1787191344.286472:0:57570:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff936b587d10b0 (ffff936b47a17bd8/1) at cl_lock_fini():72 00000080:00200000:2.0:1787191344.286478:0:57570:0:(vvp_io.c:533:vvp_io_advance()) advancing 5 bytes 00000080:00200000:2.0:1787191344.286483:0:57570:0:(file.c:2205:ll_file_io_generic()) Range unlock [0, 0] 00000080:00200000:2.0:1787191344.286488:0:57570:0:(vvp_io.c:304:vvp_io_fini()) [0x200000405:0xf1:0x0] ignore/verify layout 0/0, layout version 4 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1787191344.286491:0:57570:0:(file.c:2238:ll_file_io_generic()) f70.sanity-flr: 2 io complete with rc: 0, result: 5, restart: 0 00000080:00200000:2.0:1787191344.286496:0:57570:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000405:0xf1:0x0] updating i_size 5 i_blocks 0 00000080:00200000:2.0:1787191344.286500:0:57570:0:(file.c:2324:ll_file_io_generic()) iot: 2, result: 5 00000080:00200008:2.0:1787191344.286516:0:57570:0:(file.c:479:ll_file_release()) START file f70.sanity-flr:[0x200000405:0xf1:0x0](ffff936b4898ba88), flags 100001 00000002:00100000:2.0:1787191344.286570:0:57570:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff936b6a475180 x1874004626873600/t8589937286(8589937286) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191360 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787191344.286721:0:57570:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff936b581fb000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787191344.286728:0:57570:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff936b513bb100 x1874004626875392/t0(0) o35->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:23/10 lens 392/944 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787191344.286749:0:57570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626875392:192.168.202.101@tcp:35:bash.0 00000100:00100000:2.0:1787191344.286826:0:57570:0:(client.c:2715:ptlrpc_set_wait()) set ffff936b5338ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787191344.289071:0:57570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff936b513bb100 pname:cluuid:pid:xid:nid:opc:job bash:f10005b0-4ec5-4888-9c81-49c0b11e82c4:57570:1874004626875392:192.168.202.101@tcp:35:bash.0 00000002:00100000:2.0:1787191344.289104:0:57570:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff936b6a475180 x1874004626873600/t8589937286(8589937286) o101->lustre-MDT0000-mdc-ffff936b581fb000@192.168.202.101@tcp:12/10 lens 920/1000 e 0 to 0 dl 1787191360 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 Debug log: 63330 lines, 63330 kept, 0 dropped, 0 bad.